HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2016T1 IPMAN User Testing 3"

From IS480
Jump to navigation Jump to search
(Created page with "<!--Logo--> 250px|center<br> <!--/Logo--> <!--Header--> {|style="background-color:#1D1D1D; color:#F5F5F5; padding: 10 0 10 0;" width="1...")
 
Line 67: Line 67:
 
</center>
 
</center>
 
<br>
 
<br>
 +
 +
 +
==Test Plan==
 +
<div style="font-family: Garamond; font-size:16px">
 +
<p>
 +
<b>Venue: </b>Hook Coffee Office @ Jalan Besar 191A / Singapore Management University<br />
 +
<b>Date: </b>3 – 6 November 2016<br />
 +
<b>Time:</b> 7.30pm <br />
 +
<b>Duration: </b>~45 minutes per user<br />
 +
<b>Number of Participant(s):</b> 10<br />
 +
<b>User Test:</b> Instructions can be found [https://www.dropbox.com/sh/5ay0bmku7mhscrs/AABYhVn-4BsO-8mregeeHq-Ma?dl=0 here] <br />
 +
</p>
 +
</div>
 +
 +
==Objectives==
 +
<div style="font-family: Garamond; font-size:16px">
 +
<ul>
 +
<li>Gather feedback from a business standpoint regarding information presented on the dashboard</li>
 +
<li>Ascertain the usability and effectiveness of the Inventory Module</li>
 +
<li>Evaluate the usefulness of data from the Analysis Module</li>
 +
</ul>
 +
</div>
 +
 +
==Scope of UAT 3==
 +
<div style="font-family: Garamond; font-size:16px">
 +
<ul>
 +
<li>Dashboard – View business information at a glance</li>
 +
<li>Inventory Module – Manage stock items and levels</li>
 +
<li>Analysis Module – View actionable steps for improving coffee demand</li>
 +
<li>Analysis Module – View uniquely clustered customer segments</li>
 +
</ul>
 +
</div>
 +
 +
==Procedures==
 +
<div style="font-family: Garamond; font-size:16px">
 +
<p>
 +
Participants are to think aloud as they follow through the instructions given for the user testing. Team IPMAN will be there to record down the participants’ behaviours. Participants are to leave their feedback at the end of their user testing. Team IPMAN will conclude the user testing by asking the participants questions with regards to their behaviours and thought process as they navigate through KOPIKaki platform.
 +
</p>
 +
</div>
 +
 +
<center>
 +
{| class="wikitable" style="font-family:Garamond; background-color:#FFFFFF; width: 1000px;" align="center"
 +
|-
 +
 +
! style="color:#ecf0f1; background-color:#07264C;" width="100pt" | S/N
 +
! style="color:#ecf0f1; background-color:#07264C;" width="400pt" | Goals
 +
! style="color:#ecf0f1; background-color:#07264C;" width="500pt" | Reached?
 +
|-
 +
 +
 +
|style="text-align: center;"| 1
 +
|style="text-align: left;"| Participants should be able to list out their top 3 values/charts from the dashboard
 +
|style="text-align: left;"| Goal reached. All participants were able to complete the task.
 +
|-
 +
 +
|style="text-align: center;"| 2
 +
|style="text-align: left;"| Participants should be able determine how well the business is doing
 +
|style="text-align: left;"| Goal reached. All participants were able to complete the task.
 +
|-
 +
 +
|style="text-align: center;"| 3
 +
|style="text-align: left;"| Participants should be able to add new coffee beans to the list of Active Beans
 +
|style="text-align: left;"| Goal reached. All participants were able to complete the task.
 +
|-
 +
 +
|style="text-align: center;"| 4
 +
|style="text-align: left;"| Participants should be able to deactivate coffee beans in the current list of Active Beans
 +
|style="text-align: left;"| Goal reached. All participants were able to complete the task.
 +
|-
 +
 +
|style="text-align: center;"| 5
 +
|style="text-align: left;"| Participants should be able to update the threshold of the system
 +
|style="text-align: left;"| Goal reached. Majority of participants were able to complete the task. 4 out of 10 participants did not click the update button
 +
|-
 +
 +
|style="text-align: center;"| 6
 +
|style="text-align: left;"| Participants should be able to validate the Coffee Demand Prediction system
 +
|style="text-align: left;"| Goal not reached. 8 out of 10 were not able to validate the system
 +
|-
 +
 +
|style="text-align: center;"| 7
 +
|style="text-align: left;"| Participants should be able to interpret the different customer segments
 +
|style="text-align: left;"| Goal reached. All participants were able to complete the task
 +
|}
 +
</center>
 +
 +
 +
==Key Findings==
 +
<center>
 +
{| class="wikitable" style="font-family:Garamond; background-color:#FFFFFF; width: 1000px;" align="center"
 +
|-
 +
 +
! style="color:#ecf0f1; background-color:#07264C;" width="100pt" | Functions
 +
! style="color:#ecf0f1; background-color:#07264C;" width="400pt" | Users’ Behaviour
 +
! style="color:#ecf0f1; background-color:#07264C;" width="500pt" | Changes to be Made
 +
|-
 +
 +
|style="text-align: center;"| User Experience
 +
|style="text-align: left;"| Users validate their actions upon change in UI
 +
|style="text-align: left;"| Remove all unintuitive and unnecessary change to the UI.
 +
|-
 +
 +
|style="text-align: center;"| User Experience
 +
|style="text-align: left;"| Users tend to have a preferred location where frequently used buttons should be
 +
|style="text-align: left;"| Place buttons in easily accessible areas
 +
|-
 +
 +
|style="text-align: center;"| User Experience
 +
|style="text-align: left;"| Users tend to notice text with bigger font sizes
 +
|style="text-align: left;"| Standardise the font size in the dashboard
 +
|-
 +
 +
|style="text-align: center;"| User Experience
 +
|style="text-align: left;"| Users prefer to see months being spelt out rather than as numerals
 +
|style="text-align: left;"| Let months be represented by the actual name rather than numerals
 +
|-
 +
 +
|style="text-align: center;"| Coffee Demand Prediction
 +
|style="text-align: left;"| Users interpreted the line for “deviation from recommendation” incorrectly
 +
|style="text-align: left;"| “Deviation from recommendation” line was removed and added as a value in the table
 +
|}
 +
</center>
 +
  
 
<!--/Content-->
 
<!--/Content-->

Revision as of 02:56, 15 November 2016

Team IPMAN Logo 1600x800.png


Team IPMAN Icon Home.png   HOME

 

Team IPMAN Icon AboutUs.png   ABOUT US

 

Team IPMAN Icon ProjectOverview.png   PROJECT OVERVIEW

 

Team IPMAN Icon ProjectManagement.png   PROJECT MANAGEMENT

 

Team IPMAN Icon ProjectDocumentation.png   DOCUMENTATION

 


IPMAN UserTesting Title.png


IPMAN InternalTesting Icon.png IPMAN UserTesting1 Icon.png IPMAN UserTesting2 Icon.png IPMAN UserTesting3 Icon.png



Test Plan

Venue: Hook Coffee Office @ Jalan Besar 191A / Singapore Management University
Date: 3 – 6 November 2016
Time: 7.30pm
Duration: ~45 minutes per user
Number of Participant(s): 10
User Test: Instructions can be found here

Objectives

  • Gather feedback from a business standpoint regarding information presented on the dashboard
  • Ascertain the usability and effectiveness of the Inventory Module
  • Evaluate the usefulness of data from the Analysis Module

Scope of UAT 3

  • Dashboard – View business information at a glance
  • Inventory Module – Manage stock items and levels
  • Analysis Module – View actionable steps for improving coffee demand
  • Analysis Module – View uniquely clustered customer segments

Procedures

Participants are to think aloud as they follow through the instructions given for the user testing. Team IPMAN will be there to record down the participants’ behaviours. Participants are to leave their feedback at the end of their user testing. Team IPMAN will conclude the user testing by asking the participants questions with regards to their behaviours and thought process as they navigate through KOPIKaki platform.

S/N Goals Reached?
1 Participants should be able to list out their top 3 values/charts from the dashboard Goal reached. All participants were able to complete the task.
2 Participants should be able determine how well the business is doing Goal reached. All participants were able to complete the task.
3 Participants should be able to add new coffee beans to the list of Active Beans Goal reached. All participants were able to complete the task.
4 Participants should be able to deactivate coffee beans in the current list of Active Beans Goal reached. All participants were able to complete the task.
5 Participants should be able to update the threshold of the system Goal reached. Majority of participants were able to complete the task. 4 out of 10 participants did not click the update button
6 Participants should be able to validate the Coffee Demand Prediction system Goal not reached. 8 out of 10 were not able to validate the system
7 Participants should be able to interpret the different customer segments Goal reached. All participants were able to complete the task


Key Findings

Functions Users’ Behaviour Changes to be Made
User Experience Users validate their actions upon change in UI Remove all unintuitive and unnecessary change to the UI.
User Experience Users tend to have a preferred location where frequently used buttons should be Place buttons in easily accessible areas
User Experience Users tend to notice text with bigger font sizes Standardise the font size in the dashboard
User Experience Users prefer to see months being spelt out rather than as numerals Let months be represented by the actual name rather than numerals
Coffee Demand Prediction Users interpreted the line for “deviation from recommendation” incorrectly “Deviation from recommendation” line was removed and added as a value in the table


Silhouettes wiki background IPMAN.png