HeaderSIS.jpg

IS480 Team wiki: 2016T1 IPMAN User Testing 3

From IS480
Revision as of 01:49, 25 November 2016 by Kester.yeo.2014 (talk | contribs) (UAT3)
Jump to navigation Jump to search
Team IPMAN Logo 1600x800.png


Team IPMAN Icon Home.png   HOME

 

Team IPMAN Icon AboutUs.png   ABOUT US

 

Team IPMAN Icon ProjectOverview.png   PROJECT OVERVIEW

 

Team IPMAN Icon ProjectManagement.png   PROJECT MANAGEMENT

 

Team IPMAN Icon ProjectDocumentation.png   DOCUMENTATION

 


IPMAN UserTesting Title.png


IPMAN InternalTesting Icon.png IPMAN UserTesting1 Icon.png IPMAN UserTesting2 Icon.png IPMAN UserTesting3 Icon.png



Test Plan

Venue: Hook Coffee Office @ Jalan Besar 191A / Singapore Management University
Date: 3 – 6 November 2016
Time: 7.30pm
Duration: ~45 minutes per user
Number of Participant(s): 10
User Test: Instructions can be found here

Objectives

  • Gather feedback from a business standpoint regarding information presented on the dashboard
  • Ascertain the usability and effectiveness of the Inventory Module
  • Evaluate the usefulness of data from the Analysis Module

Scope of UAT 3

  • Dashboard – View business information at a glance
  • Inventory Module – Manage stock items and levels
  • Analysis Module – View actionable steps for improving coffee demand
  • Analysis Module – View uniquely clustered customer segments

Procedures

Participants are to think aloud as they follow through the instructions given for the user testing. Team IPMAN will be there to record down the participants’ behaviours. Participants are to leave their feedback at the end of their user testing. Team IPMAN will conclude the user testing by asking the participants questions with regards to their behaviours and thought process as they navigate through KOPIKaki platform.

S/N Goals Reached?
1 Participants should be able to list out their top 3 values/charts from the dashboard Goal reached. All participants were able to complete the task.
2 Participants should be able determine how well the business is doing Goal reached. All participants were able to complete the task.
3 Participants should be able to add new coffee beans to the list of Active Beans Goal reached. All participants were able to complete the task.
4 Participants should be able to deactivate coffee beans in the current list of Active Beans Goal reached. All participants were able to complete the task.
5 Participants should be able to update the threshold of the system Goal reached. Majority of participants were able to complete the task. 4 out of 10 participants did not click the update button
6 Participants should be able to validate the Coffee Demand Prediction system Goal partially reached. 8 out of 10 were not able to validate the system
7 Participants should be able to interpret the different customer segments Goal reached. All participants were able to complete the task


Key Findings

Functions Users’ Behaviour Changes to be Made
User Experience Participants validated their actions upon change in UI Remove all unintuitive and unnecessary change to the UI.
User Experience Participants tend to have a preferred location where frequently used buttons should be Place buttons in easily accessible areas
User Experience Participants tend to notice text with bigger font sizes Standardise the font size in the dashboard
User Experience Participants prefer to see months being spelt out rather than as numerals Let months be represented by the actual name rather than numerals
Coffee Demand Prediction Participants interpreted the line for “deviation from recommendation” incorrectly “Deviation from recommendation” line was removed and added as a value in the table
Customer Segmentation Participants felt segment breakdown could be more informative “Reworked segment breakdown to include unit of measurement, tooltips and link to mailchimp button"


Key Findings - Business Perspective All testers were able to interpret business health accurately from the dashboard 4 out of 10 testers were able to interpret the Coffee Demand Graph correctly All testers were able to understand the customer segments e.g. Giving of committed customers more vouchers to ensure that they stay committed

Overall Results/Comments

  • Standardization of font sizes and text-form of words (rather than numerical values for calendar months) can help to further enhance user experience.
  • Better placement of buttons and clearer graphical interpretations can help to make our application more intuitive and user-friendly
  • Clients were pleased with the quality of product that Team IPMAN has delivered and also commended on the ease of use of our application.
  • The list of pre-UAT and post-UAT changes can be found below:


IPMAN PrePostUAT3Screenshots.png



Silhouettes wiki background IPMAN.png