HeaderSIS.jpg

IS480 Team wiki:2017T1 Ducky King User Testing 2

From IS480
Revision as of 12:07, 16 November 2017 by Sally.chin.2015 (talk | contribs)
Jump to navigation Jump to search
DuckyKingLogo.png


Duckyking home logo.png   HOME

 

Duckyking about us.png   ABOUT US

 

Duckyking project overview.png   PROJECT OVERVIEW

 

Duckyking project management.png   PROJECT MANAGEMENT

 

Ducky king documentation.png   DOCUMENTATION

 



FlowAdmin UAT Header.png



UAT 1

Test Plan

Venue: Flow Labs Office @ 165 Telok Ayer Street
Date: 15 August 2017
Time: 5.30PM
Duration: ~ 15 minutes per user
Number of Participants for FlowAdmin: 4
User Test: Instructions can be found here

Objectives

  • To gather feedback regarding user interface and the developed functions
  • To detect usability issues based on users’ behaviour
  • To improve web application interface based on the feedback

Scope of UAT 1

  • Delete Bids
  • Delete Auctions

High Fidelity Prototypes


Low Fidelity Prototypes


Procedures

Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud as they follow through the instructions given for the user testing. Team Ducky King will be there to record down the participants’ behaviours. Participants will complete a post-test questionnaire at the end of their user testing. Team Ducky King will conclude the user testing by asking the participants questions with regards to their behaviours and thought process as they navigate through FlowAdmin platform.

S/N Goals Reached?
1 User should be able to complete the tasks without guidance from a test facilitator Goal reached. Participants were able to complete the tasks without guidance from a test facilitator
2 User should find it easy to remove a specific auction Goal reached. Participants were able to complete the tasks.
3 User should find it easy to remove a specific bid Goal reached. Participants were able to complete the tasks.

Key Findings

Functions Users’ Behaviour Changes to be made
User Interface Participants tend to click on the ‘delete auction’ and ‘delete bid’ buttons multiple times and do not know that the request is being processed. Introduce a loading spinner into the platform when the button is clicked so the user knows that the request has been sent.
User Interface Participants had a slight pause before being able to view the list of auctions. Put the navigation to the list of actions in a more visible position.
User Interface Participants had slight difficulty in finding the bids to delete from the respective auctions. Have a bids tab in the menu bar and a listing of all bids.
Functions Users’ Comment Changes to be made
Function Refinement Sponsor requested for a way to identify spam bids more easily using timestamps
  • Introduce the time stamps for easy identification of spam bids on the FlowAdmin platform
  • List all bids on 1 page

Overall Results/Comments

Based on the results and feedback from the UAT,

  • User interface can be improved to be more intuitive to identify dubious auctions and bids
  • Client was impressed by the FlowAdmin interface as they only required a command line interface

UAT 2

Test Plan

Venue: Flow Labs Office @ 165 Telok Ayer Street
Date: 9 October 2017
Time: 5.30PM
Duration: ~ 20 minutes per user
Number of Participants for FlowAdmin: 4
User Test: Instructions can be found here
Type of test: Laboratory Test

Objectives

  • To gather feedback regarding user interface and the developed functions
  • To detect usability issues based on target users’ behaviour
  • To improve web application interface based on the feedback

Scope of UAT 2

  • View FlowAdmin dashboard statistics
  • Delete Bids
  • Delete Auctions

Environment

As we want to conduct the study in the most realistic environment as a member of FlowLabs, we will be conducting our study at the Flowlabs office at 165 Telok Ayer St. We will be briefing the participants on what our application will be used for before they proceed with the tasks. The participants will test the application using a laptop running Windows 8 and on the Google Chrome browser.

Procedures

After the pre-screening of participants has been done, participants who pass the pre-test questionnaire will be given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud as they follow through the instructions given for the user testing. Team Ducky King will be there to record down the participants’ behaviours. Participants will complete a post-test questionnaire at the end of their user testing. Team Ducky King will conclude the user testing by asking the participants questions with regards to their behaviours and thought process as they navigate through FlowAdmin platform.

UAT 2 Results

S/N Goals Reached?
1 User should be able to complete task #1 without guidance from a test facilitator Goal Reached. All users were able to complete the task without guidance
2 User should be able to easily find statistics on the auctions and bids Goal Reached. All users were able to find the statistics
3 User should find it easy to delete a specific auction Goal Reached. All users were able to delete a specific auction
4 User should find it easy to delete a specific bid Goal Reached. All users were able to delete a specific bid




Key Findings

Functions Users’ Behaviour Changes to be made
User Interface Participants were confused when bids were not listed in chronological order. This is due to the user interface sorting the bids from the earliest to the latest time. The user interface would now instead sort the bids in reverse chronological order, from the latest bid to the earliest.
User Interface The loading screen for the auction details shows an error status and an inaccurate auction expiry. This momentarily confuses the participants before the screen finishes loading. The user interface should instead have no default values to avoid confusing the users.
User Interface Even though there was a loading screen when deleting a bid, as the operation took a slightly longer time, the participants were unsure if the web application was still running. The longer loading time is due to the nature of the blockchain. We will be conducting scalability study after the midterms to research on optimization methods.


UAT 3

Test Plan

Venue: Flow Labs Office @ 165 Telok Ayer Street
Date: 17 November 2017
Time: 4.30PM
Duration: ~ 20 minutes per user
Number of Participants for FlowAdmin: TBC
User Test: Instructions can be found here

Objectives

  • To evaluate if the changes made to the interface from UAT#2 has increased the usability of FlowAdmin
  • To detect usability issues based on target users’ behaviour
  • To ensure that the system is what the user requires

Scope of UAT 3

  • Remove Peer
  • Delete Bids
  • Delete Auctions

Environment

As we want to conduct the study in the most realistic environment as a member of FlowLabs, we will be conducting our study at the Flowlabs office at 165 Telok Ayer St. We will be briefing the participants on what our application will be used for before they proceed with the tasks. The participants will test the application using a laptop running Windows 8 and on the Google Chrome browser.

Procedures

After the pre-screening of participants has been done, participants who pass the pre-test questionnaire will be given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud as they follow through the instructions given for the user testing. Team Ducky King will be there to record down the participants’ behaviours. Participants will complete a post-test questionnaire at the end of their user testing. Team Ducky King will conclude the user testing by asking the participants questions with regards to their behaviours and thought process as they navigate through FlowAdmin platform.