HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki:2017T1 Ducky King User Testing 1"

From IS480
Jump to navigation Jump to search
Line 183: Line 183:
  
 
== <div style="background: #FF7504; padding: 15px; font-weight: bold; line-height: 0.3em; font-size:18px; font-family:helvetica" ><font color= #FFFFFF>UAT 2</font></div> ==
 
== <div style="background: #FF7504; padding: 15px; font-weight: bold; line-height: 0.3em; font-size:18px; font-family:helvetica" ><font color= #FFFFFF>UAT 2</font></div> ==
 +
=== Test Plan ===
 +
<div style="font-family: Verdana; ">
 +
<p>
 +
<b>Venue:</b> Flow Labs Office @ 165 Telok Ayer Street<br/>
 +
<b>Date:</b> 9 October 2017<br/>
 +
<b>Time:</b> 4.30PM<br/>
 +
<b>Duration:</b> ~ 30 minutes per user<br/>
 +
<b>Number of Participants for FlowLabs Middleware:</b> 3<br/>
 +
<b>User Test:</b> Instructions can be found [https://drive.google.com/drive/u/0/folders/0BxzKKmVovZrnRkt4dlpjMjdpcUk here] <br/>
 +
</p>
 +
</div>
 +
 +
=== Objectives===
 +
<div style="font-family: Verdana; ">
 +
<p>
 +
<ul>
 +
<li>To let the participants understand how additional functionalities for the middleware are might potentially affect integration with the front end application</li>
 +
</ul>
 +
</p>
 +
</div>
 +
 +
=== Scope of UAT 1===
 +
<div style="font-family: Verdana">
 +
<p>
 +
<ul>
 +
<li>Authenticate before any action</li>
 +
<li>Create Auctions</li>
 +
<li>Create Bids</li>
 +
<li>View Auctions</li>
 +
<li>View Bids</li>
 +
<li>Cancel Auctions</li>
 +
<li>Cancel Bids</li>
 +
<li>Update Bid</li>
 +
<li>Update Auction Status</li>
 +
<li>View Winning Bid Price and Volume</li>
 +
</ul>
 +
</p>
 +
</div>
 +
 +
=== Procedures ===
 +
<div style="font-family: Verdana;">
 +
<p>
 +
Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud as they follow through the instructions given for the user testing. Team Ducky King will be there to record down the participants’ behaviours. Participants will complete a post-test questionnaire at the end of their user testing. Team Ducky King will conclude the user testing by asking the participants questions with regards to their behaviours and thought process as they navigate through FlowLabs Middleware.
 +
</p>
 +
</div>
 +
<center>
 +
{|class="wikitable" style="font-family: Verdana; background-color:#FFFFFF; width: 1000px;" align="center"
 +
|-
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="100pt" | S/N
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="400pt" | Goals
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="500pt" | Reached?
 +
|-
 +
|style="text-align: center;"| 1
 +
|style="text-align: left;"| Participants should be able to authenticate themselves
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the tasks.
 +
|-
 +
|style="text-align: center;"| 2
 +
|style="text-align: left;"|Participants should be able to create an auction using JWT tokens
 +
|style="text-align: left;"|Goal reached. Participants were able to complete the tasks.
 +
|-
 +
|style="text-align: center;"| 3
 +
|style="text-align: left;"| Participants should be able to shortlist bids and proceed to negotiation stage using JWT tokens
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the tasks.
 +
|-
 +
|style="text-align: center;"| 4
 +
|style="text-align: left;"| Participants should be able to shortlist bids and proceed to completed stage using JWT tokens
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the tasks.
 +
|-
 +
|style="text-align: center;"| 5
 +
|style="text-align: left;"| Participants should be able to bid on an auction using JWT tokens
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the tasks.
 +
|-
 +
|style="text-align: center;"| 6
 +
|style="text-align: left;"| Participants should be able to cancel an auction using JWT tokens
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the tasks.
 +
|-
 +
|style="text-align: center;"| 7
 +
|style="text-align: left;"| Participants should be able to cancel a bid using JWT tokens
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the tasks.
 +
|-
 +
|style="text-align: center;"| 8
 +
|style="text-align: left;"| Participants should be able to update a bid during open stage using JWT tokens
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the tasks.
 +
|-
 +
|style="text-align: center;"| 9
 +
|style="text-align: left;"| Participants should be able to get the winning price and volume from completed auctions using JWT tokens
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the tasks.
 +
|-
 +
|style="text-align: center;"| 10
 +
|style="text-align: left;"| Participants will input the auction data into postman and encountered a validation error
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the tasks.
 +
|}
 +
</center>
 +
 +
=== Key Findings ===
 +
<center>
 +
{|class="wikitable" style="font-family: Verdana; background-color:#FFFFFF; width: 1000px;" align="center"
 +
|-
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="100pt" | Functions
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="400pt" | Users' Comment
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="500pt" | Changes to be made
 +
|-
 +
|style="text-align: center;"| Function Refinement
 +
|style="text-align: left;"| Sponsor requested the need for the index to process events in batches
 +
|style="text-align: left;"| Ducky King development team will process and break down the events into sizeable batches for processing before saving/updating the database
 +
|-
 +
|}
 +
</center>
 +
 +
=== Overall Results/Comments ===
 +
<div style="font-family: Verdana; ">
 +
<p>
 +
<ul>
 +
<li>Sponsor is extremely satisfied with the team’s progress and achievement</li>
 +
</ul>
 +
</p>
 +
</div>
 +
 +
== <div style="background: #FF7504; padding: 15px; font-weight: bold; line-height: 0.3em; font-size:18px; font-family:helvetica" ><font color= #FFFFFF>UAT 3</font></div> ==
 
=== Test Plan ===
 
=== Test Plan ===
 
<div style="font-family: Verdana; ">
 
<div style="font-family: Verdana; ">

Revision as of 03:49, 15 November 2017

DuckyKingLogo.png


Duckyking home logo.png   HOME

 

Duckyking about us.png   ABOUT US

 

Duckyking project overview.png   PROJECT OVERVIEW

 

Duckyking project management.png   PROJECT MANAGEMENT

 

Ducky king documentation.png   DOCUMENTATION

 



FlowAdmin UAT Header.png


UAT 1

Test Plan

Venue: Flow Labs Office @ 165 Telok Ayer Street
Date: 15 August 2017
Time: 4.30PM
Duration: ~ 15 minutes per user
Number of Participants for FlowLabs Middleware: 3
User Test: Instructions can be found here

Objectives

  • To let the participants verify if the core functionalities for the middleware are suitable for integration with the front end application
  • To identify missing functionality

Scope of UAT 1

  • Create Auctions
  • Create Bids
  • View Auctions
  • View Bids
  • Cancel Auctions
  • Cancel Bids
  • Update Bid
  • Update Auction Status

Procedures

Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud and ask questions as they follow through the instructions given for the user testing. Team Ducky King will be there to record down the participants’ comments. Participants will complete a post-test questionnaire at the end of their user testing. Team Ducky King will conclude the user testing by asking the participants questions with regards to Flow Middleware platform.

S/N Goals Reached?
1 Participants should be able to create an auction. Goal reached. Participants were able to complete the tasks..
2 Participants should be able to shortlist auctions and proceed to negotiation stage Goal reached. Participants were able to complete the tasks.
3 Participants should be able to bid on an auction Goal reached. Participants were able to complete the tasks.
4 Participants should be able to cancel an auction Goal reached. Participant were able to complete the tasks.
5 Participants should be able to cancel a bid Goal reached. Participants were able to complete the tasks.
6 Participants should be able to update a bid during open stage Goal reached. Participant was able to complete the tasks.

Key Findings

Functions Users' Comment Changes to be made
Function Refinement Sponsor requested for the endpoints to not accept any inputs that are prone to manipulation. Ducky King development team reduce any required user inputs and allow the inputs to be abstracted from the database.
Function Refinement Sponsor highlighted the need for the auction winner’s details to be easily accessible on the blockchain. Ducky King development team will process and break down the bid details and only allow auction winner’s non-sensitive information to be available on the blockchain.
Function Refinement Sponsor requested add more endpoints for the frontend layer to easily query winning bids’ detail sorted by time. Ducky King development team will add new functions and endpoints to allow the winning bids’ details to be easily queried.
Function Refinement Sponsor requested that the endpoints return JSON payload of a certain format. Ducky King development team reduce any required user inputs and allow the inputs to be abstracted from the database.

Overall Results/Comments

  • Implementing stringent validation rules
  • To return more meaningful JSON response for readability
  • Sponsor is satisfied with the team’s progress

UAT 2

Test Plan

Venue: Flow Labs Office @ 165 Telok Ayer Street
Date: 9 October 2017
Time: 4.30PM
Duration: ~ 30 minutes per user
Number of Participants for FlowLabs Middleware: 3
User Test: Instructions can be found here

Objectives

  • To let the participants understand how additional functionalities for the middleware are might potentially affect integration with the front end application

Scope of UAT 1

  • Authenticate before any action
  • Create Auctions
  • Create Bids
  • View Auctions
  • View Bids
  • Cancel Auctions
  • Cancel Bids
  • Update Bid
  • Update Auction Status
  • View Winning Bid Price and Volume

Procedures

Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud as they follow through the instructions given for the user testing. Team Ducky King will be there to record down the participants’ behaviours. Participants will complete a post-test questionnaire at the end of their user testing. Team Ducky King will conclude the user testing by asking the participants questions with regards to their behaviours and thought process as they navigate through FlowLabs Middleware.

S/N Goals Reached?
1 Participants should be able to authenticate themselves Goal reached. Participants were able to complete the tasks.
2 Participants should be able to create an auction using JWT tokens Goal reached. Participants were able to complete the tasks.
3 Participants should be able to shortlist bids and proceed to negotiation stage using JWT tokens Goal reached. Participants were able to complete the tasks.
4 Participants should be able to shortlist bids and proceed to completed stage using JWT tokens Goal reached. Participants were able to complete the tasks.
5 Participants should be able to bid on an auction using JWT tokens Goal reached. Participants were able to complete the tasks.
6 Participants should be able to cancel an auction using JWT tokens Goal reached. Participants were able to complete the tasks.
7 Participants should be able to cancel a bid using JWT tokens Goal reached. Participants were able to complete the tasks.
8 Participants should be able to update a bid during open stage using JWT tokens Goal reached. Participants were able to complete the tasks.
9 Participants should be able to get the winning price and volume from completed auctions using JWT tokens Goal reached. Participants were able to complete the tasks.
10 Participants will input the auction data into postman and encountered a validation error Goal reached. Participants were able to complete the tasks.

Key Findings

Functions Users' Comment Changes to be made
Function Refinement Sponsor requested the need for the index to process events in batches Ducky King development team will process and break down the events into sizeable batches for processing before saving/updating the database

Overall Results/Comments

  • Sponsor is extremely satisfied with the team’s progress and achievement

UAT 3

Test Plan

Venue: Flow Labs Office @ 165 Telok Ayer Street
Date: 9 October 2017
Time: 4.30PM
Duration: ~ 30 minutes per user
Number of Participants for FlowLabs Middleware: 3
User Test: Instructions can be found here

Objectives

  • To let the participants understand how additional functionalities for the middleware are might potentially affect integration with the front end application

Scope of UAT 1

  • Authenticate before any action
  • Create Auctions
  • Create Bids
  • View Auctions
  • View Bids
  • Cancel Auctions
  • Cancel Bids
  • Update Bid
  • Update Auction Status
  • View Winning Bid Price and Volume

Procedures

Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud as they follow through the instructions given for the user testing. Team Ducky King will be there to record down the participants’ behaviours. Participants will complete a post-test questionnaire at the end of their user testing. Team Ducky King will conclude the user testing by asking the participants questions with regards to their behaviours and thought process as they navigate through FlowLabs Middleware.

S/N Goals Reached?
1 Participants should be able to authenticate themselves Goal reached. Participants were able to complete the tasks.
2 Participants should be able to create an auction using JWT tokens Goal reached. Participants were able to complete the tasks.
3 Participants should be able to shortlist bids and proceed to negotiation stage using JWT tokens Goal reached. Participants were able to complete the tasks.
4 Participants should be able to shortlist bids and proceed to completed stage using JWT tokens Goal reached. Participants were able to complete the tasks.
5 Participants should be able to bid on an auction using JWT tokens Goal reached. Participants were able to complete the tasks.
6 Participants should be able to cancel an auction using JWT tokens Goal reached. Participants were able to complete the tasks.
7 Participants should be able to cancel a bid using JWT tokens Goal reached. Participants were able to complete the tasks.
8 Participants should be able to update a bid during open stage using JWT tokens Goal reached. Participants were able to complete the tasks.
9 Participants should be able to get the winning price and volume from completed auctions using JWT tokens Goal reached. Participants were able to complete the tasks.
10 Participants will input the auction data into postman and encountered a validation error Goal reached. Participants were able to complete the tasks.

Key Findings

Functions Users' Comment Changes to be made
Function Refinement Sponsor requested the need for the index to process events in batches Ducky King development team will process and break down the events into sizeable batches for processing before saving/updating the database

Overall Results/Comments

  • Sponsor is extremely satisfied with the team’s progress and achievement