HeaderSIS.jpg

IS480 Team wiki:2017T1 Ducky King User Testing 1

From IS480
Jump to navigation Jump to search
DuckyKingLogo.png


Duckyking home logo.png   HOME

 

Duckyking about us.png   ABOUT US

 

Duckyking project overview.png   PROJECT OVERVIEW

 

Duckyking project management.png   PROJECT MANAGEMENT

 

Ducky king documentation.png   DOCUMENTATION

 



FlowAdmin UAT Header.png


UAT 1

Test Plan

Venue: Flow Labs Office @ 165 Telok Ayer Street
Date: 15 August 2017
Time: 4.30PM
Duration: ~ 15 minutes per user
Number of Participants for FlowLabs Middleware: 3
User Test: Instructions can be found here

Objectives

  • To let the participants verify if the core functionalities for the middleware are suitable for integration with the front end application
  • To identify missing functionality

Scope of UAT 1

  • Create Auctions
  • Create Bids
  • View Auctions
  • View Bids
  • Cancel Auctions
  • Cancel Bids
  • Update Bid
  • Update Auction Status

Procedures

Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud and ask questions as they follow through the instructions given for the user testing. Team Ducky King will be there to record down the participants’ comments. Participants will complete a post-test questionnaire at the end of their user testing. Team Ducky King will conclude the user testing by asking the participants questions with regards to Flow Middleware platform.

S/N Goals Reached?
1 Participants should be able to create an auction. Goal reached. Participants were able to complete the tasks..
2 Participants should be able to shortlist auctions and proceed to negotiation stage Goal reached. Participants were able to complete the tasks.
3 Participants should be able to bid on an auction Goal reached. Participants were able to complete the tasks.
4 Participants should be able to cancel an auction Goal reached. Participant were able to complete the tasks.
5 Participants should be able to cancel a bid Goal reached. Participants were able to complete the tasks.
6 Participants should be able to update a bid during open stage Goal reached. Participant was able to complete the tasks.

Key Findings

Functions Users' Comment Changes to be made
Function Refinement Sponsor requested for the endpoints to not accept any inputs that are prone to manipulation. Ducky King development team reduce any required user inputs and allow the inputs to be abstracted from the database.
Function Refinement Sponsor highlighted the need for the auction winner’s details to be easily accessible on the blockchain. Ducky King development team will process and break down the bid details and only allow auction winner’s non-sensitive information to be available on the blockchain.
Function Refinement Sponsor requested add more endpoints for the frontend layer to easily query winning bids’ detail sorted by time. Ducky King development team will add new functions and endpoints to allow the winning bids’ details to be easily queried.
Function Refinement Sponsor requested that the endpoints return JSON payload of a certain format. Ducky King development team reduce any required user inputs and allow the inputs to be abstracted from the database.

Overall Results/Comments

  • Implementing stringent validation rules
  • To return more meaningful JSON response for readability
  • Sponsor is satisfied with the team’s progress

UAT 2

Test Plan

Venue: Flow Labs Office @ 165 Telok Ayer Street
Date: 9 October 2017
Time: 4.30PM
Duration: ~ 30 minutes per user
Number of Participants for FlowLabs Middleware: 3
User Test: Instructions can be found here

Objectives

  • To let the participants understand how additional functionalities for the middleware are might potentially affect integration with the front end application

Scope of UAT 2

  • Authenticate before any action
  • Create Auctions
  • Create Bids
  • View Auctions
  • View Bids
  • Cancel Auctions
  • Cancel Bids
  • Update Bid
  • Update Auction Status
  • View Winning Bid Price and Volume

Procedures

Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud as they follow through the instructions given for the user testing. Team Ducky King will be there to record down the participants’ behaviours. Participants will complete a post-test questionnaire at the end of their user testing. Team Ducky King will conclude the user testing by asking the participants questions with regards to their behaviours and thought process as they navigate through FlowLabs Middleware.

S/N Goals Reached?
1 Participants should be able to authenticate themselves Goal reached. Participants were able to complete the tasks.
2 Participants should be able to create an auction using JWT tokens Goal reached. Participants were able to complete the tasks.
3 Participants should be able to shortlist bids and proceed to negotiation stage using JWT tokens Goal reached. Participants were able to complete the tasks.
4 Participants should be able to shortlist bids and proceed to completed stage using JWT tokens Goal reached. Participants were able to complete the tasks.
5 Participants should be able to bid on an auction using JWT tokens Goal reached. Participants were able to complete the tasks.
6 Participants should be able to cancel an auction using JWT tokens Goal reached. Participants were able to complete the tasks.
7 Participants should be able to cancel a bid using JWT tokens Goal reached. Participants were able to complete the tasks.
8 Participants should be able to update a bid during open stage using JWT tokens Goal reached. Participants were able to complete the tasks.
9 Participants should be able to get the winning price and volume from completed auctions using JWT tokens Goal reached. Participants were able to complete the tasks.
10 Participants will input the auction data into postman and encountered a validation error Goal reached. Participants were able to complete the tasks.

Key Findings

Functions Users' Comment Changes to be made
Function Refinement Sponsor requested the need for the index to process events in batches Ducky King development team will process and break down the events into sizeable batches for processing before saving/updating the database

Overall Results/Comments

  • Sponsor is extremely satisfied with the team’s progress and achievement

UAT 3

Test Plan

Venue: Flow Labs Office @ 165 Telok Ayer Street
Date: 17 November 2017
Time: 4.30PM
Duration: ~ 30 minutes per user
Number of Participants for FlowLabs Middleware: 3
User Test: Instructions can be found here

Objectives

  • To let the participants ascertain the adequacy of information provided by middleware api provided through relating to the FlowLabs platform requirements
  • Ensure participants are able to read the logs and identify the root problem of the error logs

Scope of UAT 3

  • Authenticate before any action
  • Create Auctions
  • Create Bids
  • View Auctions
  • View Bids
  • Cancel Auctions
  • Cancel Bids
  • Update Bid
  • Update Auction Status
  • View Winning Bid Price and Volume
  • View Logs and Action Implementation

Procedures

Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud as they follow through the instructions given for the user testing. Team Ducky King will be there to record down the participants’ behaviours. Participants will complete a post-test questionnaire at the end of their user testing. Team Ducky King will conclude the user testing by asking the participants questions with regards to their behaviours and thought process as they navigate through FlowLabs Middleware.

S/N Goals Reached?
1 Participants should be able to get all variables via middleware API required for FlowLabs platform MAIN page Goal reached. Participants were able to get the required variables for FlowLabs platform and there were no lacking variables
2 Participants should be able to get all variables via middleware API required for FlowLabs platform DASHBOARD <Our Auctions> page Goal reached. Participants were able to get the required variables for FlowLabs platform and there were no lacking variables
3 Participants should be able to get all variables via middleware API required for FlowLabs platform DASHBOARD <Our Bids> page Goal reached. Participants were able to get the required variables for FlowLabs platform and there were no lacking variables
4 Participants should be able to get the winning price and volume from completed auctions via middleware API required for FlowLabs Goal reached. Participants were able to get the required variables for FlowLabs platform and there were no lacking variables
5 Participants should be able match all the input fields on the <New Auction> page to the parameters required by Postman Goal reached. Participants were able to get the required variables for FlowLabs platform and there were no lacking variables
6 Participants should be able match all the input fields on the <New Bid> page to the parameters required by Postman Goal reached. Participants were able to get the required variables for FlowLabs platform and there were no lacking variables
7 Participants should be able to match all the input fields on the <Update Bid> page to the parameters required by Postman Goal reached. Participants were able to get the required variables for FlowLabs platform and there were no lacking variables
8 Participants should be able to pass the checkboxes ticked for bids selection to Postman Goal reached. Participants were able to get the required variables for FlowLabs platform and there were no lacking variables
9 Participants will input the auction data into postman, encountered a validation error and are able to understand the logs to find the root of the problem Goal reached. Participants were able to understand the error logs and take any measures required
10 Participants will input the wrong auction address into postman while creating new bid and are able to understand the logs to find the root of the problem Goal reached. Participants were able to understand the error logs and take any measures required
11 Participants will input the wrong public key into postman while updating auction and are able to understand the logs to find the root of the problem Goal reached. Participants were able to understand the error logs and take any measures required
12 Participants should be able to identify database connection errors from the logs to find the root of the problem Goal reached. Participants were able to understand the error logs and take any measures required
13 Participants should be able to identify blockchain connection errors from the logs to find the root of the problem Goal reached. Participants were able to understand the error logs and take any measures required

Key Findings

Functions Users' Comment Changes to be made
API Refinement Sponsor requested the need for public_key to be included when adding a new bid Ducky King development team will include the required parameter into the API
API Refinement Sponsor requested the need for pagination of the information returned via the API Ducky King development team will paginate the information into different segments before returning the information back to FlowLabs platform

Overall Results/Comments

  • Sponsor is happy that the API design is very intuitive and very scalable for their usage