Difference between revisions of "IS480 Team wiki:2017T1 Ducky King User Testing 1"
Tcgan.2015 (talk | contribs) |
|||
Line 170: | Line 170: | ||
<p> | <p> | ||
<ul> | <ul> | ||
− | <li> | + | <li>Implementing stringent validation rules</li> |
+ | <li>To return more meaningful JSON response for readability</li> | ||
<li>Sponsor is satisfied with the team’s progress</li> | <li>Sponsor is satisfied with the team’s progress</li> | ||
</ul> | </ul> |
Revision as of 13:20, 18 August 2017
Contents
FlowLabs Middleware
Test Plan
Venue: Flow Labs Office @ 165 Telok Ayer Street
Date: 15 August 2017
Time: 4.30PM
Duration: ~ 15 minutes per user
Number of Participants for FlowLabs Middleware: 3
User Test: Instructions can be found here
Objectives
- To let the participants verify if the core functionalities for the middleware are suitable for integration with the front end application
- To identify missing functionality
Scope of UAT 1
- Create Auctions
- Create Bids
- View Auctions
- View Bids
- Cancel Auctions
- Cancel Bids
- Update Bid
- Update Auction Status
Procedures
Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud and ask questions as they follow through the instructions given for the user testing. Team Ducky King will be there to record down the participants’ comments. Participants will complete a post-test questionnaire at the end of their user testing. Team Ducky King will conclude the user testing by asking the participants questions with regards to Flow Middleware platform.
S/N | Goals | Reached? |
---|---|---|
1 | Participants should be able to create an auction. | Goal reached. Participants were able to complete the tasks.. |
2 | Participants should be able to shortlist auctions and proceed to negotiation stage | Goal reached. Participants were able to complete the tasks. |
3 | Participants should be able to bid on an auction | Goal reached. Participants were able to complete the tasks. |
4 | Participants should be able to cancel an auction | Goal reached. Participant were able to complete the tasks. |
5 | Participants should be able to cancel a bid | Goal reached. Participants were able to complete the tasks. |
6 | Participants should be able to update a bid during open stage | Goal reached. Participant was able to complete the tasks. |
Key Findings
Functions | Users' Comment | Changes to be made |
---|---|---|
Function Refinement | Sponsor requested for the endpoints to not accept any inputs that are prone to manipulation. | Ducky King development team reduce any required user inputs and allow the inputs to be abstracted from the database. |
Function Refinement | Sponsor highlighted the need for the auction winner’s details to be easily accessible on the blockchain. | Ducky King development team will process and break down the bid details and only allow auction winner’s non-sensitive information to be available on the blockchain. |
Function Refinement | Sponsor requested add more endpoints for the frontend layer to easily query winning bids’ detail sorted by time. | Ducky King development team will add new functions and endpoints to allow the winning bids’ details to be easily queried. |
Function Refinement | Sponsor requested that the endpoints return JSON payload of a certain format. | Ducky King development team reduce any required user inputs and allow the inputs to be abstracted from the database. |
Overall Results/Comments
- Implementing stringent validation rules
- To return more meaningful JSON response for readability
- Sponsor is satisfied with the team’s progress
FlowAdmin
Test Plan
Venue: Flow Labs Office @ 165 Telok Ayer Street
Date: 15 August 2017
Time: 5.30PM
Duration: ~ 15 minutes per user
Number of Participants for FlowLabs Middleware: 4
User Test: Instructions can be found here
Objectives
- To gather feedback regarding user interface and the developed functions
- To detect usability issues based on users’ behaviour
- To improve web application interface based on the feedback
Scope of UAT 1
- Delete Bids
- Delete Auctions
Procedures
Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud as they follow through the instructions given for the user testing. Team Ducky King will be there to record down the participants’ behaviours. Participants will complete a post-test questionnaire at the end of their user testing. Team Ducky King will conclude the user testing by asking the participants questions with regards to their behaviours and thought process as they navigate through FlowAdmin platform.
S/N | Goals | Reached? |
---|---|---|
1 | User should be able to complete the tasks without guidance from a test facilitator | Goal reached. Participants were able to complete the tasks without guidance from a test facilitator |
2 | User should find it easy to remove a specific auction | Goal reached. Participants were able to complete the tasks. |
3 | User should find it easy to remove a specific bid | Goal reached. Participants were able to complete the tasks. |
Key Findings
Functions | Users’ Behaviour | Changes to be made |
---|---|---|
User Interface | Participants tend to click on the ‘delete auction’ and ‘delete bid’ buttons multiple times and do not know that the request is being processed. | Introduce a loading spinner into the platform when the button is clicked so the user knows that the request has been sent. |
User Interface | Participants had a slight pause before being able to view the list of auctions. | Put the navigation to the list of actions in a more visible position. |
User Interface | Participants had slight difficulty in finding the bids to delete from the respective auctions. | Have a bids tab in the menu bar and a listing of all bids. |
Functions | Users’ Comment | Changes to be made |
---|---|---|
Function Refinement | Sponsor requested for a way to identify spam bids more easily using timestamps |
|
Overall Results/Comments
Based on the results and feedback from the UAT,
- User interface can be improved to be more intuitive to identify dubious auctions and bids
- Client was impressed by the FlowAdmin interface as they only required a command line interface