IS480 Team wiki: 2017T2 Royal Flush Documentation User Testing UAT1

From IS480
Jump to navigation Jump to search
RF menu home.png
RF menu team.png
RF menu proj ovw.png
RF menu proj mgmt.png
RF menu doc active.png
RF submenu doc pers scen.png
RF submenu doc diagrams.png
RF submenu doc proto.png
RF submenu doc tech.png
RF submenu doc user testing active.png
RF submenu doc min.png
RF submenu doc deliverables.png
RF submenu doc usrtest internal.png
RF submenu doc usrtest uat1 active.png
RF submenu doc usrtest uat2.png
RF submenu doc usrtest uat3.png

UAT 1 Details

Venue: ST Aerspace Academy
Date: 2nd February 2018
Time: 7am to 12pm
Number of Participants:

  • Captain Robert Champion
  • Captain Anthony
  • 3 Testing Pilots


  • Gather user feedback on developed user interface for developed functions from real users
  • Identify potential usability issues


  • Search for schedule
  • Start an assessment
  • Grading candidates
  • Sign and review form
  • Submit the form


We have assigned roles to the team members, which includes:

  • A main facilitator, who will facilitate the test with a fixed set of instructions
  • A secondary facilitator, to collect feedback at the end of the user testing session
  • A scribe, who will be recording behaviors and comments from our participants if participants think aloud while testing
S/N Objective Attained?
1 Participant should be able to login using SSO Passed
2 Participant should be able to search for pilot scheduled assigned 'Today' Passed
3 Participant should be able to start 2 assessments Passed
4 Participant should be able to switch within 2 assessments Passed
5 Participant should be able to sign the form Passed
6 Participants should be able to submit the form in flight mode Passed

Key Findings

Functions Feedback Changes
UI/UX (Practical Base Test Module) Too many remarks forms Remove all remarks table for each section and add a big remarks table at the end of the form before submitting
UI/UX (Practical Base Test Module) Unable to clear signature Enable clear function for signature
Performance Page refresh between assessment page is too slow. Code refactoring to improve performance
UI/UX User took more than 5 seconds to know how to go to the schedule page Make flow more intuitive by moving "My Schedule" page to front page of application.
Practical Based Test Module Save button forces form to close. When user clicks save, details should be saved and not exit
UI/UX After filtering the schedule, user unable to clear filter. Implement a "clear filter" function