HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2016T1 HumbleBees User Testing"

From IS480
Jump to navigation Jump to search
Line 228: Line 228:
 
# "After the coordinates start running, I can’t tell the start point again.”
 
# "After the coordinates start running, I can’t tell the start point again.”
 
# "Cannot remember starting point. Placing a marker will be good”
 
# "Cannot remember starting point. Placing a marker will be good”
 
  
 
<h3>Improvements to be made </h3>
 
<h3>Improvements to be made </h3>

Revision as of 17:22, 29 November 2016

Team humblebees.png


Humblebees home.png   HOME

 

Humblebees about us.png   ABOUT US

 

Humblebees overview.png   PROJECT OVERVIEW

 

Humblebees proj mgmt.png   PROJECT MANAGEMENT

 

Humblebees documentation.png   DOCUMENTATION


User Test 1


Time Period: 5th - 8th August
Total Number of users: 10
Venue: Handicap Welfare Association (HWA)
Duration: 30 mins per user

Objectives:

  • Gather feedback from volunteers about the mounting of IoT device on their wheelchairs
  • Gather feedback on the interface of the Wheelroutes web application
  • Improve on the design of the interface based on UT result and feedback
  • Scope:

  • Mounting of IoT device on wheelchair
  • Landing page of web application
  • Login function of web application
  • Register function of web application
  • Users:

  • Users consisted of 4 HWA wheelchair volunteers and 6 caregivers and HWA staff members
  • Environment:

  • The IoT device was mounted on their wheelchair depending on the model of their wheelchair
  • The Wheelchair users were briefed on the project and how to operate the device
  • A Macbook Pro was used for testing the web application
  • Actions taken by users during UT1:

  • Navigate landing page without the assistance of a team member
  • Navigate registration page without the assistance of a team member
  • Log in an account created at the landing page
  • Register a new account at the log in page
  • User's feedback

    Slide4.png Slide5.png

    Improvements made after UT1:

  • Pouch for the RPi changed to a plastic container
    1. By changing to a plastic container, it will address the users concern of using a cloth pouch which may get wet in the event of we weather
    2. A plastic container is more rigid, providing better protection for the users
    3. The wires can also be stored neatly in the plastic container
  • Added error messages when a field is entered wrongly
    1. With error messages, it will enhance the user’s experience during registration/ log in as the user will know the cause of the error


    User Test 2


    Time Period: 13th - 27th September
    Total Number of users: 7
    Venue: Handicap Welfare Association (HWA), Volunteers' homes
    Duration: 30 mins per user

    Objectives:

  • Gather feedback from volunteers of the device after one week of data collection
  • Follow up with volunteers after device was mounted on their wheelchairs
  • Gather feedback on the interface of the Wheelroutes web application
  • Fix any bugs or errors occurring with the device
  • Scope:

  • IoT device on wheelchair
  • WheelRoutes' obstacle reporting function and route display
  • Users:

  • 7 HWA volunteers with device mounted on wheelchair
  • Environment:

  • Actual device has already been mounted on the volunteers' wheelchair
  • Volunteers have been collecting data for approximately a week
  • Actions taken by users during UT2:

  • Gave responses on a scale of 1 - 5 (1 strongly disagree, 5 strongly agree) to statements made by a team member
  • Comment on routes displayed on the map using data collected form the IoT device
  • User's feedback

    UT2 results.png


    Waiting time.001.png


    Improvements to be made after UT2:

  • Instruction manual issued to volunteers
    1. Manual will explain the project as well as the volunteers roles and responsibilities for the device
    2. Advise them on a waiting time before unplugging the power bank from device (15-20mins)
    3. Call the volunteers if 3 days worth of data are not uploaded
  • Improve the display of routes on WheelRoutes

  • User Test 3

    Time Period: 27th September
    Total Number of users: 6
    Venue: Handicap Welfare Association (HWA), Enabling village
    Duration: 30 - 40 mins per user

    Objectives:

  • Find out usability of our web application WheelRoutes
  • Gather feedback on the interface of the Wheelroutes web application
  • Scope:

  • Login function of web application
  • Register function of web application
  • Search location
  • Find current location
  • Report obstacle
  • Users:

  • Users consisted of 2 HWA wheelchair volunteers, 2 HWA staff members and 2 Wheelchair users from Enabling village
  • Environment:

  • Users were asked to perform tasks on WheelRoutes based on test cases designed
  • Team members did not provide any assistance unless required
  • Tested on a Macbook Pro
  • Actions taken by users during UT3:

  • Register a new account at the log in page
  • Log in an account created at the landing page
  • Search for a location using the search function
  • Find out the current location using the current location button
  • User's feedback

    UT3 results summary.png

    Comments made by users

    1. "Lacks instructions and guides to help me as a user."
    2. "Don't know what the flag is for."
    3. "The website is too laggy."
    4. "Takes too long to load."
    5. "Good application but needs more instructions."
    6. "Design is simple and nice but it would be good if there's a guide."

    Improvements to be made

  • Improve the loading time of WheelRoutes
  • Provide more instructions for users for e.g How to report an obstacle
  • Label buttons so the buttons of the function is clearer
  • Improve the display of the routes by colour coding routes as well as making it neater
  • User Acceptance Test

    Time Period: 14th to 17th November
    Total Number of users: 10
    Venue: Singapore Management University
    Duration: 40 - 45 mins per user

    Objectives:

  • Test usability of our web application WheelRoutes
  • Gather feedback on the interface of the WheelRoutes web application
  • Scope:

  • Login function of web application
  • Register function of web application
  • Landing page functions
  • Report obstacle
  • Admin function - Manage Obstacle
  • Admin function - View routes by coordinates
  • Users:

  • Users consisted of 2 sponsors, 5 wheelchair users, 3 able-bodied personnel
  • Environment:

  • Users were asked to perform tasks on WheelRoutes based on test cases designed
  • Team members did not provide any assistance unless required
  • Tested on a Macbook Pro
  • Conducted at Singapore Management University
  • Goals

    Screen Shot 2016-11-29 at 5.08.30 PM.png
    Screen Shot 2016-11-29 at 5.08.44 PM.png

    Tasks performed by user for UAT

  • Register a new account at the log in page
  • Log in an account created at the landing page
  • Identify a route on the map from the screenshot provided to them
  • Report an obstacle at SIS with a picture of the obstacle provided
  • Approve/ Reject an obstacle
  • Filter the userID, time and date for the 'view routes by coordinate' function and identify the starting point
  • User's feedback

  • 5 out of 10 users were unable to identify the bumpiness of the route from the screenshot
  • The 5 users who did not manage to identify bumpiness mentioned that they do not know what the colours mean
  • For the 'view by coordinates' function, 80% of the users were unable to identify the starting point of the route when the dots started plotting
  • Comments made by users

    1. "After the coordinates start running, I can’t tell the start point again.”
    2. "Cannot remember starting point. Placing a marker will be good”

    Improvements to be made

  • Added a 'Help' button to explain what the different colours mean on the routes
  • Added a flag to indicate the start and end point of the 'view routes by coordinates' function
  • Added a 'back' button at the admin page to allow users to return to the landing page
  • Improve the display of the routes by colour coding routes as well as making it neater