HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2016T1 HumbleBees User Testing"

From IS480
Jump to navigation Jump to search
Line 44: Line 44:
 
<!--Sub Header End-->
 
<!--Sub Header End-->
 
<br>
 
<br>
<h1>Usability Test 1 </h1>
+
<h1>User Test 1 </h1>
 
<br>
 
<br>
 
Time Period: 5th - 8th August <br>
 
Time Period: 5th - 8th August <br>
Line 89: Line 89:
 
# With error messages, it will enhance the user’s experience during registration/ log in as the user will know the cause of the error
 
# With error messages, it will enhance the user’s experience during registration/ log in as the user will know the cause of the error
 
<br>
 
<br>
<h1>Usability Test 2 </h1>
+
<h1>User Test 2 </h1>
 
<br>
 
<br>
 
Time Period: 13th - 27th September <br>
 
Time Period: 13th - 27th September <br>
Line 119: Line 119:
 
<h3>User's feedback</h3>
 
<h3>User's feedback</h3>
 
[[Image: UT2_results.png|center|600px]]
 
[[Image: UT2_results.png|center|600px]]
 +
<br>
 +
[[Image: Waiting_time.001.png|center|600px]]
 +
<br>
 +
<h3>Improvements to be made after UT2:</h3>
 +
<li> Instruction manual issued to volunteers</li>
 +
# Manual will explain the project as well as the volunteers roles and responsibilities for the device
 +
# Advise them on a waiting time before unplugging the power bank from device (15-20mins)
 +
# Call the volunteers if 3 days worth of data are not uploaded
 +
<li> Improve the display of routes on WheelRoutes </li>
 +
<br>
 +
 +
<h1>User Test 3 </h1>
 +
Time Period: 27th September <br>
 +
Total Number of users: 6 <br>
 +
Venue: Handicap Welfare Association (HWA), Enabling village<br>
 +
Duration: 30 - 40 mins per user<br>
 +
 +
<h3>Objectives:</h3>
 +
<li> Find out usability of our web application WheelRoutes</li>
 +
<li> Gather feedback on the interface of the Wheelroutes web application</li>
 +
 +
<h3>Scope:</h3>
 +
<li>Login function of web application</li>
 +
<li>Register function of web application</li>
 +
<li>Search location </li>
 +
<li>Find current location </li>
 +
<li>Report obstacle </li>
 +
 +
<h3>Users:</h3>
 +
<li>Users consisted of 2 HWA wheelchair volunteers, 2 HWA staff members and 2 Wheelchair users from Enabling village</li>
 +
 +
<h3>Environment:</h3>
 +
<li> Users were asked to perform tasks on WheelRoutes based on test cases designed</li>
 +
<li> Team members did not provide any assistance unless required</li>
 +
<li> Tested on a Macbook Pro</li>
 +
 +
<h3>Actions taken by users during UT1:</h3>
 +
<li>Register a new account at the log in page</li>
 +
<li>Log in an account created at the landing page</li>
 +
<li>Search for a location using the search function</li>
 +
<li>Find out the current location using the current location button </li>
 +
 +
<h3>User's feedback</h3>
 +
[[Image: UT3_results_summary.png|center|600px]]
 +
 +
<h3>Comments made by users</h3>
 +
# "Lacks instructions and guides to help me as a user."
 +
# "Don't know what the flag is for."
 +
# "The website is too laggy."
 +
# "Takes too long to load."
 +
# "Good application but needs more instructions."
 +
# "Design is simple and nice but it would be good if there's a guide."
 +
 +
<h3>Improvements to be made </h3>
 +
<li> Improve the loading time of WheelRoutes </li>
 +
<li> Provide more instructions for users for e.g How to report an obstacle </li>
 +
<li> Label buttons so the buttons of the function is clearer </li>
 +
<li>Improve the display of the routes by colour coding routes as well as making it neater</li>

Revision as of 22:26, 28 September 2016

Team humblebees.png


Humblebees home.png   HOME

 

Humblebees about us.png   ABOUT US

 

Humblebees overview.png   PROJECT OVERVIEW

 

Humblebees proj mgmt.png   PROJECT MANAGEMENT

 

Humblebees documentation.png   DOCUMENTATION


User Test 1


Time Period: 5th - 8th August
Total Number of users: 10
Venue: Handicap Welfare Association (HWA)
Duration: 30 mins per user

Objectives:

  • Gather feedback from volunteers about the mounting of IoT device on their wheelchairs
  • Gather feedback on the interface of the Wheelroutes web application
  • Improve on the design of the interface based on UT result and feedback
  • Scope:

  • Mounting of IoT device on wheelchair
  • Landing page of web application
  • Login function of web application
  • Register function of web application
  • Users:

  • Users consisted of 4 HWA wheelchair volunteers and 6 caregivers and HWA staff members
  • Environment:

  • The IoT device was mounted on their wheelchair depending on the model of their wheelchair
  • The Wheelchair users were briefed on the project and how to operate the device
  • A Macbook Pro was used for testing the web application
  • Actions taken by users during UT1:

  • Navigate landing page without the assistance of a team member
  • Navigate registration page without the assistance of a team member
  • Log in an account created at the landing page
  • Register a new account at the log in page
  • User's feedback

    Slide4.png Slide5.png

    Improvements made after UT1:

  • Pouch for the RPi changed to a plastic container
    1. By changing to a plastic container, it will address the users concern of using a cloth pouch which may get wet in the event of we weather
    2. A plastic container is more rigid, providing better protection for the users
    3. The wires can also be stored neatly in the plastic container
  • Added error messages when a field is entered wrongly
    1. With error messages, it will enhance the user’s experience during registration/ log in as the user will know the cause of the error


    User Test 2


    Time Period: 13th - 27th September
    Total Number of users: 7
    Venue: Handicap Welfare Association (HWA), Volunteers' homes
    Duration: 30 mins per user

    Objectives:

  • Gather feedback from volunteers of the device after one week of data collection
  • Follow up with volunteers after device was mounted on their wheelchairs
  • Gather feedback on the interface of the Wheelroutes web application
  • Fix any bugs or errors occurring with the device
  • Scope:

  • IoT device on wheelchair
  • WheelRoutes' obstacle reporting function and route display
  • Users:

  • 7 HWA volunteers with device mounted on wheelchair
  • Environment:

  • Actual device has already been mounted on the volunteers' wheelchair
  • Volunteers have been collecting data for approximately a week
  • Actions taken by users during UT2:

  • Gave responses on a scale of 1 - 5 (1 strongly disagree, 5 strongly agree) to statements made by a team member
  • Comment on routes displayed on the map using data collected form the IoT device
  • User's feedback

    UT2 results.png


    Waiting time.001.png


    Improvements to be made after UT2:

  • Instruction manual issued to volunteers
    1. Manual will explain the project as well as the volunteers roles and responsibilities for the device
    2. Advise them on a waiting time before unplugging the power bank from device (15-20mins)
    3. Call the volunteers if 3 days worth of data are not uploaded
  • Improve the display of routes on WheelRoutes

  • User Test 3

    Time Period: 27th September
    Total Number of users: 6
    Venue: Handicap Welfare Association (HWA), Enabling village
    Duration: 30 - 40 mins per user

    Objectives:

  • Find out usability of our web application WheelRoutes
  • Gather feedback on the interface of the Wheelroutes web application
  • Scope:

  • Login function of web application
  • Register function of web application
  • Search location
  • Find current location
  • Report obstacle
  • Users:

  • Users consisted of 2 HWA wheelchair volunteers, 2 HWA staff members and 2 Wheelchair users from Enabling village
  • Environment:

  • Users were asked to perform tasks on WheelRoutes based on test cases designed
  • Team members did not provide any assistance unless required
  • Tested on a Macbook Pro
  • Actions taken by users during UT1:

  • Register a new account at the log in page
  • Log in an account created at the landing page
  • Search for a location using the search function
  • Find out the current location using the current location button
  • User's feedback

    UT3 results summary.png

    Comments made by users

    1. "Lacks instructions and guides to help me as a user."
    2. "Don't know what the flag is for."
    3. "The website is too laggy."
    4. "Takes too long to load."
    5. "Good application but needs more instructions."
    6. "Design is simple and nice but it would be good if there's a guide."

    Improvements to be made

  • Improve the loading time of WheelRoutes
  • Provide more instructions for users for e.g How to report an obstacle
  • Label buttons so the buttons of the function is clearer
  • Improve the display of the routes by colour coding routes as well as making it neater