Difference between revisions of "IS480 Team wiki: 2016T1 HumbleBees User Testing"
Jump to navigation
Jump to search
Gather feedback from volunteers about the mounting of IoT device on their wheelchairs
Gather feedback on the interface of the Wheelroutes web application
Improve on the design of the interface based on UT result and feedback
Mounting of IoT device on wheelchair
Landing page of web application
Login function of web application
Register function of web application
Users consisted of 4 HWA wheelchair volunteers and 6 caregivers and HWA staff members
The IoT device was mounted on their wheelchair depending on the model of their wheelchair
The Wheelchair users were briefed on the project and how to operate the device
A Macbook Pro was used for testing the web application
Navigate landing page without the assistance of a team member
Navigate registration page without the assistance of a team member
Log in an account created at the landing page
Register a new account at the log in page
Pouch for the RPi changed to a plastic container
Added error messages when a field is entered wrongly
Gather feedback from volunteers of the device after one week of data collection
Follow up with volunteers after device was mounted on their wheelchairs
Gather feedback on the interface of the Wheelroutes web application
Fix any bugs or errors occurring with the device
IoT device on wheelchair
WheelRoutes' obstacle reporting function and route display
7 HWA volunteers with device mounted on wheelchair
Actual device has already been mounted on the volunteers' wheelchair
Volunteers have been collecting data for approximately a week
Gave responses on a scale of 1 - 5 (1 strongly disagree, 5 strongly agree) to statements made by a team member
Comment on routes displayed on the map using data collected form the IoT device
Instruction manual issued to volunteers
Improve the display of routes on WheelRoutes
Find out usability of our web application WheelRoutes
Gather feedback on the interface of the Wheelroutes web application
Login function of web application
Register function of web application
Search location
Find current location
Report obstacle
Users consisted of 2 HWA wheelchair volunteers, 2 HWA staff members and 2 Wheelchair users from Enabling village
Users were asked to perform tasks on WheelRoutes based on test cases designed
Team members did not provide any assistance unless required
Tested on a Macbook Pro
Register a new account at the log in page
Log in an account created at the landing page
Search for a location using the search function
Find out the current location using the current location button
Improve the loading time of WheelRoutes
Provide more instructions for users for e.g How to report an obstacle
Label buttons so the buttons of the function is clearer
Improve the display of the routes by colour coding routes as well as making it neater
Test usability of our web application WheelRoutes
Gather feedback on the interface of the WheelRoutes web application
Login function of web application
Register function of web application
Landing page functions
Report obstacle
Admin function - Manage Obstacle
Admin function - View routes by coordinates
Users consisted of 2 sponsors, 5 wheelchair users, 3 able-bodied personnel
Users were asked to perform tasks on WheelRoutes based on test cases designed
Team members did not provide any assistance unless required
Tested on a Macbook Pro
Conducted at Singapore Management University
Register a new account at the log in page
Log in an account created at the landing page
Identify a route on the map from the screenshot provided to them
Report an obstacle at SIS with a picture of the obstacle provided
Approve/ Reject an obstacle
Filter the userID, time and date for the 'view routes by coordinate' function and identify the starting point
5 out of 10 users were unable to identify the bumpiness of the route from the screenshot
The 5 users who did not manage to identify bumpiness mentioned that they do not know what the colours mean
For the 'view by coordinates' function, 80% of the users were unable to identify the starting point of the route when the dots started plotting
Added a 'Help' button to explain what the different colours mean on the routes
Added a flag to indicate the start and end point of the 'view routes by coordinates' function
Added a 'back' button at the admin page to allow users to return to the landing page
Improve the display of the routes by colour coding routes as well as making it neater
Line 228: | Line 228: | ||
# "After the coordinates start running, I can’t tell the start point again.” | # "After the coordinates start running, I can’t tell the start point again.” | ||
# "Cannot remember starting point. Placing a marker will be good” | # "Cannot remember starting point. Placing a marker will be good” | ||
− | |||
<h3>Improvements to be made </h3> | <h3>Improvements to be made </h3> |
Revision as of 17:22, 29 November 2016
User Test 1
Time Period: 5th - 8th August
Total Number of users: 10
Venue: Handicap Welfare Association (HWA)
Duration: 30 mins per user
Objectives:
Scope:
Users:
Environment:
Actions taken by users during UT1:
User's feedback
Improvements made after UT1:
- By changing to a plastic container, it will address the users concern of using a cloth pouch which may get wet in the event of we weather
- A plastic container is more rigid, providing better protection for the users
- The wires can also be stored neatly in the plastic container
- With error messages, it will enhance the user’s experience during registration/ log in as the user will know the cause of the error
User Test 2
Time Period: 13th - 27th September
Total Number of users: 7
Venue: Handicap Welfare Association (HWA), Volunteers' homes
Duration: 30 mins per user
Objectives:
Scope:
Users:
Environment:
Actions taken by users during UT2:
User's feedback
Improvements to be made after UT2:
- Manual will explain the project as well as the volunteers roles and responsibilities for the device
- Advise them on a waiting time before unplugging the power bank from device (15-20mins)
- Call the volunteers if 3 days worth of data are not uploaded
User Test 3
Time Period: 27th September
Total Number of users: 6
Venue: Handicap Welfare Association (HWA), Enabling village
Duration: 30 - 40 mins per user
Objectives:
Scope:
Users:
Environment:
Actions taken by users during UT3:
User's feedback
Comments made by users
- "Lacks instructions and guides to help me as a user."
- "Don't know what the flag is for."
- "The website is too laggy."
- "Takes too long to load."
- "Good application but needs more instructions."
- "Design is simple and nice but it would be good if there's a guide."
Improvements to be made
User Acceptance Test
Time Period: 14th to 17th November
Total Number of users: 10
Venue: Singapore Management University
Duration: 40 - 45 mins per user
Objectives:
Scope:
Users:
Environment:
Goals
Tasks performed by user for UAT
User's feedback
Comments made by users
- "After the coordinates start running, I can’t tell the start point again.”
- "Cannot remember starting point. Placing a marker will be good”