IS480 Team wiki: 2015T6 6nificance Test Documents
Technical Documents | Design Documents | Test Documents | Meeting Minutes | Proposal/Presentations |
User Testing 1 | Heuristic Evaluation | User Testing 2 | User Testing 3 |
---|
Contents
Test Plan
Date: 08 Aug 2015, Saturday
Venue: Based on testers' convenience
Duration: 20 mins per user
Number of Users:
Android App | Back-end Website |
---|---|
Daryl (Project Sponsor) | Daryl (Project Sponsor) |
JJ (Project Sponsor) | JJ (Project Sponsor) |
14 Female (Age 14-24 years old) | - |
2 Male (Age 14-24 years old) | - |
Objectives:
- Determine if user interface is intuitive
- Discover any usability problems
- To improve application and website based on User Testing 1 result
Scope:
- User Module (Login/Logout, Signup via Facebook/Email, Forget Password)
- Design Module
- Photo Module
- Collection Module (Save Color and View Collection)
- Back-end website (Only for Project Sponsors)
Procedure:
- Testers will follow instructions in the questionnaire to use the app/website
- Testers will fill up the questionnaire as they follow the instructions
Android App Metrics
Listed below are the list of metrics that are recorded during User Testing 1 that will help us improve our application.
Bug-Related Metrics
Average User Friendliness Score
Average Task Simplicity Score
Each task has a "How simple is it to do *insert task's name* score. The average task simplicity score indicates how simple a task is: 1 - Too difficult to use, 5 - Very simple to use.
Users' Likes
- App is user friendly
- Design is nice
- Being able to pick your own color
- Being able to choose color from photo
- Good that app gives suggestion on what color matches the color you selected
- The idea of personalizing nail polish color
Users' Complains
Having a high frequency shows that many users are having the same issue, it does not necessarily mean that the team is changing the complains mentioned. The team will review the complains mentioned as well as review if the complain negatively impacts functionality or the business process before deciding to make a change.
Android App Main Issues
- Difficulty figuring out what certain functions are
- Naming of pages can be improved
- Users have difficulty figuring out that blueprint is the place to store saved colors
- Users have difficulty figuring out where "tones" of "Complement/Clash/Tones" is
- Users are afraid that the color that they see in the screen will not be the same as the nail polish color
- Need to improve color detection as image is compressed
- Users do not know how to save color
Android App Changes
Problem | Changes Made | Before | After |
---|---|---|---|
Difficulty figuring out what certain functions are | The team understands the problem the user is facing, however our task "View Tutorial" is scheduled to be in Iteration 7. The task "View Tutorial" will allow users to view tutorial on how to use the app, as well as having instructions on screen that can be toggled on or off. | N.A | N.A |
Naming of pages can be improved | 1. Change blueprint to favourites | ||
Naming of pages can be improved | 2. Change save to favourite | ||
Naming of pages can be improved | 3. Change tones to shades | ||
Naming of pages can be improved | 4. Change Chosen Color to Click Me | ||
Worry that color in screen maybe different from the nail polish color | 1. This is a risk that we have acknowledged in our Risk Management 2. Change the words in the I Want to include money back guarantee |
||
Need to improve color detection | Fixed a rare occurence where the image will be scaled incorrectly | N.A | N.A |
Website Metrics
Listed below are the list of metrics that are recorded during User Testing 1 that will help us improve our website.
Average Task Simplicity Score
Each task has a "How simple is it to do *insert task's name* score. The average task simplicity score indicates how simple a task is: 1 - Too difficult to use, 5 - Very simple to use.
Website Main Issues
- User does not know which page they are in
- User needs to click 2 times to see archived/pending orders
- User prefers to have a wider range of colors for credibility rating
Website Changes Made
Problem | Changes Made | Before & After | |
---|---|---|---|
User does not know which page they are in | Header is added at the top of the website to indicate which page the user is at | After |
|
User needs to click 2 times to see archived/pending orders | Removed landing page | After | |
User prefers to have a wider range of colors for credibility rating | Added a wider range of colors to represent different credibility rating | After |