HeaderSIS.jpg

IS480 Team wiki: 2015T6 6nificance Test Documents

From IS480
Jump to navigation Jump to search

6nificance Logo.png

6nificance-home.png
HOME

6nificance-about-us.png
ABOUT US

6nificance-proj-overview.png
PROJECT OVERVIEW

6nificance-proj-mgmt.png
PROJECT MANAGEMENT

6nificance-docs.png
DOCUMENTATION

Technical Documents Design Documents Test Documents Meeting Minutes Proposal/Presentations


User Testing 1 Heuristic Evaluation User Testing 2 User Testing 3


Test Plan

Date: 08 Aug 2015, Saturday
Venue: Based on testers' convenience
Duration: 20 mins per user
Number of Users:

Android App Back-end Website
Daryl (Project Sponsor) Daryl (Project Sponsor)
JJ (Project Sponsor) JJ (Project Sponsor)
14 Female (Age 14-24 years old) -
2 Male (Age 14-24 years old) -

Objectives:

  • Determine if user interface is intuitive
  • Discover any usability problems
  • To improve application and website based on User Testing 1 result

Scope:

  • User Module (Login/Logout, Signup via Facebook/Email, Forget Password)
  • Design Module
  • Photo Module
  • Collection Module (Save Color and View Collection)
  • Back-end website (Only for Project Sponsors)

Procedure:

  • Testers will follow instructions in the questionnaire to use the app/website
  • Testers will fill up the questionnaire as they follow the instructions

Android App Metrics

Listed below are the list of metrics that are recorded during User Testing 1 that will help us improve our application.

Bug-Related Metrics


6nificance UT1 Bug Metric.png

Average User Friendliness Score


6nificance UT1 User Friendly Score.png

Average Task Simplicity Score


Each task has a "How simple is it to do *insert task's name* score. The average task simplicity score indicates how simple a task is: 1 - Too difficult to use, 5 - Very simple to use.

6nificance Average Task Simplicty Score.png

Users' Likes


  1. App is user friendly
  2. Design is nice
  3. Being able to pick your own color
  4. Being able to choose color from photo
  5. Good that app gives suggestion on what color matches the color you selected
  6. The idea of personalizing nail polish color

Users' Complains


Having a high frequency shows that many users are having the same issue, it does not necessarily mean that the team is changing the complains mentioned. The team will review the complains mentioned as well as review if the complain negatively impacts functionality or the business process before deciding to make a change.

6nificance Frequency Rates.png

Android App Main Issues

  • Difficulty figuring out what certain functions are
  • Naming of pages can be improved
    • Users have difficulty figuring out that blueprint is the place to store saved colors
    • Users have difficulty figuring out where "tones" of "Complement/Clash/Tones" is
  • Users are afraid that the color that they see in the screen will not be the same as the nail polish color
  • Need to improve color detection as image is compressed
  • Users do not know how to save color

Android App Changes

Problem Changes Made Before After
Difficulty figuring out what certain functions are The team understands the problem the user is facing, however our task "View Tutorial" is scheduled to be in Iteration 7. The task "View Tutorial" will allow users to view tutorial on how to use the app, as well as having instructions on screen that can be toggled on or off. N.A N.A
Naming of pages can be improved 1. Change blueprint to favourites
6nificance UT1 Blueprint Before.png
6nificance UT1 Blueprint after.png
Naming of pages can be improved 2. Change save to favourite
6nificance UT1 Save before.png
6nificance UT1 Save after.png
Naming of pages can be improved 3. Change tones to shades
6nificance UT1 Tones before.png
6nificance UT1 Tones After.png
Naming of pages can be improved 4. Change Chosen Color to Click Me
6nificance UT1 Color Chosen Before.png
6nificance UT1 Color Chosen After.png
Worry that color in screen maybe different from the nail polish color 1. This is a risk that we have acknowledged in our Risk Management

2. Change the words in the I Want to include money back guarantee

6nificance UT1 I Want Before.png
6nificance UT1 I Want After.png
Need to improve color detection Fixed a rare occurence where the image will be scaled incorrectly N.A N.A

Website Metrics

Listed below are the list of metrics that are recorded during User Testing 1 that will help us improve our website.

Average Task Simplicity Score


Each task has a "How simple is it to do *insert task's name* score. The average task simplicity score indicates how simple a task is: 1 - Too difficult to use, 5 - Very simple to use.

6nificance UT1 Website avg task score.png

Website Main Issues

  1. User does not know which page they are in
  2. User needs to click 2 times to see archived/pending orders
  3. User prefers to have a wider range of colors for credibility rating

Website Changes Made

Problem Changes Made Before & After
User does not know which page they are in Header is added at the top of the website to indicate which page the user is at
Before
6nificance UT1 Website Header Beore.png


After
6nificance UT1 Website Header After.png
User needs to click 2 times to see archived/pending orders Removed landing page
Before
6nificance UT1 Website Page Before.png


After
6nificance UT1 Website Page After.png
User prefers to have a wider range of colors for credibility rating Added a wider range of colors to represent different credibility rating
Before
6nificance UT1 Website Ratings Color Before.png


After
6nificance UT1 Website Ratings Color After.png