IS480 Team wiki: 2015T6 6nificance User Testing 3

From IS480
Jump to navigation Jump to search

6nificance Logo.png






Technical Documents Design Documents Test Documents Meeting Minutes Proposal/Presentations

User Testing 1 Heuristic Evaluation User Testing 2 User Testing 3

Test Plan

Date: 16 November 2015, Monday
Venue: NUS
Duration: 30 mins per user
Number of Users: 20 Females

  • Determine if user interface is intuitive
  • Discover any usability problems
  • To improve application based on User Testing 3 result


  • User Module
  • Design Module
  • Photo Module
  • Collection Module
  • Social Module


  • Testers will follow instructions in the questionnaire to use the app
  • Testers will fill up the questionnaire as they follow the instructions


Summary Results

  • Many users love the concept of the app:
    • The function of searching posts by exact color
    • Extracting real world colors into their phone
    • Having a dedicated social media for nail art
  • A few are concerned about not having enough nail photos

Android App Metrics

Listed below are the list of metrics that are recorded during User Testing 3 that will help us improve our application.

Bug-Related Metrics

6nificance UT3 Bug Metric.png

Average User Friendliness Score

6nificance UT3 User Friendliness.png

Average Task Simplicity Score

Each task has a "How simple is it to do *insert task's name* score. The average task simplicity score indicates how simple a task is: 1 - Too difficult to use, 5 - Very simple to use.
6nificance UT3 Average Task Simplicity Score-table.png6nificance UT3 Average Task Simplicity Score.png

Users' Likes

  1. Users love the concept of the application where you can search posts by the exact shade of color.
  2. Users love the color recommendation "Complement/Contrast/Trio" that recommends colors that match the color chosen by the user.
  3. Users feels that it is refreshing to have a dedicated social media platform for nail art.
  4. Users are wow-ed by the function to selected color from any photo.
  5. Design is nice.

Users' Complains

Having a high frequency shows that many users are having the same issue, it does not necessarily mean that the team is changing the complains mentioned. The team will review the complains mentioned as well as review if the complain negatively impacts functionality or the business process before deciding to make a change.

6nificance UT 3 User Complains.png

A/B Testing

We presented the testers with 2 different version of the app. One is the one that they have downloaded, another one is the one loaded in our phones. There are a total of 4 difference between the 2 versions and we asked them 4 questions to determine which version is better so that we can use the ones that users think are better in our final product.

6nificance UT 3 AB Test1.png6nificance UT 3 AB Test2.png
6nificance UT 3 AB Test3.png6nificance UT 3 AB Test4.png

Changes and Improvements

6nificance UT3 before and after.png

Improvements from User Testing 2 to User Testing 3

Tasks that have been improved based on UT2 feedback that are also in UT3 are listed below. To show that our app has been made improvements from UT2, those tasks are listed down with their corresponding simplicity score.

6nificance UT2 vs UT3.png