HeaderSIS.jpg

IS480 Team wiki: 2015T2 Period. Documentation - User Test 2

From IS480
Revision as of 12:03, 8 April 2015 by Zz.leong.2012 (talk | contribs)
Jump to navigation Jump to search


Phome.png Home Poverview.png Project Overview Pmanagement.png Project Management Pdoc.png Documentation Pteam.png The Team
Diagrams Prototype Testing Project Documents
INTERNAL TESTING USER TEST 1 USER TEST 2

Description

Number of Users: 30 users
Gender: Female
Venue: At user's convenience
Date: 13 to 14 Mar 2015
Duration: 15 minutes per user
Test Platform: iPhone 6 (Provided by team)
Questionnaire Platform: Hard copy

Objectives

  • To compare the time users take carrying out the tasks, to the time of our experts
  • To identify tasks that take a significantly longer duration for users as compared to experts
  • To detect issues that users face in using our application
  • To learn more about the good and bad aspects of our application
  • To gather feedback regarding the usability of our application
  • To further improve our application based on the test results

Scope

  • Onboarding
    • Create account
  • Period Tracker
    • View countdown
    • View cycle stage
    • Manage symptoms
    • View promotions
  • Calendar
    • View calendar
    • Manage periods
  • Profile
    • Manage period log
    • Manage notifications
    • Manage profile
    • Sync calendar


Timeline

Phase Date Range Description
Pre-test 09 to 12 Mar 2015
  • Sourcing for users
  • After sourcing, an email will be sent to confirm venue and timing
Test 13 to 14 Mar 2015
  • Users will use team’s iPhone to carry out the user test


Documentations


User Test 2 (UT2) Consolidated Results

Quantitative Results

Task 1: Find out the Number of days to period/Period day number

Task1.JPG

As seen from the tables above, over 80% of the users rated the aesthetics of the onboarding process over the scale "Good". With that, over 50% of the users rated the aesthetics of our onboarding process "Very Good". However, usability is a questionable issue because of several issues that will be raised in the qualitative results section.


Task 2: Add a past period

Task2.JPG

As for the home page, the responses is well received with over 80% of our users rating the usability and aesthetics of our application over a rating scale of "Good".


Task 3: Log your symptoms with these inputs

Task3.JPG

As for the home page, the responses is well received with over 80% of our users rating the usability and aesthetics of our application over a rating scale of "Good".


Task 4: Edit and put your last name as “SMU”

Task4.JPG

As for the home page, the responses is well received with over 80% of our users rating the usability and aesthetics of our application over a rating scale of "Good".


Task 5: Turn on the notification to inform you about your period 3 days before it arrives

Task5.JPG

As for the home page, the responses is well received with over 80% of our users rating the usability and aesthetics of our application over a rating scale of "Good".


Task 6: View the latest promotion and news

Task6.JPG

As for the home page, the responses is well received with over 80% of our users rating the usability and aesthetics of our application over a rating scale of "Good".


Task 7: Sync your period calendar to iCal

Task7.JPG

As for the home page, the responses is well received with over 80% of our users rating the usability and aesthetics of our application over a rating scale of "Good".


Task 8: Find out your cycle stage

Task8.JPG

As for the home page, the responses is well received with over 80% of our users rating the usability and aesthetics of our application over a rating scale of "Good".



Overall

Ratings of ms.png

Overall, the application receives good ratings in terms of usability, aesthetics and functionalities. Out of the 3 variables, aesthetics seems to be the best aspect of MenstruTrack currently.

Likeability of ms.png

75% of our participants do like our application, with 5% of them absolutely loving it. All ratings are above the "Don't really like it" scale. That shows that our application is able to appeal to our targeted audience.

Purchase ms.png

Over 80% of the users mentioned that they would download MenstruTrack and buy period supplies from it, if the supplies are cheaper than those sold outside.

Qualitative Results

Severity Ratings
To evaluate the severity of our qualitative results, we will be looking at:

  • The frequency with which the problem occurs: Is it common or rare?
  • The impact of the problem if it occurs: Will it be easy or difficult for the users to overcome?
  • The persistence of the problem: Is it a one-time problem that users can overcome once they know about it or will users repeatedly be bothered by the problem?

With that, we will be categorizing issues into these 5 severity rating levels.

Severity ratings.png



Onboarding

What do you like about Signing-up process?
Like about onboarding.png

The survey feedback on our onboarding process have proven it to be simple to use and aesthetically pleasing.

Did you face any issues while Signing-up?
Issues onboarding.png

However, there were several issues being raised for our onboarding process. Firstly, there were 2 users who has a period length of 4 days but our application only allows a minimum period length of 5 days. Secondly, a few users commented that the scroller is rather hard to use. Also, a few of the users mentioned that the onboarding process should allow the user to go backwards because at times, data may be keyed in wrongly and users have to go back to edit them.

Home

What do you like about the Home page?
Like home.png

Similar to our onboarding process, our users find the home page very clean, easy to use and contain all the information they need.

Did you face any general issues while surfing the Home page?
Issues home.png

In terms of the general home page, users also have issues understanding the range indication of the logging of symptoms. For instance, they do not know if pulling the pointer to the maximum end of the scale is indicating "Yes" to having the "Acne" symptom, or indicating that the user has severe "Acne" symptom.

Calendar

What do you like about the Calendar page?
Like cal.png

Users mentioned that our calendar page is very easy to use and intuitive.

What do you dislike about the Calendar page?
Dislike cal.png

However, the vertical scrolling of our calendar function did not appeal to all users, with some preferring swiping through the different months.

Changes from UT1

Our team have decided to implement changes for issues that has a severity level of at least 3. Thus, these are the changes we have decided to make.

1. Allow Onboarding to be swiped backwards
Currently, users cannot go back after they inputted their data and they have to start over the entire onboarding process if they input any wrong data. Hence, our team have decided to allow swiping backwards for the process.

2. Replace “Swipe” Text for Cycle Stage
Many of our users were unable to find the cycle page, making it a severe issue. This is because the text "Swipe" is not intuitive enough. Thus, ‘Swipe’ will be replaced by ‘Swipe to see your current stage’.

3. Include Range Indicators for Symptoms
Our team have decided to include range indicators for the logging of symptoms. This is because there are missing information to the users, such as for ‘Acne’, they do not know if sliding right means 'Yes’ or a more severe case of outbreak. Moreover, these information are important to both users and our sponsors and if the user interprets the sliders wrongly, they will input the wrong information, leading to incorrect data analytics.

4. Include Period Length: 4 Days
As several users feedback that their average period length is 4 days, we have decided to include 4 days as the minimum average period length. This change is essential because inputting the wrong average period length will result in incorrect period results.