HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2015T2 Period. Documentation - User Test 2"

From IS480
Jump to navigation Jump to search
Line 38: Line 38:
 
|}
 
|}
 
<!---------------END of sub-header ---------------------->
 
<!---------------END of sub-header ---------------------->
<center><br>
+
<h2><span style="color:#ff5750">Description</span></h2>
Not yet Conducted.
+
Number of Users: 20 users<br/>
</center>
+
Gender: Female<br/>
 +
Venue: At user's convenience <br/>
 +
Date: 10 to 14 Feb 2015 <br/>
 +
Duration: 15 minutes per user <br/>
 +
Test Platform: iPhone 6 (Provided by team)<br/>
 +
Questionnaire Platform: www.qualtrics.com<br/><br/>
 +
 
 +
<h2><span style="color:#ff5750">Objectives</span></h2>
 +
*To detect issues that users face in using our application
 +
*To learn more about the good and bad aspects of our application
 +
*To gather feedback regarding the userability of our application
 +
*To further improve our application based on the test results<br/>
 +
 
 +
 
 +
<h2><span style="color:#ff5750">Constraints</span></h2>
 +
In this section, we would like to address our constraints of UT1. For each Apple Developer license, the developers are allowed to add up to 100 devices to the built applications. Our team would like to minimize the number of devices being added for UT1, considering that our clients would need to develop more applications and add more devices in the future. Thus, we have decided to only use <u>1 iOS device</u> for the test, instead of adding our application to all of our 10 users' devices. With that, our team will be conducting UT1 one participant at a time.<br/><br/>
 +
 
 +
<h2><span style="color:#ff5750">Scope</span></h2>
 +
*Onboarding
 +
**Create account
 +
*Period Tracker
 +
**View countdown
 +
**View cycle stage
 +
**Manage symptoms
 +
**View promotions
 +
*Calendar
 +
**View calendar
 +
**Manage periods
 +
<br/>
 +
<h2><span style="color:#ff5750">Timeline</span></h2>
 +
{| class="wikitable" width="100%"
 +
|-
 +
! width="200px" style="padding: 8px; text-align: center; background:#434343; color:#ffffff; font-size: 14px;"| Phase
 +
! width="300px" style="padding: 8px; text-align: center; background:#434343; color:#ffffff; font-size: 14px;"| Date Range
 +
! width="600px" style="padding: 8px; text-align: center; background:#434343; color:#ffffff; font-size: 14px;"| Description
 +
|-
 +
|Pre-test
 +
|09 to 10 Feb 2015
 +
|
 +
*Source for users
 +
*After sourcing, an email will be sent to confirm venue and timing
 +
|-
 +
|Test
 +
|10 to 14 Feb 2015
 +
|
 +
*Users will use team’s iPhone to carry out the user test
 +
|-
 +
|Post-test
 +
|14 Feb 2015
 +
|
 +
*Users can fill up the questionnaire after they have tested our application
 +
*Email to be sent to thank users for their participation
 +
|-
 +
|}
 +
<br/>
 +
<h2><span style="color:#ff5750">Documentations</span></h2>
 +
*[[Media:UT1 Test Plan.pdf|UT1 Test Plan]]<br/>
 +
*[[Media:UT1 Questionnaire.pdf|UT1 Questionnaire]]<br/>
 +
<br/>
 +
<center><h1><span style="color:#ff5750">User Test 1 (UT1) Consolidated Results</span></h1></center>
 +
<h2><span style="color:#ff5750">Quantitative Results</span></h2>
 +
<b>Onboarding</b><br>
 +
<center>[[Image:Usability of onboarding.png|600px]]</center>
 +
As seen from the tables above, over 80% of the users rated the aesthetics of the onboarding process over the scale "Good". With that, over 50% of the users rated the aesthetics of our onboarding process "Very Good". However, usability is a questionable issue because of several issues that will be raised in the qualitative results section.<br><br>
 +
 
 +
<b>Home</b><br>
 +
<center>[[Image:Usability and aesthetic of home.png|600px]]</center>
 +
As for the home page, the responses is well received with over 80% of our users rating the usability and aesthetics of our application over a rating scale of "Good". <br>
 +
<center>[[Image:Rank features.png|600px]]</center>
 +
In terms of the features in our home page, over 50% of our participants rated the "Countdown to your Period" function the most likable one. On the other end of the scale, "News Feed" is being rated as the least likable functionality of the home page.<br><br>
 +
 
 +
<b>Calendar</b><br>
 +
<center>[[Image:Usability_and_aes_of_calendar.png|600px]]</center>
 +
Our calendar page has mixed reviews with quite a number of users rating the usability of the page below "Good". Our team will be putting more focus on improving the usability and aesthetics of the calendar page in future iterations. <br><br>
 +
 
 +
 
 +
<b>Overall</b><br>
 +
<center>[[Image:Ratings_of_ms.png|600px]]</center>
 +
Overall, the application receives good ratings in terms of usability, aesthetics and functionalities. Out of the 3 variables, aesthetics seems to be the best aspect of MenstruTrack currently.
 +
<center>[[Image:Likeability of ms.png|600px]]</center>
 +
75% of our participants do like our application, with 5% of them absolutely loving it. All ratings are above the "Don't really like it" scale. That shows that our application is able to appeal to our targeted audience.
 +
<center>[[Image:Purchase_ms.png|600px]]</center>
 +
Over 80% of the users mentioned that they would download MenstruTrack and buy period supplies from it, if the supplies are cheaper than those sold outside.<br><br>
 +
 
 +
<h2><span style="color:#ff5750">Qualitative Results</span></h2>
 +
<b>Severity Ratings</b><br>
 +
To evaluate the severity of our qualitative results, we will be looking at:
 +
*The frequency with which the problem occurs: Is it common or rare?
 +
*The impact of the problem if it occurs: Will it be easy or difficult for the users to overcome?
 +
*The persistence of the problem: Is it a one-time problem that users can overcome once they know about it or will users repeatedly be bothered by the problem?<br><br>
 +
With that, we will be categorizing issues into these 5 severity rating levels.
 +
<br>
 +
<center>[[Image:Severity_ratings.png|600px]]</center>
 +
<br><br>
 +
 
 +
<b>Onboarding</b><br>
 +
<center><i>What do you like about Signing-up process?</i></center>
 +
<center>[[Image:Like about onboarding.png|600px]]</center>
 +
The survey feedback on our onboarding process have proven it to be simple to use and aesthetically pleasing.<br>
 +
<center><i>Did you face any issues while Signing-up?</i></center>
 +
<center>[[Image:Issues_onboarding.png|600px]]</center>
 +
However, there were several issues being raised for our onboarding process. Firstly, there were 2 users who has a period length of 4 days but our application only allows a minimum period length of 5 days. Secondly, a few users commented that the scroller is rather hard to use. Also, a few of the users mentioned that the onboarding process should allow the user to go backwards because at times, data may be keyed in wrongly and users have to go back to edit them. <br><br>
 +
 
 +
<b>Home</b><br>
 +
<center><i>What do you like about the Home page?</i></center>
 +
<center>[[Image:Like home.png|600px]]</center>
 +
Similar to our onboarding process, our users find the home page very clean, easy to use and contain all the information they need.<br>
 +
<center><i>Did you face any general issues while surfing the Home page?</i></center>
 +
<center>[[Image:Issues home.png|600px]]</center>
 +
In terms of the general home page, users also have issues understanding the range indication of the logging of symptoms. For instance, they do not know if pulling the pointer to the maximum end of the scale is indicating "Yes" to having the "Acne" symptom, or indicating that the user has severe "Acne" symptom.<br><br>
 +
 
 +
<b>Calendar</b><br>
 +
<center><i>What do you like about the Calendar page?</i></center>
 +
<center>[[Image:Like cal.png|600px]]</center>
 +
Users mentioned that our calendar page is very easy to use and intuitive.<br>
 +
<center><i>What do you dislike about the Calendar page?</i></center>
 +
<center>[[Image:Dislike cal.png|600px]]</center>
 +
However, the vertical scrolling of our calendar function did not appeal to all users, with some preferring swiping through the different months.<br><br>
 +
 
 +
<h2><span style="color:#ff5750">Changes from UT1</span></h2>
 +
Our team have decided to implement changes for issues that has a severity level of at least 3. Thus, these are the changes we have decided to make.<br><br>
 +
 
 +
<b>1. Allow Onboarding to be swiped backwards</b><br>
 +
Currently, users cannot go back after they inputted their data and they have to start over the entire onboarding process if they input any wrong data. Hence, our team have decided to allow swiping backwards for the process.<br><br>
 +
 
 +
<b>2. Replace “Swipe” Text for Cycle Stage</b><br>
 +
Many of our users were unable to find the cycle page, making it a severe issue. This is because the text "Swipe" is not intuitive enough. Thus, ‘Swipe’ will be replaced by ‘Swipe to see your current stage’.<br><br>
 +
 
 +
<b>3. Include Range Indicators for Symptoms</b><br>
 +
Our team have decided to include range indicators for the logging of symptoms. This is because there are missing information to the users, such as for ‘Acne’, they do not know if sliding right means 'Yes’ or a more severe case of outbreak. Moreover, these information are important to both users and our sponsors and if the user interprets the sliders wrongly, they will input the wrong information, leading to incorrect data analytics.<br><br>
 +
 
 +
<b>4. Include Period Length: 4 Days</b><br>
 +
As several users feedback that their average period length is 4 days, we have decided to include 4 days as the minimum average period length. This change is essential because inputting the wrong average period length will result in incorrect period results.

Revision as of 11:10, 8 April 2015


Phome.png Home Poverview.png Project Overview Pmanagement.png Project Management Pdoc.png Documentation Pteam.png The Team
Diagrams Prototype Testing Project Documents
INTERNAL TESTING USER TEST 1 USER TEST 2

Description

Number of Users: 20 users
Gender: Female
Venue: At user's convenience
Date: 10 to 14 Feb 2015
Duration: 15 minutes per user
Test Platform: iPhone 6 (Provided by team)
Questionnaire Platform: www.qualtrics.com

Objectives

  • To detect issues that users face in using our application
  • To learn more about the good and bad aspects of our application
  • To gather feedback regarding the userability of our application
  • To further improve our application based on the test results


Constraints

In this section, we would like to address our constraints of UT1. For each Apple Developer license, the developers are allowed to add up to 100 devices to the built applications. Our team would like to minimize the number of devices being added for UT1, considering that our clients would need to develop more applications and add more devices in the future. Thus, we have decided to only use 1 iOS device for the test, instead of adding our application to all of our 10 users' devices. With that, our team will be conducting UT1 one participant at a time.

Scope

  • Onboarding
    • Create account
  • Period Tracker
    • View countdown
    • View cycle stage
    • Manage symptoms
    • View promotions
  • Calendar
    • View calendar
    • Manage periods


Timeline

Phase Date Range Description
Pre-test 09 to 10 Feb 2015
  • Source for users
  • After sourcing, an email will be sent to confirm venue and timing
Test 10 to 14 Feb 2015
  • Users will use team’s iPhone to carry out the user test
Post-test 14 Feb 2015
  • Users can fill up the questionnaire after they have tested our application
  • Email to be sent to thank users for their participation


Documentations


User Test 1 (UT1) Consolidated Results

Quantitative Results

Onboarding

Usability of onboarding.png

As seen from the tables above, over 80% of the users rated the aesthetics of the onboarding process over the scale "Good". With that, over 50% of the users rated the aesthetics of our onboarding process "Very Good". However, usability is a questionable issue because of several issues that will be raised in the qualitative results section.

Home

Usability and aesthetic of home.png

As for the home page, the responses is well received with over 80% of our users rating the usability and aesthetics of our application over a rating scale of "Good".

Rank features.png

In terms of the features in our home page, over 50% of our participants rated the "Countdown to your Period" function the most likable one. On the other end of the scale, "News Feed" is being rated as the least likable functionality of the home page.

Calendar

Usability and aes of calendar.png

Our calendar page has mixed reviews with quite a number of users rating the usability of the page below "Good". Our team will be putting more focus on improving the usability and aesthetics of the calendar page in future iterations.


Overall

Ratings of ms.png

Overall, the application receives good ratings in terms of usability, aesthetics and functionalities. Out of the 3 variables, aesthetics seems to be the best aspect of MenstruTrack currently.

Likeability of ms.png

75% of our participants do like our application, with 5% of them absolutely loving it. All ratings are above the "Don't really like it" scale. That shows that our application is able to appeal to our targeted audience.

Purchase ms.png

Over 80% of the users mentioned that they would download MenstruTrack and buy period supplies from it, if the supplies are cheaper than those sold outside.

Qualitative Results

Severity Ratings
To evaluate the severity of our qualitative results, we will be looking at:

  • The frequency with which the problem occurs: Is it common or rare?
  • The impact of the problem if it occurs: Will it be easy or difficult for the users to overcome?
  • The persistence of the problem: Is it a one-time problem that users can overcome once they know about it or will users repeatedly be bothered by the problem?

With that, we will be categorizing issues into these 5 severity rating levels.

Severity ratings.png



Onboarding

What do you like about Signing-up process?
Like about onboarding.png

The survey feedback on our onboarding process have proven it to be simple to use and aesthetically pleasing.

Did you face any issues while Signing-up?
Issues onboarding.png

However, there were several issues being raised for our onboarding process. Firstly, there were 2 users who has a period length of 4 days but our application only allows a minimum period length of 5 days. Secondly, a few users commented that the scroller is rather hard to use. Also, a few of the users mentioned that the onboarding process should allow the user to go backwards because at times, data may be keyed in wrongly and users have to go back to edit them.

Home

What do you like about the Home page?
Like home.png

Similar to our onboarding process, our users find the home page very clean, easy to use and contain all the information they need.

Did you face any general issues while surfing the Home page?
Issues home.png

In terms of the general home page, users also have issues understanding the range indication of the logging of symptoms. For instance, they do not know if pulling the pointer to the maximum end of the scale is indicating "Yes" to having the "Acne" symptom, or indicating that the user has severe "Acne" symptom.

Calendar

What do you like about the Calendar page?
Like cal.png

Users mentioned that our calendar page is very easy to use and intuitive.

What do you dislike about the Calendar page?
Dislike cal.png

However, the vertical scrolling of our calendar function did not appeal to all users, with some preferring swiping through the different months.

Changes from UT1

Our team have decided to implement changes for issues that has a severity level of at least 3. Thus, these are the changes we have decided to make.

1. Allow Onboarding to be swiped backwards
Currently, users cannot go back after they inputted their data and they have to start over the entire onboarding process if they input any wrong data. Hence, our team have decided to allow swiping backwards for the process.

2. Replace “Swipe” Text for Cycle Stage
Many of our users were unable to find the cycle page, making it a severe issue. This is because the text "Swipe" is not intuitive enough. Thus, ‘Swipe’ will be replaced by ‘Swipe to see your current stage’.

3. Include Range Indicators for Symptoms
Our team have decided to include range indicators for the logging of symptoms. This is because there are missing information to the users, such as for ‘Acne’, they do not know if sliding right means 'Yes’ or a more severe case of outbreak. Moreover, these information are important to both users and our sponsors and if the user interprets the sliders wrongly, they will input the wrong information, leading to incorrect data analytics.

4. Include Period Length: 4 Days
As several users feedback that their average period length is 4 days, we have decided to include 4 days as the minimum average period length. This change is essential because inputting the wrong average period length will result in incorrect period results.