HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2015T1 Vulcan User Test"

From IS480
Jump to navigation Jump to search
 
(63 intermediate revisions by 3 users not shown)
Line 26: Line 26:
 
| style="vertical-align:top;width:13%;" | <div style="padding: 3px; font-weight: bold; text-align:center; line-height: wrap_content; font-size:14px; border-bottom:2px solid #ffffff;"> [[IS480_Team_wiki:_2015T1 Vulcan Sponsors | <font color="#203470"><b>SPONSORS</b>]]
 
| style="vertical-align:top;width:13%;" | <div style="padding: 3px; font-weight: bold; text-align:center; line-height: wrap_content; font-size:14px; border-bottom:2px solid #ffffff;"> [[IS480_Team_wiki:_2015T1 Vulcan Sponsors | <font color="#203470"><b>SPONSORS</b>]]
 
| style="vertical-align:top;width:13%;" | <div style="padding: 3px; font-weight: bold; text-align:center; line-height: wrap_content; font-size:14px; border-bottom:2px solid #ffffff;"> [[IS480_Team_wiki:_2015T1 Vulcan Scope | <font color="#203470"><b>SCOPE</b>]]
 
| style="vertical-align:top;width:13%;" | <div style="padding: 3px; font-weight: bold; text-align:center; line-height: wrap_content; font-size:14px; border-bottom:2px solid #ffffff;"> [[IS480_Team_wiki:_2015T1 Vulcan Scope | <font color="#203470"><b>SCOPE</b>]]
| style="vertical-align:top;width:15%;" | <div style="padding: 3px; font-weight: bold; text-align:center; line-height: wrap_content; font-size:14px; border-bottom:2px solid #ffffff;"> [[IS480_Team_wiki:_2015T1 Vulcan Market Research | <font color="#203470"><b>MARKET RESEARCH</b>]]
+
| style="vertical-align:top;width:13%;" | <div style="padding: 3px; font-weight: bold; text-align:center; line-height: wrap_content; font-size:14px; border-bottom:2px solid #ffffff;"> [[IS480_Team_wiki:_2015T1 Vulcan Market Research | <font color="#203470"><b>MARKET RESEARCH</b>]]
 
| style="vertical-align:top;width:13%;" | <div style="padding: 3px; font-weight: bold; text-align:center; line-height: wrap_content; font-size:14px; border-bottom:2px solid #ffffff;"> [[IS480_Team_wiki:_2015T1 Vulcan X Factor| <font color="#203470"><b>X-FACTOR</b>]]
 
| style="vertical-align:top;width:13%;" | <div style="padding: 3px; font-weight: bold; text-align:center; line-height: wrap_content; font-size:14px; border-bottom:2px solid #ffffff;"> [[IS480_Team_wiki:_2015T1 Vulcan X Factor| <font color="#203470"><b>X-FACTOR</b>]]
| style="vertical-align:top;width:15%;" | <div style="padding: 3px; font-weight: bold; text-align:center; line-height: wrap_content; font-size:14px; border-bottom:2px solid #ffffff;"> [[IS480_Team_wiki:_2015T1 Vulcan Technologies| <font color="#203470"><b>TOOLS & TECHNOLOGY</b>]]
+
| style="vertical-align:top;width:13%;" | <div style="padding: 3px; font-weight: bold; text-align:center; line-height: wrap_content; font-size:14px; border-bottom:2px solid #ffffff;"> [[IS480_Team_wiki:_2015T1 Vulcan Technologies| <font color="#203470"><b>TOOLS & TECHNOLOGY</b>]]
| style="vertical-align:top;width:15%;" | <div style="padding: 3px; font-weight: bold; text-align:center; line-height: wrap_content; font-size:14px; border-bottom:2px solid #5478E4;">  
+
| style="vertical-align:top;width:13%;" | <div style="padding: 3px; font-weight: bold; text-align:center; line-height: wrap_content; font-size:14px; border-bottom:2px solid #5478E4;">  
 
[[IS480_Team_wiki:_2015T1 Vulcan User Test| <font color="#203470"><b>USER TEST</b>]]
 
[[IS480_Team_wiki:_2015T1 Vulcan User Test| <font color="#203470"><b>USER TEST</b>]]
 
|}
 
|}
Line 37: Line 37:
 
<div style="background: #6CACFF; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 0px; font-size:20px; font-family:helvetica"><font color= #FFFFFF>User Test 1</font></div>
 
<div style="background: #6CACFF; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 0px; font-size:20px; font-family:helvetica"><font color= #FFFFFF>User Test 1</font></div>
 
<br>
 
<br>
The first user test was targeted at our sponsors Professor William Tov and Professor Jochen Reb, where they were exposed to the meditation app for the first time. They approached the application from the perspective of a user meditating instead of the researcher's point of view.
+
The first user test was targeted at our sponsors- Assistant Professor William Tov and Associate Professor Jochen Reb, where they were exposed to the meditation app for the first time. They approached the application from the perspective of a user meditating instead of the researcher's point of view.
 
<br>
 
<br>
 
<br>
 
<br>
Line 46: Line 46:
 
Date: 13th August 2015
 
Date: 13th August 2015
 
<br>
 
<br>
'''Professor William Tov's Results'''
+
'''Assistant Professor William Tov's Results'''
 
<br>
 
<br>
 
{| class="wikitable"
 
{| class="wikitable"
Line 65: Line 65:
 
|}
 
|}
 
<br>
 
<br>
<br>
+
'''Associate Professor Jochen Reb's Results'''
'''Professor Jochen Reb's Results'''
 
 
<br>
 
<br>
 
{| class="wikitable"
 
{| class="wikitable"
Line 78: Line 77:
 
| Complete the post session survey || 3 || 3
 
| Complete the post session survey || 3 || 3
 
|-
 
|-
| Beeper Survey || ||  
+
| Beeper Survey || 2 || 3
 
|-
 
|-
 
| Register for a new account || 5 || 3
 
| Register for a new account || 5 || 3
Line 84: Line 83:
 
| Login with your registered account || 5 || 3
 
| Login with your registered account || 5 || 3
 
|}
 
|}
 +
 +
<br>
 +
'''Comments by Sponsors'''
 +
{| class="wikitable"
 +
|-
 +
! Comment !! Priority level
 +
|-
 +
| Menu bar disappears after the phone wakes from sleep mode || High
 +
|-
 +
| Age and gender of user is asked twice || High
 +
|-
 +
| Survey sliders are not labeled || High
 +
|-
 +
| Failed logged in through Facebook leads to summary page || High
 +
|-
 +
| Registration should not ask for user's name || High
 +
|-
 +
| User are not able to find the download podcast page || High
 +
|-
 +
| Purpose of surveys should be explained to users || Medium
 +
|-
 +
| "Remember me" login function || Medium
 +
|-
 +
| White space during the playing of podcast should have instructions for the users on meditation || Medium
 +
|-
 +
| Add short description of the podcast before user plays the podcast || Medium
 +
|-
 +
| Welcome screen info shows redundant info || Medium
 +
|-
 +
| Incorrect credentials warning for users appearing at the bottom of the screen || Low
 +
|-
 +
| No need for the user's photo on the menu bar || Low
 +
|-
 +
| Demographics survey questions not aligned || Low
 +
|}
 +
 +
Based on the comments and scores from the professors, Team Vulcan has decided to focus on the high priority bugs to be fixed before acceptance.
 +
<br>
 +
The medium and low priority bugs will be resolved in the upcoming iterations after acceptance.
 +
 +
<br>
 +
<div style="background: #6CACFF; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 0px; font-size:20px; font-family:helvetica"><font color= #FFFFFF>User Test 2 (Researcher)</font></div>
 +
<br>
 +
This user test was for the ReFokus Web portal, where researchers keyed in program details which can be used as studies for the mobile application. They approached the application from the perspective of researchers.
 +
For this test, we took down the user's time taken for each task and the number of clicks. For the exact numbers of time taken for each task, please click on the results link below.
 +
<br>
 +
{| class="wikitable"
 +
| Users: || 10
 +
|-
 +
| Demographics: || Sponsor, SMU PhD Students (RAs), SMU undergraduates.
 +
|}
 +
<br>
 +
'''User Test Task Document'''
 +
<br>
 +
[[Media:Vulcan_User_Test_2_(Researcher_Portal).docx| Vulcan User Test 2 Task Document (Researcher Portal)]] <br/>
 +
<br>
 +
'''Results Consolidation'''
 +
<br>
 +
[[Media:User_Test_2_(Researcher_Portal)_results.xlsx| Vulcan User Test 2 Consolidated Results (Researcher Portal)]] <br/>
 +
<br>
 +
'''Results Analysis'''
 +
<br>
 +
[[Media:Vulcan_User_Test_2_(Researcher_Portal)_Analysis.docx| Vulcan User Test 2 Analysis (Researcher Portal)]] <br/>
 +
<br>
 +
'''Insights'''
 +
<br>
 +
The main insight found was that researchers had trouble with the naming of buttons and dashboard links. They were not too sure where the "done" button will lead them to most of the time. As such, we have renamed buttons which have clearer instructions on the button's destination.
 +
<br>
 +
 +
<br>
 +
<div style="background: #6CACFF; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 0px; font-size:20px; font-family:helvetica"><font color= #FFFFFF>User Test 3 (Mobile)</font></div>
 +
<br>
 +
This user test was for the ReFokus Meditation app, where users were able to take part in programs specified by the researchers from the ReFokus Web App. The users approached the application from the perspective of new users learning to meditate.
 +
For this test, we took down the user's time taken for each task. For the exact numbers of time taken for each task, please click on the results link below.
 +
<br>
 +
{| class="wikitable"
 +
| Users: || 10
 +
|-
 +
| Demographics: || Sponsor, SMU PhD Students (RAs), SMU undergraduates.
 +
|}
 +
[[File:Vulcan_Gender.png|center|550px|link=]]
 +
<br>
 +
'''User Test Task Document'''
 +
<br>
 +
[[Media:Vulcan_User_Test_3_Final.docx| Vulcan User Test 3 Task Document(Mobile App)]] <br/>
 +
<br>
 +
'''Results Collation'''
 +
<br>
 +
[[Media:Vulcan User Test 3 Consolidated.xlsx| Vulcan User Test 3 Results Consolidation(Mobile App)]] <br/>
 +
<br>
 +
'''Results Analysis'''
 +
<br>
 +
[[Media:Vulcan_User_Test_3_Results_Analysis.docx| Vulcan User Test 3 Results Analysis (Mobile App)]] <br/>
 +
<br>
 +
'''Insights'''
 +
<br>
 +
The main insight found was that it was hard to locate the setting of beeper survey timing page. Since this timing was critical to the project's beeper survey function, the setting of timing has since been made to be part of the registration process. A remember me function was also added after this test based on feedback given by users.
 +
<br>
 +
<br>
 +
<div style="background: #6CACFF; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 0px; font-size:20px; font-family:helvetica"><font color= #FFFFFF>User Test 4 (Mobile & Web Portal)</font></div>
 +
<br>
 +
This user test was for the ReFokus Meditation app and the web portal. The users all had background in research and are interested/involved in mindfulness research. The purpose of this user test was to ensure that functions built will be usable to researchers, and that they are able to navigate through the web portal easily to obtain data collected through a program.
 +
<br>
 +
{| class="wikitable"
 +
| Users: || 4
 +
|-
 +
| Demographics: || Sponsor, SMU PhD Students (RAs) interested in the fields of mindfulness.
 +
|}
 +
<br>
 +
'''User Test 4 Task Document'''
 +
<br>
 +
[[Media:Vulcan_User_Test_4_Document.docx| Vulcan User Test 4 Task Document(Mobile and Web)]] <br/>
 +
For the feedback and bugs found in User Test 4, please refer to the results collation document below.
 +
<br>
 +
<br>
 +
'''Results Collation'''
 +
<br>
 +
[[Media:Vulcan_User_Test_4_bugs_and_comments.docx| Vulcan User Test 4 Results]] <br/>
 +
<br>
 +
'''Insights'''
 +
<br>
 +
The main insight was that the button ordering for our web app was confusing for the users. With important buttons such as deactivate and delete program, these buttons should be colored and ordered differently so that it is clear to users of the different purposes of these buttons.
 +
<br>
 +
<br>
 +
<div style="background: #6CACFF; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 0px; font-size:20px; font-family:helvetica"><font color= #FFFFFF>User Test 5 (Mobile)</font></div>
 +
<br>
 +
This user test was for the ReFokus Meditation mobile app. With the functions built so far deemed to be satisfactory to our sponsor's request, this user test was to identify any usability issues to new users who had no expectations of what a meditation app would be like.
 +
<br>
 +
{| class="wikitable"
 +
| Users: || 20
 +
|-
 +
| Demographics: || SMU SIS Students
 +
|}
 +
<br>
 +
'''User Test 5 Task Document'''
 +
<br>
 +
[[Media:Vulcan_User_Test_5_Document.docx| Vulcan User Test 5 Task Document(Mobile App)]] <br/>
 +
<br>
 +
For the summary of bugs and comments from UT 5, please click on the results summary file below.
 +
<br>
 +
'''Results Summary'''
 +
<br>
 +
[[Media:Vulcan_User_Test_5_bugs_and_comments.docx| Vulcan User Test 5 Summary]] <br/>
 +
<br>
 +
 +
For the specific results of each user, please click on the results collation file below.
 +
<br>
 +
'''Results Collation'''
 +
<br>
 +
[[Media:Vulcan_UT_5_Results.xlsx| Vulcan User Test 5 Results]] <br/>
 +
<br>

Latest revision as of 10:27, 24 November 2015

VulcanLogo.png
Vulcan home icon2.png
Vulcan aboutus icon2.png
Vulcan projectoverview icon2.png
Vulcan projectmanagement icon2.png
Vulcan documentation icon2.png

HOME ABOUT US PROJECT OVERVIEW PROJECT MANAGEMENT DOCUMENTATION


User Test 1


The first user test was targeted at our sponsors- Assistant Professor William Tov and Associate Professor Jochen Reb, where they were exposed to the meditation app for the first time. They approached the application from the perspective of a user meditating instead of the researcher's point of view.

The user test document and tasks assigned can be found here:
Vulcan User Test 1

Date: 13th August 2015
Assistant Professor William Tov's Results

Task Ranking of Usefulness from 1-5 Ranking of Usability from 1-5
Complete the demographics survey 1 3
Download the podcast 5 5
Complete the post session survey 3 2
Beeper Survey 2 2
Register for a new account 3 4
Login with your registered account 5 5


Associate Professor Jochen Reb's Results

Task Ranking of Usefulness from 1-5 Ranking of Usability from 1-5
Complete the demographics survey 1 3
Download the podcast 4 5
Complete the post session survey 3 3
Beeper Survey 2 3
Register for a new account 5 3
Login with your registered account 5 3


Comments by Sponsors

Comment Priority level
Menu bar disappears after the phone wakes from sleep mode High
Age and gender of user is asked twice High
Survey sliders are not labeled High
Failed logged in through Facebook leads to summary page High
Registration should not ask for user's name High
User are not able to find the download podcast page High
Purpose of surveys should be explained to users Medium
"Remember me" login function Medium
White space during the playing of podcast should have instructions for the users on meditation Medium
Add short description of the podcast before user plays the podcast Medium
Welcome screen info shows redundant info Medium
Incorrect credentials warning for users appearing at the bottom of the screen Low
No need for the user's photo on the menu bar Low
Demographics survey questions not aligned Low

Based on the comments and scores from the professors, Team Vulcan has decided to focus on the high priority bugs to be fixed before acceptance.
The medium and low priority bugs will be resolved in the upcoming iterations after acceptance.


User Test 2 (Researcher)


This user test was for the ReFokus Web portal, where researchers keyed in program details which can be used as studies for the mobile application. They approached the application from the perspective of researchers. For this test, we took down the user's time taken for each task and the number of clicks. For the exact numbers of time taken for each task, please click on the results link below.

Users: 10
Demographics: Sponsor, SMU PhD Students (RAs), SMU undergraduates.


User Test Task Document
Vulcan User Test 2 Task Document (Researcher Portal)

Results Consolidation
Vulcan User Test 2 Consolidated Results (Researcher Portal)

Results Analysis
Vulcan User Test 2 Analysis (Researcher Portal)

Insights
The main insight found was that researchers had trouble with the naming of buttons and dashboard links. They were not too sure where the "done" button will lead them to most of the time. As such, we have renamed buttons which have clearer instructions on the button's destination.


User Test 3 (Mobile)


This user test was for the ReFokus Meditation app, where users were able to take part in programs specified by the researchers from the ReFokus Web App. The users approached the application from the perspective of new users learning to meditate. For this test, we took down the user's time taken for each task. For the exact numbers of time taken for each task, please click on the results link below.

Users: 10
Demographics: Sponsor, SMU PhD Students (RAs), SMU undergraduates.
Vulcan Gender.png


User Test Task Document
Vulcan User Test 3 Task Document(Mobile App)

Results Collation
Vulcan User Test 3 Results Consolidation(Mobile App)

Results Analysis
Vulcan User Test 3 Results Analysis (Mobile App)

Insights
The main insight found was that it was hard to locate the setting of beeper survey timing page. Since this timing was critical to the project's beeper survey function, the setting of timing has since been made to be part of the registration process. A remember me function was also added after this test based on feedback given by users.

User Test 4 (Mobile & Web Portal)


This user test was for the ReFokus Meditation app and the web portal. The users all had background in research and are interested/involved in mindfulness research. The purpose of this user test was to ensure that functions built will be usable to researchers, and that they are able to navigate through the web portal easily to obtain data collected through a program.

Users: 4
Demographics: Sponsor, SMU PhD Students (RAs) interested in the fields of mindfulness.


User Test 4 Task Document
Vulcan User Test 4 Task Document(Mobile and Web)
For the feedback and bugs found in User Test 4, please refer to the results collation document below.

Results Collation
Vulcan User Test 4 Results

Insights
The main insight was that the button ordering for our web app was confusing for the users. With important buttons such as deactivate and delete program, these buttons should be colored and ordered differently so that it is clear to users of the different purposes of these buttons.

User Test 5 (Mobile)


This user test was for the ReFokus Meditation mobile app. With the functions built so far deemed to be satisfactory to our sponsor's request, this user test was to identify any usability issues to new users who had no expectations of what a meditation app would be like.

Users: 20
Demographics: SMU SIS Students


User Test 5 Task Document
Vulcan User Test 5 Task Document(Mobile App)

For the summary of bugs and comments from UT 5, please click on the results summary file below.
Results Summary
Vulcan User Test 5 Summary

For the specific results of each user, please click on the results collation file below.
Results Collation
Vulcan User Test 5 Results