HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2015T1 Vulcan User Test"

From IS480
Jump to navigation Jump to search
 
(17 intermediate revisions by 2 users not shown)
Line 37: Line 37:
 
<div style="background: #6CACFF; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 0px; font-size:20px; font-family:helvetica"><font color= #FFFFFF>User Test 1</font></div>
 
<div style="background: #6CACFF; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 0px; font-size:20px; font-family:helvetica"><font color= #FFFFFF>User Test 1</font></div>
 
<br>
 
<br>
The first user test was targeted at our sponsors Professor William Tov and Professor Jochen Reb, where they were exposed to the meditation app for the first time. They approached the application from the perspective of a user meditating instead of the researcher's point of view.
+
The first user test was targeted at our sponsors- Assistant Professor William Tov and Associate Professor Jochen Reb, where they were exposed to the meditation app for the first time. They approached the application from the perspective of a user meditating instead of the researcher's point of view.
 
<br>
 
<br>
 
<br>
 
<br>
Line 46: Line 46:
 
Date: 13th August 2015
 
Date: 13th August 2015
 
<br>
 
<br>
'''Professor William Tov's Results'''
+
'''Assistant Professor William Tov's Results'''
 
<br>
 
<br>
 
{| class="wikitable"
 
{| class="wikitable"
Line 65: Line 65:
 
|}
 
|}
 
<br>
 
<br>
'''Professor Jochen Reb's Results'''
+
'''Associate Professor Jochen Reb's Results'''
 
<br>
 
<br>
 
{| class="wikitable"
 
{| class="wikitable"
Line 85: Line 85:
  
 
<br>
 
<br>
'''Comments by Professors'''
+
'''Comments by Sponsors'''
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
Line 191: Line 191:
 
| Demographics: || Sponsor, SMU PhD Students (RAs) interested in the fields of mindfulness.
 
| Demographics: || Sponsor, SMU PhD Students (RAs) interested in the fields of mindfulness.
 
|}
 
|}
 +
<br>
 +
'''User Test 4 Task Document'''
 +
<br>
 +
[[Media:Vulcan_User_Test_4_Document.docx| Vulcan User Test 4 Task Document(Mobile and Web)]] <br/>
 +
For the feedback and bugs found in User Test 4, please refer to the results collation document below.
 +
<br>
 +
<br>
 +
'''Results Collation'''
 +
<br>
 +
[[Media:Vulcan_User_Test_4_bugs_and_comments.docx| Vulcan User Test 4 Results]] <br/>
 +
<br>
 +
'''Insights'''
 +
<br>
 +
The main insight was that the button ordering for our web app was confusing for the users. With important buttons such as deactivate and delete program, these buttons should be colored and ordered differently so that it is clear to users of the different purposes of these buttons.
 +
<br>
 
<br>
 
<br>
 
<div style="background: #6CACFF; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 0px; font-size:20px; font-family:helvetica"><font color= #FFFFFF>User Test 5 (Mobile)</font></div>
 
<div style="background: #6CACFF; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 0px; font-size:20px; font-family:helvetica"><font color= #FFFFFF>User Test 5 (Mobile)</font></div>
Line 204: Line 219:
 
'''User Test 5 Task Document'''
 
'''User Test 5 Task Document'''
 
<br>
 
<br>
[[Media:Vulcan_User_Test_5_Document.docxx| Vulcan User Test 5 Task Document(Mobile App)]] <br/>
+
[[Media:Vulcan_User_Test_5_Document.docx| Vulcan User Test 5 Task Document(Mobile App)]] <br/>
 +
<br>
 +
For the summary of bugs and comments from UT 5, please click on the results summary file below.
 +
<br>
 +
'''Results Summary'''
 +
<br>
 +
[[Media:Vulcan_User_Test_5_bugs_and_comments.docx| Vulcan User Test 5 Summary]] <br/>
 +
<br>
 +
 
 +
For the specific results of each user, please click on the results collation file below.
 +
<br>
 +
'''Results Collation'''
 +
<br>
 +
[[Media:Vulcan_UT_5_Results.xlsx| Vulcan User Test 5 Results]] <br/>
 
<br>
 
<br>

Latest revision as of 10:27, 24 November 2015

VulcanLogo.png
Vulcan home icon2.png
Vulcan aboutus icon2.png
Vulcan projectoverview icon2.png
Vulcan projectmanagement icon2.png
Vulcan documentation icon2.png

HOME ABOUT US PROJECT OVERVIEW PROJECT MANAGEMENT DOCUMENTATION


User Test 1


The first user test was targeted at our sponsors- Assistant Professor William Tov and Associate Professor Jochen Reb, where they were exposed to the meditation app for the first time. They approached the application from the perspective of a user meditating instead of the researcher's point of view.

The user test document and tasks assigned can be found here:
Vulcan User Test 1

Date: 13th August 2015
Assistant Professor William Tov's Results

Task Ranking of Usefulness from 1-5 Ranking of Usability from 1-5
Complete the demographics survey 1 3
Download the podcast 5 5
Complete the post session survey 3 2
Beeper Survey 2 2
Register for a new account 3 4
Login with your registered account 5 5


Associate Professor Jochen Reb's Results

Task Ranking of Usefulness from 1-5 Ranking of Usability from 1-5
Complete the demographics survey 1 3
Download the podcast 4 5
Complete the post session survey 3 3
Beeper Survey 2 3
Register for a new account 5 3
Login with your registered account 5 3


Comments by Sponsors

Comment Priority level
Menu bar disappears after the phone wakes from sleep mode High
Age and gender of user is asked twice High
Survey sliders are not labeled High
Failed logged in through Facebook leads to summary page High
Registration should not ask for user's name High
User are not able to find the download podcast page High
Purpose of surveys should be explained to users Medium
"Remember me" login function Medium
White space during the playing of podcast should have instructions for the users on meditation Medium
Add short description of the podcast before user plays the podcast Medium
Welcome screen info shows redundant info Medium
Incorrect credentials warning for users appearing at the bottom of the screen Low
No need for the user's photo on the menu bar Low
Demographics survey questions not aligned Low

Based on the comments and scores from the professors, Team Vulcan has decided to focus on the high priority bugs to be fixed before acceptance.
The medium and low priority bugs will be resolved in the upcoming iterations after acceptance.


User Test 2 (Researcher)


This user test was for the ReFokus Web portal, where researchers keyed in program details which can be used as studies for the mobile application. They approached the application from the perspective of researchers. For this test, we took down the user's time taken for each task and the number of clicks. For the exact numbers of time taken for each task, please click on the results link below.

Users: 10
Demographics: Sponsor, SMU PhD Students (RAs), SMU undergraduates.


User Test Task Document
Vulcan User Test 2 Task Document (Researcher Portal)

Results Consolidation
Vulcan User Test 2 Consolidated Results (Researcher Portal)

Results Analysis
Vulcan User Test 2 Analysis (Researcher Portal)

Insights
The main insight found was that researchers had trouble with the naming of buttons and dashboard links. They were not too sure where the "done" button will lead them to most of the time. As such, we have renamed buttons which have clearer instructions on the button's destination.


User Test 3 (Mobile)


This user test was for the ReFokus Meditation app, where users were able to take part in programs specified by the researchers from the ReFokus Web App. The users approached the application from the perspective of new users learning to meditate. For this test, we took down the user's time taken for each task. For the exact numbers of time taken for each task, please click on the results link below.

Users: 10
Demographics: Sponsor, SMU PhD Students (RAs), SMU undergraduates.
Vulcan Gender.png


User Test Task Document
Vulcan User Test 3 Task Document(Mobile App)

Results Collation
Vulcan User Test 3 Results Consolidation(Mobile App)

Results Analysis
Vulcan User Test 3 Results Analysis (Mobile App)

Insights
The main insight found was that it was hard to locate the setting of beeper survey timing page. Since this timing was critical to the project's beeper survey function, the setting of timing has since been made to be part of the registration process. A remember me function was also added after this test based on feedback given by users.

User Test 4 (Mobile & Web Portal)


This user test was for the ReFokus Meditation app and the web portal. The users all had background in research and are interested/involved in mindfulness research. The purpose of this user test was to ensure that functions built will be usable to researchers, and that they are able to navigate through the web portal easily to obtain data collected through a program.

Users: 4
Demographics: Sponsor, SMU PhD Students (RAs) interested in the fields of mindfulness.


User Test 4 Task Document
Vulcan User Test 4 Task Document(Mobile and Web)
For the feedback and bugs found in User Test 4, please refer to the results collation document below.

Results Collation
Vulcan User Test 4 Results

Insights
The main insight was that the button ordering for our web app was confusing for the users. With important buttons such as deactivate and delete program, these buttons should be colored and ordered differently so that it is clear to users of the different purposes of these buttons.

User Test 5 (Mobile)


This user test was for the ReFokus Meditation mobile app. With the functions built so far deemed to be satisfactory to our sponsor's request, this user test was to identify any usability issues to new users who had no expectations of what a meditation app would be like.

Users: 20
Demographics: SMU SIS Students


User Test 5 Task Document
Vulcan User Test 5 Task Document(Mobile App)

For the summary of bugs and comments from UT 5, please click on the results summary file below.
Results Summary
Vulcan User Test 5 Summary

For the specific results of each user, please click on the results collation file below.
Results Collation
Vulcan User Test 5 Results