HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2015T1 Vulcan User Test"

From IS480
Jump to navigation Jump to search
Line 137: Line 137:
 
'''User Test Task Document'''
 
'''User Test Task Document'''
 
<br>
 
<br>
[[Media:Vulcan_User_Test_2_(Researcher_Portal).docx| Vulcan User Test 2 Task Document (Researcher Portal)]]</br>
+
[[Media:Vulcan_User_Test_2_(Researcher_Portal).docx| Vulcan User Test 2 Task Document (Researcher Portal)]] </br>
 
'''Results'''
 
'''Results'''
 
<br>
 
<br>
[[Media:User_Test_2_(Researcher_Portal)_results.xlsx| Vulcan User Test 2 Consolidated Results (Researcher Portal)]]</br>
+
[[Media:User_Test_2_(Researcher_Portal)_results.xlsx| Vulcan User Test 2 Consolidated Results (Researcher Portal)]] </br>
 
<br>
 
<br>
 
'''Insights'''
 
'''Insights'''
Line 162: Line 162:
 
'''User Test Task Document'''
 
'''User Test Task Document'''
 
<br>
 
<br>
[[Media:Vulcan_User_Test_3_Final.docx| Vulcan User Test 3 Task Document(Mobile App)]]</br>
+
[[Media:Vulcan_User_Test_3_Final.docx| Vulcan User Test 3 Task Document(Mobile App)]] </br>
  
 
<br>
 
<br>
 
'''Results Collation'''
 
'''Results Collation'''
 
<br>
 
<br>
[[Media:Vulcan User Test 3 Consolidated.xlsx| Vulcan User Test 3 Results Consolidation(Mobile App)]]</br>
+
[[Media:Vulcan User Test 3 Consolidated.xlsx| Vulcan User Test 3 Results Consolidation(Mobile App)]] </br>
 
<br>
 
<br>
 
'''Results Analysis'''
 
'''Results Analysis'''
 
<br>
 
<br>
[[Media:Vulcan_User_Test_3_Results_Analysis.docx| Vulcan User Test 3 Results Analysis (Mobile App)]]</br>
+
[[Media:Vulcan_User_Test_3_Results_Analysis.docx| Vulcan User Test 3 Results Analysis (Mobile App)]] </br>
 
<br>
 
<br>
 
'''Insights'''
 
'''Insights'''

Revision as of 05:41, 7 October 2015

VulcanLogo.png
Vulcan home icon2.png
Vulcan aboutus icon2.png
Vulcan projectoverview icon2.png
Vulcan projectmanagement icon2.png
Vulcan documentation icon2.png

HOME ABOUT US PROJECT OVERVIEW PROJECT MANAGEMENT DOCUMENTATION


User Test 1


The first user test was targeted at our sponsors Professor William Tov and Professor Jochen Reb, where they were exposed to the meditation app for the first time. They approached the application from the perspective of a user meditating instead of the researcher's point of view.

The user test document and tasks assigned can be found here:
Vulcan User Test 1

Date: 13th August 2015
Professor William Tov's Results

Task Ranking of Usefulness from 1-5 Ranking of Usability from 1-5
Complete the demographics survey 1 3
Download the podcast 5 5
Complete the post session survey 3 2
Beeper Survey 2 2
Register for a new account 3 4
Login with your registered account 5 5


Professor Jochen Reb's Results

Task Ranking of Usefulness from 1-5 Ranking of Usability from 1-5
Complete the demographics survey 1 3
Download the podcast 4 5
Complete the post session survey 3 3
Beeper Survey 2 3
Register for a new account 5 3
Login with your registered account 5 3


Comments by Professors

Comment Priority level
Menu bar disappears after the phone wakes from sleep mode High
Age and gender of user is asked twice High
Survey sliders are not labeled High
Failed logged in through Facebook leads to summary page High
Registration should not ask for user's name High
User are not able to find the download podcast page High
Purpose of surveys should be explained to users Medium
"Remember me" login function Medium
White space during the playing of podcast should have instructions for the users on meditation Medium
Add short description of the podcast before user plays the podcast Medium
Welcome screen info shows redundant info Medium
Incorrect credentials warning for users appearing at the bottom of the screen Low
No need for the user's photo on the menu bar Low
Demographics survey questions not aligned Low

Based on the comments and scores from the professors, Team Vulcan has decided to focus on the high priority bugs to be fixed before acceptance.
The medium and low priority bugs will be resolved in the upcoming iterations after acceptance.


User Test 2 (Researcher)


This user test was for the ReFokus Web portal, where researchers keyed in program details which can be used as studies for the mobile application. They approached the application from the perspective of researchers. For this test, we took down the user's time taken for each task and the number of clicks. For the exact numbers of time taken for each task, please click on the results link below.

Users: 10
Demographics: Sponsor, SMU PhD Students (RAs), SMU undergraduates.


User Test Task Document
Vulcan User Test 2 Task Document (Researcher Portal)
Results
Vulcan User Test 2 Consolidated Results (Researcher Portal)

Insights
The main insight found was that researchers had trouble with the naming of buttons and dashboard links. They were not too sure where the "done" button will lead them to most of the time. As such, we have renamed buttons which have clearer instructions on the button's destination.


User Test 3 (Mobile)


This user test was for the ReFokus Meditation app, where users were able to take part in programs specified by the researchers from the ReFokus Web App. The users approached the application from the perspective of new users learning to meditate. For this test, we took down the user's time taken for each task. For the exact numbers of time taken for each task, please click on the results link below.

Users: 10
Demographics: Sponsor, SMU PhD Students (RAs), SMU undergraduates.
Vulcan Gender.png


User Test Task Document
Vulcan User Test 3 Task Document(Mobile App)


Results Collation
Vulcan User Test 3 Results Consolidation(Mobile App)

Results Analysis
Vulcan User Test 3 Results Analysis (Mobile App)

Insights
The main insight found was that it was hard to locate the setting of beeper survey timing page. Since this timing was critical to the project's beeper survey function, the setting of timing has since been made to be part of the registration process. A remember me function was also added after this test based on feedback given by users.