HeaderSIS.jpg

IS480 Team wiki: 2015T1 Vulcan User Test

From IS480
Jump to navigation Jump to search
VulcanLogo.png
Vulcan home icon2.png
Vulcan aboutus icon2.png
Vulcan projectoverview icon2.png
Vulcan projectmanagement icon2.png
Vulcan documentation icon2.png

HOME ABOUT US PROJECT OVERVIEW PROJECT MANAGEMENT DOCUMENTATION


User Test 1


The first user test was targeted at our sponsors- Assistant Professor William Tov and Associate Professor Jochen Reb, where they were exposed to the meditation app for the first time. They approached the application from the perspective of a user meditating instead of the researcher's point of view.

The user test document and tasks assigned can be found here:
Vulcan User Test 1

Date: 13th August 2015
Assistant Professor William Tov's Results

Task Ranking of Usefulness from 1-5 Ranking of Usability from 1-5
Complete the demographics survey 1 3
Download the podcast 5 5
Complete the post session survey 3 2
Beeper Survey 2 2
Register for a new account 3 4
Login with your registered account 5 5


Associate Professor Jochen Reb's Results

Task Ranking of Usefulness from 1-5 Ranking of Usability from 1-5
Complete the demographics survey 1 3
Download the podcast 4 5
Complete the post session survey 3 3
Beeper Survey 2 3
Register for a new account 5 3
Login with your registered account 5 3


Comments by Sponsors

Comment Priority level
Menu bar disappears after the phone wakes from sleep mode High
Age and gender of user is asked twice High
Survey sliders are not labeled High
Failed logged in through Facebook leads to summary page High
Registration should not ask for user's name High
User are not able to find the download podcast page High
Purpose of surveys should be explained to users Medium
"Remember me" login function Medium
White space during the playing of podcast should have instructions for the users on meditation Medium
Add short description of the podcast before user plays the podcast Medium
Welcome screen info shows redundant info Medium
Incorrect credentials warning for users appearing at the bottom of the screen Low
No need for the user's photo on the menu bar Low
Demographics survey questions not aligned Low

Based on the comments and scores from the professors, Team Vulcan has decided to focus on the high priority bugs to be fixed before acceptance.
The medium and low priority bugs will be resolved in the upcoming iterations after acceptance.


User Test 2 (Researcher)


This user test was for the ReFokus Web portal, where researchers keyed in program details which can be used as studies for the mobile application. They approached the application from the perspective of researchers. For this test, we took down the user's time taken for each task and the number of clicks. For the exact numbers of time taken for each task, please click on the results link below.

Users: 10
Demographics: Sponsor, SMU PhD Students (RAs), SMU undergraduates.


User Test Task Document
Vulcan User Test 2 Task Document (Researcher Portal)

Results Consolidation
Vulcan User Test 2 Consolidated Results (Researcher Portal)

Results Analysis
Vulcan User Test 2 Analysis (Researcher Portal)

Insights
The main insight found was that researchers had trouble with the naming of buttons and dashboard links. They were not too sure where the "done" button will lead them to most of the time. As such, we have renamed buttons which have clearer instructions on the button's destination.


User Test 3 (Mobile)


This user test was for the ReFokus Meditation app, where users were able to take part in programs specified by the researchers from the ReFokus Web App. The users approached the application from the perspective of new users learning to meditate. For this test, we took down the user's time taken for each task. For the exact numbers of time taken for each task, please click on the results link below.

Users: 10
Demographics: Sponsor, SMU PhD Students (RAs), SMU undergraduates.
Vulcan Gender.png


User Test Task Document
Vulcan User Test 3 Task Document(Mobile App)

Results Collation
Vulcan User Test 3 Results Consolidation(Mobile App)

Results Analysis
Vulcan User Test 3 Results Analysis (Mobile App)

Insights
The main insight found was that it was hard to locate the setting of beeper survey timing page. Since this timing was critical to the project's beeper survey function, the setting of timing has since been made to be part of the registration process. A remember me function was also added after this test based on feedback given by users.

User Test 4 (Mobile & Web Portal)


This user test was for the ReFokus Meditation app and the web portal. The users all had background in research and are interested/involved in mindfulness research. The purpose of this user test was to ensure that functions built will be usable to researchers, and that they are able to navigate through the web portal easily to obtain data collected through a program.

Users: 4
Demographics: Sponsor, SMU PhD Students (RAs) interested in the fields of mindfulness.


User Test 4 Task Document
Vulcan User Test 4 Task Document(Mobile and Web)
For the feedback and bugs found in User Test 4, please refer to the results collation document below.

Results Collation
Vulcan User Test 4 Results

Insights
The main insight was that the button ordering for our web app was confusing for the users. With important buttons such as deactivate and delete program, these buttons should be colored and ordered differently so that it is clear to users of the different purposes of these buttons.

User Test 5 (Mobile)


This user test was for the ReFokus Meditation mobile app. With the functions built so far deemed to be satisfactory to our sponsor's request, this user test was to identify any usability issues to new users who had no expectations of what a meditation app would be like.

Users: 20
Demographics: SMU SIS Students


User Test 5 Task Document
Vulcan User Test 5 Task Document(Mobile App)

For the summary of bugs and comments from UT 5, please click on the results summary file below.
Results Summary
Vulcan User Test 5 Summary

For the specific results of each user, please click on the results collation file below.
Results Collation
Vulcan User Test 5 Results