HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2013T1 ThunderBolt Project Documentation Usability Test"

From IS480
Jump to navigation Jump to search
Line 224: Line 224:
 
{| style="border: 1px solid darkgray; text-align: center;font-siz:14px; height:50px"
 
{| style="border: 1px solid darkgray; text-align: center;font-siz:14px; height:50px"
 
|scope="row"  width="330" style="text-align: left; background: #eeeeee"|
 
|scope="row"  width="330" style="text-align: left; background: #eeeeee"|
:1. '''Scenario Task Lists'''
+
:1. '''Test Plan'''
 +
:#Test plan: [https://www.dropbox.com/s/v7iiqpsesyefl07/Usability%20Test%201%20Plan.docx]<br>
 +
:2. '''Scenario Task Lists'''
 
:#Admin task: [https://www.dropbox.com/s/5e4wxzhzdk3ma97/Task%20List%20for%20Admin.pdf]<br>
 
:#Admin task: [https://www.dropbox.com/s/5e4wxzhzdk3ma97/Task%20List%20for%20Admin.pdf]<br>
 
:#Course Coordinator task: [https://www.dropbox.com/s/x0sx78ws1k3i8j6/Task%20List%20for%20Course%20Coordinator.pdf]<br>
 
:#Course Coordinator task: [https://www.dropbox.com/s/x0sx78ws1k3i8j6/Task%20List%20for%20Course%20Coordinator.pdf]<br>
 
:#Supervisor/Reviewer task: [https://www.dropbox.com/s/6nmrm1pbme9apy0/Task%20List%20for%20Supervisor.pdf]<br>
 
:#Supervisor/Reviewer task: [https://www.dropbox.com/s/6nmrm1pbme9apy0/Task%20List%20for%20Supervisor.pdf]<br>
 
:#Student task: [https://www.dropbox.com/s/kjw9tagoy5ap42z/Task%20List%20for%20Student.pdf]<br>
 
:#Student task: [https://www.dropbox.com/s/kjw9tagoy5ap42z/Task%20List%20for%20Student.pdf]<br>
:2. '''Qualtrics Survey Questions'''<br>
+
:3. '''Qualtrics Survey Questions'''<br>
 
:#Survey Link: [http://smusg.asia.qualtrics.com/SE/?SID=SV_1TilRZmAClTRIbz]<br>
 
:#Survey Link: [http://smusg.asia.qualtrics.com/SE/?SID=SV_1TilRZmAClTRIbz]<br>
 
:#Survey Raw Result:[https://www.dropbox.com/s/7iu4qie9gibxr1p/User%20Testing%201%20Survey%20Raw%20Result.pdf]<br>
 
:#Survey Raw Result:[https://www.dropbox.com/s/7iu4qie9gibxr1p/User%20Testing%201%20Survey%20Raw%20Result.pdf]<br>
:3. '''Participant Informed Consent Form'''<br>
+
:4. '''Participant Informed Consent Form'''<br>
 
:#Consent Form: [https://www.dropbox.com/s/imfibqb9moy7vtm/Participant%20Informed%20Constent%20Form.pdf]
 
:#Consent Form: [https://www.dropbox.com/s/imfibqb9moy7vtm/Participant%20Informed%20Constent%20Form.pdf]
 
|}
 
|}

Revision as of 01:06, 23 September 2013

Wikiprofilepic.jpg

Home

  About Us   Project Overview   Project Management   Project Documentation
Diagrams Prototype Usability Test Meeting Minutes Downloads

Usability Test 1

Date and Venue

Date: 2 Sep 2013
Time: 1.30pm - 3pm
Venue: SIS MR4.7

Participants

No. of Participants: 10
Participant Profile:
- Admin
- Course Coordinator
- Supervisor/Reviewer
- Students doing FYP next semester

UT1Photo.png
UT1Photo2.png
UT1Photo3.png

Scope of Test

Function Admin Course Coordinator Supervisor/Reviewer Student
Single Sign On Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png
Role switching - Transparent-green-checkmark.png - -
Create schedule Transparent-green-checkmark.png Transparent-green-checkmark.png - -
View schedule Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png
Create booking Transparent-green-checkmark.png Transparent-green-checkmark.png - Transparent-green-checkmark.png
View booking Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png
Edit booking Transparent-green-checkmark.png Transparent-green-checkmark.png - -
Delete booking Transparent-green-checkmark.png Transparent-green-checkmark.png - Transparent-green-checkmark.png
Approve/Reject booking - - Transparent-green-checkmark.png -
View booking history Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png
Supervisor Availability - - Transparent-green-checkmark.png -
Add default milestones Transparent-green-checkmark.png Transparent-green-checkmark.png - -
Add required attendees for different milestones Transparent-green-checkmark.png Transparent-green-checkmark.png - -
Set presentation duration Transparent-green-checkmark.png Transparent-green-checkmark.png - -

Testing Method

A list of tasks based on different scenarios were given to participants and they need to follow the scenarios and figure out how to complete them in the system. Respective facilitators who sat beside them need to observe and record down how they were using the system to complete the task assigned.
Upon completion of all tasks, participants were given a link to complete a questionnaire with regards to their experiences of using our system and feedback any issues they faced during testing or improvements they would like to see in the future.

Survey Result

When asked about what do they like about our system:
- 9 out of 10 said that UI is clean and intuitive
- 1 out of 10 said that new system, better than nothing

What asked what they dislike about the system:
- 2 out of 10 said that they are not sure how to check profile information
- 1 out of 10 said that system is slow
- 1 out of 10 not sure they can check booking history
- 1 out of 10 said that no confirmation when delete booking
- 1 out of 10 said that create schedule for Admin and Course Coordinator is not intuitive
- 1 out of 10 said that abit too many clicks
- 1 out of 10 encountered errors while performing tasks

Some of the issues they faced when performing tasks are:
- 2 out of 10 said that they have problem checking their role in the system
- 1 out of 10 face DB connection error
- 1 out of 10 said that Safari browser unable to click down arrow
- 1 out of 10 said that date and time field for edit booking is hard to use
- 1 out of 10 said that they cant use SSO auto login, need to have manual login
- 1 out of 10 said that email content is not sufficient

Improvements they would like to have to have a better user experience:
- 1 out of 10 wants the system to be faster
- 1 out of 10 want to improve on buttons e.g Booking history
- 1 out of 10 wants email header to be color-coded, easier for user to identify the status of the booking
- 1 out of 10 wants lesser clicks
- '1 out of 10 wants tool-tip/Breadcrumbs

Click here to see our Response Plan: [1]

SurveyResult1.PNG
SurveyResult2.PNG

SurveyResult3.PNG
SurveyResult4.PNG


Documentation

1. Test Plan
  1. Test plan: [2]
2. Scenario Task Lists
  1. Admin task: [3]
  2. Course Coordinator task: [4]
  3. Supervisor/Reviewer task: [5]
  4. Student task: [6]
3. Qualtrics Survey Questions
  1. Survey Link: [7]
  2. Survey Raw Result:[8]
4. Participant Informed Consent Form
  1. Consent Form: [9]

Usability Test 2

Date and Venue

Date: 4 Oct 2013
Time: TBC
Venue: TBC