HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2013T1 ThunderBolt Project Documentation Usability Test"

From IS480
Jump to navigation Jump to search
Line 187: Line 187:
 
{| style="border: 1px solid darkgray; height:600px"
 
{| style="border: 1px solid darkgray; height:600px"
 
|scope="row"  width="1000" style="text-align: left; background: #eeeeee"|
 
|scope="row"  width="1000" style="text-align: left; background: #eeeeee"|
[[Image:SurveyResult1.PNG|450px|left]][[Image:SurveyResult2.PNG|450px|center]]<br>
+
'''When asked about what do they like about our system:'''<br>
[[Image:SurveyResult3.PNG|450px|left]][[Image:SurveyResult4.PNG|450px|center]]<br>
+
- '''9/10''' said that UI is clean and intuitive<br>
'''When asked about what do they like about our system, MOST people said that:'''<br>
+
- '''1/10''' said that new system, better than nothing<br>
- UI is clean and intuitive<br>
+
 
- User friendly<br>
 
- Layout is simple and consistent<br>
 
 
'''What asked what they dislike about the system, MOST people said that:'''<br>  
 
'''What asked what they dislike about the system, MOST people said that:'''<br>  
 
- System is slow<br>
 
- System is slow<br>
Line 213: Line 211:
 
- Tool-tip/Breadcrumbs<br><br>
 
- Tool-tip/Breadcrumbs<br><br>
 
'''Click here to see our Response Plan:''' [https://www.dropbox.com/s/2yrqpgp127c1ebh/Response%20Plan%20to%20User%20Testing%201.xlsx]
 
'''Click here to see our Response Plan:''' [https://www.dropbox.com/s/2yrqpgp127c1ebh/Response%20Plan%20to%20User%20Testing%201.xlsx]
 +
 +
[[Image:SurveyResult1.PNG|450px|left]][[Image:SurveyResult2.PNG|450px|center]]<br>
 +
[[Image:SurveyResult3.PNG|450px|left]][[Image:SurveyResult4.PNG|450px|center]]<br>
 +
 +
 
|}
 
|}
  

Revision as of 00:17, 8 September 2013

Wikiprofilepic.jpg

Home

  About Us   Project Overview   Project Management   Project Documentation
Diagrams Prototype Usability Test Meeting Minutes Downloads

Usability Test 1

Date and Venue

Date: 2 Sep 2013
Time: 1.30pm - 3pm
Venue: SIS MR4.7

Participants

No. of Participants: 10
Participant Profile:
- Admin
- Course Coordinator
- Supervisor/Reviewer
- Students doing FYP next semester

UT1Photo.png
UT1Photo2.png
UT1Photo3.png

Scope of Test

Function Admin Course Coordinator Supervisor/Reviewer Student
Single Sign On Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png
Role switching - Transparent-green-checkmark.png - -
Create schedule Transparent-green-checkmark.png Transparent-green-checkmark.png - -
View schedule Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png
Create booking Transparent-green-checkmark.png Transparent-green-checkmark.png - Transparent-green-checkmark.png
View booking Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png
Edit booking Transparent-green-checkmark.png Transparent-green-checkmark.png - -
Delete booking Transparent-green-checkmark.png Transparent-green-checkmark.png - Transparent-green-checkmark.png
Approve/Reject booking - - Transparent-green-checkmark.png -
View booking history Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png Transparent-green-checkmark.png
Supervisor Availability - - Transparent-green-checkmark.png -
Add default milestones Transparent-green-checkmark.png Transparent-green-checkmark.png - -
Add required attendees for different milestones Transparent-green-checkmark.png Transparent-green-checkmark.png - -
Set presentation duration Transparent-green-checkmark.png Transparent-green-checkmark.png - -

Testing Method

A list of tasks based on different scenarios were given to participants and they need to follow the scenarios and figure out how to complete them in the system. Respective facilitators who sat beside them need to observe and record down how they were using the system to complete the task assigned.
Upon completion of all tasks, participants were given a link to complete a questionnaire with regards to their experiences of using our system and feedback any issues they faced during testing or improvements they would like to see in the future.

Survey Result

When asked about what do they like about our system:
- 9/10 said that UI is clean and intuitive
- 1/10 said that new system, better than nothing

What asked what they dislike about the system, MOST people said that:
- System is slow
- Not sure how to check profile information
- Not sure they can check booking history
- No confirmation when delete booking
- Create schedule for Admin and Course Coordinator is not intuitive
Some of the issues they faced when performing tasks are:
- System too slow
- DB connection error
- Safari browser unable to click down arrow
- Date and time field for edit booking is hard to use
- Cant use SSO auto login, need to have manual login

Improvements they would like to have to have a better user experience:
- Make the system faster
- Some buttons not very intuitive, e.g Booking history
- Email header can be color-coded, easier for user to identify the status of the booking
- Less clicks
- Tool-tip/Breadcrumbs

Click here to see our Response Plan: [1]

SurveyResult1.PNG
SurveyResult2.PNG

SurveyResult3.PNG
SurveyResult4.PNG


Documentation

1. Scenario Task Lists
  1. Admin task: [2]
  2. Course Coordinator task: [3]
  3. Supervisor/Reviewer task: [4]
  4. Student task: [5]
2. Qualtrics Survey Questions
  1. Survey Link: [6]
  2. Survey Raw Result:[7]
3. Participant Informed Consent Form
  1. Consent Form: [8]