HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki:2017T2 Zenith User Testing 2"

From IS480
Jump to navigation Jump to search
 
(13 intermediate revisions by the same user not shown)
Line 45: Line 45:
 
<div style="font-family: Verdana;">
 
<div style="font-family: Verdana;">
 
<p>
 
<p>
<b>Venue:</b> Singapore General Hospital<br/>
+
<b>Venue:</b> SGH, Alexandra Hospital, NUH, NUS<br/>
<b>Date:</b> 9 - 13 February 2018<br/>
+
<b>Date:</b> 5 - 6 April 2018<br/>
 
<b>Duration:</b> ~ 30 minutes per user<br/>
 
<b>Duration:</b> ~ 30 minutes per user<br/>
<b>Number of Participants:</b> 42 <br/>
+
<b>Number of Participants:</b> 67<br/>
 
<b>User Test:</b> Instructions can be found here: <br/>
 
<b>User Test:</b> Instructions can be found here: <br/>
[[Media: zenith_uat1_admin.docx‎|UAT 1 Admin Instructions]] <br/>
+
[[Media: zenith_uat2_admin.docx‎|UAT 2 Admin Instructions]] <br/>
[[Media: zenith_uat1_prof.docx‎|UAT 1 Professor Instructions]] <br/>
+
[[Media: zenith_uat2_prof.docx‎|UAT 2 Professor Instructions]] <br/>
[[Media: zenith_uat_student.docx‎|UAT 1 Student Instructions]] <br/>
+
[[Media: zenith_uat2_student.docx‎|UAT 2 Student Instructions]] <br/>
  
 
</p>
 
</p>
Line 65: Line 65:
 
! style="color:#ecf0f1; background-color:#565656;" width="400pt" | Role
 
! style="color:#ecf0f1; background-color:#565656;" width="400pt" | Role
 
! style="color:#ecf0f1; background-color:#565656;" width="500pt" | Number of participants
 
! style="color:#ecf0f1; background-color:#565656;" width="500pt" | Number of participants
 +
|-
 +
 +
|style="text-align: center;"| Admin
 +
|style="text-align: center;"| 5
 +
|-
 +
|style="text-align: center;"| Professors
 +
|style="text-align: center;"| 6
 
|-
 
|-
  
 
|style="text-align: center;"| Students, year 2  
 
|style="text-align: center;"| Students, year 2  
|style="text-align: center;"| 2
+
|style="text-align: center;"| 15
 
|-
 
|-
  
 
|style="text-align: center;"| Students, year 3  
 
|style="text-align: center;"| Students, year 3  
|style="text-align: center;"| 15
+
|style="text-align: center;"| 25
 
|-
 
|-
  
 
|style="text-align: center;"| Students, year 4  
 
|style="text-align: center;"| Students, year 4  
|style="text-align: center;"| 25
+
|style="text-align: center;"| 13
 
|-
 
|-
  
|style="text-align: center;"| Admin
+
|style="text-align: center;"| Students, year 5
|style="text-align: center;"| 4
+
|style="text-align: center;"| 3
 
|-
 
|-
  
 
|}
 
|}
[[Image:zenith_uat1.jpg|center|700px|link=]]
+
[[Image:zenith_uat2.jpg|center|700px|link=]]
 
</center>
 
</center>
  
Line 91: Line 98:
 
<p>
 
<p>
 
<ul>
 
<ul>
<li>Determine if user interface is intuitive</li>
+
<li>Determine if user interface is intuitive, and preferred over last version</li>
 
<li>Discover usability problem which users might face</li>
 
<li>Discover usability problem which users might face</li>
<li>Evaluate accuracy of case marking module</li>
 
 
</ul>
 
</ul>
 
</p>
 
</p>
Line 103: Line 109:
 
<ul>
 
<ul>
 
<b>Admin</b>
 
<b>Admin</b>
<li>Create student accounts</li>
+
<li>Create/delete student, professor and admin accounts</li>
<li>Create Professor accounts</li>
 
<li>Delete users</li>
 
 
<li>Delete cases</li>
 
<li>Delete cases</li>
 +
<li>Add/delete approaches</li>
 +
<li> Add/delete specialty/sub-specialty</li>
 +
<li>View analytics dashboard</li>
 +
 
<b>Professor</b>
 
<b>Professor</b>
 +
<li>Update Profile </li>
 
<li>Upload cases</li>
 
<li>Upload cases</li>
 
<li>Vet cases</li>
 
<li>Vet cases</li>
 +
<li>View analytics dashboard</li>
 +
 
<b>Students</b>
 
<b>Students</b>
<li>Update user profiles</li>
+
<li>Update profile</li>
 
<li>Upload cases</li>
 
<li>Upload cases</li>
<li>Find games</li>
+
<li>Case challenge</li>
<li>Play games</li>
+
<li>View analytics dashboard</li>  
<li>Marking for MCQ questions</li>
 
<li>Marking for open-ended questions</li>
 
 
</ul>
 
</ul>
 
</p>
 
</p>
Line 136: Line 145:
 
|-
 
|-
  
! style="color:#ecf0f1; background-color:#565656;" width="100pt" | User
 
 
! style="color:#ecf0f1; background-color:#565656;" width="400pt" | Likes
 
! style="color:#ecf0f1; background-color:#565656;" width="400pt" | Likes
! style="color:#ecf0f1; background-color:#565656;" width="300pt" | Dislikes
+
! style="color:#ecf0f1; background-color:#565656;" width="400pt" | Areas for improvements
 
|-
 
|-
  
|style="text-align: center;"| Admin
+
 
 
|style="text-align: center;"|
 
|style="text-align: center;"|
Simple and neat design <br/>
+
Lesser Participants Struggling with UI<br/>
Search functions are useful  <br/>
+
Positive think aloud data<br/>
Easy to create and delete users <br/>
+
Familiar format of cases<br/>
 +
Dashboard is useful
  
 
|style="text-align: center;"|  
 
|style="text-align: center;"|  
Add instructions <br/>
+
Increase number of MCQ options (done)<br/>
Plain Design <br/>
+
Display mark allocation for each question (done)<br/>
Prompt before deleting <br/>
+
Cases for each year of study<br/>
 +
 
 
|-
 
|-
  
|style="text-align: center;"| Professors
 
|style="text-align: center;"|
 
Easy to vet cases <br/>
 
User friendly layout  <br/>
 
Easy to upload a case <br/>
 
Simple and clean design <br/>
 
  
|style="text-align: center;"|
 
Hard to re-upload images <br/>
 
Size of text box is too small  <br/>
 
Display all fields in "story so far" <br/>
 
|-
 
  
|style="text-align: center;"| Students
 
|style="text-align: center;"|
 
Very user friendly <br/>
 
Intuitive and straightforward design  <br/>
 
Easy to upload cases <br/>
 
Simple and clean design <br/>
 
Familiar format of cases <br/>
 
  
|style="text-align: center;"|
 
Unfair/inflexible grading <br/>
 
Problems uploading profile picture <br/>
 
Too much scrolling <br/>
 
|-
 
  
 
|}
 
|}
Line 185: Line 172:
  
 
==Overall Results==
 
==Overall Results==
<center><div style="font-family: Verdana;">
+
<br/>
Coming soon! :)
+
<center>
</div> </center>
+
<div style="font-family: Verdana;">
 +
[[File:Zenith UAT2 results.png|800px]]
 +
<br> <br>
 +
 
 +
<b>Average increase of 0.42 </b>
 +
</div>
 +
</center>

Latest revision as of 15:13, 15 April 2018

Zenith banner.png

Home

Team

Project Overview

Project Management

Documentation

Personas Prototypes Meeting Minutes Diagrams Technologies User Testing Deliverables


Test Plan

Venue: SGH, Alexandra Hospital, NUH, NUS
Date: 5 - 6 April 2018
Duration: ~ 30 minutes per user
Number of Participants: 67
User Test: Instructions can be found here:
UAT 2 Admin Instructions
UAT 2 Professor Instructions
UAT 2 Student Instructions

Demographics of participants

Role Number of participants
Admin 5
Professors 6
Students, year 2 15
Students, year 3 25
Students, year 4 13
Students, year 5 3
Zenith uat2.jpg

Objectives

  • Determine if user interface is intuitive, and preferred over last version
  • Discover usability problem which users might face

Scope

    Admin
  • Create/delete student, professor and admin accounts
  • Delete cases
  • Add/delete approaches
  • Add/delete specialty/sub-specialty
  • View analytics dashboard
  • Professor
  • Update Profile
  • Upload cases
  • Vet cases
  • View analytics dashboard
  • Students
  • Update profile
  • Upload cases
  • Case challenge
  • View analytics dashboard

Procedures

Participants will be given a consent form prior to the user testing. Once signed, they will be handed the study tasks instructions. We will encourage them to think aloud and ask questions as they attempt to complete the tasks, and note down the participant's comments. Participants will complete a post-test questionnaire at the end of their user testing.

Key Findings


Likes Areas for improvements

Lesser Participants Struggling with UI
Positive think aloud data
Familiar format of cases
Dashboard is useful

Increase number of MCQ options (done)
Display mark allocation for each question (done)
Cases for each year of study

Overall Results


Zenith UAT2 results.png

Average increase of 0.42