HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki:2017T2 Zenith User Testing 2"

From IS480
Jump to navigation Jump to search
 
(9 intermediate revisions by the same user not shown)
Line 45: Line 45:
 
<div style="font-family: Verdana;">
 
<div style="font-family: Verdana;">
 
<p>
 
<p>
<b>Venue:</b> Singapore General Hospital<br/>
+
<b>Venue:</b> SGH, Alexandra Hospital, NUH, NUS<br/>
<b>Date:</b> 9 - 13 February 2018<br/>
+
<b>Date:</b> 5 - 6 April 2018<br/>
 
<b>Duration:</b> ~ 30 minutes per user<br/>
 
<b>Duration:</b> ~ 30 minutes per user<br/>
<b>Number of Participants:</b> 42 <br/>
+
<b>Number of Participants:</b> 67<br/>
 
<b>User Test:</b> Instructions can be found here: <br/>
 
<b>User Test:</b> Instructions can be found here: <br/>
[[Media: zenith_uat1_admin.docx‎|UAT 1 Admin Instructions]] <br/>
+
[[Media: zenith_uat2_admin.docx‎|UAT 2 Admin Instructions]] <br/>
[[Media: zenith_uat1_prof.docx‎|UAT 1 Professor Instructions]] <br/>
+
[[Media: zenith_uat2_prof.docx‎|UAT 2 Professor Instructions]] <br/>
[[Media: zenith_uat_student.docx‎|UAT 1 Student Instructions]] <br/>
+
[[Media: zenith_uat2_student.docx‎|UAT 2 Student Instructions]] <br/>
  
 
</p>
 
</p>
Line 68: Line 68:
  
 
|style="text-align: center;"| Admin
 
|style="text-align: center;"| Admin
|style="text-align: center;"|  
+
|style="text-align: center;"| 5
 
|-
 
|-
 
|style="text-align: center;"| Professors
 
|style="text-align: center;"| Professors
|style="text-align: center;"|  
+
|style="text-align: center;"| 6
 
|-
 
|-
  
 
|style="text-align: center;"| Students, year 2  
 
|style="text-align: center;"| Students, year 2  
|style="text-align: center;"|  
+
|style="text-align: center;"| 15
 
|-
 
|-
  
 
|style="text-align: center;"| Students, year 3  
 
|style="text-align: center;"| Students, year 3  
|style="text-align: center;"|  
+
|style="text-align: center;"| 25
 
|-
 
|-
  
 
|style="text-align: center;"| Students, year 4  
 
|style="text-align: center;"| Students, year 4  
|style="text-align: center;"|  
+
|style="text-align: center;"| 13
 +
|-
 +
 
 +
|style="text-align: center;"| Students, year 5
 +
|style="text-align: center;"| 3
 
|-
 
|-
  
Line 96: Line 100:
 
<li>Determine if user interface is intuitive, and preferred over last version</li>
 
<li>Determine if user interface is intuitive, and preferred over last version</li>
 
<li>Discover usability problem which users might face</li>
 
<li>Discover usability problem which users might face</li>
<li>Evaluate accuracy of case marking module</li>
 
<li> Evaluate usability of Analyics Dashboard </li>
 
 
</ul>
 
</ul>
 
</p>
 
</p>
Line 111: Line 113:
 
<li>Add/delete approaches</li>  
 
<li>Add/delete approaches</li>  
 
<li> Add/delete specialty/sub-specialty</li>  
 
<li> Add/delete specialty/sub-specialty</li>  
 +
<li>View analytics dashboard</li>
  
 
<b>Professor</b>
 
<b>Professor</b>
Line 119: Line 122:
  
 
<b>Students</b>
 
<b>Students</b>
<li>Update Profile</li>
+
<li>Update profile</li>
 
<li>Upload cases</li>
 
<li>Upload cases</li>
<li>Play games</li>
+
<li>Case challenge</li>
 
<li>View analytics dashboard</li>  
 
<li>View analytics dashboard</li>  
 
</ul>
 
</ul>
Line 137: Line 140:
  
 
<br/>
 
<br/>
<center>
 
 
<div style="font-family: Verdana;">
 
<div style="font-family: Verdana;">
Coming soon! :)
+
<center>
</div> </center>
+
{| class="wikitable" style="background-color:#FFFFFF; width: 800px;" align="center"
 +
|-
 +
 
 +
! style="color:#ecf0f1; background-color:#565656;" width="400pt" | Likes
 +
! style="color:#ecf0f1; background-color:#565656;" width="400pt" | Areas for improvements
 +
|-
 +
 
 +
 
 +
|style="text-align: center;"|
 +
Lesser Participants Struggling with UI<br/>
 +
Positive think aloud data<br/>
 +
Familiar format of cases<br/>
 +
Dashboard is useful
 +
 
 +
|style="text-align: center;"|
 +
Increase number of MCQ options (done)<br/>
 +
Display mark allocation for each question (done)<br/>
 +
Cases for each year of study<br/>
 +
 
 +
|-
 +
 
 +
 
 +
 
 +
 
 +
 
 +
|}
 +
</center>
 
<div>
 
<div>
  
 
==Overall Results==
 
==Overall Results==
<center><div style="font-family: Verdana;">
+
<br/>
Coming soon! :)
+
<center>
</div> </center>
+
<div style="font-family: Verdana;">
 +
[[File:Zenith UAT2 results.png|800px]]
 +
<br> <br>
 +
 
 +
<b>Average increase of 0.42 </b>
 +
</div>
 +
</center>

Latest revision as of 15:13, 15 April 2018

Zenith banner.png

Home

Team

Project Overview

Project Management

Documentation

Personas Prototypes Meeting Minutes Diagrams Technologies User Testing Deliverables


Test Plan

Venue: SGH, Alexandra Hospital, NUH, NUS
Date: 5 - 6 April 2018
Duration: ~ 30 minutes per user
Number of Participants: 67
User Test: Instructions can be found here:
UAT 2 Admin Instructions
UAT 2 Professor Instructions
UAT 2 Student Instructions

Demographics of participants

Role Number of participants
Admin 5
Professors 6
Students, year 2 15
Students, year 3 25
Students, year 4 13
Students, year 5 3
Zenith uat2.jpg

Objectives

  • Determine if user interface is intuitive, and preferred over last version
  • Discover usability problem which users might face

Scope

    Admin
  • Create/delete student, professor and admin accounts
  • Delete cases
  • Add/delete approaches
  • Add/delete specialty/sub-specialty
  • View analytics dashboard
  • Professor
  • Update Profile
  • Upload cases
  • Vet cases
  • View analytics dashboard
  • Students
  • Update profile
  • Upload cases
  • Case challenge
  • View analytics dashboard

Procedures

Participants will be given a consent form prior to the user testing. Once signed, they will be handed the study tasks instructions. We will encourage them to think aloud and ask questions as they attempt to complete the tasks, and note down the participant's comments. Participants will complete a post-test questionnaire at the end of their user testing.

Key Findings


Likes Areas for improvements

Lesser Participants Struggling with UI
Positive think aloud data
Familiar format of cases
Dashboard is useful

Increase number of MCQ options (done)
Display mark allocation for each question (done)
Cases for each year of study

Overall Results


Zenith UAT2 results.png

Average increase of 0.42