Difference between revisions of "IS480 Team wiki:2017T2 Zenith User Testing 2"
Jump to navigation
Jump to search
(13 intermediate revisions by the same user not shown) | |||
Line 45: | Line 45: | ||
<div style="font-family: Verdana;"> | <div style="font-family: Verdana;"> | ||
<p> | <p> | ||
− | <b>Venue:</b> | + | <b>Venue:</b> SGH, Alexandra Hospital, NUH, NUS<br/> |
− | <b>Date:</b> | + | <b>Date:</b> 5 - 6 April 2018<br/> |
<b>Duration:</b> ~ 30 minutes per user<br/> | <b>Duration:</b> ~ 30 minutes per user<br/> | ||
− | <b>Number of Participants:</b> | + | <b>Number of Participants:</b> 67<br/> |
<b>User Test:</b> Instructions can be found here: <br/> | <b>User Test:</b> Instructions can be found here: <br/> | ||
− | [[Media: | + | [[Media: zenith_uat2_admin.docx|UAT 2 Admin Instructions]] <br/> |
− | [[Media: | + | [[Media: zenith_uat2_prof.docx|UAT 2 Professor Instructions]] <br/> |
− | [[Media: | + | [[Media: zenith_uat2_student.docx|UAT 2 Student Instructions]] <br/> |
</p> | </p> | ||
Line 65: | Line 65: | ||
! style="color:#ecf0f1; background-color:#565656;" width="400pt" | Role | ! style="color:#ecf0f1; background-color:#565656;" width="400pt" | Role | ||
! style="color:#ecf0f1; background-color:#565656;" width="500pt" | Number of participants | ! style="color:#ecf0f1; background-color:#565656;" width="500pt" | Number of participants | ||
+ | |- | ||
+ | |||
+ | |style="text-align: center;"| Admin | ||
+ | |style="text-align: center;"| 5 | ||
+ | |- | ||
+ | |style="text-align: center;"| Professors | ||
+ | |style="text-align: center;"| 6 | ||
|- | |- | ||
|style="text-align: center;"| Students, year 2 | |style="text-align: center;"| Students, year 2 | ||
− | |style="text-align: center;"| | + | |style="text-align: center;"| 15 |
|- | |- | ||
|style="text-align: center;"| Students, year 3 | |style="text-align: center;"| Students, year 3 | ||
− | |style="text-align: center;"| | + | |style="text-align: center;"| 25 |
|- | |- | ||
|style="text-align: center;"| Students, year 4 | |style="text-align: center;"| Students, year 4 | ||
− | |style="text-align: center;"| | + | |style="text-align: center;"| 13 |
|- | |- | ||
− | |style="text-align: center;"| | + | |style="text-align: center;"| Students, year 5 |
− | |style="text-align: center;"| | + | |style="text-align: center;"| 3 |
|- | |- | ||
|} | |} | ||
− | [[Image: | + | [[Image:zenith_uat2.jpg|center|700px|link=]] |
</center> | </center> | ||
Line 91: | Line 98: | ||
<p> | <p> | ||
<ul> | <ul> | ||
− | <li>Determine if user interface is intuitive</li> | + | <li>Determine if user interface is intuitive, and preferred over last version</li> |
<li>Discover usability problem which users might face</li> | <li>Discover usability problem which users might face</li> | ||
− | |||
</ul> | </ul> | ||
</p> | </p> | ||
Line 103: | Line 109: | ||
<ul> | <ul> | ||
<b>Admin</b> | <b>Admin</b> | ||
− | <li>Create student accounts | + | <li>Create/delete student, professor and admin accounts</li> |
− | |||
− | |||
<li>Delete cases</li> | <li>Delete cases</li> | ||
+ | <li>Add/delete approaches</li> | ||
+ | <li> Add/delete specialty/sub-specialty</li> | ||
+ | <li>View analytics dashboard</li> | ||
+ | |||
<b>Professor</b> | <b>Professor</b> | ||
+ | <li>Update Profile </li> | ||
<li>Upload cases</li> | <li>Upload cases</li> | ||
<li>Vet cases</li> | <li>Vet cases</li> | ||
+ | <li>View analytics dashboard</li> | ||
+ | |||
<b>Students</b> | <b>Students</b> | ||
− | <li>Update | + | <li>Update profile</li> |
<li>Upload cases</li> | <li>Upload cases</li> | ||
− | <li> | + | <li>Case challenge</li> |
− | <li> | + | <li>View analytics dashboard</li> |
− | |||
− | |||
</ul> | </ul> | ||
</p> | </p> | ||
Line 136: | Line 145: | ||
|- | |- | ||
− | |||
! style="color:#ecf0f1; background-color:#565656;" width="400pt" | Likes | ! style="color:#ecf0f1; background-color:#565656;" width="400pt" | Likes | ||
− | ! style="color:#ecf0f1; background-color:#565656;" width=" | + | ! style="color:#ecf0f1; background-color:#565656;" width="400pt" | Areas for improvements |
|- | |- | ||
− | + | ||
|style="text-align: center;"| | |style="text-align: center;"| | ||
− | + | Lesser Participants Struggling with UI<br/> | |
− | + | Positive think aloud data<br/> | |
− | + | Familiar format of cases<br/> | |
+ | Dashboard is useful | ||
|style="text-align: center;"| | |style="text-align: center;"| | ||
− | + | Increase number of MCQ options (done)<br/> | |
− | + | Display mark allocation for each question (done)<br/> | |
− | + | Cases for each year of study<br/> | |
+ | |||
|- | |- | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
|} | |} | ||
Line 185: | Line 172: | ||
==Overall Results== | ==Overall Results== | ||
− | <center><div style="font-family: Verdana;"> | + | <br/> |
− | + | <center> | |
− | </div> </center> | + | <div style="font-family: Verdana;"> |
+ | [[File:Zenith UAT2 results.png|800px]] | ||
+ | <br> <br> | ||
+ | |||
+ | <b>Average increase of 0.42 </b> | ||
+ | </div> | ||
+ | </center> |
Latest revision as of 15:13, 15 April 2018
Personas | Prototypes | Meeting Minutes | Diagrams | Technologies | User Testing | Deliverables |
Contents
Test Plan
Venue: SGH, Alexandra Hospital, NUH, NUS
Date: 5 - 6 April 2018
Duration: ~ 30 minutes per user
Number of Participants: 67
User Test: Instructions can be found here:
UAT 2 Admin Instructions
UAT 2 Professor Instructions
UAT 2 Student Instructions
Demographics of participants
Role | Number of participants |
---|---|
Admin | 5 |
Professors | 6 |
Students, year 2 | 15 |
Students, year 3 | 25 |
Students, year 4 | 13 |
Students, year 5 | 3 |
Objectives
- Determine if user interface is intuitive, and preferred over last version
- Discover usability problem which users might face
Scope
-
Admin
- Create/delete student, professor and admin accounts
- Delete cases
- Add/delete approaches
- Add/delete specialty/sub-specialty
- View analytics dashboard Professor
- Update Profile
- Upload cases
- Vet cases
- View analytics dashboard Students
- Update profile
- Upload cases
- Case challenge
- View analytics dashboard
Procedures
Participants will be given a consent form prior to the user testing. Once signed, they will be handed the study tasks instructions. We will encourage them to think aloud and ask questions as they attempt to complete the tasks, and note down the participant's comments. Participants will complete a post-test questionnaire at the end of their user testing.
Key Findings