HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2015T2 Starteur User Testing 1"

From IS480
Jump to navigation Jump to search
(Created page with "<!--Logo--> center|300px <!--MAIN HEADER--> {|style="background-color:#FFFFFF; color:#FFFFFF; padding: 10 0 10 0;" width="100%" cellspacing="0" cellpad...")
 
m
Line 43: Line 43:
 
|}
 
|}
 
<!--SUB HEADER END-->
 
<!--SUB HEADER END-->
 +
 +
<!--MAIN CONTENT-->
 +
==<div style="background: #354b60; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px;letter-spacing:-0.08em;font-size:20px"><font color=#ffffff>Venue</font></div>==
 +
* Location: CHIJ St Nicholas Girls' School, Raffles Institution, SMU
 +
* Date: 3 - 10 Dec 2015
 +
* Time: -
 +
 +
==<div style="background: #354b60; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px;letter-spacing:-0.08em;font-size:20px"><font color=#ffffff>Objectives</font></div>==
 +
* Verify that functionalities built are in line with user requirements
 +
* Determine if the user interface is intuitive
 +
* Gather feedback on current functionalities
 +
* Identify usability problems
 +
 +
==<div style="background: #354b60; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px;letter-spacing:-0.08em;font-size:20px"><font color=#ffffff>Participants</font></div>==
 +
* Number of participants: 3
 +
* Roles of participants: Head-of-Department, Academic Director, Year Head, Personal Development Trainer
 +
 +
 +
<center>
 +
[[File:Photo 2015-08-23 13-51-48.jpg|250px|link=]]
 +
insert photo of participant
 +
</center>
 +
 +
==<div style="background: #354b60; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px;letter-spacing:-0.08em;font-size:20px"><font color=#ffffff>Tasks</font></div>==
 +
* Each of the users was given a list of tasks to complete. Click [[Media:Task Instructions.docx| here]] to download tasklist.
 +
* Before and after completing all the tasks, users are given a survey questionnaire to complete.
 +
 +
==<div style="background: #354b60; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px;letter-spacing:-0.08em;font-size:20px"><font color=#ffffff>Survey Results</font></div>==
 +
===Collated Task Score===
 +
<div style="text-align: left; width:99%;  margin-left:auto; margin-right:auto;">
 +
{| class="wikitable" width="100%" font-family="Roboto Lt"
 +
|-
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:10px; border:1px solid #999" | #
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:30px; border:1px solid #999" | Task
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:20px; border:1px solid #999" | Participant 1
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:20px; border:1px solid #999" | Participant 2
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:20px; border:1px solid #999" | Participant 3
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:20px; border:1px solid #999" | Overall Mean
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:30px; border:1px solid #999" | Remark
 +
 +
|-
 +
| style="text-align:center" | 1
 +
| style="text-align:center" | Login
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | Nil
 +
 +
|-
 +
| style="text-align:center" | 2
 +
| style="text-align:center" | View appointments on calendar
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | Nil
 +
 +
|-
 +
| style="text-align:center" | 3
 +
| style="text-align:center" | Navigate calendar (Day/Week/Month)
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | Nil
 +
 +
|-
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | Filter appointments
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | 4.33
 +
| style="text-align:center" | Nil
 +
 +
|-
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | Create an appointment
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | 4.67
 +
| style="text-align:center" | Nil
 +
 +
|-
 +
| style="text-align:center" | 6
 +
| style="text-align:center" | Search for an appointment
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | 4.67
 +
| style="text-align:center" | Nil
 +
 +
|-
 +
| style="text-align:center" | 7
 +
| style="text-align:center" | Edit an appointment (Same Appointment Type)
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | 4.67
 +
| style="text-align:center" | Nil
 +
 +
|-
 +
| style="text-align:center" | 8
 +
| style="text-align:center" | Edit an appointment (Different Appointment Type)
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | 4.67
 +
| style="text-align:center" | Nil
 +
 +
|-
 +
| style="text-align:center" | 9
 +
| style="text-align:center" | Delete an appointment (With more than 1 patient)
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 3
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 4.33
 +
| style="text-align:center" | Add pop-up to confirm deletion
 +
 +
|-
 +
| style="text-align:center" | 10
 +
| style="text-align:center" | Delete an appointment (With 1 patient)
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 3
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 4.33
 +
| style="text-align:center" | Add pop-up to confirm deletion
 +
 +
|-
 +
| style="text-align:center" | 11
 +
| style="text-align:center" | Add an appointment + on waiting list
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 3
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | Nil
 +
 +
|-
 +
| style="text-align:center" | 12
 +
| style="text-align:center" | View waiting list
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 3
 +
| style="text-align:center" | 4.33
 +
| style="text-align:center" | Nil
 +
 +
|-
 +
| style="text-align:center" | 13
 +
| style="text-align:center" | Delete an appointment
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | 4.67
 +
| style="text-align:center" | Nil
 +
 +
|-
 +
| style="text-align:center" | 14
 +
| style="text-align:center" | View waiting list and make the swap
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | 3
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | Nil
 +
|}
 +
</div>
 +
 +
[[File:4Sight TaskUsabilityScore.JPG|1100px|center|link=]]<br/>
 +
 +
[[File:4Sight TaskUsabilityScore Mean.JPG|1100px|center|link=]]<br/>
 +
 +
===Collated Feedback Score===
 +
 +
<div style="text-align: left; width:99%;  margin-left:auto; margin-right:auto;">
 +
{| class="wikitable" width="100%" font-family="Roboto Lt"
 +
|-
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:10px; border:1px solid #999" | #
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:30px; border:1px solid #999" | Comments on the application
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:20px; border:1px solid #999" | Participant 1
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:20px; border:1px solid #999" | Participant 2
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:20px; border:1px solid #999" | Participant 3
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:20px; border:1px solid #999" | Overall Mean
 +
 +
|-
 +
| style="text-align:center" | 1
 +
| style="text-align:center" | The application is easy to use
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | 4.67
 +
 +
|-
 +
| style="text-align:center" | 2
 +
| style="text-align:center" | The user interface is intuitive
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | 4.33
 +
 +
|-
 +
| style="text-align:center" | 2
 +
| style="text-align:center" | The color scheme is appropriate
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | 4.67
 +
|}
 +
</div>
 +
 +
 +
<center>
 +
[[File:4Sight UserTestingFeedbackScore.JPG|570px|link=]]
 +
[[File:4Sight UserTestingFeedbackMeanScore.JPG|500px|link=]]<br/>
 +
</center>
 +
 +
 +
<div style="text-align: left; width:99%;  margin-left:auto; margin-right:auto;">
 +
{| class="wikitable" width="100%" font-family="Roboto Lt"
 +
|-
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:30px; border:1px solid #999" | #
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:40px; border:1px solid #999" | Comments on features of application
 +
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:50px; border:1px solid #999" | Collated feedback
 +
 +
|-
 +
| style="text-align:center" | 1
 +
| style="text-align:center" | Heatmap
 +
| style="text-align:center" | color coding of heatmap is good. <br> Prefer if timing is available.<br> Current layout of application is good.<br> Do not need to enable iSchedule on main calendar page
 +
 +
|-
 +
| style="text-align:center" | 2
 +
| style="text-align:center" | Suggested timings
 +
| style="text-align:center" | Allow for customization of suggested timings
 +
 +
|-
 +
| style="text-align:center" | 3
 +
| style="text-align:center" | Swapping of appointments
 +
| style="text-align:center" | Very simple to use. <br> This feature is very useful as they do KIV patient's preferred time slot now. However, there are often negligence on the front desk staff and patient's request is often not followed up with a reply on any possibilities of a swap.
 +
 +
|-
 +
| style="text-align:center" | 4
 +
| style="text-align:center" | Any areas of improvement?
 +
| style="text-align:center" | Include export function for graph<br>Show appointment type in search results<br>Check for international number as we do have patients from abroad<br>Refresh waiting list page on swap
 +
 +
|-
 +
| style="text-align:center" | 5
 +
| style="text-align:center" | Any thing you will like to see in the application?
 +
| style="text-align:center" | Overall list of patients and if they came for the appointment (appointment log)<br> Blocking of time slots on calendar. This will be useful as it will prevent staff from making an appointment on days when doctors are on leave/ MC <br> Allow for adding of more doctors to calendar view <br>Is it possible to click on a time slot in the calendar and it will open the drawer with the create new appointment form, without me having to click on the create new appointment button and choosing the date and time <br> Drag and drop feature for appointments. eg: editing <br>
 +
Include UI to manually input marketing expenditure for analytics dashboard <br> Add another appointment type called eyecare/ miscellaneous for general eye checkup etc. <br>
 +
|}
 +
</div>
 +
 +
 +
===User Study Summary===
 +
* Overall, users find the application easy to user, intuitive to perform an appointment booking
 +
* Usability scores did not vary drastically from user to user
 +
* In general, users are satisfied with most functions, except for a few
 +
* User feedback for important features are fairly useful
 +
 +
===User Study Takeaways===
 +
* A consistency in usability for different users. Consider that different users have different functions to perform in their day-to-day operation.
 +
* With users' feedback, we identified areas of improvement on these functions. Eg. Include user confirmation upon deleting an appointment
 +
* Allow us to evaluate the usefulness of these features. Consideration on improvising the features and removing features that are redundant to users. Eg. Form for marketing expenditure. Most feedback has been accounted for in our implementation plan, which will then be confirmed into subsequent development.

Revision as of 21:41, 14 February 2016

Starteur.jpg

HOME

ABOUT US

PROJECT OVERVIEW

PROJECT MANAGEMENT

DOCUMENTATION

Use Cases Technical Diagrams Design Documents Meeting Minutes User Testings Project Documents

Venue

  • Location: CHIJ St Nicholas Girls' School, Raffles Institution, SMU
  • Date: 3 - 10 Dec 2015
  • Time: -

Objectives

  • Verify that functionalities built are in line with user requirements
  • Determine if the user interface is intuitive
  • Gather feedback on current functionalities
  • Identify usability problems

Participants

  • Number of participants: 3
  • Roles of participants: Head-of-Department, Academic Director, Year Head, Personal Development Trainer


Photo 2015-08-23 13-51-48.jpg insert photo of participant

Tasks

  • Each of the users was given a list of tasks to complete. Click here to download tasklist.
  • Before and after completing all the tasks, users are given a survey questionnaire to complete.

Survey Results

Collated Task Score

# Task Participant 1 Participant 2 Participant 3 Overall Mean Remark
1 Login 5 5 5 5 Nil
2 View appointments on calendar 5 5 5 5 Nil
3 Navigate calendar (Day/Week/Month) 5 5 5 5 Nil
4 Filter appointments 4 5 4 4.33 Nil
5 Create an appointment 5 5 4 4.67 Nil
6 Search for an appointment 5 5 4 4.67 Nil
7 Edit an appointment (Same Appointment Type) 5 5 4 4.67 Nil
8 Edit an appointment (Different Appointment Type) 5 5 4 4.67 Nil
9 Delete an appointment (With more than 1 patient) 5 3 5 4.33 Add pop-up to confirm deletion
10 Delete an appointment (With 1 patient) 5 3 5 4.33 Add pop-up to confirm deletion
11 Add an appointment + on waiting list 4 5 3 4 Nil
12 View waiting list 5 5 3 4.33 Nil
13 Delete an appointment 5 5 4 4.67 Nil
14 View waiting list and make the swap 5 4 3 4 Nil
4Sight TaskUsabilityScore.JPG


4Sight TaskUsabilityScore Mean.JPG


Collated Feedback Score

# Comments on the application Participant 1 Participant 2 Participant 3 Overall Mean
1 The application is easy to use 5 5 4 4.67
2 The user interface is intuitive 4 5 4 4.33
2 The color scheme is appropriate 5 5 4 4.67


4Sight UserTestingFeedbackScore.JPG 4Sight UserTestingFeedbackMeanScore.JPG


# Comments on features of application Collated feedback
1 Heatmap color coding of heatmap is good.
Prefer if timing is available.
Current layout of application is good.
Do not need to enable iSchedule on main calendar page
2 Suggested timings Allow for customization of suggested timings
3 Swapping of appointments Very simple to use.
This feature is very useful as they do KIV patient's preferred time slot now. However, there are often negligence on the front desk staff and patient's request is often not followed up with a reply on any possibilities of a swap.
4 Any areas of improvement? Include export function for graph
Show appointment type in search results
Check for international number as we do have patients from abroad
Refresh waiting list page on swap
5 Any thing you will like to see in the application? Overall list of patients and if they came for the appointment (appointment log)
Blocking of time slots on calendar. This will be useful as it will prevent staff from making an appointment on days when doctors are on leave/ MC
Allow for adding of more doctors to calendar view
Is it possible to click on a time slot in the calendar and it will open the drawer with the create new appointment form, without me having to click on the create new appointment button and choosing the date and time
Drag and drop feature for appointments. eg: editing

Include UI to manually input marketing expenditure for analytics dashboard
Add another appointment type called eyecare/ miscellaneous for general eye checkup etc.


User Study Summary

  • Overall, users find the application easy to user, intuitive to perform an appointment booking
  • Usability scores did not vary drastically from user to user
  • In general, users are satisfied with most functions, except for a few
  • User feedback for important features are fairly useful

User Study Takeaways

  • A consistency in usability for different users. Consider that different users have different functions to perform in their day-to-day operation.
  • With users' feedback, we identified areas of improvement on these functions. Eg. Include user confirmation upon deleting an appointment
  • Allow us to evaluate the usefulness of these features. Consideration on improvising the features and removing features that are redundant to users. Eg. Form for marketing expenditure. Most feedback has been accounted for in our implementation plan, which will then be confirmed into subsequent development.