HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2015T1 4Sight User Testing 2"

From IS480
Jump to navigation Jump to search
Line 113: Line 113:
 
====Claim 1 Results====
 
====Claim 1 Results====
 
[[File:4Sight UT2 claim1Score.png|900px|center|link=]]<br/>
 
[[File:4Sight UT2 claim1Score.png|900px|center|link=]]<br/>
 +
 +
Taking the average of the component scores, the average mean score is 4.39 > 4. This supports our claim that participants find it easy to navigate the calendar and manage patients' appointments (CUD) effectively.
  
 
===Collated Feedback Score===
 
===Collated Feedback Score===

Revision as of 18:28, 15 November 2015

4Sight team logo.png
4Sight Home.png HOME   4Sight Team.png ABOUT US   4Sight Project overview.png PROJECT OVERVIEW   4Sight Project management.png PROJECT MANAGEMENT   4Sight Documentation.png DOCUMENTATION  
Technical Diagrams Design Documents Meeting Minutes User Testings Project Documents

Venue

  • Location: Clearvision @ 6 Nutmeg Road
  • Date: 16 October 2015 (Wednesday)
  • Time: 15:00pm

Objectives

  • Verify that functionalities built are in line with user requirements
  • Determine if the user interface is intuitive
  • Gather feedback on current functionalities
  • Identify usability problems

Claims

Our team made 4 claims -
1. Participants find it easy to navigate the calendar and manage patients’ appointments (CUD) effectively (average rating: 4/5)
2. Participants find the patient queue useful in helping them track patient’s attendance (average rating: 3.5/5)
3. Participants find the marketing conversion and appointment scheduling dashboard beneficial in their performance analysis (average rating: 4/5)
4. Participants like and have positive comments about our user interface (average rating: 4/5)

Participants

  • Number of participants: 8
  • Roles of participants: Optometrist, admin clerk and marketing team member


IMG 1365.JPG IMG 1358.JPG IMG 1353.JPG IMG 1367.JPG

Tasks

Each of the users was given a list of tasks to complete. Click here to download tasklist. The tasklist also consists of some questionnaire to gather feedback from users.

Summary of Survey Results

Click here to download the raw data.

Usability Results

4Sight UT2 UsabilityScore.png



4Sight UT2 UsabilityScore2.png


Usability Analysis

  • No drastic variation in the usability scores between users of different roles
  • Simple UI that allows user to perform fundamental tasks easily
  • Confirmed the value of proposed features such as swap list
  • Discover potential improvement eg: Block off doctor’s time slots on calendar

Claim 1 Results

Claim: Participants find it easy to navigate the calendar and manage patients' appointments (CUD) effectively (average rating: 4/5)

Number of Clicks

4Sight UT2 Claim1NoOfClicks.png


Based on the above chart, create appointment results has the largest deviation compared to the other features. Many users encountered the same issue - activation of heat map does not navigate the calendar to the current date. This has caused many confusions and additional clicks to toggle back to the current date heatmap view if they are on a different week view. Based on these feedback, we have made some changes to improve users' experience in using the heat map by removing the unnecessary clicks (toggle to the current date). In the improved version, user will be brought to the current week's heatmap upon selecting "create new appointment" form

4Sight UT2 claim1Changes.png



Number of Errors

4Sight UT2 Claim1NoOfErrors.png


Based on the above chart, create and update appointment have the highest number of errors, 3 and 2 respectively. Many users encountered the same issue - Participants change dropdown selections before heat map finishes loading. Based on the feedback we have gotten, we have made improvement to prevent users from selecting the options in the dropdown too quickly.

4Sight UT2 claim2Changes.png


Claim 1 Results

4Sight UT2 claim1Score.png


Taking the average of the component scores, the average mean score is 4.39 > 4. This supports our claim that participants find it easy to navigate the calendar and manage patients' appointments (CUD) effectively.

Collated Feedback Score

# Comments on the application Participant 1 Participant 2 Participant 3 Overall Mean
1 The application is easy to use 5 5 4 4.67
2 The user interface is intuitive 4 5 4 4.33
2 The color scheme is appropriate 5 5 4 4.67


4Sight UserTestingFeedbackScore.JPG 4Sight UserTestingFeedbackMeanScore.JPG


# Comments on features of application Collated feedback
1 Heatmap color coding of heatmap is good.
Prefer if timing is available.
Current layout of application is good.
Do not need to enable iSchedule on main calendar page
2 Suggested timings Allow for customization of suggested timings
3 Swapping of appointments Very simple to use.
This feature is very useful as they do KIV patient's preferred time slot now. However, there are often negligence on the front desk staff and patient's request is often not followed up with a reply on any possibilities of a swap.
4 Any areas of improvement? Include export function for graph
Show appointment type in search results
Check for international number as we do have patients from abroad
Refresh waiting list page on swap
5 Any thing you will like to see in the application? Overall list of patients and if they came for the appointment (appointment log)
Blocking of time slots on calendar. This will be useful as it will prevent staff from making an appointment on days when doctors are on leave/ MC
Allow for adding of more doctors to calendar view
Is it possible to click on a time slot in the calendar and it will open the drawer with the create new appointment form, without me having to click on the create new appointment button and choosing the date and time
Drag and drop feature for appointments. eg: editing

Include UI to manually input marketing expenditure for analytics dashboard
Add another appointment type called eyecare/ miscellaneous for general eye checkup etc.


User Study Summary

  • Overall, users find the application easy to user, intuitive to perform an appointment booking
  • Usability scores did not vary drastically from user to user
  • In general, users are satisfied with most functions, except for a few
  • User feedback for important features are fairly useful

User Study Takeaways

  • A consistency in usability for different users. Consider that different users have different functions to perform in their day-to-day operation.
  • With users' feedback, we identified areas of improvement on these functions. Eg. Include user confirmation upon deleting an appointment
  • Allow us to evaluate the usefulness of these features. Consideration on improvising the features and removing features that are redundant to users. Eg. Form for marketing expenditure. Most feedback has been accounted for in our implementation plan, which will then be confirmed into subsequent development.