HeaderSIS.jpg

IS480 Team wiki: 2015T1 4Sight User Testing 2

From IS480
Revision as of 17:38, 15 November 2015 by Amabel.lau.2012 (talk | contribs)
Jump to navigation Jump to search
4Sight team logo.png
4Sight Home.png HOME   4Sight Team.png ABOUT US   4Sight Project overview.png PROJECT OVERVIEW   4Sight Project management.png PROJECT MANAGEMENT   4Sight Documentation.png DOCUMENTATION  
Technical Diagrams Design Documents Meeting Minutes User Testings Project Documents

Venue

  • Location: Clearvision @ 6 Nutmeg Road
  • Date: 16 October 2015 (Wednesday)
  • Time: 15:00pm

Objectives

  • Verify that functionalities built are in line with user requirements
  • Determine if the user interface is intuitive
  • Gather feedback on current functionalities
  • Identify usability problems

Claims

Our team made 4 claims -
1. Participants find it easy to navigate the calendar and manage patients’ appointments (CUD) effectively (average rating: 4/5)
2. Participants find the patient queue useful in helping them track patient’s attendance (average rating: 3.5/5)
3. Participants find the marketing conversion and appointment scheduling dashboard beneficial in their performance analysis (average rating: 4/5)
4. Participants like and have positive comments about our user interface (average rating: 4/5)

Participants

  • Number of participants: 8
  • Roles of participants: Optometrist, admin clerk and marketing team member


IMG 1365.JPG IMG 1358.JPG IMG 1353.JPG IMG 1367.JPG

Tasks

Each of the users was given a list of tasks to complete. Click here to download tasklist. The tasklist also consists of some questionnaire to gather feedback from users.

Survey Results

Click here to download the raw data.

Summary of Results

Usability Results

4Sight UT2 UsabilityScore.png



4Sight UT2 UsabilityScore2.png


Usability Analysis

  • No drastic variation in the usability scores between users of different roles
  • Simple UI that allows user to perform fundamental tasks easily
  • Confirmed the value of proposed features such as swap list
  • Discover potential improvement eg: Block off doctor’s time slots on calendar

Claim 1 Results

Claim: Participants find it easy to navigate the calendar and manage patients' appointments (CUD) effectively (average rating: 4/5)

4Sight UT2 Claim1NoOfClicks.png



Based on the above chart, create appointment results has the largest deviation compared to the other features. Many users encountered the same issue - activation of heat map does not navigate the calendar to the current date. This has caused many confusions and additional clicks to toggle back to the current date if they are on a different week view. Based on these feedback, we have made some changes to improve users' experience in using the heat map by removing the unnecessary clicks (toggle to the current date). In the improved version,

4Sight UT2 claim1Changes.png




# Task Participant 1 Participant 2 Participant 3 Overall Mean Remark
1 Login 5 5 5 5 Nil
2 View appointments on calendar 5 5 5 5 Nil
3 Navigate calendar (Day/Week/Month) 5 5 5 5 Nil
4 Filter appointments 4 5 4 4.33 Nil
5 Create an appointment 5 5 4 4.67 Nil
6 Search for an appointment 5 5 4 4.67 Nil
7 Edit an appointment (Same Appointment Type) 5 5 4 4.67 Nil
8 Edit an appointment (Different Appointment Type) 5 5 4 4.67 Nil
9 Delete an appointment (With more than 1 patient) 5 3 5 4.33 Add pop-up to confirm deletion
10 Delete an appointment (With 1 patient) 5 3 5 4.33 Add pop-up to confirm deletion
11 Add an appointment + on waiting list 4 5 3 4 Nil
12 View waiting list 5 5 3 4.33 Nil
13 Delete an appointment 5 5 4 4.67 Nil
14 View waiting list and make the swap 5 4 3 4 Nil
4Sight TaskUsabilityScore.JPG


4Sight TaskUsabilityScore Mean.JPG


Collated Feedback Score

# Comments on the application Participant 1 Participant 2 Participant 3 Overall Mean
1 The application is easy to use 5 5 4 4.67
2 The user interface is intuitive 4 5 4 4.33
2 The color scheme is appropriate 5 5 4 4.67


4Sight UserTestingFeedbackScore.JPG 4Sight UserTestingFeedbackMeanScore.JPG


# Comments on features of application Collated feedback
1 Heatmap color coding of heatmap is good.
Prefer if timing is available.
Current layout of application is good.
Do not need to enable iSchedule on main calendar page
2 Suggested timings Allow for customization of suggested timings
3 Swapping of appointments Very simple to use.
This feature is very useful as they do KIV patient's preferred time slot now. However, there are often negligence on the front desk staff and patient's request is often not followed up with a reply on any possibilities of a swap.
4 Any areas of improvement? Include export function for graph
Show appointment type in search results
Check for international number as we do have patients from abroad
Refresh waiting list page on swap
5 Any thing you will like to see in the application? Overall list of patients and if they came for the appointment (appointment log)
Blocking of time slots on calendar. This will be useful as it will prevent staff from making an appointment on days when doctors are on leave/ MC
Allow for adding of more doctors to calendar view
Is it possible to click on a time slot in the calendar and it will open the drawer with the create new appointment form, without me having to click on the create new appointment button and choosing the date and time
Drag and drop feature for appointments. eg: editing

Include UI to manually input marketing expenditure for analytics dashboard
Add another appointment type called eyecare/ miscellaneous for general eye checkup etc.


User Study Summary

  • Overall, users find the application easy to user, intuitive to perform an appointment booking
  • Usability scores did not vary drastically from user to user
  • In general, users are satisfied with most functions, except for a few
  • User feedback for important features are fairly useful

User Study Takeaways

  • A consistency in usability for different users. Consider that different users have different functions to perform in their day-to-day operation.
  • With users' feedback, we identified areas of improvement on these functions. Eg. Include user confirmation upon deleting an appointment
  • Allow us to evaluate the usefulness of these features. Consideration on improvising the features and removing features that are redundant to users. Eg. Form for marketing expenditure. Most feedback has been accounted for in our implementation plan, which will then be confirmed into subsequent development.