HeaderSIS.jpg

IS480 Team wiki: 2017T2 Alpha Midterm Elders UAT

From IS480
Jump to navigation Jump to search
AlphaLogoHeader.jpg
HOME OUR TEAM PROJECT OVERVIEW PROJECT MANAGEMENT DOCUMENTATION
DIAGRAMS DESIGN USER TESTING MEETING MINUTES DELIVERABLES
Alpha User testing.jpg

You are currently viewing the Midterm UAT page for the elders. To go back to the main user testing page, please click here.

Test Plan

Venues:
1)Various public locations like neighborhood parks, community centers and churches
2)Homes of elders that are under the SMU iCity SHINESeniors project team
Date:
1)2 Feb – 3 Feb
2)6 Feb – 10 Feb
3)13 Feb - 16 Feb

Time: Various timing
Duration: around 20 minutes each
Number of participants: 80

  • We only recruit the participants if they are >= 50 years old.

Objectives

1. Gather feedback on the mobile application based on the developed functionalities
2. Identify potential areas of improvement on the user interface and user experience

Tasks

For this user testing, the elders have to attempt the 2 tasks as shown below:

1. You are a patient who wishes to find out your current urological health condition. Complete the questionnaires.

2. When you have completed your questionnaires, write down your IPSS score in the box below.

Goals

1. Participants should find it easy to complete the questionnaires
a) (quantitative, question) "How easy was it for you to complete the questionnaires on the iPad?" (scale of 1 to 5)(target:average 3 or higher)
b) (qualitative, question) provide an explanation for the choice of rating

2. Participants should find it easy to interpret the summary page.
a) (quantitative, question) "How easy was it for you to find your IPSS score on the iPad?" (scale of 1 to 5)(target:average 3 or higher)
b) (qualitative, question) provide an explanation for the choice of rating

3. Participants should find the design of the application aesthetically pleasing.
a) (quantitative, question) "How do you find the aesthetic design of the web application? " (scale of 1 to 5)(target:average 3 or higher)
b) (qualitative, question) provide an explanation for the choice of rating

Feedback/Comments

UAT 1

We conducted user testing with 15 participants only to realise that 11 of them were unwilling / unable to attempt the sensitive IIEF.
Reasons are due to:
1. Unwilling to give away their private information about their sexual health
2. Not married, hence unable to answer the IIEF questions

Due to the reluctance of participants to even attempt the IIEF, team feels that this is a major issue.
It would be meaningless if the participants are stuck at IIEF and unable to proceed with any actions.
Change request started and at the end, team added in the skip function to allow participants to skip the IIEF section if they wish to.

Changes made

Team added in the new feature: skip function.

UAT 2

What our client gave was the internationally validated IPSS in 3 different languages. However for IIEF, the only internationally validated language is in English.
We conducted user testing with 35 elders. Of those who attempted IIEF, most of them were unable to attempt IIEF independently as they do not understand English.
Due to this, team realized that it would be better to provide the participants with a more holistic questionnaire experience.
Change request started and at the end, the clients allowed us to include the Chinese IIEF despite it not being validated internationally.

Changes made

Team added in the Chinese IIEF.

UAT 3

We conducted user testing with 30 elders.

Results

# Task Result
1 Participants should be able to complete the questionnaires. Passed
2 Participants should be able to find his IPSS score. Passed


UAT(Elder).JPG

Goals Target Average Score UAT 1 - Average Score UAT 2 - Average Score UAT 3 - Average Score Improvements?Target Achieved?
Participants should find it easy to complete the questionnaires. >=3 3.67 4.14 4.13 Achieved improvements and achieved target score
Participants should find it easy to interpret the summary page. >=3 3.87 4.06 4.10 Achieved improvements and achieved target score
Participants should find the design of the application aesthetically pleasing. >=3 3.93 4.09 4.10 Achieved improvements and achieved target score

Overall feedback and comments

Simple and easy to use
Some still prefer verbal communication
Fat finger problems

Alpha Bottom.jpg