HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2017T2 Alpha UAT2"

From IS480
Jump to navigation Jump to search
(edited the tasks)
Line 46: Line 46:
  
 
|}
 
|}
 +
 +
 +
==Test Plan==
 +
Venue: Conference room at the urology center at SGH<br>
 +
Date: 12/4/2018<br>
 +
Time: 9pm - 3pm<br>
 +
Duration: around 15 minutes each<br>
 +
Number of participants: 6 <br>
 +
 +
*We liaised with our clients to recruit our participants - doctors who are working in the urology center at SGH. <br>
 +
 +
==Objectives==
 +
1. Gather feedback on the web application based on the developed functionalities<br>
 +
2. To determine the usability of the web application
 +
 +
==Tasks==
 
<center>
 
<center>
 +
For this user testing, the doctors have to attempt the 8 tasks as shown below:<br><br>
 +
1. Login with the following details as shown below.<br>
 +
Username: TestDoc01 <br>
 +
Password: @TestDoc123!
 +
<br><br>
 +
2. You are a doctor and patient S9876543A has entered your consultation room. <br>
 +
View Patient S9876543A’s IPSS, VAUS and IIEF score. Write it down in the box below.
 +
<br><br>
 +
3. Your patient S9876543A came last week and you would like to review his past records. Write down the IPSS value he took on 16/2/17. <br>
 +
<br>
 +
4. During your break, you would like to view U3022’s latest test results. Write down U3022’s IPSS score. <br>
 +
<br>
 +
5. During your free time in the consultation room, you would like to view the correlation between the questionnaires and age from the 1009 records that have been collected previously. Write down the Age vs IPSS’s analysis result and its corresponding R value. <br>
 +
<br>
 +
6. Patients in the clinic have been using the iPad to complete the questionnaires. As a doctor, you would like to know some insights regarding the data collected for analysis.  <br>
 +
<br>
 +
6a. As a doctor, you would like to have an idea on the average total time taken for people who attempted all 3 questionnaires (IPSS, VAUS and IIEF). Write down the average total time taken for a patient to complete all 3 questionnaires.  <br>
 +
<br>
 +
6b. As IPSS has a total of 8 questions, you would like to know which questions patients usually spend more time on. This is so that doctors can inform nurses to take note after the patients begin the questionnaires. For IIEF, write down the question number(s) in which the average timing spent is above the average. <br>
 +
<br>
 +
6c. You would like to know which age group of patients the nurses should pay more attention to during normal clinical hours. Write down which age group of patients spend the most time completing IPSS.  <br>
 +
<br>
 +
</center>
 +
 +
==Goals==
 +
1.Participants should find it easy to retrieve a patient's results to understand his condition.<br>
 +
a) (quantitative, question) "How easy do you think the web application is for retrieving a patient’s results (uroflow result, IPSS, VAUS and IIEF) to understand his condition" (scale of 1 to 5)(target:average 3 or higher)<br>
 +
b) (qualitative, question) provide an explanation for the choice of rating
 +
<br><br>
 +
2.Participants should be able to interpret the database display quickly.<br>
 +
a) (quantitative, question) "How intuitive do you find the web application for reviewing a patient’s latest and past records? " (scale of 1 to 5)(target:average 3 or higher) <br>
 +
b) (qualitative, question) provide an explanation for the choice of rating<br>
 +
c) (quantitative, observation) time taken to complete the task
 +
<br><br>
 +
3.Participants should find the design of the application aesthetically pleasing.<br>
 +
a) (quantitative, question) "How do you find the aesthetic design of the web application? " (scale of 1 to 5)(target:average 3 or higher) <br>
 +
b) (qualitative, question) provide an explanation for the choice of rating
 +
 +
==Results==
 +
{| border="1"
 +
|- style="background:blue; color:white"
 +
||#
 +
|Task
 +
|Result
 +
|-
 +
 +
||1
 +
|Participants should be able to login.
 +
|Passed
 +
|-
 +
 +
||2
 +
|Participants should be able to view patient's questionnaires score.
 +
|Passed
 +
|-
 +
 +
||3
 +
|Participants should be able to review patient's past records.
 +
|Passed
 +
|-
 +
|}
 +
 +
<br>
 +
[[File:UAT(Doctor).JPG]]
 +
<br>
 +
 +
 +
{| border="1"
 +
|- style="background:blue; color:white"
 +
||Goals
 +
|Average Score
 +
|Target Average Score
 +
|Target Achieved?
 +
|-
 +
 +
|| Participants should find it easy to retrieve a patient's results.
 +
|| 3.75
 +
|| >= 4
 +
|| Missed target score by 0.25; seek feedback on reason and areas of improvement
 +
|-
 +
 +
|| Participants should be able to interpret the database display quickly
 +
|| 3.75
 +
|| >= 4
 +
|| Missed target score by 0.25; seek feedback on reason and areas of improvement
 +
|-
 +
 +
||Participants should find the design of the application aesthetically pleasing
 +
|| 4.25
 +
|| >=4
 +
|| Design of the app has achieved and exceeded our target
 +
|-
 +
|}
 +
 +
==Feedback/Comments==
 +
General feedback: <br>
 +
1) Web interface design is good.<br>
 +
2) Correlations & analytics are meant for research teams rather than doctors. <br>
  
 +
Specific comments: <br>
 +
1) Summarize points  to view everything on one glance. <br>
 +
2) Displaying of data could be better positioned. <br>
 +
3) Line chart not intuitive to use. <br>
 +
|}
  
 
[[File:Alpha Bottom.jpg|center|1000px]]
 
[[File:Alpha Bottom.jpg|center|1000px]]

Revision as of 12:45, 15 April 2018

AlphaLogoHeader.jpg
HOME OUR TEAM PROJECT OVERVIEW PROJECT MANAGEMENT DOCUMENTATION
DIAGRAMS DESIGN USER TESTING MEETING MINUTES DELIVERABLES
Alpha User testing.jpg
UAT 1 UAT 2
For finals, we have conducted user acceptance test on our web application.

The table below shows the actual user acceptance test that we have conducted:

User group Is it planned? If yes, how many? Actual number we achieved Comment
Doctors working in the urology center at SGH Yes, planned. 3 6 Achieved and exceeded the number of planned participants


Test Plan

Venue: Conference room at the urology center at SGH
Date: 12/4/2018
Time: 9pm - 3pm
Duration: around 15 minutes each
Number of participants: 6

  • We liaised with our clients to recruit our participants - doctors who are working in the urology center at SGH.

Objectives

1. Gather feedback on the web application based on the developed functionalities
2. To determine the usability of the web application

Tasks

For this user testing, the doctors have to attempt the 8 tasks as shown below:

1. Login with the following details as shown below.
Username: TestDoc01
Password: @TestDoc123!

2. You are a doctor and patient S9876543A has entered your consultation room.
View Patient S9876543A’s IPSS, VAUS and IIEF score. Write it down in the box below.

3. Your patient S9876543A came last week and you would like to review his past records. Write down the IPSS value he took on 16/2/17.

4. During your break, you would like to view U3022’s latest test results. Write down U3022’s IPSS score.

5. During your free time in the consultation room, you would like to view the correlation between the questionnaires and age from the 1009 records that have been collected previously. Write down the Age vs IPSS’s analysis result and its corresponding R value.

6. Patients in the clinic have been using the iPad to complete the questionnaires. As a doctor, you would like to know some insights regarding the data collected for analysis.

6a. As a doctor, you would like to have an idea on the average total time taken for people who attempted all 3 questionnaires (IPSS, VAUS and IIEF). Write down the average total time taken for a patient to complete all 3 questionnaires.

6b. As IPSS has a total of 8 questions, you would like to know which questions patients usually spend more time on. This is so that doctors can inform nurses to take note after the patients begin the questionnaires. For IIEF, write down the question number(s) in which the average timing spent is above the average.

6c. You would like to know which age group of patients the nurses should pay more attention to during normal clinical hours. Write down which age group of patients spend the most time completing IPSS.

Goals

1.Participants should find it easy to retrieve a patient's results to understand his condition.
a) (quantitative, question) "How easy do you think the web application is for retrieving a patient’s results (uroflow result, IPSS, VAUS and IIEF) to understand his condition" (scale of 1 to 5)(target:average 3 or higher)
b) (qualitative, question) provide an explanation for the choice of rating

2.Participants should be able to interpret the database display quickly.
a) (quantitative, question) "How intuitive do you find the web application for reviewing a patient’s latest and past records? " (scale of 1 to 5)(target:average 3 or higher)
b) (qualitative, question) provide an explanation for the choice of rating
c) (quantitative, observation) time taken to complete the task

3.Participants should find the design of the application aesthetically pleasing.
a) (quantitative, question) "How do you find the aesthetic design of the web application? " (scale of 1 to 5)(target:average 3 or higher)
b) (qualitative, question) provide an explanation for the choice of rating

Results

# Task Result
1 Participants should be able to login. Passed
2 Participants should be able to view patient's questionnaires score. Passed
3 Participants should be able to review patient's past records. Passed


UAT(Doctor).JPG


Goals Average Score Target Average Score Target Achieved?
Participants should find it easy to retrieve a patient's results. 3.75 >= 4 Missed target score by 0.25; seek feedback on reason and areas of improvement
Participants should be able to interpret the database display quickly 3.75 >= 4 Missed target score by 0.25; seek feedback on reason and areas of improvement
Participants should find the design of the application aesthetically pleasing 4.25 >=4 Design of the app has achieved and exceeded our target

Feedback/Comments

General feedback:
1) Web interface design is good.
2) Correlations & analytics are meant for research teams rather than doctors.

Specific comments:
1) Summarize points to view everything on one glance.
2) Displaying of data could be better positioned.
3) Line chart not intuitive to use.

Alpha Bottom.jpg