HeaderSIS.jpg

IS480 Team wiki: 2015T2 Creovate User Test

From IS480
Jump to navigation Jump to search

Creovate.JPG

HomeButton.png Home Aboutus.png About Us Glyphicons 042 pie chart.png Project Overview Calendaricon.png Project Management Tableicon.png Project Documentation


Technical Diagrams UI Mockups UAT Meeting Minutes



UAT1

Test Information

Date: 2014.12.11
Vanue: TWC2 Office
Number of users: 7
Duration: 3 hours
Scope of testing: create case, search worker, view/edit/add worker, job, problem complements, view/edit/add benefactions, add new job to existing worker, add new problem to existing job, view/edit worker, job, problem profile
Objectives: (1). detect usability issues based on user behavior, (2). gather feedback regarding user interface of the application, (3). use UAT results as a reference to futher improvethe application

Test Result

Positve feedbacks:
(1). Create case progress bar is useful
(2). Navigation is clear and app is easy to use

Other general feedbacks
(1). Add side bar menu so that new items can be added easily
(2). Date format are not standardized
(3). Response time is too long

UAT2

Test Information

Date: 2015.01.22
Vanue: SIS GSR 3.3
Number of users: 8. 3 administrators and 5 specialists
Duration: 3 hours
Scope of testing: create case, search worker, view/edit/add worker, job, problem complements, view/edit/add benefactions, add new job to existing worker, add new problem to existing job, view/edit worker, job problem profile, attachment management, case referral

admin functions:

user management, dropdown setting, audit log
Objectives: (1). detect usability issues based on user behavior, (2). gather feedback regarding user interface of the application, (3). test administrator functions, (4). use UAT results as a reference to futher improvethe application

Test Result

Quantitative Feedback

Comparison between UAT1 and UAT2:

Bug score-UAT2.PNG Impact distribution of bug-UAT2.PNG
No of bugs-UAT2.PNG



Ranking-UAT2.PNG
Time taken-UAT2.PNG

Qualitative feedback

Positve feedbacks:
(1). imporved user iterface is simple and clean
(2). much fewer bugs comparing to UAT1

Other general feedbacks
(1). there are some problems regarding form validation
(2). better add notification after an action is done
(3). administrator should be able to delete the record

UAT3

Test Information

Date: 2015.03.12
Vanue: TWC2 Office
Number of users: 10. 3 administrators and 7 associates
Duration: 3 hours
Scope of testing: create case, add new job/problem, view case summary, search worker, review/issue benefits, view history of benefits, add/view complements, refer case, profile management
Objectives: (1). detect usability issues based on user behavior, (2). gather feedback regarding user interface of the application, (3). use UAT results as a reference to futher improvethe application

Test Result

Quantitative Feedback

Rating-UAT3.png

Qualitative feedback

Positve feedbacks:
(1). Easy to use and navigate
(2). Admin dashboard is useful

Other general feedbacks
(1). Notifications are not in the same format
(2). Better be no case sensitive when searching worker FIN number
(3). List of R2R appointment should be ordered according to date

Student Testing 1

Test Information

Date: 2015.01.19
Vanue: SIS GSR 2.5
Number of users: 10
Duration: half an hour for each tester
Scope of testing: create case, search worker, view/edit/add worker, job, problem complements, view/edit/add benefactions, add new job to existing worker, add new problem to existing job, view/edit worker, job problem profile, upload attachment, case referral;

admin functions:

user management, dropdown setting

Objectives: (1). detect usability issues based on user behavior, (2). gather feedback from non-business people regarding user interface of the application, (3). test administrator functions, (4). use UAT results as a reference to futher improvethe application

Test Result

Quantitative Feedback

Ranking-st.PNG Time taken-st.PNG

Qualitative feedback

Positve feedbacks:
(1). internface is simple and easy to understand
(2). instructions are clear
Other general feedbacks
(1). reponse time is too long
(2). display for dropdown list setting is a bit messy

Student Testing 2

Test Information

Date: 2015.03.20
Vanue: SMU Campus
Number of users: 20 students as associates
Duration: 20 minutes for each tester
Scope of testing: create case, add new job/problem, view case summary, search worker, review/issue benefits, view history of benefits, add/view complements, refer case, profile management

Objectives: (1). detect usability issues based on user behavior, (2). gather feedback from non-business people regarding user interface of the application, (3). use UAT results as a reference to further improve the application

Test Result

Quantitative Feedback

Creovate student test2 results.png

Qualitative feedback

Positve feedbacks:
(1). Search function is easy to use
(2). Dialogue popup is very helpful
Other general feedbacks
(1). Notification is not clear for refer case
(2). Back Button is not very obvious
(3). Better categorize content of case summary to make it clearer for user