IS480 Team wiki: 2015T2 Creovate User Test
Home | About Us | Project Overview | Project Management | Project Documentation |
Technical Diagrams | UI Mockups | UAT | Meeting Minutes |
UAT1
Test Information
Date: 2014.12.11
Vanue: TWC2 Office
Number of users: 7
Duration: 3 hours
Scope of testing: create case, search worker, view/edit/add worker, job, problem complements, view/edit/add benefactions, add new job to existing worker, add new problem to existing job, view/edit worker, job, problem profile
Objectives: (1). detect usability issues based on user behavior, (2). gather feedback regarding user interface of the application, (3). use UAT results as a reference to futher improvethe application
Test Result
Positve feedbacks:
(1). Create case progress bar is useful
(2). Navigation is clear and app is easy to use
Other general feedbacks
(1). Add side bar menu so that new items can be added easily
(2). Date format are not standardized
(3). Response time is too long
UAT2
Test Information
Date: 2015.01.22
Vanue: SIS GSR 3.3
Number of users: 8. 3 administrators and 5 specialists
Duration: 3 hours
Scope of testing: create case, search worker, view/edit/add worker, job, problem complements, view/edit/add benefactions, add new job to existing worker, add new problem to existing job, view/edit worker, job problem profile, attachment management, case referral
admin functions:
user management, dropdown setting, audit log
Objectives: (1). detect usability issues based on user behavior, (2). gather feedback regarding user interface of the application, (3). test administrator functions, (4). use UAT results as a reference to futher improvethe application
Test Result
Quantitative Feedback
Comparison between UAT1 and UAT2:
Qualitative feedback
Positve feedbacks:
(1). imporved user iterface is simple and clean
(2). much fewer bugs comparing to UAT1
Other general feedbacks
(1). there are some problems regarding form validation
(2). better add notification after an action is done
(3). administrator should be able to delete the record
UAT3
Test Information
Date: 2015.03.12
Vanue: TWC2 Office
Number of users: 10. 3 administrators and 7 associates
Duration: 3 hours
Scope of testing: create case, add new job/problem, view case summary, search worker, review/issue benefits, view history of benefits, add/view complements, refer case, profile management
Objectives: (1). detect usability issues based on user behavior, (2). gather feedback regarding user interface of the application, (3). use UAT results as a reference to futher improvethe application
Test Result
Quantitative Feedback
Qualitative feedback
Positve feedbacks:
(1). Easy to use and navigate
(2). Admin dashboard is useful
Other general feedbacks
(1). Notifications are not in the same format
(2). Better be no case sensitive when searching worker FIN number
(3). List of R2R appointment should be ordered according to date
Student Testing 1
Test Information
Date: 2015.01.19
Vanue: SIS GSR 2.5
Number of users: 10
Duration: half an hour for each tester
Scope of testing: create case, search worker, view/edit/add worker, job, problem complements, view/edit/add benefactions, add new job to existing worker, add new problem to existing job, view/edit worker, job problem profile, upload attachment, case referral;
admin functions:
user management, dropdown setting
Objectives: (1). detect usability issues based on user behavior, (2). gather feedback from non-business people regarding user interface of the application, (3). test administrator functions, (4). use UAT results as a reference to futher improvethe application
Test Result
Quantitative Feedback
Qualitative feedback
Positve feedbacks:
(1). internface is simple and easy to understand
(2). instructions are clear
Other general feedbacks
(1). reponse time is too long
(2). display for dropdown list setting is a bit messy
Student Testing 2
Test Information
Date: 2015.03.20
Vanue: SMU Campus
Number of users: 20 students as associates
Duration: 20 minutes for each tester
Scope of testing: create case, add new job/problem, view case summary, search worker, review/issue benefits, view history of benefits, add/view complements, refer case, profile management
Objectives: (1). detect usability issues based on user behavior, (2). gather feedback from non-business people regarding user interface of the application, (3). use UAT results as a reference to further improve the application
Test Result
Quantitative Feedback
Qualitative feedback
Positve feedbacks:
(1). Search function is easy to use
(2). Dialogue popup is very helpful
Other general feedbacks
(1). Notification is not clear for refer case
(2). Back Button is not very obvious
(3). Better categorize content of case summary to make it clearer for user