Difference between revisions of "IS480 Team wiki:2018T1 FORD USER TESTING"
Jump to navigation
Jump to search
Line 137: | Line 137: | ||
|- | |- | ||
! style="color:#ecf0f1; background-color:#FF7504;" width="200pt" | Admin Portal | ! style="color:#ecf0f1; background-color:#FF7504;" width="200pt" | Admin Portal | ||
− | |style="text-align: left;"| Dashboard should be more informative, eg dual axis for hit analysis graph | + | |style="text-align: left;"| 1. Dashboard should be more informative, eg dual axis for hit analysis graph |
− | Time frame filtering function should be added, which allows users to filter by day, week, | + | 2. Time frame filtering function should be added, which allows users to filter by day, week, year |
|- | |- | ||
|} | |} |
Revision as of 18:18, 8 October 2018
Contents
UAT 1
Testing Plan
- Date:6 Aug 2018
- Iteration:5
- Location: PSA Help Desk Office
- Participants: 6 PSA help desk staff
- Testing system: Windows
- Testing browser: Google Chrome
Objectives
- To test all the developed functionalities for both chatbot and dashboard
- To test the accuracy rate of the chatbot
- To test whether the functionalities and user experience meet expectations of the clients
Scope
Chatbot | Admin Portal |
---|---|
Portnet Related | Authentication |
Enquiries | Dashboard - Hits Analysis |
API Module | Dashboard - Category Analysis |
Account Management - Change Password | |
Account Management - Add New User | |
Data Management - Bootstrap |
Test Instruction Form
Key Comments Raised by the Help Desk Staff
Chatbot | Chatbot logic need to be improved to handle some corner questions, such as specific error code. |
---|---|
Admin Portal | 1. Dashboard should be more informative, eg dual axis for hit analysis graph
2. Time frame filtering function should be added, which allows users to filter by day, week, year |
Overall Result
- The admin portal is fully functioning with 0 bug detected.
- There are minor logic errors found for chatbot, which will be fixed during next iteration.
UAT 2
Testing Plan
- Date:27 September 2018 - 1 October
- Iteration:9
- Location: PSA Help Desk Office
- Participants: 6 PSA help desk staff
- Testing system: Windows
- Testing browser: Google Chrome
Objectives
- To test all the developed functionalities for both Chatbot and dashboard
- To test the accuracy rate of the Chatbot
- To test whether the functionalities and user experience meet the expectations of the clients
Scope
Chatbot | Admin Portal |
---|---|
Portnet Related | Authentication |
Enquiries | Dashboard - Hits Analysis |
API Module | Dashboard - Category Analysis |
Account Management - Change Password | |
Account Management - Add New User | |
Data Management - Bootstrap |
Test Instruction Form
Key Comments Raised by the Help Desk Staff
Chatbot | 1. User guide should be opened in a new tab instead of the original page, since the original user guide page contains the chat history 2. Submission of the feedback should not refresh the chatbot page, which will clear the chat history 3. The Chatbot did not provide the answer for some of the testers’ queries |
---|---|
Admin Portal | 1. Dashboard should be more informative, eg dual axis for hit analysis graph 2. Time frame filtering function should be added, which allows users to filter by day, week, year |
Overall Result
- The admin portal is fully functioning with 0 bug detected. Its performance meets the expectation of the clients.
- Minor user experience issues are identified for chatbot, and the accuracy rate can be further improved. These changes will be discussed and implemented during the following iterations.