Difference between revisions of "IS480 Team wiki:2018T1 FORD USER TESTING"
Jump to navigation
Jump to search
Line 241: | Line 241: | ||
<p> | <p> | ||
<ul> | <ul> | ||
− | <li>The admin portal is fully functioning with 0 bug detected.</li> | + | <li>The admin portal is fully functioning with 0 bug detected. Its performance meets the expectation of the clients.</li> |
− | <li> | + | <li>Minor user experience issues are identified for chatbot, and the accuracy rate can be further improved. These changes will be discussed and implemented during the following iterations.</li> |
</ul> | </ul> | ||
</p> | </p> | ||
</div> | </div> |
Revision as of 18:09, 8 October 2018
Contents
UAT 1
Testing Plan
- Date:6 Aug 2018
- Iteration:5
- Location: PSA Help Desk Office
- Participants: 6 PSA help desk staff
- Testing system: Windows
- Testing browser: Google Chrome
Objectives
- To test all the developed functionalities for both chatbot and dashboard
- To test the accuracy rate of the chatbot
- To test whether the functionalities and user experience meet expectations of the clients
Scope
Chatbot | Admin Portal |
---|---|
Portnet Related | Authentication |
Enquiries | Dashboard - Hits Analysis |
API Module | Dashboard - Category Analysis |
Account Management - Change Password | |
Account Management - Add New User | |
Data Management - Bootstrap |
Test Instruction Form
Key Comments Raised by the Help Desk Staff
Chatbot | Chatbot logic need to be improved to handle some corner questions, such as specific error code. |
---|---|
Admin Portal | Dashboard should be more informative, eg dual axis for hit analysis graph
Time frame filtering function should be added, which allows users to filter by day, week, month |
Overall Result
- The admin portal is fully functioning with 0 bug detected.
- There are minor logic errors found for chatbot, which will be fixed during next iteration.
UAT 2
Testing Plan
- Date:27 September 2018 - 1 October
- Iteration:9
- Location: PSA Help Desk Office
- Participants: 6 PSA help desk staff
- Testing system: Windows
- Testing browser: Google Chrome
Objectives
- To test all the developed functionalities for both Chatbot and dashboard
- To test the accuracy rate of the Chatbot
- To test whether the functionalities and user experience meet the expectations of the clients
Scope
Chatbot | Admin Portal |
---|---|
Portnet Related | Authentication |
Enquiries | Dashboard - Hits Analysis |
API Module | Dashboard - Category Analysis |
Account Management - Change Password | |
Account Management - Add New User | |
Data Management - Bootstrap |
Test Instruction Form
Key Comments Raised by the Help Desk Staff
Chatbot | Chatbot logic need to be improved to handle some corner questions, such as specific error code. |
---|---|
Admin Portal | Dashboard should be more informative, eg dual axis for hit analysis graph
Time frame filtering function should be added, which allows users to filter by day, week, month |
Overall Result
- The admin portal is fully functioning with 0 bug detected. Its performance meets the expectation of the clients.
- Minor user experience issues are identified for chatbot, and the accuracy rate can be further improved. These changes will be discussed and implemented during the following iterations.