Difference between revisions of "IS480 Team wiki: 2018T1 R&I Documentation: User Testing 7"
Line 71: | Line 71: | ||
<p> | <p> | ||
<b>Venue:</b> SIS GSR 3-1 <br/> | <b>Venue:</b> SIS GSR 3-1 <br/> | ||
− | <b>Date:</b> | + | <b>Date:</b> 23th July 2019 - 25th July 2019<br/> |
<b>Duration:</b> ~ 30 minutes per user<br/> | <b>Duration:</b> ~ 30 minutes per user<br/> | ||
− | <b>Participant Demographics:</b> | + | <b>Participant Demographics:</b> 12 SMU students <br/> |
− | <b>Test Script:</b> [https://wiki.smu.edu.sg/is480/img_auth.php/ | + | <b>Test Script:</b> [https://wiki.smu.edu.sg/is480/img_auth.php/f/fb/R%26I_UT_7.pdf User Testing 7] <br> |
<b>Responses:</b> [https://drive.google.com/drive/folders/1pIPBNtt3KMj6EZHSTvOqOLtHeaobEi1t?usp=sharing UT 7 Responses] <br><br/> | <b>Responses:</b> [https://drive.google.com/drive/folders/1pIPBNtt3KMj6EZHSTvOqOLtHeaobEi1t?usp=sharing UT 7 Responses] <br><br/> | ||
Line 87: | Line 87: | ||
<li>Ensure there is proper error handling </li> | <li>Ensure there is proper error handling </li> | ||
<li>Improve on the application based on the results </li> | <li>Improve on the application based on the results </li> | ||
+ | <li>Ensure that there is no major bugs in the upcoming Ngee Ann Polytechic Lab Session and ISUS610 Lab Session (X-Factor) </li> | ||
</p> | </p> | ||
</div> | </div> | ||
Line 102: | Line 103: | ||
<p> | <p> | ||
<ul> | <ul> | ||
− | <b> | + | <b>Gamification Module</b> |
− | <li> | + | <li>Able to trigger Pre-Quiz, Timed Quiz and Post-Quiz</li> |
− | + | <li>Scores are calculated and reflected</li> | |
− | <li> | ||
</ul> | </ul> | ||
</p> | </p> | ||
Line 111: | Line 111: | ||
<p> | <p> | ||
<ul> | <ul> | ||
− | <b> | + | <b>Wealth Portfolio Module</b> |
− | <li> | + | <li>Check Stock Price</li> |
− | <li> | + | <li>Able to trigger the buying and selling of stocks.</li> |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
</ul> | </ul> | ||
</p> | </p> |
Revision as of 00:11, 30 July 2019
User Testing
|
Test Plan
Venue: SIS GSR 3-1
Date: 23th July 2019 - 25th July 2019
Duration: ~ 30 minutes per user
Participant Demographics: 12 SMU students
Test Script: User Testing 7
Responses: UT 7 Responses
Objectives
Scope
-
Authentication Module
- Login with 2FA and Group Id
-
Gamification Module
- Able to trigger Pre-Quiz, Timed Quiz and Post-Quiz
- Scores are calculated and reflected
-
Wealth Portfolio Module
- Check Stock Price
- Able to trigger the buying and selling of stocks.
Procedure
Participants were given a set of instructions to follow and complete the test cases. Participants were encouraged to note the estimated time taken for each task to complete the task. During the user testing, participants were encouraged to voice out any usability issues as they navigated through the test cases. Their feedback was noted. Participants were given a post-test questionnaire at the end of the testing to gauge their satisfaction.
Results
S/N | Test Case | Outcome |
---|---|---|
1 | Participants should be able to login with incorrect credentials and group Id with 2FA. An error message is shown. | Successful. |
2 | Participants should be able to login with correct credentials and group Id with 2FA. | Successful. |
3 | Participants should not be able to login to the application with wrong OTP. An error message is shown. | Successful. |
4 | Participants should be able to login to the application with correct OTP input. | Successful. |
5 | Participants should not be able to filter transactions in the months where there is no transaction occured. An error message is shown. | Successful. |
6 | Participants should not be able to add payee with an invalid account number. | Successful. |
7 | Participants should be able to add new payee with the correct CASA account and OTP input. | Successful. |
8 | Participants should not be able to make a fund transfer more than their remaining balance in the account. An error message is shown. | Successful. |
9 | Participants should be able to make a future transfer to payee created in test case 7. | Successful. |
10 | Participants should be able to edit a standing instruction. | Unsuccessful, the standing instruction table is not updated. |
11 | Participants should not be able for a loan with decimal place for loan term. An error message is shown. | Successful. |
12 | Participants should be able to apply for a loan. | Successful. |
Key Findings
Functions | Users' Behaviour & Comments | Proposed Changes |
---|---|---|
Accounts Modules | Transaction history part is a little cluttered and have to scroll to the side. | Include more space at the side. |
Loan Module | Show the minimum loan account pop-up message longer | Include minimum loan account in the pop out message to ensure the users know it. |
Bill Payment Module | Standing Instruction Page doesn’t appear upon creation. | Make parsing variable names in component consistent for bill payment n fund transfer |
Overall Feedback
Participants feel that the web interface is easy to use and minimalist design. However, rescaling cuts some of the words in the application and detailed pop out message is recommended.