IS480 Team wiki: 2018T1 R&I Documentation: User Testing 5
User Testing
|
Test Plan
Venue: SIS SR 2-3
Date: 05th April 2019
Duration: ~ 60 minutes per user
Participant Demographics: 20 SMU students
Test Script: User Testing 5
Responses: UT5 Reponses
Objectives
Scope
-
Authentication Module
- Login with 2FA and Group Id
-
Accounts Module
- View Transaction History
- Manage Personal Details
- View Deposits and Loan Details
-
Dual Currency Deposit Module with Gamification Module
- Easy Conversion of currencies
- Create and Edit Dual Currency Accounts
- Dual Currency Deposit Teaching Material and Quiz
- Leadership Board
-
Bill Payment Module
- Add, edit and remove existing future bill payment
- Authorise GIRO Payment to Organisation
-
Fund Transfer Module
- Create Payee with 2FA
- Add, edit and remove future or recurring fund transfer
-
Loan Module
- Loan Calculator
- Loan Application
- Loan Full Repayment
- Loan Partial Repayment
-
Customer Preferences Module
- Notification & Trigger Settings
- Update customer interests
Procedure
Participants were given a set of instructions to follow and complete the test cases. Participants were encouraged to note the estimated time taken for each task to complete the task. During the user testing, participants were encouraged to voice out any usability issues as they navigated through the test cases. Their feedback was noted. Participants were given a post-test questionnaire at the end of the testing to gauge their satisfaction.
Results
S/N | Test Case | Outcome |
---|---|---|
1 | Participants should be able to login with correct credentials and group Id with 2FA | Successful. |
2 | Participants should be able to add a new payee. | Successful. |
3 | Participants should be able to perform a immediate fund transfer to payee. | Successful. |
4 | Participants should be able to perform a future fund transfer to payee. | Successful. |
5 | Participants should be able to delete payee. | Successful. |
6 | Participants should be able to make a immediate payment to a billing organisation. | Successful. |
7 | Participants should be able to make a future payment to a billing organisation. | Successful. |
8 | Participants should be able to make a GIRO payment to a billing organisation. | Successful. |
9 | Participants should be able to edit a standing instruction. | Successful. |
10 | Participants should be able to delete a standing instruction. | Unsuccessful, due to slow loading time. |
11 | Participants should be able to delete a GIRO payment. | Successful. |
12 | Participants should be able to apply for a loan. | Successful. |
13 | Participants should be able to perform a partial repayment on the loan account. | Successful. |
14 | Participants should be able to perform a full repayment on the loan account. | Unsuccessful, due to insufficient fund in the account |
15 | Participants should be able to create a new DCD account and understand the teaching material. | Successful. |
16 | Participants should be able to edit an existing DCD accounts and completed the quiz successfully. | Successful. |
17 | Participants should be able to update notification triggers options | Successful. |
18 | Participants should be able to update their interests | Successful. |
19 | Participants should be able to view group score and individual score on the scoreboard | Successful. |
20 | Participants should be able to view the leadership for any date range selected | Successful. |
Key Findings
Functions | Users' Behaviour & Comments | Proposed Changes |
---|---|---|
Overall | Would prefer to a more human readable error (currently is in JSON) | Replace with human readable error |
Overall | Change grid sizes. | Make the web application more responsive according to scalability |
Loan Module | Might want to put a restriction on the numbers input | Set a data validation rule for minimum and maximum amount |
Loan Module | If repayment has been rejected due to insufficient fund, don’t show the make repayment button again. | Repayment button is not shown when payment is rejected |
Loan Module | If repayment has been rejected due to insufficient fund, don’t show the make repayment button again. | Repayment button is not shown when payment is rejected |
Fund Transfer | Might want to block out past dates like the bill payment page | Repayment button is not shown when payment is rejected |
Gamification Module | The quiz result doesn’t update my individual score at the top right. | Score is reflected based on the latest quiz score |
Bill Payment Module | Standing Instruction Page doesn’t appear upon creation. | Make parsing variable names in component consistent for bill payment n fund transfer |
Overall Feedback
Participants feel that the web interface is easy to use and minimalist design. However, error message must be human-readable. The client is satisfied with the overall look of the UI and looks forward to the improved web application.