HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2018T1 R&I Documentation: User Testing 7"

From IS480
Jump to navigation Jump to search
Line 71: Line 71:
 
<p>
 
<p>
 
<b>Venue:</b> SIS GSR 3-1 <br/>
 
<b>Venue:</b> SIS GSR 3-1 <br/>
<b>Date:</b> 22th May 2019 - 24th May 2019<br/>
+
<b>Date:</b> 23th July 2019 - 25th July 2019<br/>
 
<b>Duration:</b> ~ 30 minutes per user<br/>
 
<b>Duration:</b> ~ 30 minutes per user<br/>
<b>Participant Demographics:</b> 6 SMU students <br/>
+
<b>Participant Demographics:</b> 12 SMU students <br/>
<b>Test Script:</b> [https://wiki.smu.edu.sg/is480/img_auth.php/6/6a/R%26I_UT_6.pdf User Testing 6]  <br>
+
<b>Test Script:</b> [https://wiki.smu.edu.sg/is480/img_auth.php/f/fb/R%26I_UT_7.pdf User Testing 7]  <br>
 
<b>Responses:</b> [https://drive.google.com/drive/folders/1pIPBNtt3KMj6EZHSTvOqOLtHeaobEi1t?usp=sharing UT 7 Responses] <br><br/>
 
<b>Responses:</b> [https://drive.google.com/drive/folders/1pIPBNtt3KMj6EZHSTvOqOLtHeaobEi1t?usp=sharing UT 7 Responses] <br><br/>
  
Line 87: Line 87:
 
<li>Ensure there is proper error handling </li>
 
<li>Ensure there is proper error handling </li>
 
<li>Improve on the application based on the results </li>
 
<li>Improve on the application based on the results </li>
 +
<li>Ensure that there is no major bugs in the upcoming Ngee Ann Polytechic Lab Session and ISUS610 Lab Session (X-Factor) </li>
 
</p>
 
</p>
 
</div>
 
</div>
Line 102: Line 103:
 
<p>
 
<p>
 
<ul>
 
<ul>
<b>Accounts Module</b>
+
<b>Gamification Module</b>
<li>View Transaction History</li>
+
<li>Able to trigger Pre-Quiz, Timed Quiz and Post-Quiz</li>
<li>Manage Personal Details</li>
+
<li>Scores are calculated and reflected</li>
<li>View Deposits and Loan Details</li>
 
 
</ul>
 
</ul>
 
</p>
 
</p>
Line 111: Line 111:
 
<p>
 
<p>
 
<ul>
 
<ul>
<b>Bill Payment Module</b>
+
<b>Wealth Portfolio Module</b>
<li>Add, edit and remove existing future bill payment</li>
+
<li>Check Stock Price</li>
<li>Authorise GIRO Payment to Organisation</li>
+
<li>Able to trigger the buying and selling of stocks.</li>
</ul>
 
</p>
 
 
 
<p>
 
<ul>
 
<b>Fund Transfer Module</b>
 
<li>Create Payee with 2FA</li>
 
<li>Add, edit and remove future or recurring fund transfer</li>
 
</ul>
 
</p>
 
 
 
<p>
 
<ul>
 
<b>Loan Module</b>
 
<li>Loan Calculator</li>
 
<li>Loan Application</li>
 
<li>Loan Full Repayment</li>
 
<li>Loan Partial Repayment</li>
 
 
</ul>
 
</ul>
 
</p>
 
</p>

Revision as of 00:11, 30 July 2019

R&I Fyplogo.PNG


HOME

ABOUT US

PROJECT OVERVIEW

PROJECT MANAGEMENT

DOCUMENTATION

User Testing




R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG
User Testing 1
User Testing 2
User Testing 3
User Testing 4
User Testing 5
User Testing 6
User Testing 7

Test Plan

Venue: SIS GSR 3-1
Date: 23th July 2019 - 25th July 2019
Duration: ~ 30 minutes per user
Participant Demographics: 12 SMU students
Test Script: User Testing 7
Responses: UT 7 Responses

Objectives

  • Gather the feedback regarding the usability of the error-prone functions the team has created
  • Observe how the users interact with our system
  • Ensure there is proper error handling
  • Improve on the application based on the results
  • Ensure that there is no major bugs in the upcoming Ngee Ann Polytechic Lab Session and ISUS610 Lab Session (X-Factor)
  • Scope

      Authentication Module
    • Login with 2FA and Group Id

      Gamification Module
    • Able to trigger Pre-Quiz, Timed Quiz and Post-Quiz
    • Scores are calculated and reflected

      Wealth Portfolio Module
    • Check Stock Price
    • Able to trigger the buying and selling of stocks.

    Procedure

    Participants were given a set of instructions to follow and complete the test cases. Participants were encouraged to note the estimated time taken for each task to complete the task. During the user testing, participants were encouraged to voice out any usability issues as they navigated through the test cases. Their feedback was noted. Participants were given a post-test questionnaire at the end of the testing to gauge their satisfaction.

    Results

    S/N Test Case Outcome
    1 Participants should be able to login with incorrect credentials and group Id with 2FA. An error message is shown. Successful.
    2 Participants should be able to login with correct credentials and group Id with 2FA. Successful.
    3 Participants should not be able to login to the application with wrong OTP. An error message is shown. Successful.
    4 Participants should be able to login to the application with correct OTP input. Successful.
    5 Participants should not be able to filter transactions in the months where there is no transaction occured. An error message is shown. Successful.
    6 Participants should not be able to add payee with an invalid account number. Successful.
    7 Participants should be able to add new payee with the correct CASA account and OTP input. Successful.
    8 Participants should not be able to make a fund transfer more than their remaining balance in the account. An error message is shown. Successful.
    9 Participants should be able to make a future transfer to payee created in test case 7. Successful.
    10 Participants should be able to edit a standing instruction. Unsuccessful, the standing instruction table is not updated.
    11 Participants should not be able for a loan with decimal place for loan term. An error message is shown. Successful.
    12 Participants should be able to apply for a loan. Successful.

    Key Findings

    Functions Users' Behaviour & Comments Proposed Changes
    Accounts Modules Transaction history part is a little cluttered and have to scroll to the side. Include more space at the side.
    Loan Module Show the minimum loan account pop-up message longer Include minimum loan account in the pop out message to ensure the users know it.
    Bill Payment Module Standing Instruction Page doesn’t appear upon creation. Make parsing variable names in component consistent for bill payment n fund transfer

    Overall Feedback

    Participants feel that the web interface is easy to use and minimalist design. However, rescaling cuts some of the words in the application and detailed pop out message is recommended.