HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2018T1 R&I Documentation: User Testing 3"

From IS480
Jump to navigation Jump to search
 
(18 intermediate revisions by 2 users not shown)
Line 55: Line 55:
 
|[[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 1]]  
 
|[[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 1]]  
 
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 2]]  
 
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 2]]  
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Acceptance 1]]
 
 
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 3]]  
 
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 3]]  
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Acceptance 2]]
 
 
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 4]]  
 
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 4]]  
 +
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 5]]
 +
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 6]]
 +
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 7]]
 +
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 8]]
 
|-
 
|-
|</center><center><font color:#E2B6AA face= "kollektif">User Testing 1</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 2</font></center> || <center><font color:#E2B6AA face= "kollektif">User Acceptance Testing 1</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 3</font></center> || <center><font color:#E2B6AA face= "kollektif">User Acceptance Test 2</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 4</font></center> ||||  
+
|</center><center><font color:#E2B6AA face= "kollektif">User Testing 1</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 2</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 3</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 4</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 5</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 6</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 7</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 8</font></center> ||  
 
|}
 
|}
 
<!--Content End-->
 
<!--Content End-->
Line 69: Line 71:
 
<div style="font-family: Calibri;">
 
<div style="font-family: Calibri;">
 
<p>
 
<p>
<b>Venue:</b> LKS PR 4-16 <br/>
+
<b>Venue:</b> SIS SR 2-3 <br/>
<b>Date:</b> 29th March 2019<br/>
+
<b>Date:</b> 15th Feb 2019<br/>
<b>Duration:</b> ~ 30 minutes per user<br/>
+
<b>Duration:</b> ~ 60 minutes per user<br/>
<b>Participant Demographics:</b> Professor Alan and 2 IS419 Students <br/>
+
<b>Participant Demographics:</b> 10 SIS Students <br/>
<b>Test Script:</b> [https://wiki.smu.edu.sg/is480/img_auth.php/3/31/R%26I_UT_3.pdf User Testing 3]  <br> <br/>
+
<b>Test Script:</b> [https://wiki.smu.edu.sg/is480/img_auth.php/f/f8/R%26I_UAT_1.pdf User Testing 3]  <br> <br/>
  
 
</p>
 
</p>
Line 81: Line 83:
 
<div style="font-family: Calibri">
 
<div style="font-family: Calibri">
 
<p>
 
<p>
<li>Gather the feedback regarding the usability of the all functions the team has created (Loan and Customer Preferences Module) </li>
+
<li>Gather the feedback regarding the usability of the all functions the team has created </li>
 
<li>Observe how the users interact with our system  </li>
 
<li>Observe how the users interact with our system  </li>
 
<li>Ensure no additional features have been overlooked </li>
 
<li>Ensure no additional features have been overlooked </li>
Line 92: Line 94:
 
<p>
 
<p>
 
<ul>
 
<ul>
<b>Loan Module</b>
+
<b>Authentication Module</b>
<li>Loan Calculator</li>
+
<li>Login with 2FA Authentication</li>
<li>Loan Application</li>
 
<li>Loan Full Repayment</li>
 
<li>Loan Partial Repayment</li>
 
 
</ul>
 
</ul>
 
</p>
 
</p>
Line 102: Line 101:
 
<p>
 
<p>
 
<ul>
 
<ul>
<b>Customer Preferences Module</b>
+
<b>Accounts Module</b>
<li>Notification & Trigger Settings</li>
+
<li>Manage Personal Details</li>
 +
<li>View Transaction History</li>
 +
</ul>
 +
</p>
 +
 
 +
<p>
 +
<ul>
 +
<b>Dual Currency Deposit Module</b>
 +
<li>Easy Conversion of currencies</li>
 +
<li>Manage Dual Currency Accounts</li>
 +
</ul>
 +
</p>
 +
 
 +
<p>
 +
<ul>
 +
<b>Bill Payment Module</b>
 +
<li>Immediate and Future Bill Payment</li>
 +
<li>Authorise GIRO Payment to Organisation</li>
 +
 
 +
</ul>
 +
</p>
 +
 
 +
<p>
 +
<ul>
 +
<b>Fund Transfer</b>
 +
<li>Create Payee with 2FA</li>
 +
<li>Immediate, Future and Recurring Fund Transfer</li>
 
</ul>
 
</ul>
 
</p>
 
</p>
Line 127: Line 152:
  
 
|style="text-align: center;"| 1
 
|style="text-align: center;"| 1
|style="text-align: left;"| Participants should be able to select any Loan Type from the dropdown list followed by entering an appropriate loan amount and loan term.
+
|style="text-align: left;"| Participants should be able to login with valid UserID and PIN
 
|style="text-align: left;"| Successful.   
 
|style="text-align: left;"| Successful.   
 
|-
 
|-
  
 
|style="text-align: center;"| 2
 
|style="text-align: center;"| 2
|style="text-align: left;"| Participants should be able to apply for loan.  
+
|style="text-align: left;"| Participants should not be able to login with invalid UserID and PIN and pop-up message is successfully displayed.
 
|style="text-align: left;"| Successful.  
 
|style="text-align: left;"| Successful.  
 
|-
 
|-
  
 
|style="text-align: center;"| 3
 
|style="text-align: center;"| 3
|style="text-align: left;"| Participants should be able to make full loan repayment.
+
|style="text-align: left;"| Participants should be able to create new DCD accounts with selected Base and Quoted Currency rate and pop-up message is successfully displayed.
|style="text-align: left;"| Successful.   
+
|style="text-align: left;"| Unsuccessful.   
 
|-
 
|-
  
 
|style="text-align: center;"| 4
 
|style="text-align: center;"| 4
|style="text-align: left;"| Participants should be able to make partial loan repayment.
+
|style="text-align: left;"| Participants should be able edit their accounts with up to three 3options for different accounts and pop-up message is successfully displayed.
 
|style="text-align: left;"| Successful.  
 
|style="text-align: left;"| Successful.  
 
|-
 
|-
  
 
|style="text-align: center;"| 5
 
|style="text-align: center;"| 5
|style="text-align: left;"| Participants should be able to Select the checkboxes accordingly to receive notifications.
+
|style="text-align: left;"| Participants should be able to view closed DCD accounts summary.
 +
|style="text-align: left;"| Successful.
 +
|-
 +
 
 +
|style="text-align: center;"| 6
 +
|style="text-align: left;"| Participants should be able to retrieve personal accounts details with valid userId and password. Else, a error message is displayed.
 +
|style="text-align: left;"| Successful for deposit accounts but, Unsuccessful for loan accounts.
 +
|-
 +
 
 +
|style="text-align: center;"| 7
 +
|style="text-align: left;"| Participants should be able to create payee with 2FA. Upon successful creation of payee, a pop out message is displayed.
 
|style="text-align: left;"| Successful.  
 
|style="text-align: left;"| Successful.  
 
|-
 
|-
  
 +
|style="text-align: center;"| 8
 +
|style="text-align: left;"| Participants should be able to transfer fund to newly created payee. Alert is displayed upon a successful transfer.
 +
|style="text-align: left;"| Successful.
 +
|-
 +
 +
|style="text-align: center;"| 9
 +
|style="text-align: left;"| Participants should be able to make future transfer fund to any payee. Alert is displayed upon a successful transfer.
 +
|style="text-align: left;"| Successful.
 +
|-
 +
 +
|style="text-align: center;"| 10
 +
|style="text-align: left;"| Participants should be able to make recurring transfer fund to any payee. Alert is displayed upon a successful transfer.
 +
|style="text-align: left;"| Successful.
 +
|-
 +
 +
|style="text-align: center;"| 11
 +
|style="text-align: left;"| Participants should be able to remove payee in the Fund Transfer Home page.
 +
|style="text-align: left;"| Successful.
 +
|-
 +
 +
|style="text-align: center;"| 12
 +
|style="text-align: left;"| Participants should be able to make an immediate transfer to any listed organisation. A summary page is displayed and confirm the transaction. After confirmation, an SMS and email will be sent to the user. 
 +
|style="text-align: left;"| Successful.
 +
|-
 +
 +
|style="text-align: center;"| 13
 +
|style="text-align: left;"| Participants should be able to make a future transfer to any listed organisation. A summary page is displayed and confirm the transaction.
 +
|style="text-align: left;"| Successful.
 +
|-
 +
 +
|style="text-align: center;"| 14
 +
|style="text-align: left;"| Participants should be able to view all future transaction in standing instruction tab.
 +
|style="text-align: left;"| Successful.
 +
|-
 +
 +
|style="text-align: center;"| 15
 +
|style="text-align: left;"| Participants should be able to enable the listed organisation for future GRIO authorisation. A summary page is displayed and confirm the transaction.
 +
|style="text-align: left;"| Successful.
 +
|-
 +
 +
|style="text-align: center;"| 16
 +
|style="text-align: left;"| Participants should be able to view all authorised GIRO transaction in GIRO authorisation tab.
 +
|style="text-align: left;"| Successful.
 +
|-
  
 
|}
 
|}
Line 165: Line 244:
 
|-
 
|-
  
|style="text-align: center;"| Loan Module
+
|style="text-align: center;"| Accounts Module
|style="text-align: left;"| Need to have better visualisation for loans
+
|style="text-align: left;"| Loan accounts did not show up but it is loading
|style="text-align: left;"| Include charts to display repayment, interest and monthly installment amounts
+
|style="text-align: left;"| Include loading percentage
  
 
|-
 
|-
|style="text-align: center;"| Loan Module
+
|style="text-align: center;"| Accounts Module
|style="text-align: left;"| The message prior to making repayment is misleading.
+
|style="text-align: left;"| Amounts to be shown beside the accounts ID
|style="text-align: left;"| Include appropriate message prior to repayment
+
|style="text-align: left;"| Include collapsible view of transaction history
 +
|-
 +
|style="text-align: center;"| Accounts Module
 +
|style="text-align: left;"| Overview of both loan and deposit accounts
 +
|style="text-align: left;"| Include in the homepage
 +
|-
 +
|style="text-align: center;"| Fund Transfer Module
 +
|style="text-align: left;"| Unable to transfer the amounts with cents
 +
|style="text-align: left;"| Amount inputted should cater for decimals
 
|-
 
|-
|style="text-align: center;"| Customer Preferences Module
+
|style="text-align: center;"| Fund Transfer Module
|style="text-align: left;"| Unsure of what is the trigger types
+
|style="text-align: left;"| Standing Instruction Information does not load beforehand
|style="text-align: left;"| Allows the users to know what the previous preferences for the respective trigger types for each account were
+
|style="text-align: left;"| Taking too long to refresh. Hence,  add into array instead of sending it and getting
 
|-
 
|-
 +
|style="text-align: center;"| Bill Payment Module
 +
|style="text-align: left;"| Button on the side in standing instructions n giro tab
 +
|style="text-align: left;"| Remove the button
  
 
|}
 
|}
Line 185: Line 275:
 
<div style="font-family: Calibri;">
 
<div style="font-family: Calibri;">
 
<p>
 
<p>
Participants feel that the web interface is easy to use and minimalist design. Also, the colours give it a nice touch to the overall look and feel of the application. However, it will be good to include charts for repayment, instalments and clear message regarding repayment. The client is satisfied with the overall look of the UI and looks forward to the improved web application.
+
Participants feel that the web interface is easy to use and minimalist design. However, the description should be included upon each successful transfer and loading percentage on different page. Most important, "Under Construction" word should be included in all the functions that are not done in the side bar. The client is satisfied with the overall look of the UI and looks forward to the improved web application.
 
</p>
 
</p>
 
</div>
 
</div>

Latest revision as of 18:03, 18 August 2019

R&I Fyplogo.PNG


HOME

ABOUT US

PROJECT OVERVIEW

PROJECT MANAGEMENT

DOCUMENTATION

User Testing




R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG
User Testing 1
User Testing 2
User Testing 3
User Testing 4
User Testing 5
User Testing 6
User Testing 7
User Testing 8

Test Plan

Venue: SIS SR 2-3
Date: 15th Feb 2019
Duration: ~ 60 minutes per user
Participant Demographics: 10 SIS Students
Test Script: User Testing 3

Objectives

  • Gather the feedback regarding the usability of the all functions the team has created
  • Observe how the users interact with our system
  • Ensure no additional features have been overlooked
  • Improve on the application based on the results
  • Scope

      Authentication Module
    • Login with 2FA Authentication

      Accounts Module
    • Manage Personal Details
    • View Transaction History

      Dual Currency Deposit Module
    • Easy Conversion of currencies
    • Manage Dual Currency Accounts

      Bill Payment Module
    • Immediate and Future Bill Payment
    • Authorise GIRO Payment to Organisation

      Fund Transfer
    • Create Payee with 2FA
    • Immediate, Future and Recurring Fund Transfer

    Procedure

    Participants were given a set of instructions to follow and complete the test cases. Participants were encouraged to note the estimated time taken for each task and number of clicks to complete the task. During the user testing, participants were encouraged to voice out any usability issues as they navigated through the test cases. Their feedback was noted. Participants were given a post-test questionnaire at the end of the testing to gauge their satisfaction.

    Results

    S/N Test Case Outcome
    1 Participants should be able to login with valid UserID and PIN Successful.
    2 Participants should not be able to login with invalid UserID and PIN and pop-up message is successfully displayed. Successful.
    3 Participants should be able to create new DCD accounts with selected Base and Quoted Currency rate and pop-up message is successfully displayed. Unsuccessful.
    4 Participants should be able edit their accounts with up to three 3options for different accounts and pop-up message is successfully displayed. Successful.
    5 Participants should be able to view closed DCD accounts summary. Successful.
    6 Participants should be able to retrieve personal accounts details with valid userId and password. Else, a error message is displayed. Successful for deposit accounts but, Unsuccessful for loan accounts.
    7 Participants should be able to create payee with 2FA. Upon successful creation of payee, a pop out message is displayed. Successful.
    8 Participants should be able to transfer fund to newly created payee. Alert is displayed upon a successful transfer. Successful.
    9 Participants should be able to make future transfer fund to any payee. Alert is displayed upon a successful transfer. Successful.
    10 Participants should be able to make recurring transfer fund to any payee. Alert is displayed upon a successful transfer. Successful.
    11 Participants should be able to remove payee in the Fund Transfer Home page. Successful.
    12 Participants should be able to make an immediate transfer to any listed organisation. A summary page is displayed and confirm the transaction. After confirmation, an SMS and email will be sent to the user. Successful.
    13 Participants should be able to make a future transfer to any listed organisation. A summary page is displayed and confirm the transaction. Successful.
    14 Participants should be able to view all future transaction in standing instruction tab. Successful.
    15 Participants should be able to enable the listed organisation for future GRIO authorisation. A summary page is displayed and confirm the transaction. Successful.
    16 Participants should be able to view all authorised GIRO transaction in GIRO authorisation tab. Successful.

    Key Findings

    Functions Users' Behaviour & Comments Proposed Changes
    Accounts Module Loan accounts did not show up but it is loading Include loading percentage
    Accounts Module Amounts to be shown beside the accounts ID Include collapsible view of transaction history
    Accounts Module Overview of both loan and deposit accounts Include in the homepage
    Fund Transfer Module Unable to transfer the amounts with cents Amount inputted should cater for decimals
    Fund Transfer Module Standing Instruction Information does not load beforehand Taking too long to refresh. Hence, add into array instead of sending it and getting
    Bill Payment Module Button on the side in standing instructions n giro tab Remove the button

    Overall Feedback

    Participants feel that the web interface is easy to use and minimalist design. However, the description should be included upon each successful transfer and loading percentage on different page. Most important, "Under Construction" word should be included in all the functions that are not done in the side bar. The client is satisfied with the overall look of the UI and looks forward to the improved web application.