HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2018T1 R&I Documentation: User Testing 2"

From IS480
Jump to navigation Jump to search
 
(28 intermediate revisions by 2 users not shown)
Line 55: Line 55:
 
|[[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 1]]  
 
|[[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 1]]  
 
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 2]]  
 
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 2]]  
|| [[Image: R&I Deliverables.PNG|150px|]]  
+
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 3]]
|| [[Image: R&I Deliverables.PNG|150px]]
+
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 4]]
 +
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 5]]
 +
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 6]]
 +
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 7]]
 +
|| [[Image: R&I Deliverables.PNG|150px|link=IS480 Team wiki: 2018T1 R&I Documentation: User Testing 8]]
 
|-
 
|-
|</center><center><font color:#E2B6AA face= "kollektif">User Testing 1</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 2</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 3</font></center> || <center><font color:#E2B6AA face= "kollektif">UAT 1</font></center>
+
|</center><center><font color:#E2B6AA face= "kollektif">User Testing 1</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 2</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 3</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 4</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 5</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 6</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 7</font></center> || <center><font color:#E2B6AA face= "kollektif">User Testing 8</font></center> ||
 
|}
 
|}
 
<!--Content End-->
 
<!--Content End-->
Line 79: Line 83:
 
<div style="font-family: Calibri">
 
<div style="font-family: Calibri">
 
<p>
 
<p>
• Gather the feedback regarding the usability of the 3 functions the team has created <br>
+
• Gather the feedback regarding the usability of the 2 functions the team has created <br>
 
• Observe how the users interact with our system <br>
 
• Observe how the users interact with our system <br>
 
• Ensure no additional features have been overlooked <br>
 
• Ensure no additional features have been overlooked <br>
Line 92: Line 96:
 
<p>
 
<p>
 
<ul>
 
<ul>
<b>Availability module</b>
+
<b>Accounts Module</b>
<li>Change zones</li>
+
<li>Get Deposit Account Details</li>
<li>Select time & location</li>
+
<li>Get Loan Account Details</li>
<li>Select time</li>
+
<li>Get Customer Account Details</li>
 
</ul>
 
</ul>
 
</p>
 
</p>
Line 101: Line 105:
 
<p>
 
<p>
 
<ul>
 
<ul>
<b>Vehicle Movement module</b>
+
<b>Dual Currency Module</b>
<li>Select time</li>
+
<li>View Closed DCD Account</li>
<li>Filtering 'Available' only & taxi id</li>
+
<li>View Current DCD Account</li>
<li>Direction & Order</li>
+
<li>Create new DCD Account</li>
 +
<li>Edit Current DCD Account</li>
 
</ul>
 
</ul>
 
</p>
 
</p>
  
<p>
 
<ul>
 
<b>Dwell Time & Service Mode module</b>
 
<li>Select relevant dropdown</li>
 
<li>View charts</li>
 
<li>Understand visualizations</li>
 
</ul>
 
</p>
 
 
</div>
 
</div>
  
Line 132: Line 129:
 
! style="color:#000000; background-color:#FFB62B;" width="100pt" | S/N
 
! style="color:#000000; background-color:#FFB62B;" width="100pt" | S/N
 
! style="color:#000000; background-color:#FFB62B;" width="400pt" | Test Case
 
! style="color:#000000; background-color:#FFB62B;" width="400pt" | Test Case
! style="color:#000000; background-color:#FFB62B;" width="500pt" | Outcome
+
! style="color:#000000; background-color:#FFB62B;" width="200pt" | Outcome
 
|-
 
|-
  
 
|style="text-align: center;"| 1
 
|style="text-align: center;"| 1
|style="text-align: left;"| Participants should be able to set time and interpret the graph
+
|style="text-align: left;"| Participants should be able to get deposit accounts details with valid UserID and PIN
|style="text-align: left;"| Unsuccessful. Unintuitive order of timing made reading prone to errors.   
+
|style="text-align: left;"| Successful.   
 
|-
 
|-
  
 
|style="text-align: center;"| 2
 
|style="text-align: center;"| 2
|style="text-align: left;"| Participants should navigate to the tool tip to find the correct vale
+
|style="text-align: left;"| Participants should be able to get loan accounts details with valid UserID and PIN
|style="text-align: left;"| Successful. All participants could navigate with ease.
+
|style="text-align: left;"| Successful.
 
|-
 
|-
  
 
|style="text-align: center;"| 3
 
|style="text-align: center;"| 3
|style="text-align: left;"| Participants should be able to locate a region and its information
+
|style="text-align: left;"| Participants should not be able to get loan accounts details with invalid UserID and PIN
|style="text-align: left;"| Successful. One participant was aided to find Yishun on the map.
+
|style="text-align: left;"| Successful.
 
|-
 
|-
  
 
|style="text-align: center;"| 4
 
|style="text-align: center;"| 4
|style="text-align: left;"| Participants should be able to identify the different attributes of a taxi
+
|style="text-align: left;"| Participants should be able to view closed DCD accounts summary
|style="text-align: left;"| Successful. Participants feedbacked for an obvious distinction.
+
|style="text-align: left;"| Successful.  
 
|-
 
|-
  
 
|style="text-align: center;"| 5
 
|style="text-align: center;"| 5
|style="text-align: left;"| Participants should be able to infer from the map and metrics
+
|style="text-align: left;"| Participants should be able to view current DCD accounts summary
|style="text-align: left;"| Successful. Participants enquired for definitions and calculations.  
+
|style="text-align: left;"| Successful.  
 
|-
 
|-
  
 
|style="text-align: center;"| 6
 
|style="text-align: center;"| 6
|style="text-align: left;"| Participants should be able to toggle between modes of hire
+
|style="text-align: left;"| Participants should be able to select up to three 3options for different accounts and pop-up message is successfully displayed.
 
|style="text-align: left;"| Successful.
 
|style="text-align: left;"| Successful.
 
|-
 
|-
  
 
|style="text-align: center;"| 7
 
|style="text-align: center;"| 7
|style="text-align: left;"| Participants should be able to identify differences in proportion through the map
+
|style="text-align: left;"| Participants should be able to create new DCD accounts with selected Base and Quoted Currency rate and pop-up message is successfully displayed.
|style="text-align: left;"| Successful. However, our calculation for proportion was misleading.
+
|style="text-align: left;"| Successful.  
 
|-
 
|-
  
Line 178: Line 175:
 
|-
 
|-
  
! style="color:#000000; background-color:#FFB62B;" width="100pt" | Functions
+
! style="color:#000000; background-color:#FFB62B;" width="200pt" | Functions
 
! style="color:#000000; background-color:#FFB62B;" width="400pt" | Users' Behaviour & Comments
 
! style="color:#000000; background-color:#FFB62B;" width="400pt" | Users' Behaviour & Comments
 
! style="color:#000000; background-color:#FFB62B;" width="500pt" | Proposed Changes
 
! style="color:#000000; background-color:#FFB62B;" width="500pt" | Proposed Changes
 
|-
 
|-
  
|style="text-align: center;"| User Interface
+
|style="text-align: center;"| Accounts Module
|style="text-align: left;"| Entering date/time is not intuitive
+
|style="text-align: left;"| Overview page can be improved on by including collapsible overview
|style="text-align: left;"| Time suggestions of 30min as a dropdown for users to select from
+
|style="text-align: left;"| Need for collapsible overview of customer accounts (Deposit & Loan Accounts)
 +
 
 
|-
 
|-
|style="text-align: center;"| User Interface
+
|style="text-align: center;"| Accounts Module
|style="text-align: left;"| “Enter” key is not obvious and upon pressing, there is no visual feedback
+
|style="text-align: left;"| Maturity Date is irrelevant to Deposit Accounts
|style="text-align: left;"| Page Spinner to indicate the page loading. Change “Enter” key
+
|style="text-align: left;"| Remove maturity date information in Deposit Account view
 
|-
 
|-
|style="text-align: center;"| User Interface
+
|style="text-align: center;"| Dual Currency Module
|style="text-align: left;"| Meaning of charts are unclear
+
|style="text-align: left;"| Default value should call from API
|style="text-align: left;"| More descriptions explaining how the visuals are calculated
+
|style="text-align: left;"| Increment unit of deposit amount to 1000, default deposit amount to 50000
 
|-
 
|-
|style="text-align: center;"| User Interface
+
|style="text-align: center;"| Dual Currency Module
|style="text-align: left;"| Order of the time labeled on the graph is confusing
+
|style="text-align: left;"| Interests Rate Formula should change, and yield curve will increase when the risk and time is high
|style="text-align: left;"| Change order ascending from left to right
+
|style="text-align: left;"| Add relevant descriptions, labels on charts, label graph axisDifference between strike rate and exchange rate, the deposit term and deposit amount should be factor in for the interest rate calculation
|-
+
 
|style="text-align: center;"| User Interface
 
|style="text-align: left;"| Unclear labelling of charts and maps
 
|style="text-align: left;"| Add relevant descriptions, labels on charts, label graph axis
 
|-
 
|style="text-align: center;"| Validation
 
|style="text-align: left;"| Prevent users from entering wrong values
 
|style="text-align: left;"| Validation check for time - start time should always be earlier than end time
 
|-
 
|style="text-align: center;"| Availability by Time
 
|style="text-align: left;"| Stacked bar: display percentage in the stacked bar
 
|style="text-align: left;"| 3 toggles for the 3 different views. In tool tip it will have discrete and percentage
 
|-
 
|style="text-align: center;"| Availability by Location
 
|style="text-align: left;"| N.A is unclear
 
|style="text-align: left;"| Indicate N.A as 0. Remove the N.A legend.
 
|-
 
|style="text-align: center;"| Vehicle Movement
 
|style="text-align: left;"| Direction is unclear in when the arrow is not accurate
 
|style="text-align: left;"| Create bearing, with historical points
 
|-
 
|style="text-align: center;"| Vehicle Movement
 
|style="text-align: left;"| The “Only Available” filter is misleading
 
|style="text-align: left;"| Re-label
 
|-
 
|style="text-align: center;"| Vehicle Movement
 
|style="text-align: left;"| Incorrect offset when zooming in & out
 
|style="text-align: left;"| Fix it.
 
|-
 
|style="text-align: center;"| Vehicle Movement
 
|style="text-align: left;"| Hard to distinguish between taxis
 
|style="text-align: left;"| Half the marker to indicate status and taxi id each
 
|-
 
|style="text-align: center;"| Dwell Time
 
|style="text-align: left;"| Hard to find location in the map
 
|style="text-align: left;"| Drop down filter of locations
 
|-
 
|style="text-align: center;"| Dwell Time
 
|style="text-align: left;"| Not easy to make comparisons
 
|style="text-align: left;"| Give another case to compare. Seeing another pattern side-by-side view
 
|-
 
|style="text-align: center;"| Dwell Time
 
|style="text-align: left;"| Unaffected islands are visible in the map
 
|style="text-align: left;"| Find out if there is another version of the map that cuts out the islands
 
|-
 
|style="text-align: center;"| Service Mode
 
|style="text-align: left;"| Misleading calculation for proportion
 
|style="text-align: left;"| Increase the time interval of our calculation. Set a minimum threshold in order to be considered in the display.
 
|-
 
|style="text-align: center;"| Service Mode
 
|style="text-align: left;"| Unnecessary display of low value statuses
 
|style="text-align: left;"| Display main 3 status. Merge the others together.
 
 
|-
 
|-
 +
|style="text-align: center;"| Dual Currency Module
 +
|style="text-align: left;"| No summary page upon creation of new DCD accounts
 +
|style="text-align: left;"| Summary page required upon successful creation of a new DCD account
 +
 
|}
 
|}
 
</center>
 
</center>
 +
 +
 +
==Overall Feedback==
 +
 +
<div style="font-family: Calibri;">
 +
<p>
 +
Participants feel that the web interface is easy to use and responsive. It is good to have the status (green and red) in the feedback. However, customers accounts can include collapsible overview.
 +
Client is satisfied with the overall look of the UI and looks forward to the improved web application.
 +
</p>
 +
</div>
 +
 +
  
 
<!-- Content End-->
 
<!-- Content End-->

Latest revision as of 18:03, 18 August 2019

R&I Fyplogo.PNG


HOME

ABOUT US

PROJECT OVERVIEW

PROJECT MANAGEMENT

DOCUMENTATION

User Testing




R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG R&I Deliverables.PNG
User Testing 1
User Testing 2
User Testing 3
User Testing 4
User Testing 5
User Testing 6
User Testing 7
User Testing 8

Test Plan

Venue: SIS GSR 2-3
Date: 11th Jan 2019, Friday
Duration: ~ 30 minutes per user
Participant Demographics: 1 Professor, 1 previous IS444 student
Test Script: User Testing 2

Objectives

• Gather the feedback regarding the usability of the 2 functions the team has created
• Observe how the users interact with our system
• Ensure no additional features have been overlooked
• Improve on the application based on the results

Scope

    Accounts Module
  • Get Deposit Account Details
  • Get Loan Account Details
  • Get Customer Account Details

    Dual Currency Module
  • View Closed DCD Account
  • View Current DCD Account
  • Create new DCD Account
  • Edit Current DCD Account

Procedure

Participants were given a set of instructions to follow and complete the test cases. Participants were encouraged to note the estimated time taken for each task and number of clicks to complete the task. During the user testing, participants were encouraged to voice out any usability issues as they navigated through the test cases. Their feedback was noted. Participants were given a post-test questionnaire at the end of the testing to gauge their satisfaction.

Results

S/N Test Case Outcome
1 Participants should be able to get deposit accounts details with valid UserID and PIN Successful.
2 Participants should be able to get loan accounts details with valid UserID and PIN Successful.
3 Participants should not be able to get loan accounts details with invalid UserID and PIN Successful.
4 Participants should be able to view closed DCD accounts summary Successful.
5 Participants should be able to view current DCD accounts summary Successful.
6 Participants should be able to select up to three 3options for different accounts and pop-up message is successfully displayed. Successful.
7 Participants should be able to create new DCD accounts with selected Base and Quoted Currency rate and pop-up message is successfully displayed. Successful.

Key Findings

Functions Users' Behaviour & Comments Proposed Changes
Accounts Module Overview page can be improved on by including collapsible overview Need for collapsible overview of customer accounts (Deposit & Loan Accounts)
Accounts Module Maturity Date is irrelevant to Deposit Accounts Remove maturity date information in Deposit Account view
Dual Currency Module Default value should call from API Increment unit of deposit amount to 1000, default deposit amount to 50000
Dual Currency Module Interests Rate Formula should change, and yield curve will increase when the risk and time is high Add relevant descriptions, labels on charts, label graph axisDifference between strike rate and exchange rate, the deposit term and deposit amount should be factor in for the interest rate calculation
Dual Currency Module No summary page upon creation of new DCD accounts Summary page required upon successful creation of a new DCD account


Overall Feedback

Participants feel that the web interface is easy to use and responsive. It is good to have the status (green and red) in the feedback. However, customers accounts can include collapsible overview. Client is satisfied with the overall look of the UI and looks forward to the improved web application.