HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2017T2 Mavericks User Testing 4"

From IS480
Jump to navigation Jump to search
 
(5 intermediate revisions by the same user not shown)
Line 70: Line 70:
 
<br>
 
<br>
  
==User Testing 3's Test Overview==
+
==User Testing 4's Test Overview==
 
<br>
 
<br>
'''Date:''' 13 February 2018 <br>
+
'''Date:''' 21 March 2018 <br>
'''Duration:''' 1900 1930<br>
+
'''Duration:''' 1830 2000<br>
'''Venue:''' SIS CR 3-1<br>
+
'''Venue:''' SOE CR B1-4<br>
'''Participants:''' 26 students from SMU <br>
+
'''Participants:''' 35 students from SMU <br>
'''Scope:''' Application consisting of 7 core features<br>
+
'''Scope:''' Application consisting of 8 core features<br>
 
# Login and OTP Verification
 
# Login and OTP Verification
 +
# Complete Pre-Quiz
 
# Check Account Balance
 
# Check Account Balance
# View Transaction History
+
# Add Beneficiary
# Loan Calculation
+
# Transfer Funds
 
# View Aggregated Expenses
 
# View Aggregated Expenses
# Live Chat Takeover: Admin Support
+
# Viewing of Scoreboard
# Educational Module: Quiz
+
# Complete Post-Quiz
'''Objective:''' To gain early feedback/user perspectives on usability of completed functionalities - especially on the educational module and speech-to-text feature, which are some of our core functions. <br>
+
'''Objective:''' To gain feedback/user perspectives on usability of completed functionalities - especially on the educational module and speech-to-text feature, which are some of our core functions. <br>
  
 
==Overview of Tasks' Results:==  
 
==Overview of Tasks' Results:==  
[[File:MV-ut3-taskoverview.png|center|700px]]<br><br>
+
[[File:UT4 Overview of Tasks' Results.PNG|center|700px]]<br><br>
  
 
==User Ratings:==  
 
==User Ratings:==  
[[Image:MV-UT3-userrating.png|center|700px]]<br />
+
[[File:UT4 User Feedbacks.PNG|center|700px]]<br />
'''Average Ease of Use Rating:''' 3.5/5<br>
+
'''Average Ease of Use Rating:''' 4.06/5<br>
'''Average Overall UI Design Rating:''' 3.8/5<br>
+
'''Average Overall UI Design Rating:''' 4.03/5<br>
'''Average Effectiveness as a Learning Tool Rating:''' 3.7/5<br>
+
'''Average Effectiveness as a Learning Tool Rating:''' 4.0/5<br>
  
 
==Feedback From Users==
 
==Feedback From Users==
# 40% of users listed "Chatbot" as their top favourite feature, with reasons such as "convenient" and "interactive"
+
# 57% of users listed "Chatbot" as their top favourite feature, with reasons such as "convenient" and "interactive"
# 30% of users listed "Admin Live Support" as their top favourite feature, with the main reason being it offers additional help which the chatbot cannot offer
+
# 27% of users listed "Interactive Quiz" as their top favourite feature, with the main reason being it provides informative and useful information
# "Lack of instructions/unclear guide on how to use the application" was a common feedback among participants. Users were unable to understand what the features it offers
 
  
 
===Comments on areas for improvement===
 
===Comments on areas for improvement===
# Live support can be a button instead
+
# Scoreboard UI should be nicer
# More colours to the UI
 
# Help/FAQ function to assist participants
 
# Clearer guide/instructions on how to use the application
 
# Clearer guide/instructions to show users the features offered on the platform
 

Latest revision as of 21:51, 3 April 2018

MV-background.png


MV-home.png   HOME

 

MV-logo.png   ABOUT US

 

MV-overview.png   PROJECT OVERVIEW

 

MV-schedule.png   PROJECT MANAGEMENT

 

MV-documentation.png   DOCUMENTATION

Personas & Scenarios

Diagrams

Meeting Minutes

Proof of Deployment

User Testing

Project Deliverables

Mv-ut-banner.png

View UT1 Results

View UT2 Results

View UT3 Results

View UT4 Results


User Testing 4's Test Overview


Date: 21 March 2018
Duration: 1830 – 2000
Venue: SOE CR B1-4
Participants: 35 students from SMU
Scope: Application consisting of 8 core features

  1. Login and OTP Verification
  2. Complete Pre-Quiz
  3. Check Account Balance
  4. Add Beneficiary
  5. Transfer Funds
  6. View Aggregated Expenses
  7. Viewing of Scoreboard
  8. Complete Post-Quiz

Objective: To gain feedback/user perspectives on usability of completed functionalities - especially on the educational module and speech-to-text feature, which are some of our core functions.

Overview of Tasks' Results:

UT4 Overview of Tasks' Results.PNG



User Ratings:

UT4 User Feedbacks.PNG


Average Ease of Use Rating: 4.06/5
Average Overall UI Design Rating: 4.03/5
Average Effectiveness as a Learning Tool Rating: 4.0/5

Feedback From Users

  1. 57% of users listed "Chatbot" as their top favourite feature, with reasons such as "convenient" and "interactive"
  2. 27% of users listed "Interactive Quiz" as their top favourite feature, with the main reason being it provides informative and useful information

Comments on areas for improvement

  1. Scoreboard UI should be nicer