HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2017T2 Mavericks User Testing 3"

From IS480
Jump to navigation Jump to search
Line 94: Line 94:
  
 
==Feedback From Users==
 
==Feedback From Users==
[[File:MV-Overall3.PNG]]<br>
+
# 40% of users listed "Chatbot" as their top favourite feature, with reasons such as "convenient" and "interactive"
 +
# 30% of users listed "Admin Live Support" as their top favourite feature, with the main reason being it offers additional help which the chatbot cannot offer
 +
# "Lack of instructions/unclear guide on how to use the application" was a common feedback among participants. Users were unable to understand what the features it offers
 +
 
 +
===Comments on areas for improvement===
 +
# Live support can be a button instead
 +
# More colours to the UI
 +
# Help/FAQ function to assist participants
 +
# Clearer guide/instructions on how to use the application
 +
# Clearer guide/instructions to show users the features offered on the platform
  
 
==Key Findings==
 
==Key Findings==

Revision as of 22:53, 18 February 2018

MV-background.png


MV-home.png   HOME

 

MV-logo.png   ABOUT US

 

MV-overview.png   PROJECT OVERVIEW

 

MV-schedule.png   PROJECT MANAGEMENT

 

MV-documentation.png   DOCUMENTATION

Personas & Scenarios

Diagrams

Meeting Minutes

Proof of Deployment

User Testing

Project Deliverables

Mv-ut-banner.png

View UT1 Results

View UT2 Results

View UT3 Results


User Testing 3's Test Overview


Date: 13 February 2018
Duration: 1900 – 1930
Venue: SIS CR 3-1
Participants: 26 students from SMU
Scope: Application consisting of 7 core features

  1. Login and OTP Verification
  2. Check Account Balance
  3. View Transaction History
  4. Loan Calculation
  5. View Aggregated Expenses
  6. Live Chat Takeover: Admin Support
  7. Educational Module: Quiz

Objective: To gain early feedback/user perspectives on usability of completed functionalities - especially on the educational module and speech-to-text feature, which are some of our core functions.

Overview of Tasks' Results:

MV-ut3-taskoverview.png



User Ratings:

MV-UT3-userrating.png


Average Ease of Use Rating: 3.5/5
Average Overall UI Design Rating: 3.8/5
Average Effectiveness as a Learning Tool Rating: 3.7/5

Feedback From Users

  1. 40% of users listed "Chatbot" as their top favourite feature, with reasons such as "convenient" and "interactive"
  2. 30% of users listed "Admin Live Support" as their top favourite feature, with the main reason being it offers additional help which the chatbot cannot offer
  3. "Lack of instructions/unclear guide on how to use the application" was a common feedback among participants. Users were unable to understand what the features it offers

Comments on areas for improvement

  1. Live support can be a button instead
  2. More colours to the UI
  3. Help/FAQ function to assist participants
  4. Clearer guide/instructions on how to use the application
  5. Clearer guide/instructions to show users the features offered on the platform

Key Findings

1. Which features do you like best based on the test? Why?
User 1: Credit Transfer as it is very convenient and step by step procedure is provided by the bot.
User 2: Admin Live Support. There will be times where a chatbot will be unable to handle certain requests and an admin will come in handy to fulfil user’s needs.
User 3: Users are given the option of typing or saying to execute certain functions provided by the app.

2. Which features do you like least based on the test? Why?
User 1: There should be a menu selection when user first enter the chat.
User 2: There are no ways to cancel live admin support
User 3: There are no notifications for zero payee in the beneficiary list.

Changes made:

1. Users can now cancel the live admin support.
MV-Change1.png

2. A menu message is displayed upon user entering the chat
MV-Change2.PNG

3. Proper description of beneficiary is displayed for user
MV-Change3.PNG

4. When user do not have any beneficiaries, a message is displayed
MV-Change4.PNG