Difference between revisions of "IS480 Team wiki: 2017T2 Mavericks User Testing 3"
Line 94: | Line 94: | ||
==Feedback From Users== | ==Feedback From Users== | ||
− | + | # 40% of users listed "Chatbot" as their top favourite feature, with reasons such as "convenient" and "interactive" | |
+ | # 30% of users listed "Admin Live Support" as their top favourite feature, with the main reason being it offers additional help which the chatbot cannot offer | ||
+ | # "Lack of instructions/unclear guide on how to use the application" was a common feedback among participants. Users were unable to understand what the features it offers | ||
+ | |||
+ | ===Comments on areas for improvement=== | ||
+ | # Live support can be a button instead | ||
+ | # More colours to the UI | ||
+ | # Help/FAQ function to assist participants | ||
+ | # Clearer guide/instructions on how to use the application | ||
+ | # Clearer guide/instructions to show users the features offered on the platform | ||
==Key Findings== | ==Key Findings== |
Revision as of 22:53, 18 February 2018
Contents
User Testing 3's Test Overview
Date: 13 February 2018
Duration: 1900 – 1930
Venue: SIS CR 3-1
Participants: 26 students from SMU
Scope: Application consisting of 7 core features
- Login and OTP Verification
- Check Account Balance
- View Transaction History
- Loan Calculation
- View Aggregated Expenses
- Live Chat Takeover: Admin Support
- Educational Module: Quiz
Objective: To gain early feedback/user perspectives on usability of completed functionalities - especially on the educational module and speech-to-text feature, which are some of our core functions.
Overview of Tasks' Results:
User Ratings:
Average Ease of Use Rating: 3.5/5
Average Overall UI Design Rating: 3.8/5
Average Effectiveness as a Learning Tool Rating: 3.7/5
Feedback From Users
- 40% of users listed "Chatbot" as their top favourite feature, with reasons such as "convenient" and "interactive"
- 30% of users listed "Admin Live Support" as their top favourite feature, with the main reason being it offers additional help which the chatbot cannot offer
- "Lack of instructions/unclear guide on how to use the application" was a common feedback among participants. Users were unable to understand what the features it offers
Comments on areas for improvement
- Live support can be a button instead
- More colours to the UI
- Help/FAQ function to assist participants
- Clearer guide/instructions on how to use the application
- Clearer guide/instructions to show users the features offered on the platform
Key Findings
1. Which features do you like best based on the test? Why?
User 1: Credit Transfer as it is very convenient and step by step procedure is provided by the bot.
User 2: Admin Live Support. There will be times where a chatbot will be unable to handle certain requests and an admin will come in handy to fulfil user’s needs.
User 3: Users are given the option of typing or saying to execute certain functions provided by the app.
2. Which features do you like least based on the test? Why?
User 1: There should be a menu selection when user first enter the chat.
User 2: There are no ways to cancel live admin support
User 3: There are no notifications for zero payee in the beneficiary list.
Changes made:
1. Users can now cancel the live admin support.
2. A menu message is displayed upon user entering the chat
3. Proper description of beneficiary is displayed for user
4. When user do not have any beneficiaries, a message is displayed