HeaderSIS.jpg

IS480 Team wiki: 2017T2 Mavericks User Testing 3

From IS480
Jump to navigation Jump to search
MV-background.png


MV-home.png   HOME

 

MV-logo.png   ABOUT US

 

MV-overview.png   PROJECT OVERVIEW

 

MV-schedule.png   PROJECT MANAGEMENT

 

MV-documentation.png   DOCUMENTATION

Personas & Scenarios

Diagrams

Meeting Minutes

Proof of Deployment

User Testing

Project Deliverables

Mv-ut-banner.png

View UT1 Results

View UT2 Results

View UT3 Results

View UT4 Results


User Testing 3's Test Overview


Date: 13 February 2018
Duration: 1900 – 1930
Venue: SIS CR 3-1
Participants: 26 students from SMU
Scope: Application consisting of 7 core features

  1. Login and OTP Verification
  2. Check Account Balance
  3. View Transaction History
  4. Loan Calculation
  5. View Aggregated Expenses
  6. Live Chat Takeover: Admin Support
  7. Educational Module: Quiz

Objective: To gain early feedback/user perspectives on usability of completed functionalities - especially on the educational module and speech-to-text feature, which are some of our core functions.

Overview of Tasks' Results:

MV-ut3-taskoverview.png



User Ratings:

MV-UT3-userrating.png


Average Ease of Use Rating: 3.5/5
Average Overall UI Design Rating: 3.8/5
Average Effectiveness as a Learning Tool Rating: 3.7/5

Feedback From Users

  1. 40% of users listed "Chatbot" as their top favourite feature, with reasons such as "convenient" and "interactive"
  2. 30% of users listed "Admin Live Support" as their top favourite feature, with the main reason being it offers additional help which the chatbot cannot offer
  3. "Lack of instructions/unclear guide on how to use the application" was a common feedback among participants. Users were unable to understand what the features it offers

Comments on areas for improvement

  1. Live support can be a button instead
  2. More colours to the UI
  3. Help/FAQ function to assist participants
  4. Clearer guide/instructions on how to use the application
  5. Clearer guide/instructions to show users the features offered on the platform