HeaderSIS.jpg

IS480 Team wiki: 2015T1 Team Hexa User Test 4

From IS480
Revision as of 19:07, 22 November 2015 by Zucheng.peh.2012 (talk | contribs)
Jump to navigation Jump to search

Cheng logo.png

HOME   ABOUT US   PROJECT OVERVIEW   PROJECT MANAGEMENT   DOCUMENTATION
TECHNICAL DOCUMENTS   DESIGN DOCUMENTS   TEST DOCUMENTS   MINUTES   PROJECT DOCUMENTS   DEPLOYMENT
INTERNAL TESTING USER TEST 1 USER TEST 2 USER TEST 3 USER TEST 4


User Test 4 (UT4) Test Plan

Objectives:

  • Gather feedback regarding user interface of developed functions
  • Detect usability issues based on user behaviour
  • Find out if new users are able to easily learn and use the application
  • Test success rate of users completing assigned tasks
  • Find out which developed functions are the most important & provides the best user experience
  • To use UT results to improve our Web Application / Mobile Application


Scope of Testing:

Web

  • Sign up & Questionnaire
  • Financial Summary
  • Financial Health Ratios & Analysis
  • Debt & Insurance
  • Milestones
  • Budgeting
  • Financial Tools
  • Social


Mobile

  • Sign up & Questionnaire
  • Financial Summary
  • Milestones
  • Budgeting
  • Social


Procedure

  • Pre User Testing
    • 10/11/15 – Send out emails/Message to the users briefing them about the aim of the user test and also giving them details of the actions they have to perform.


  • User Testing
    • 11/11/15 9:00 am - 18/11/15 01:00 am: Send out the URL of the website and the post-survey Google Form to the users. The users can login to the website from their desired location and browse through the website.


  • Post User Testing
    • 11/11/15 9:00 am - 18/11/15 01:00 am: The users can fill the post-survey questions from their desired location.
    • 19/11/15: Send out emails/Messages to the users to thank them for their contribution.
    • Consolidate the feedback gathered and notify the developers about issues.

User Test Results

The following are the quantitative results collated from the 32 unique user responses

  • Number of Web Users = 22
  • Number of Mobile Users = 10


Demographics of Users

During our UT4, we asked our users about their age and employment background. This also helps verify that our users are within the target scope of users for our application

UT4 Age Range.png UT4 Employment Status.png


Web Quantitative Results


For the tasks based questions, we asked users to follow a set of instructions based on the functionalities of the application, they would then answer the ease in which they were able to complete the tasks given for each functionality tested - each tasks would be rated between 1 (Very Difficult) to 5 (Very Easy)

(Web) Tasks Based Results


UT4 Task Results(Web).png


Task 1

  • Task 1.1: Complete Sign up & Questionnaire
  • Task 1.2: View your credit profile analysis

Task 2

  • Task 2.1: Update your Assets financial records
  • Task 2.2: Update your Income & Expenses financial records

Task 3

  • Task 3.1: Adding a new Insurance
  • Task 3.2: Adding a new Debt

Task 4

  • Task 4.1: Adding a new Milestone
  • Task 4.2: Adding a contribution to your Milestone

Task 5

  • Task 5.1: Setting up a Budget
  • Task 5.2: Adding an Expense

Task 6

  • Task 6.1: Retirement Planning Calculator
  • Task 6.2: Loan Comparison and Calculator

Task 7

  • Task 7.1: Add a new friend
  • Task 7.2: Commenting on a post
  • Task 7.3: Create a new post


(Web)Task Results Analysis (Web)

Most users were able to complete Task 1 through 7, there are some users who have issues with completing the tasks in social function. a check with their feedback reveals that for tasks 7.2 where we asked users to find our a specific user's post, they had difficulty in searching for it and had to resort to scrolling through the page to manually find it. Some users also thought that they could find friends through the 'friends' tab, and thought that the find users and friends tab should be combined.



(Web) Usefulness of Functions


UT4 Function breakdown.png


Based on the task-based user testing of each feature, users were asked about the utility of the functions based on their needs. Based on the results (as shown in the graph above), generally our testers find that most of the functions are useful. Some feel that it addresses their need for a personal financial planning tool that they can track on a weekly/monthly basis. There are some users who felt that the social function does not feel of use to them, and some are concerned that the ability to let other users see their financial status may be a privacy issue or even a potential security issue. Even though I-Wealth does not use any sensitive data that may identify users or link sensitive financial information through their social function, these users are not comfortable with sharing of non-sensitive financial details inside a personal financial planning application.

Mobile Quantitative Results

(Mobile) Tasks Based Results


UT4 Task Results(Mobile).png


(Mobile) Usefulness of Functions


UT4 Function breakdown (Mobile).png


Task 1

  • Task 1.1: Complete Sign up & Questionnaire
  • Task 1.2: View your credit profile analysis

Task 2

  • Task 2.1: Update your Assets financial records
  • Task 2.2: Update your Income & Expenses financial records

Task 3

  • Task 3.1: Adding a new Milestone
  • Task 3.2: Adding a contribution to your Milestone

Task 4

  • Task 4.1: Setting up a Budget
  • Task 4.2: Adding an Expense

Task 5

  • Task 5.1: Add a new friend
  • Task 5.2: Commenting on a post
  • Task 5.3: Create a new post


(Web)Task Results Analysis (Mobile)

Similar to the Web results, users were generally able to complete Task 1 through 5 without much difficulty,

Overall Quantitative Results


UT4 Overall.png


Top 5 important features.png


Qualitative Feedback

UT4 Documentations