HeaderSIS.jpg

IS480 Team wiki: 2015T1 Team Hexa User Test 4

From IS480
Revision as of 19:36, 22 November 2015 by Zucheng.peh.2012 (talk | contribs)
Jump to navigation Jump to search

Cheng logo.png

HOME   ABOUT US   PROJECT OVERVIEW   PROJECT MANAGEMENT   DOCUMENTATION
TECHNICAL DOCUMENTS   DESIGN DOCUMENTS   TEST DOCUMENTS   MINUTES   PROJECT DOCUMENTS   DEPLOYMENT
INTERNAL TESTING USER TEST 1 USER TEST 2 USER TEST 3 USER TEST 4


User Test 4 (UT4) Test Plan

Objectives:

  • Gather feedback regarding user interface of developed functions
  • Detect usability issues based on user behaviour
  • Find out if new users are able to easily learn and use the application
  • Test success rate of users completing assigned tasks
  • Find out which developed functions are the most important & provides the best user experience
  • To use UT results to improve our Web Application / Mobile Application


Scope of Testing:

Web

  • Sign up & Questionnaire
  • Financial Summary
  • Financial Health Ratios & Analysis
  • Debt & Insurance
  • Milestones
  • Budgeting
  • Financial Tools
  • Social


Mobile

  • Sign up & Questionnaire
  • Financial Summary
  • Milestones
  • Budgeting
  • Social


Procedure

  • Pre User Testing
    • 10/11/15 – Send out emails/Message to the users briefing them about the aim of the user test and also giving them details of the actions they have to perform.


  • User Testing
    • 11/11/15 9:00 am - 18/11/15 01:00 am: Send out the URL of the website and the post-survey Google Form to the users. The users can login to the website from their desired location and browse through the website.


  • Post User Testing
    • 11/11/15 9:00 am - 18/11/15 01:00 am: The users can fill the post-survey questions from their desired location.
    • 19/11/15: Send out emails/Messages to the users to thank them for their contribution.
    • Consolidate the feedback gathered and notify the developers about issues.

User Test Results

The following are the quantitative results collated from the 32 unique user responses

  • Number of Web Users = 22
  • Number of Mobile Users = 10


Demographics of Users

During our UT4, we asked our users about their age and employment background. This also helps verify that our users are within the target scope of users for our application

UT4 Age Range.png UT4 Employment Status.png


Web Quantitative Results


For the tasks based questions, we asked users to follow a set of instructions based on the functionalities of the application, they would then answer the ease in which they were able to complete the tasks given for each functionality tested - each tasks would be rated between 1 (Very Difficult) to 5 (Very Easy)

(Web) Tasks Based Results


UT4 Task Results(Web).png


Task 1

  • Task 1.1: Complete Sign up & Questionnaire
  • Task 1.2: View your credit profile analysis

Task 2

  • Task 2.1: Update your Assets financial records
  • Task 2.2: Update your Income & Expenses financial records

Task 3

  • Task 3.1: Adding a new Insurance
  • Task 3.2: Adding a new Debt

Task 4

  • Task 4.1: Adding a new Milestone
  • Task 4.2: Adding a contribution to your Milestone

Task 5

  • Task 5.1: Setting up a Budget
  • Task 5.2: Adding an Expense

Task 6

  • Task 6.1: Retirement Planning Calculator
  • Task 6.2: Loan Comparison and Calculator

Task 7

  • Task 7.1: Add a new friend
  • Task 7.2: Commenting on a post
  • Task 7.3: Create a new post


(Web)Task Results Analysis (Web)

Most users were able to complete Task 1 through 7, there are some users who have issues with completing the tasks in social function. a check with their feedback reveals that for tasks 7.2 where we asked users to find our a specific user's post, they had difficulty in searching for it and had to resort to scrolling through the page to manually find it. Some users also thought that they could find friends through the 'friends' tab, and thought that the find users and friends tab should be combined.



(Web) Usefulness of Functions


UT4 Function breakdown.png


Based on the task-based user testing of each feature, users were asked about the utility of the functions based on their needs. Based on the results (as shown in the graph above), generally our testers find that most of the functions are useful. Some feel that it addresses their need for a personal financial planning tool that they can track on a weekly/monthly basis. There are some users who felt that the social function does not feel of use to them, and some are concerned that the ability to let other users see their financial status may be a privacy issue or even a potential security issue. Even though I-Wealth does not use any sensitive data that may identify users or link sensitive financial information through their social function, these users are not comfortable with sharing of non-sensitive financial details inside a personal financial planning application.

Mobile Quantitative Results

Similar to the Web Task-Based Testing, we asked our 10 mobile testers to follow a set of instructions based on the functionalities of the application, they would then answer the ease in which they were able to complete the tasks given for each functionality tested - each tasks would be rated between 1 (Very Difficult) to 5 (Very Easy)

(Mobile) Tasks Based Results


UT4 Task Results(Mobile).png


(Mobile) Usefulness of Functions


Task 1

  • Task 1.1: Complete Sign up & Questionnaire
  • Task 1.2: View your credit profile analysis

Task 2

  • Task 2.1: Update your Assets financial records
  • Task 2.2: Update your Income & Expenses financial records

Task 3

  • Task 3.1: Adding a new Milestone
  • Task 3.2: Adding a contribution to your Milestone

Task 4

  • Task 4.1: Setting up a Budget
  • Task 4.2: Adding an Expense

Task 5

  • Task 5.1: Add a new friend
  • Task 5.2: Commenting on a post
  • Task 5.3: Create a new post


(Web)Task Results Analysis (Mobile)

Similar to the Web results, users were generally able to complete Task 1 through 5 without much difficulty, there were some testers that had difficulty in completing the task 5.2, which was difficult for users to comment on a specific post as they had to scroll through a number of posts on the mobile interface in order to find the right one.

UT4 Function breakdown (Mobile).png


We asked our mobile testers their view of the mobile function utility with regards to their needs. Similar to our web results, our mobile testers felt that the mobile functions were useful , especially with regards to the cash expense tracker. Some users felt that this was useful in planning their budget and help limit their expenses. the social function was seen by some of our testers as not that useful, albeit for different reasons as compared to the web results for social. Testers felt that the UI for the social function can be further improved, as the current UI does not easily help in the completion of the social tasks.

Overall Quantitative Results


UT4 Overall.png


After completing of the tasks and feedback based on each of the functions to be tested, our testers were asked about the Overall usability and functionality of the I-Wealth Application. Testers were asked to rate between 1 (Worst) to 5 (Best) for Usefulness of the application, as well as the User Experience of it.

In terms of overall usefulness, our application scored relatively well among our testers, as a whole they feel that it has the required functions that makes it a good personal financial planning and tracking application. Similarly, the overall user experience of our application has been rated almost as well, with many appreciating the simple usability of most parts of the applications. There are still some minor improvements to be made that were found by the testers.

Top 5 important features.png


In addition to the above questions, we asked our users - among the features that our application offers, to pick the top 5 important features to them. as seen from the above graph, features that had at least 70% mentions among users were

  • Financial Summary (Assets, Liabilities, Income & Expenses)
  • Cash Expense Tracker (Budget)
  • Financial Tools (Retirement Calculator & Loan Calculator)

These coincides with our market research that there is a need for a one-stop application that offers these different functions under a single account, allowing them to track their finances from the web & Mobile

The survey also showed that our testers find the social function to be the least important of the features that I-Wealth has, and as explained by the tasks-based results, many are not comfortable with mixing private financial information with a social function

Qualitative Feedback

UT4 Documentations