IS480 Team wiki: 2015T1 Team Hexa User Test 4
HOME | ABOUT US | PROJECT OVERVIEW | PROJECT MANAGEMENT | DOCUMENTATION |
TECHNICAL DOCUMENTS | DESIGN DOCUMENTS | TEST DOCUMENTS | MINUTES | PROJECT DOCUMENTS | DEPLOYMENT |
INTERNAL TESTING | USER TEST 1 | USER TEST 2 | USER TEST 3 | USER TEST 4 |
---|
Contents
User Test 4 (UT4) Test Plan
Objectives:
- Gather feedback regarding user interface of developed functions
- Detect usability issues based on user behaviour
- Find out if new users are able to easily learn and use the application
- Test success rate of users completing assigned tasks
- Find out which developed functions are the most important & provides the best user experience
- To use UT results to improve our Web Application / Mobile Application
Scope of Testing:
Web
- Sign up & Questionnaire
- Financial Summary
- Financial Health Ratios & Analysis
- Debt & Insurance
- Milestones
- Budgeting
- Financial Tools
- Social
Mobile
- Sign up & Questionnaire
- Financial Summary
- Milestones
- Budgeting
- Social
Procedure
- Pre User Testing
- 10/11/15 – Send out emails/Message to the users briefing them about the aim of the user test and also giving them details of the actions they have to perform.
- User Testing
- 11/11/15 9:00 am - 18/11/15 01:00 am: Send out the URL of the website and the post-survey Google Form to the users. The users can login to the website from their desired location and browse through the website.
- Post User Testing
- 11/11/15 9:00 am - 18/11/15 01:00 am: The users can fill the post-survey questions from their desired location.
- 19/11/15: Send out emails/Messages to the users to thank them for their contribution.
- Consolidate the feedback gathered and notify the developers about issues.
User Test Results
The following are the quantitative results collated from the 32 unique user responses
- Number of Web Users = 22
- Number of Mobile Users = 10
Demographics of Users
During our UT4, we asked our users about their age and employment background. This also helps verify that our users are within the target scope of users for our application
Web Quantitative Results
For the tasks based questions, we asked users to follow a set of instructions based on the functionalities of the application, they would then answer the ease in which they were able to complete the tasks given for each functionality tested - each tasks would be rated between 1 (Very Difficult) to 5 (Very Easy)
Task 1
- Task 1.1: Complete Sign up & Questionnaire
- Task 1.2: View your credit profile analysis
Task 2
- Task 2.1: Update your Assets financial records
- Task 2.2: Update your Income & Expenses financial records
Task 3
- Task 3.1: Adding a new Insurance
- Task 3.2: Adding a new Debt
Task 4
- Task 4.1: Adding a new Milestone
- Task 4.2: Adding a contribution to your Milestone
Task 5
- Task 5.1: Setting up a Budget
- Task 5.2: Adding an Expense
Task 6
- Task 6.1: Retirement Planning Calculator
- Task 6.2: Loan Comparison and Calculator
Task 7
- Task 7.1: Add a new friend
- Task 7.2: Commenting on a post
- Task 7.3: Create a new post
Most users were able to complete Task 1 through 7, there are some users who have issues with completing the tasks in social function. a check with their feedback reveals that for tasks 7.2 where we asked users to find our a specific user's post, they had difficulty in searching for it and had to resort to scrolling through the page to manually find it. Some users also thought that they could find friends through the 'friends' tab, and thought that the find users and friends tab should be combined.
Based on the task-based user testing of each feature, users were asked about the utility of the functions based on their needs. Based on the results (as shown in the graph above), generally our testers find that most of the functions are useful. Some feel that it addresses their need for a personal financial planning tool that they can track on a weekly/monthly basis. There are some users who felt that the social function does not feel of use to them, and some are concerned that the ability to let other users see their financial status may be a privacy issue or even a potential security issue. Even though I-Wealth does not use any sensitive data that may identify users or link sensitive financial information through their social function, these users are not comfortable with sharing of non-sensitive financial details inside a personal financial planning application.
Mobile Quantitative Results
Similar to the Web Task-Based Testing, we asked our 10 mobile testers to follow a set of instructions based on the functionalities of the application, they would then answer the ease in which they were able to complete the tasks given for each functionality tested - each tasks would be rated between 1 (Very Difficult) to 5 (Very Easy)
Task 1
- Task 1.1: Complete Sign up & Questionnaire
- Task 1.2: View your credit profile analysis
Task 2
- Task 2.1: Update your Assets financial records
- Task 2.2: Update your Income & Expenses financial records
Task 3
- Task 3.1: Adding a new Milestone
- Task 3.2: Adding a contribution to your Milestone
Task 4
- Task 4.1: Setting up a Budget
- Task 4.2: Adding an Expense
Task 5
- Task 5.1: Add a new friend
- Task 5.2: Commenting on a post
- Task 5.3: Create a new post
Similar to the Web results, users were generally able to complete Task 1 through 5 without much difficulty, there were some testers that had difficulty in completing the task 5.2, which was difficult for users to comment on a specific post as they had to scroll through a number of posts on the mobile interface in order to find the right one.
We asked our mobile testers their view of the mobile function utility with regards to their needs. Similar to our web results, our mobile testers felt that the mobile functions were useful , especially with regards to the cash expense tracker. Some users felt that this was useful in planning their budget and help limit their expenses. the social function was seen by some of our testers as not that useful, albeit for different reasons as compared to the web results for social. Testers felt that the UI for the social function can be further improved, as the current UI does not easily help in the completion of the social tasks.
Overall Quantitative Results
After completing of the tasks and feedback based on each of the functions to be tested, our testers were asked about the Overall usability and functionality of the I-Wealth Application. Testers were asked to rate between 1 (Worst) to 5 (Best) for Usefulness of the application, as well as the User Experience of it.
In terms of overall usefulness, our application scored relatively well among our testers, as a whole they feel that it has the required functions that makes it a good personal financial planning and tracking application. Similarly, the overall user experience of our application has been rated almost as well, with many appreciating the simple usability of most parts of the applications. There are still some minor improvements to be made that were found by the testers.
In addition to the above questions, we asked our users - among the features that our application offers, to pick the top 5 important features to them. as seen from the above graph, features that had at least 70% mentions among users were
- Financial Summary (Assets, Liabilities, Income & Expenses)
- Cash Expense Tracker (Budget)
- Financial Tools (Retirement Calculator & Loan Calculator)
These coincides with our market research that there is a need for a one-stop application that offers these different functions under a single account, allowing them to track their finances from the web & Mobile
The survey also showed that our testers find the social function to be the least important of the features that I-Wealth has, and as explained by the tasks-based results, many are not comfortable with mixing private financial information with a social function