IS480 Team wiki: 2015T1 Team Hexa User Test 4
HOME | ABOUT US | PROJECT OVERVIEW | PROJECT MANAGEMENT | DOCUMENTATION |
TECHNICAL DOCUMENTS | DESIGN DOCUMENTS | TEST DOCUMENTS | MINUTES | PROJECT DOCUMENTS | DEPLOYMENT |
INTERNAL TESTING | USER TEST 1 | USER TEST 2 | USER TEST 3 | USER TEST 4 |
---|
Contents
User Test 4 (UT4) Test Plan
Objectives:
- Gather feedback regarding user interface of developed functions
- Detect usability issues based on user behaviour
- Find out if new users are able to easily learn and use the application
- Test success rate of users completing assigned tasks
- Find out which developed functions are the most important & provides the best user experience
- To use UT results to improve our Web Application / Mobile Application
Scope of Testing:
Web
- Sign up & Questionnaire
- Financial Summary
- Financial Health Ratios & Analysis
- Debt & Insurance
- Milestones
- Budgeting
- Financial Tools
- Social
Mobile
- Sign up & Questionnaire
- Financial Summary
- Milestones
- Budgeting
- Social
Procedure
- Pre User Testing
- 10/11/15 – Send out emails/Message to the users briefing them about the aim of the user test and also giving them details of the actions they have to perform.
- User Testing
- 11/11/15 9:00 am - 18/11/15 01:00 am: Send out the URL of the website and the post-survey Google Form to the users. The users can login to the website from their desired location and browse through the website.
- Post User Testing
- 11/11/15 9:00 am - 18/11/15 01:00 am: The users can fill the post-survey questions from their desired location.
- 19/11/15: Send out emails/Messages to the users to thank them for their contribution.
- Consolidate the feedback gathered and notify the developers about issues.
User Test Results
The following are the quantitative results collated from the 32 unique user responses
- Number of Web Users = 22
- Number of Mobile Users = 10
Demographics of Users
During our UT4, we asked our users about their age and employment background. This also helps verify that our users are within the target scope of users for our application
Web Quantitative Results
For the tasks based questions, we asked users to follow a set of instructions based on the functionalities of the application, they would then answer the ease in which they were able to complete the tasks given for each functionality tested - each tasks would be rated between 1 (Very Difficult) to 5 (Very Easy)
Task 1
- Task 1.1: Complete Sign up & Questionnaire
- Task 1.2: View your credit profile analysis
Task 2
- Task 2.1: Update your Assets financial records
- Task 2.2: Update your Income & Expenses financial records
Task 3
- Task 3.1: Adding a new Insurance
- Task 3.2: Adding a new Debt
Task 4
- Task 4.1: Adding a new Milestone
- Task 4.2: Adding a contribution to your Milestone
Task 5
- Task 5.1: Setting up a Budget
- Task 5.2: Adding an Expense
Task 6
- Task 6.1: Retirement Planning Calculator
- Task 6.2: Loan Comparison and Calculator
Task 7
- Task 7.1: Add a new friend
- Task 7.2: Commenting on a post
- Task 7.3: Create a new post
Most users were able to complete Task 1 through 7, there are some users who have issues with completing the tasks in social function. a check with their feedback reveals that for tasks 7.2 where we asked users to find our a specific user's post, they had difficulty in searching for it and had to resort to scrolling through the page to manually find it. Some users also thought that they could find friends through the 'friends' tab, and thought that the find users and friends tab should be combined.
Based on the task-based user testing of each feature, users were asked about the utility of the functions based on their needs. Based on the results (as shown in the graph above), generally our testers find that most of the functions are useful. Some feel that it addresses their need for a personal financial planning tool that they can track on a weekly/monthly basis. There are some users who felt that the social function does not feel of use to them, and some are concerned that the ability to let other users see their financial status may be a privacy issue or even a potential security issue. Even though I-Wealth does not use any sensitive data that may identify users or link sensitive financial information through their social function, these users are not comfortable with sharing of non-sensitive financial details inside a personal financial planning application.
Mobile Quantitative Results
Overall Quantitative Results