Difference between revisions of "IS480 Team wiki: 2016T1 Charlies-Angels-UAT2"
Xwzheng.2014 (talk | contribs) |
Xwzheng.2014 (talk | contribs) |
||
Line 145: | Line 145: | ||
<b>Venue:</b> School of Information Systems, Singapore Management University<br/> | <b>Venue:</b> School of Information Systems, Singapore Management University<br/> | ||
<b>Duration:</b> 15 Sep 2016: 0900 - 1200 Hours @ SIS CR 3-2 & 1800 - 2100 Hours @ SIS CR 3-1; 16 Sep 2016: 0900 - 1200 & 1800 - 2100 Hours @ SIS CR 3-2<br/> | <b>Duration:</b> 15 Sep 2016: 0900 - 1200 Hours @ SIS CR 3-2 & 1800 - 2100 Hours @ SIS CR 3-1; 16 Sep 2016: 0900 - 1200 & 1800 - 2100 Hours @ SIS CR 3-2<br/> | ||
− | <b>Number of Participants:</b> | + | <b>Number of Participants:</b> 20<br/> |
− | <b>Target Audience:</b> Millennials; aged 16-36 with Basic Investment Background<br/> | + | <b>Target Audience:</b> Millennials; aged 16-36 with Basic or No Investment Background<br/> |
<br/> | <br/> | ||
<hr> | <hr> | ||
Line 225: | Line 225: | ||
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Results</font> | <div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Results</font> | ||
</div> | </div> | ||
− | + | <b>Demographics of our testers</b><br/> | |
+ | <ul> | ||
+ | <li>Total number of testers: 20</li> | ||
+ | <li>Age group: 19 testers aged between 20 and 29; 1 tester aged above 30 years old</li> | ||
+ | <li>Working: 3 testers are currently working</li> | ||
+ | <li>Not Working: 17 testers are currently not working</li> | ||
+ | <li>Investment Background: 12 of 20 testers indicated no background; 3 out of 20 testers indicated investment background of half a year; 3 out of 20 testers indicated investment background of 1 year; and the remaining 2 testers indicated investment background of 2 years | ||
+ | </ul> | ||
<br/> | <br/> | ||
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Key Findings</font> | <div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Key Findings</font> |
Revision as of 22:42, 25 September 2016
Technical Documents | Wireframes | Quality Assurance | Meeting Minutes | Deliverables |
Contents
Survey Findings
Key Findings from Survey
This survey is meant to gather sentiments towards the features of our application that is intended to be rolled out (i.e. Dashboard, Robot Advisor). The targeted audience in this survey are millenials whom have little or no investment experience.
Key Findings:
- Total no. of participants: 50
- We have a fair mix of composition of gender, with 64% males and 36% females
- All participants were aged between 20-29
- 96% of our participants were Chinese, and 4% were Malay
- 22% of our participants have began working full time, 76% have not began, and the remaining 2% are currently looking for jobs
- We discovered that 92% of participants place between $0-$500 monthly into investments, or 8% > $1000. Surprisingly, there seem to not be a 'moderate' range of $501- $1000
- 68% of participants have not began investment, while the other 32% being distributed across several ranges
- 96% of participants felt that a feature to consider CPF and Housing Loan would be a useful one in a portfolio management
Graphical breakdowns of the survey can be found below:
We have also took our initial design of the application, specifically for the Robot Advisor to the users, and have requested for their feedback regarding the User Interface and Experience. The reason why we narrowed down to specifically Robot Advisor as it is a never-before-seen feature in any portfolio management application. The following are screenshots of the design that was shown to the users:
Screenshots of CPF-Robot Advisor
Screenshot #1:
Screenshot #2:
Screenshot #3:
User Feedback via Survey
Key Comments:
- Having to input so many fields at once is really troublesome. It is a turn off!
- I have not even began working, I don't have CPF, so effectively having me to enter 0s does not make sense
- I am not buying a house so soon, housing loan does not affect me
- Maybe a segmented survey would be more pleasing to the eyes
With these comments, we have properly evaluated that the user interface created was horrible and required immediate actions to be taken. This is despite of the good intentions of being thorough and precise when it came to calculations. Instead, we have considered what are the most essential of inputs, and have changed the user interface to ensure a more seamless experience for the user to utilise the feature.
Regression Testing
Results of Internal Unit Testing | ||
---|---|---|
Iteration No. | Date | Results |
3 | 06 JUL 2016 | 33/36; Bug Metrics of 7 - Hitting 1 High Impact & 2 Low Impact |
4 | 27 JUL 2016 | 69/74; Bug Metrics of 9 - Hitting 1 High Impact & 4 Low Impact |
5 | 10 AUG 2016 | 87/90; Bug Metrics of 7 - Hitting 1 High Impact & 2 Low Impact |
6 | 29 AUG 2016 | 101/105; Bug Metrics of 8 - Hitting 1 High Impact & 3 Low Impact |
7 | 8 SEP 2016 | 118/120; Bug Metrics of 6 - Hitting 1 High Impact & 1 Low Impact |
UAT #2 Results
Date: 15 Sep 2016 - 16 Sep 2016
Venue: School of Information Systems, Singapore Management University
Duration: 15 Sep 2016: 0900 - 1200 Hours @ SIS CR 3-2 & 1800 - 2100 Hours @ SIS CR 3-1; 16 Sep 2016: 0900 - 1200 & 1800 - 2100 Hours @ SIS CR 3-2
Number of Participants: 20
Target Audience: Millennials; aged 16-36 with Basic or No Investment Background
Objectives:
- Identify functionalities and usability issues
- Determine is the user interface is intuitive
- Discover ways to improve features and functions of the website based on the results of User Testing #2
- Introduce CPF & Housing Loan calculations - Never seen before feature in the market
Scope:
Functionalities tested are ones developed between Iteration 3 and 8
Procedure:
- A UAT document with instructions on how to test the website have been given to the testers
- Participants will log down the testing outcomes & team members would note the time taken per task in the sheet
- Participants are welcomed to type their general comments and feedback into the feedback textbox provided at the end of the test plan document
Tasks:
The UAT document requests participants to perform the following task(s):
To be filled in after UAT
For every task, participants were required to document down the following information:
- Execution of Task (Successful or Unsuccessful)
- Outcome
- Time Taken
- Login & Registration Test Cases
- Register a New Account
- Retrieve your Password
- Login
- Change your Password
- Portfolio Test Cases
- Create a Portfolio
- Search for a Stock
- Buy a Specific Stock
- Buy Two Other Stocks
- Sell One Stock
- PDF & Excel Test Cases
- View your Portfolio Summary
- Generate PDF Report of your Portfolio
- View your PDF Report summary and verify if the information is correct
- Generate Excel Report of your Portfolio
- View your Excel Sheet and verify if the information is correct
- Delete your Portfolio
- Watch List Test Cases
- Add any Two Stocks into your Portfolio
- Delete the stocks from your watch list
At the end of the test plan, we also asked the participants the following questions:
- Demographics Questions such as Age, Race, Work Experience, Investment Habits
- Do you have investment knowledge prior to using this application?
- Any Comments?
Demographics of our testers
- Total number of testers: 20
- Age group: 19 testers aged between 20 and 29; 1 tester aged above 30 years old
- Working: 3 testers are currently working
- Not Working: 17 testers are currently not working
- Investment Background: 12 of 20 testers indicated no background; 3 out of 20 testers indicated investment background of half a year; 3 out of 20 testers indicated investment background of 1 year; and the remaining 2 testers indicated investment background of 2 years
Overall Findings
To be filled in after UAT
Key Improvements to be made
To be filled in after UAT