Difference between revisions of "IS480 Team wiki: 2016T1 Charlies-Angels-UAT2"
Xwzheng.2014 (talk | contribs) (Created page with "<!--TEAM LOGO--> center|300px|link= <br/> <!--MAIN HEADER --> {|style="background-color:#000000;" width="100%" cellspacing="0" cellpaddin...") |
Xwzheng.2014 (talk | contribs) |
||
Line 49: | Line 49: | ||
<!--CONTENT--> | <!--CONTENT--> | ||
<div style="margin-top:20px;"> | <div style="margin-top:20px;"> | ||
− | + | ==Survey Findings== | |
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Survey Findings</font> | <div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Survey Findings</font> | ||
</div> | </div> | ||
− | + | ===Key Findings from Survey=== | |
<div style="margin-top: 20px;"> | <div style="margin-top: 20px;"> | ||
<p> | <p> | ||
Line 74: | Line 74: | ||
</p><br/><br/> | </p><br/><br/> | ||
<p>We have also took our initial design of the application, specifically for the Robot Advisor to the users, and have requested for their feedback regarding the User Interface and Experience. The reason why we narrowed down to specifically Robot Advisor as it is a never-before-seen feature in any portfolio management application. The following are screenshots of the design that was shown to the users: <br/><br/> | <p>We have also took our initial design of the application, specifically for the Robot Advisor to the users, and have requested for their feedback regarding the User Interface and Experience. The reason why we narrowed down to specifically Robot Advisor as it is a never-before-seen feature in any portfolio management application. The following are screenshots of the design that was shown to the users: <br/><br/> | ||
+ | ===Screenshots of CPF-Robot Advisor=== | ||
<b>Screenshot #1:</b> [[Image:Charlies_Angels_CPF_1.jpg|1000px|link=]]<br/> | <b>Screenshot #1:</b> [[Image:Charlies_Angels_CPF_1.jpg|1000px|link=]]<br/> | ||
<b>Screenshot #2:</b> [[Image:Charlies_Angels_CPF_2.jpg|1000px|link=]]<br/> | <b>Screenshot #2:</b> [[Image:Charlies_Angels_CPF_2.jpg|1000px|link=]]<br/> | ||
<b>Screenshot #3:</b> [[Image:Charlies_Angels_CPF_3.jpg|1000px|link=]]<br/><br/> | <b>Screenshot #3:</b> [[Image:Charlies_Angels_CPF_3.jpg|1000px|link=]]<br/><br/> | ||
+ | ===User Feedback via Survey=== | ||
<b>Key Comments:</b><br/> | <b>Key Comments:</b><br/> | ||
<ul> | <ul> | ||
Line 88: | Line 90: | ||
</div> | </div> | ||
+ | ==Regression Testing== | ||
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Regression Testing</font> | <div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Regression Testing</font> | ||
</div> | </div> | ||
Line 122: | Line 125: | ||
</div> | </div> | ||
+ | ==UAT Results== | ||
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> UAT Results & Findings</font> | <div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> UAT Results & Findings</font> | ||
</div> | </div> | ||
Line 139: | Line 143: | ||
<div style="background:#ffffff; padding: 10px"> | <div style="background:#ffffff; padding: 10px"> | ||
<b>Date:</b> 15 Sep 2016 - 16 Sep 2016<br/> | <b>Date:</b> 15 Sep 2016 - 16 Sep 2016<br/> | ||
− | <b>Venue:</b> | + | <b>Venue:</b> School of Information Systems, Singapore Management University<br/> |
− | <b>Duration:</b> 15 Sep 2016: 0900 - 1200 @ SIS CR 3-2 & 1800 - 2100 @ SIS CR 3-1; 16 Sep 2016: 0900 - 1200 & 1800 - 2100 @ SIS CR 3-2<br/> | + | <b>Duration:</b> 15 Sep 2016: 0900 - 1200 Hours @ SIS CR 3-2 & 1800 - 2100 Hours @ SIS CR 3-1; 16 Sep 2016: 0900 - 1200 & 1800 - 2100 Hours @ SIS CR 3-2<br/> |
− | <b>Number of Participants:</b>TBC<br/> | + | <b>Number of Participants:</b> TBC<br/> |
<b>Target Audience:</b> Users with Beginners' Investment Background<br/> | <b>Target Audience:</b> Users with Beginners' Investment Background<br/> | ||
<br/> | <br/> | ||
Line 152: | Line 156: | ||
<li> Determine is the user interface is intuitive</li> | <li> Determine is the user interface is intuitive</li> | ||
<li> Discover ways to improve features and functions of the website based on the results of User Testing #2</li> | <li> Discover ways to improve features and functions of the website based on the results of User Testing #2</li> | ||
− | <li> | + | <li> Introduce CPF & Housing Loan calculations - Never seen before feature in the market</li> |
</ol> | </ol> | ||
<br/> | <br/> | ||
Line 159: | Line 163: | ||
<b>Scope:</b><br/> | <b>Scope:</b><br/> | ||
Functionalities tested are ones developed between Iteration 3 and 8<br/> | Functionalities tested are ones developed between Iteration 3 and 8<br/> | ||
+ | |||
<br/> | <br/> | ||
<hr> | <hr> | ||
Line 166: | Line 171: | ||
<ol> | <ol> | ||
<li> A UAT document with instructions on how to test the website have been given to the testers</li> | <li> A UAT document with instructions on how to test the website have been given to the testers</li> | ||
− | <li> Participants will log down the testing outcomes & | + | <li> Participants will log down the testing outcomes & team members would note the time taken per task in the sheet</li> |
<li> Participants are welcomed to type their general comments and feedback into the feedback textbox provided at the end of the test plan document</li> | <li> Participants are welcomed to type their general comments and feedback into the feedback textbox provided at the end of the test plan document</li> | ||
</ol> | </ol> | ||
Line 175: | Line 180: | ||
<br/> | <br/> | ||
The UAT document requests participants to perform the following task(s): | The UAT document requests participants to perform the following task(s): | ||
+ | To be filled in after UAT | ||
<br/> | <br/> | ||
For every task, participants were required to document down the following information: | For every task, participants were required to document down the following information: | ||
Line 190: | Line 196: | ||
<br/> | <br/> | ||
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Results</font> | <div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Results</font> | ||
+ | To be filled in after UAT | ||
</div> | </div> | ||
− | |||
<br/> | <br/> | ||
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Key Findings</font> | <div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Key Findings</font> | ||
Line 197: | Line 203: | ||
<br/> | <br/> | ||
<b>Overall Findings</b> | <b>Overall Findings</b> | ||
− | + | To be filled in after UAT | |
<br/> | <br/> | ||
<hr> | <hr> | ||
<b>Key Improvements to be made</b> | <b>Key Improvements to be made</b> | ||
− | + | To be filled in after UAT | |
<br/> | <br/> | ||
</div> | </div> |
Revision as of 15:46, 11 September 2016
Technical Documents | Wireframes | Quality Assurance | Meeting Minutes | Deliverables |
Contents
Survey Findings
Key Findings from Survey
This survey is meant to gather sentiments towards the features of our application that is intended to be rolled out (i.e. Dashboard, Robot Advisor). The targeted audience in this survey are millenials whom have little or no investment experience.
Key Findings:
- Total no. of participants: 50
- We have a fair mix of composition of gender, with 64% males and 36% females
- All participants were aged between 20-29
- 96% of our participants were Chinese, and 4% were Malay
- 22% of our participants have began working full time, 76% have not began, and the remaining 2% are currently looking for jobs
- We discovered that 92% of participants place between $0-$500 monthly into investments, or 8% > $1000. Surprisingly, there seem to not be a 'moderate' range of $501- $1000
- 68% of participants have not began investment, while the other 32% being distributed across several ranges
- 96% of participants felt that a feature to consider CPF and Housing Loan would be a useful one in a portfolio management
Graphical breakdowns of the survey can be found below:
We have also took our initial design of the application, specifically for the Robot Advisor to the users, and have requested for their feedback regarding the User Interface and Experience. The reason why we narrowed down to specifically Robot Advisor as it is a never-before-seen feature in any portfolio management application. The following are screenshots of the design that was shown to the users:
Screenshots of CPF-Robot Advisor
Screenshot #1:
Screenshot #2:
Screenshot #3:
User Feedback via Survey
Key Comments:
- Having to input so many fields at once is really troublesome. It is a turn off!
- I have not even began working, I don't have CPF, so effectively having me to enter 0s does not make sense
- I am not buying a house so soon, housing loan does not affect me
- Maybe a segmented survey would be more pleasing to the eyes
With these comments, we have properly evaluated that the user interface created was horrible and required immediate actions to be taken. This is despite of the good intentions of being thorough and precise when it came to calculations. Instead, we have considered what are the most essential of inputs, and have changed the user interface to ensure a more seamless experience for the user to utilise the feature.
Regression Testing
Results of Internal Unit Testing | ||
---|---|---|
Iteration No. | Date | Results |
3 | 06 JUL 2016 | 33/36; Bug Metrics of 7 - Hitting 1 High Impact & 2 Low Impact |
4 | 27 JUL 2016 | 69/74; Bug Metrics of 9 - Hitting 1 High Impact & 4 Low Impact |
5 | 10 AUG 2016 | 87/90; Bug Metrics of 7 - Hitting 1 High Impact & 2 Low Impact |
6 | 29 AUG 2016 | 101/105; Bug Metrics of 8 - Hitting 1 High Impact & 3 Low Impact |
7 | 8 SEP 2016 | 118/120; Bug Metrics of 6 - Hitting 1 High Impact & 1 Low Impact |
UAT Results
Date: 15 Sep 2016 - 16 Sep 2016
Venue: School of Information Systems, Singapore Management University
Duration: 15 Sep 2016: 0900 - 1200 Hours @ SIS CR 3-2 & 1800 - 2100 Hours @ SIS CR 3-1; 16 Sep 2016: 0900 - 1200 & 1800 - 2100 Hours @ SIS CR 3-2
Number of Participants: TBC
Target Audience: Users with Beginners' Investment Background
Objectives:
- Identify functionalities and usability issues
- Determine is the user interface is intuitive
- Discover ways to improve features and functions of the website based on the results of User Testing #2
- Introduce CPF & Housing Loan calculations - Never seen before feature in the market
Scope:
Functionalities tested are ones developed between Iteration 3 and 8
Procedure:
- A UAT document with instructions on how to test the website have been given to the testers
- Participants will log down the testing outcomes & team members would note the time taken per task in the sheet
- Participants are welcomed to type their general comments and feedback into the feedback textbox provided at the end of the test plan document
Tasks:
The UAT document requests participants to perform the following task(s):
To be filled in after UAT
For every task, participants were required to document down the following information:
- Execution of Task (Successful or Unsuccessful)
- Outcome
- Time Taken
At the end of the test plan, we also asked the participants the following questions:
- Do you have investment knowledge prior to using this application?
- Any Comments?
To be filled in after UAT
Overall Findings
To be filled in after UAT
Key Improvements to be made
To be filled in after UAT