HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2016T1 Charlies-Angels-UAT2"

From IS480
Jump to navigation Jump to search
Line 145: Line 145:
 
<b>Venue:</b> School of Information Systems, Singapore Management University<br/>
 
<b>Venue:</b> School of Information Systems, Singapore Management University<br/>
 
<b>Duration:</b> 15 Sep 2016: 0900 - 1200 Hours @ SIS CR 3-2 & 1800 - 2100 Hours @ SIS CR 3-1; 16 Sep 2016: 0900 - 1200 & 1800 - 2100 Hours @ SIS CR 3-2<br/>
 
<b>Duration:</b> 15 Sep 2016: 0900 - 1200 Hours @ SIS CR 3-2 & 1800 - 2100 Hours @ SIS CR 3-1; 16 Sep 2016: 0900 - 1200 & 1800 - 2100 Hours @ SIS CR 3-2<br/>
<b>Number of Participants:</b> TBC<br/>
+
<b>Number of Participants:</b> 20<br/>
<b>Target Audience:</b> Millennials; aged 16-36 with Basic Investment Background<br/>
+
<b>Target Audience:</b> Millennials; aged 16-36 with Basic or No Investment Background<br/>
 
<br/>
 
<br/>
 
<hr>
 
<hr>
Line 225: Line 225:
 
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff">  Results</font>
 
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff">  Results</font>
 
</div>
 
</div>
To be filled in after UAT
+
<b>Demographics of our testers</b><br/>
 +
<ul>
 +
<li>Total number of testers: 20</li>
 +
<li>Age group: 19 testers aged between 20 and 29; 1 tester aged above 30 years old</li>
 +
<li>Working: 3 testers are currently working</li>
 +
<li>Not Working: 17 testers are currently not working</li>
 +
<li>Investment Background: 12 of 20 testers indicated no background; 3 out of 20 testers indicated investment background of half a year; 3 out of 20 testers indicated investment background of 1 year; and the remaining 2 testers indicated investment background of 2 years
 +
</ul>
 
<br/>
 
<br/>
 
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Key Findings</font>
 
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Key Findings</font>

Revision as of 22:42, 25 September 2016


Charlies Angels Logo.png


Charlies Angels Home.png  HOME

 

Charlies Angels About Us.png  ABOUT US

 

Charlies Angels Project Overview.png  PROJECT OVERVIEW

 

Charlies Angels Project Management.png  PROJECT MANAGEMENT

 

Charlies Angels Project Documentation.png  DOCUMENTATION

 
Technical Documents Wireframes Charlies Angels Current Stage.png Quality Assurance Meeting Minutes Deliverables

Survey Findings

Survey Findings

Key Findings from Survey

This survey is meant to gather sentiments towards the features of our application that is intended to be rolled out (i.e. Dashboard, Robot Advisor). The targeted audience in this survey are millenials whom have little or no investment experience.

Key Findings:

  • Total no. of participants: 50
  • We have a fair mix of composition of gender, with 64% males and 36% females
  • All participants were aged between 20-29
  • 96% of our participants were Chinese, and 4% were Malay
  • 22% of our participants have began working full time, 76% have not began, and the remaining 2% are currently looking for jobs
  • We discovered that 92% of participants place between $0-$500 monthly into investments, or 8% > $1000. Surprisingly, there seem to not be a 'moderate' range of $501- $1000
  • 68% of participants have not began investment, while the other 32% being distributed across several ranges
  • 96% of participants felt that a feature to consider CPF and Housing Loan would be a useful one in a portfolio management

Graphical breakdowns of the survey can be found below:
Charlies Angels Survey Age.pngCharlies Angels Survey Gender.png
Charlies Angels Survey Race.pngCharlies Angels Survey Working.png
Charlies Angels Survey InvestmentExp.pngCharlies Angels Survey InvestmentAmt.png
Charlies Angels Survey CPF.png



We have also took our initial design of the application, specifically for the Robot Advisor to the users, and have requested for their feedback regarding the User Interface and Experience. The reason why we narrowed down to specifically Robot Advisor as it is a never-before-seen feature in any portfolio management application. The following are screenshots of the design that was shown to the users:

Screenshots of CPF-Robot Advisor

Screenshot #1: Charlies Angels CPF 1.jpg
Screenshot #2: Charlies Angels CPF 2.jpg
Screenshot #3: Charlies Angels CPF 3.jpg

User Feedback via Survey

Key Comments:

  • Having to input so many fields at once is really troublesome. It is a turn off!
  • I have not even began working, I don't have CPF, so effectively having me to enter 0s does not make sense
  • I am not buying a house so soon, housing loan does not affect me
  • Maybe a segmented survey would be more pleasing to the eyes

With these comments, we have properly evaluated that the user interface created was horrible and required immediate actions to be taken. This is despite of the good intentions of being thorough and precise when it came to calculations. Instead, we have considered what are the most essential of inputs, and have changed the user interface to ensure a more seamless experience for the user to utilise the feature.

Regression Testing

Regression Testing
Results of Internal Unit Testing
Iteration No. Date Results
3 06 JUL 2016 33/36; Bug Metrics of 7 - Hitting 1 High Impact & 2 Low Impact
4 27 JUL 2016 69/74; Bug Metrics of 9 - Hitting 1 High Impact & 4 Low Impact
5 10 AUG 2016 87/90; Bug Metrics of 7 - Hitting 1 High Impact & 2 Low Impact
6 29 AUG 2016 101/105; Bug Metrics of 8 - Hitting 1 High Impact & 3 Low Impact
7 8 SEP 2016 118/120; Bug Metrics of 6 - Hitting 1 High Impact & 1 Low Impact

UAT #2 Results

UAT Results & Findings

Date: 15 Sep 2016 - 16 Sep 2016
Venue: School of Information Systems, Singapore Management University
Duration: 15 Sep 2016: 0900 - 1200 Hours @ SIS CR 3-2 & 1800 - 2100 Hours @ SIS CR 3-1; 16 Sep 2016: 0900 - 1200 & 1800 - 2100 Hours @ SIS CR 3-2
Number of Participants: 20
Target Audience: Millennials; aged 16-36 with Basic or No Investment Background



Objectives:

  1.   Identify functionalities and usability issues
  2.   Determine is the user interface is intuitive
  3.   Discover ways to improve features and functions of the website based on the results of User Testing #2
  4.   Introduce CPF & Housing Loan calculations - Never seen before feature in the market




Scope:
Functionalities tested are ones developed between Iteration 3 and 8




Procedure:

  1.   A UAT document with instructions on how to test the website have been given to the testers
  2.   Participants will log down the testing outcomes & team members would note the time taken per task in the sheet
  3.   Participants are welcomed to type their general comments and feedback into the feedback textbox provided at the end of the test plan document




Tasks:
The UAT document requests participants to perform the following task(s): To be filled in after UAT
For every task, participants were required to document down the following information:

  • Execution of Task (Successful or Unsuccessful)
  • Outcome
  • Time Taken


  • Login & Registration Test Cases
    • Register a New Account
    • Retrieve your Password
    • Login
    • Change your Password
  • Portfolio Test Cases
    • Create a Portfolio
    • Search for a Stock
    • Buy a Specific Stock
    • Buy Two Other Stocks
    • Sell One Stock
  • PDF & Excel Test Cases
    • View your Portfolio Summary
    • Generate PDF Report of your Portfolio
    • View your PDF Report summary and verify if the information is correct
    • Generate Excel Report of your Portfolio
    • View your Excel Sheet and verify if the information is correct
    • Delete your Portfolio
  • Watch List Test Cases
    • Add any Two Stocks into your Portfolio
    • Delete the stocks from your watch list


At the end of the test plan, we also asked the participants the following questions:

  • Demographics Questions such as Age, Race, Work Experience, Investment Habits
  • Do you have investment knowledge prior to using this application?
  • Any Comments?


Results

Demographics of our testers

  • Total number of testers: 20
  • Age group: 19 testers aged between 20 and 29; 1 tester aged above 30 years old
  • Working: 3 testers are currently working
  • Not Working: 17 testers are currently not working
  • Investment Background: 12 of 20 testers indicated no background; 3 out of 20 testers indicated investment background of half a year; 3 out of 20 testers indicated investment background of 1 year; and the remaining 2 testers indicated investment background of 2 years


Key Findings


Overall Findings To be filled in after UAT


Key Improvements to be made To be filled in after UAT