HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2016T1 Charlies-Angels-UAT2"

From IS480
Jump to navigation Jump to search
(Created page with "<!--TEAM LOGO--> center|300px|link= <br/> <!--MAIN HEADER --> {|style="background-color:#000000;" width="100%" cellspacing="0" cellpaddin...")
 
Line 49: Line 49:
 
<!--CONTENT-->
 
<!--CONTENT-->
 
<div style="margin-top:20px;">
 
<div style="margin-top:20px;">
 
+
==Survey Findings==
 
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Survey Findings</font>
 
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Survey Findings</font>
 
</div>
 
</div>
 
+
===Key Findings from Survey===
 
<div style="margin-top: 20px;">
 
<div style="margin-top: 20px;">
 
<p>  
 
<p>  
Line 74: Line 74:
 
</p><br/><br/>
 
</p><br/><br/>
 
<p>We have also took our initial design of the application, specifically for the Robot Advisor to the users, and have requested for their feedback regarding the User Interface and Experience. The reason why we narrowed down to specifically Robot Advisor as it is a never-before-seen feature in any portfolio management application. The following are screenshots of the design that was shown to the users: <br/><br/>
 
<p>We have also took our initial design of the application, specifically for the Robot Advisor to the users, and have requested for their feedback regarding the User Interface and Experience. The reason why we narrowed down to specifically Robot Advisor as it is a never-before-seen feature in any portfolio management application. The following are screenshots of the design that was shown to the users: <br/><br/>
 +
===Screenshots of CPF-Robot Advisor===
 
<b>Screenshot #1:</b> [[Image:Charlies_Angels_CPF_1.jpg|1000px|link=]]<br/>
 
<b>Screenshot #1:</b> [[Image:Charlies_Angels_CPF_1.jpg|1000px|link=]]<br/>
 
<b>Screenshot #2:</b> [[Image:Charlies_Angels_CPF_2.jpg|1000px|link=]]<br/>
 
<b>Screenshot #2:</b> [[Image:Charlies_Angels_CPF_2.jpg|1000px|link=]]<br/>
 
<b>Screenshot #3:</b> [[Image:Charlies_Angels_CPF_3.jpg|1000px|link=]]<br/><br/>
 
<b>Screenshot #3:</b> [[Image:Charlies_Angels_CPF_3.jpg|1000px|link=]]<br/><br/>
 +
===User Feedback via Survey===
 
<b>Key Comments:</b><br/>
 
<b>Key Comments:</b><br/>
 
<ul>
 
<ul>
Line 88: Line 90:
 
</div>
 
</div>
  
 +
==Regression Testing==
 
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Regression Testing</font>
 
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Regression Testing</font>
 
</div>
 
</div>
Line 122: Line 125:
 
</div>
 
</div>
  
 +
==UAT Results==
 
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> UAT Results & Findings</font>
 
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> UAT Results & Findings</font>
 
</div>
 
</div>
Line 139: Line 143:
 
<div style="background:#ffffff; padding: 10px">
 
<div style="background:#ffffff; padding: 10px">
 
<b>Date:</b> 15 Sep 2016 - 16 Sep 2016<br/>
 
<b>Date:</b> 15 Sep 2016 - 16 Sep 2016<br/>
<b>Venue:</b> SIS CR 3-1 & SIS CR 3-2<br/>
+
<b>Venue:</b> School of Information Systems, Singapore Management University<br/>
<b>Duration:</b> 15 Sep 2016: 0900 - 1200 @ SIS CR 3-2 & 1800 - 2100 @ SIS CR 3-1; 16 Sep 2016: 0900 - 1200 & 1800 - 2100 @ SIS CR 3-2<br/>
+
<b>Duration:</b> 15 Sep 2016: 0900 - 1200 Hours @ SIS CR 3-2 & 1800 - 2100 Hours @ SIS CR 3-1; 16 Sep 2016: 0900 - 1200 & 1800 - 2100 Hours @ SIS CR 3-2<br/>
<b>Number of Participants:</b>TBC<br/>
+
<b>Number of Participants:</b> TBC<br/>
 
<b>Target Audience:</b> Users with Beginners' Investment Background<br/>
 
<b>Target Audience:</b> Users with Beginners' Investment Background<br/>
 
<br/>
 
<br/>
Line 152: Line 156:
 
<li>&nbsp;&nbsp;Determine is the user interface is intuitive</li>
 
<li>&nbsp;&nbsp;Determine is the user interface is intuitive</li>
 
<li>&nbsp;&nbsp;Discover ways to improve features and functions of the website based on the results of User Testing #2</li>
 
<li>&nbsp;&nbsp;Discover ways to improve features and functions of the website based on the results of User Testing #2</li>
<li>Validate CPF & Housing Loan functionality and its usefulness</li>
+
<li>&nbsp;&nbsp;Introduce CPF & Housing Loan calculations - Never seen before feature in the market</li>
 
</ol>
 
</ol>
 
<br/>
 
<br/>
Line 159: Line 163:
 
<b>Scope:</b><br/>
 
<b>Scope:</b><br/>
 
Functionalities tested are ones developed between Iteration 3 and 8<br/>
 
Functionalities tested are ones developed between Iteration 3 and 8<br/>
 +
 
<br/>
 
<br/>
 
<hr>
 
<hr>
Line 166: Line 171:
 
<ol>
 
<ol>
 
  <li>&nbsp;&nbsp;A UAT document with instructions on how to test the website have been given to the testers</li>
 
  <li>&nbsp;&nbsp;A UAT document with instructions on how to test the website have been given to the testers</li>
  <li>&nbsp;&nbsp;Participants will log down the testing outcomes & the team would note down the time taken per task in the sheet</li>
+
  <li>&nbsp;&nbsp;Participants will log down the testing outcomes & team members would note the time taken per task in the sheet</li>
 
  <li>&nbsp;&nbsp;Participants are welcomed to type their general comments and feedback into the feedback textbox provided at the end of the test plan document</li>
 
  <li>&nbsp;&nbsp;Participants are welcomed to type their general comments and feedback into the feedback textbox provided at the end of the test plan document</li>
 
</ol>
 
</ol>
Line 175: Line 180:
 
<br/>
 
<br/>
 
The UAT document requests participants to perform the following task(s):
 
The UAT document requests participants to perform the following task(s):
 +
To be filled in after UAT
 
<br/>
 
<br/>
 
For every task, participants were required to document down the following information:
 
For every task, participants were required to document down the following information:
Line 190: Line 196:
 
<br/>
 
<br/>
 
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff">  Results</font>
 
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff">  Results</font>
 +
To be filled in after UAT
 
</div>
 
</div>
 
 
<br/>
 
<br/>
 
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Key Findings</font>
 
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Key Findings</font>
Line 197: Line 203:
 
<br/>
 
<br/>
 
<b>Overall Findings</b>
 
<b>Overall Findings</b>
 
+
To be filled in after UAT
 
<br/>
 
<br/>
 
<hr>
 
<hr>
 
<b>Key Improvements to be made</b>
 
<b>Key Improvements to be made</b>
 
+
To be filled in after UAT
 
<br/>
 
<br/>
 
</div>
 
</div>

Revision as of 15:46, 11 September 2016


Charlies Angels Logo.png


Charlies Angels Home.png  HOME

 

Charlies Angels About Us.png  ABOUT US

 

Charlies Angels Project Overview.png  PROJECT OVERVIEW

 

Charlies Angels Project Management.png  PROJECT MANAGEMENT

 

Charlies Angels Project Documentation.png  DOCUMENTATION

 
Technical Documents Wireframes Charlies Angels Current Stage.png Quality Assurance Meeting Minutes Deliverables

Survey Findings

Survey Findings

Key Findings from Survey

This survey is meant to gather sentiments towards the features of our application that is intended to be rolled out (i.e. Dashboard, Robot Advisor). The targeted audience in this survey are millenials whom have little or no investment experience.

Key Findings:

  • Total no. of participants: 50
  • We have a fair mix of composition of gender, with 64% males and 36% females
  • All participants were aged between 20-29
  • 96% of our participants were Chinese, and 4% were Malay
  • 22% of our participants have began working full time, 76% have not began, and the remaining 2% are currently looking for jobs
  • We discovered that 92% of participants place between $0-$500 monthly into investments, or 8% > $1000. Surprisingly, there seem to not be a 'moderate' range of $501- $1000
  • 68% of participants have not began investment, while the other 32% being distributed across several ranges
  • 96% of participants felt that a feature to consider CPF and Housing Loan would be a useful one in a portfolio management

Graphical breakdowns of the survey can be found below:
Charlies Angels Survey Age.pngCharlies Angels Survey Gender.png
Charlies Angels Survey Race.pngCharlies Angels Survey Working.png
Charlies Angels Survey InvestmentExp.pngCharlies Angels Survey InvestmentAmt.png
Charlies Angels Survey CPF.png



We have also took our initial design of the application, specifically for the Robot Advisor to the users, and have requested for their feedback regarding the User Interface and Experience. The reason why we narrowed down to specifically Robot Advisor as it is a never-before-seen feature in any portfolio management application. The following are screenshots of the design that was shown to the users:

Screenshots of CPF-Robot Advisor

Screenshot #1: Charlies Angels CPF 1.jpg
Screenshot #2: Charlies Angels CPF 2.jpg
Screenshot #3: Charlies Angels CPF 3.jpg

User Feedback via Survey

Key Comments:

  • Having to input so many fields at once is really troublesome. It is a turn off!
  • I have not even began working, I don't have CPF, so effectively having me to enter 0s does not make sense
  • I am not buying a house so soon, housing loan does not affect me
  • Maybe a segmented survey would be more pleasing to the eyes

With these comments, we have properly evaluated that the user interface created was horrible and required immediate actions to be taken. This is despite of the good intentions of being thorough and precise when it came to calculations. Instead, we have considered what are the most essential of inputs, and have changed the user interface to ensure a more seamless experience for the user to utilise the feature.

Regression Testing

Regression Testing
Results of Internal Unit Testing
Iteration No. Date Results
3 06 JUL 2016 33/36; Bug Metrics of 7 - Hitting 1 High Impact & 2 Low Impact
4 27 JUL 2016 69/74; Bug Metrics of 9 - Hitting 1 High Impact & 4 Low Impact
5 10 AUG 2016 87/90; Bug Metrics of 7 - Hitting 1 High Impact & 2 Low Impact
6 29 AUG 2016 101/105; Bug Metrics of 8 - Hitting 1 High Impact & 3 Low Impact
7 8 SEP 2016 118/120; Bug Metrics of 6 - Hitting 1 High Impact & 1 Low Impact

UAT Results

UAT Results & Findings

Date: 15 Sep 2016 - 16 Sep 2016
Venue: School of Information Systems, Singapore Management University
Duration: 15 Sep 2016: 0900 - 1200 Hours @ SIS CR 3-2 & 1800 - 2100 Hours @ SIS CR 3-1; 16 Sep 2016: 0900 - 1200 & 1800 - 2100 Hours @ SIS CR 3-2
Number of Participants: TBC
Target Audience: Users with Beginners' Investment Background



Objectives:

  1.   Identify functionalities and usability issues
  2.   Determine is the user interface is intuitive
  3.   Discover ways to improve features and functions of the website based on the results of User Testing #2
  4.   Introduce CPF & Housing Loan calculations - Never seen before feature in the market




Scope:
Functionalities tested are ones developed between Iteration 3 and 8




Procedure:

  1.   A UAT document with instructions on how to test the website have been given to the testers
  2.   Participants will log down the testing outcomes & team members would note the time taken per task in the sheet
  3.   Participants are welcomed to type their general comments and feedback into the feedback textbox provided at the end of the test plan document




Tasks:
The UAT document requests participants to perform the following task(s): To be filled in after UAT
For every task, participants were required to document down the following information:

  • Execution of Task (Successful or Unsuccessful)
  • Outcome
  • Time Taken


At the end of the test plan, we also asked the participants the following questions:

  • Do you have investment knowledge prior to using this application?
  • Any Comments?


Results

To be filled in after UAT


Key Findings


Overall Findings To be filled in after UAT


Key Improvements to be made To be filled in after UAT