HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2015T1 Chipmunks User Testing 2"

From IS480
Jump to navigation Jump to search
 
(21 intermediate revisions by 2 users not shown)
Line 60: Line 60:
 
[[Image: Chipmunks_UT2_Icon_Selected.png|200px|link=IS480_Team_wiki:_2015T1 Chipmunks User Testing 2]]
 
[[Image: Chipmunks_UT2_Icon_Selected.png|200px|link=IS480_Team_wiki:_2015T1 Chipmunks User Testing 2]]
 
[[Image: Chipmunks LT1 Icon.png|200px|link=IS480_Team_wiki:_2015T1 Chipmunks Lab Testing 1]]
 
[[Image: Chipmunks LT1 Icon.png|200px|link=IS480_Team_wiki:_2015T1 Chipmunks Lab Testing 1]]
 +
[[Image: Chipmunks_ut3_icon.png|200px|link=IS480_Team_wiki:_2015T1 Chipmunks User Testing 3]]
 
</center>
 
</center>
 
==Test Plan==
 
==Test Plan==
Line 70: Line 71:
 
<b>Number of Users: </b>  
 
<b>Number of Users: </b>  
 
*Guy Weyns (Sponsor/Product Owner) <br>
 
*Guy Weyns (Sponsor/Product Owner) <br>
*Hd. Stock Selection Committee, UBS <br>
+
*Hd. Stock Selection Committee at a leading investment bank <br>
*Hd. Investment Research Division, UBS <br>
+
*Hd. Investment Research Division at a leading investment bank <br>
  
 
<b>Date: </b> 21 August 2015 – 31 August 2015 <br>
 
<b>Date: </b> 21 August 2015 – 31 August 2015 <br>
<b>Scope of UAT2</b><br>
+
<b>Scope of UT2</b><br>
 
* Log in/Log out functionality
 
* Log in/Log out functionality
 
* Registration functionality
 
* Registration functionality
Line 83: Line 84:
 
* View Reports functionality
 
* View Reports functionality
  
Testing Document: [https://drive.google.com/open?id=0BxHzSbena_cOOHloVWwtNmlsdTA UAT Document 2]
+
Testing Document: [https://drive.google.com/open?id=0BxHzSbena_cOOHloVWwtNmlsdTA UT Document 2]
  
 
<br><b>Procedure: </b> A set of User Testing document was supplied to the various testers which allows for them to input various comments, feedbacks, problem faced and recommendations for Stock Parser.  
 
<br><b>Procedure: </b> A set of User Testing document was supplied to the various testers which allows for them to input various comments, feedbacks, problem faced and recommendations for Stock Parser.  
Line 96: Line 97:
 
<i><b>
 
<i><b>
 
“The potential is immense. I am very interested in the future development of this and would love to see more.”
 
“The potential is immense. I am very interested in the future development of this and would love to see more.”
- Hd, Equity Research Division, UBS Investment Bank
+
- Hd, Investment Research Division at a leading investment bank
 
</b></i> <br>
 
</b></i> <br>
 
<i><b>
 
<i><b>
 
“Possibility for an online modelling platform, highlighting only essential items that can be similarly submitted and reviewed.”
 
“Possibility for an online modelling platform, highlighting only essential items that can be similarly submitted and reviewed.”
- Hd, Stock Selection Committee, UBS Investment Bank
+
- Hd, Stock Selection Committee at a leading investment bank
 +
</b></i>
 +
</center>
 +
<br>
 +
 
 +
* The list of pre-UAT and post-UAT changes can be found [https://www.dropbox.com/s/vsf9ckopov69xkv/UT%202%20Changes.docx?dl=0 here]
 +
 
 +
==Feedback Results==
 +
*Hd. Investment Research Division at a leading investment bank
 +
 
 +
{| class="wikitable"
 +
! style="font-weight: bold;background: #0077B5;color:#fff;" | How much does Stock Parser help in the following
 +
! style="font-weight: bold;background: #0077B5;color:#fff;" | Time Taken without Stock Parser
 +
! style="font-weight: bold;background: #0077B5;color:#fff;" | Time Taken with Stock Parser
 +
! style="font-weight: bold;background: #0077B5;color:#fff;" | Percentage Improvement (%)
 +
|-
 +
| Data Retrieval (Grabbing values from Capital IQ, Factset, Bloomberg)
 +
| 15 minutes
 +
| 1 minute
 +
| 93.33% time saved
 +
|-
 +
| Thesis Review (How much time does it take to review a thesis)
 +
| 45 minutes
 +
| 15 minutes
 +
| 66.67% time saved
 +
|-
 +
 
 +
|}
 +
 
 +
*Hd. Stock Selection Committee at a leading investment bank
 +
 
 +
{| class="wikitable"
 +
! style="font-weight: bold;background: #0077B5;color:#fff;" | How much does Stock Parser help in the following
 +
! style="font-weight: bold;background: #0077B5;color:#fff;" | Time Taken without Stock Parser
 +
! style="font-weight: bold;background: #0077B5;color:#fff;" | Time Taken with Stock Parser
 +
! style="font-weight: bold;background: #0077B5;color:#fff;" | Percentage Improvement (%)
 +
|-
 +
| Data Retrieval (Grabbing values from Capital IQ, Factset, Bloomberg)
 +
| 30 minutes
 +
| Instant
 +
| 100% time saved
 +
|-
 +
| Thesis Review (How much time does it take to review a thesis)
 +
| 45 minutes
 +
| 13.5 minutes
 +
| 70% time saved
 +
|-
 +
|}
 +
*Professor Guy Weyns
 +
 
 +
{| class="wikitable"
 +
! style="font-weight: bold;background: #0077B5;color:#fff;" | How much does Stock Parser help in the following
 +
! style="font-weight: bold;background: #0077B5;color:#fff;" | Time Taken without Stock Parser
 +
! style="font-weight: bold;background: #0077B5;color:#fff;" | Time Taken with Stock Parser
 +
! style="font-weight: bold;background: #0077B5;color:#fff;" | Percentage Improvement (%)
 +
|-
 +
| Data Retrieval (Grabbing values from Capital IQ, Factset, Bloomberg)
 +
| 5 minutes/company
 +
| 0.5 minutes
 +
| 90% time saved
 +
|-
 +
| Thesis Review (How much time does it take to review a thesis)
 +
| 1 hour
 +
| 20 minutes
 +
| 66.66% time saved
 +
|-
 +
| Investment Analysis
 +
| 2 hours
 +
| 20 minutes
 +
| 83.33% time saved
 +
|-
 +
|}
 +
 
 +
==Survey==
  
</b></i>
+
{| class="wikitable"
 +
! style="font-weight: bold;background: #0077B5;color:#fff;" | How much does Stock Parser help in the following?
 +
! style="font-weight: bold;background: #0077B5;color:#fff;" | On a scale of 1 - 7 (1 being not helpful, 7 being very helpful)
 +
! style="font-weight: bold;background: #0077B5;color:#fff;" | Comments
 +
|-
 +
| Quality of Investment Recommendations
 +
| 5.5
 +
| Future possibilities of an online modelling platform could be explored
 +
|-
 +
| Quality of Visualizations
 +
| 5
 +
| nil
 +
|-
 +
| Importance of Consistent Visualisations
 +
| 6
 +
| nil
 +
|-
 +
|}
  
</center>
 
 
<!--/Content-->
 
<!--/Content-->

Latest revision as of 14:04, 23 November 2015

Chipmunks-logo-small.png


Team Chipmunks Icon Home.png   HOME

 

Team Chipmunks Icon AboutUs.png   ABOUT US

 

Team Chipmunks Icon Overview.png   PROJECT OVERVIEW

 

Team Chipmunks Icon ProjectManagement.png   PROJECT MANAGEMENT

 

Team Chipmunks Icon Documentation.png   DOCUMENTATION

 


Chipmunks UserTesting Title.png

850637192 5981766254237212309.jpg Chipmunks UT1 Icon.png Chipmunks UT2 Icon Selected.png Chipmunks LT1 Icon.png Chipmunks ut3 icon.png

Test Plan

Objectives

  • Gathering feedback from potential stakeholders with regards to the heuristics and design of the existing functions of the current application
  • Identify any usability issues that persist in the application
  • Improvement of our application based on the results
  • Access the level of interest for our application on real industry users

Number of Users:

  • Guy Weyns (Sponsor/Product Owner)
  • Hd. Stock Selection Committee at a leading investment bank
  • Hd. Investment Research Division at a leading investment bank

Date: 21 August 2015 – 31 August 2015
Scope of UT2

  • Log in/Log out functionality
  • Registration functionality
  • Scenario Pricing Tree Single functionality
  • Scenario Pricing Tree Multiple functionality
  • Profitability Map functionality
  • Forecast Dispersion functionality
  • View Reports functionality

Testing Document: UT Document 2


Procedure: A set of User Testing document was supplied to the various testers which allows for them to input various comments, feedbacks, problem faced and recommendations for Stock Parser.

Results/Comments

  • A recommendation was made to include certain key aspects to shift the focus of the application’s display, allowing for a higher level consensus for the end users.
  • Minor tweaks to graphical displays of information for the various functionalities.
  • The users commended on the time savings brought about by the application as compared to current industry practices

The users of the application did further express their pleasure in using the application, notably stating

“The potential is immense. I am very interested in the future development of this and would love to see more.” - Hd, Investment Research Division at a leading investment bank
“Possibility for an online modelling platform, highlighting only essential items that can be similarly submitted and reviewed.” - Hd, Stock Selection Committee at a leading investment bank


  • The list of pre-UAT and post-UAT changes can be found here

Feedback Results

  • Hd. Investment Research Division at a leading investment bank
How much does Stock Parser help in the following Time Taken without Stock Parser Time Taken with Stock Parser Percentage Improvement (%)
Data Retrieval (Grabbing values from Capital IQ, Factset, Bloomberg) 15 minutes 1 minute 93.33% time saved
Thesis Review (How much time does it take to review a thesis) 45 minutes 15 minutes 66.67% time saved
  • Hd. Stock Selection Committee at a leading investment bank
How much does Stock Parser help in the following Time Taken without Stock Parser Time Taken with Stock Parser Percentage Improvement (%)
Data Retrieval (Grabbing values from Capital IQ, Factset, Bloomberg) 30 minutes Instant 100% time saved
Thesis Review (How much time does it take to review a thesis) 45 minutes 13.5 minutes 70% time saved
  • Professor Guy Weyns
How much does Stock Parser help in the following Time Taken without Stock Parser Time Taken with Stock Parser Percentage Improvement (%)
Data Retrieval (Grabbing values from Capital IQ, Factset, Bloomberg) 5 minutes/company 0.5 minutes 90% time saved
Thesis Review (How much time does it take to review a thesis) 1 hour 20 minutes 66.66% time saved
Investment Analysis 2 hours 20 minutes 83.33% time saved

Survey

How much does Stock Parser help in the following? On a scale of 1 - 7 (1 being not helpful, 7 being very helpful) Comments
Quality of Investment Recommendations 5.5 Future possibilities of an online modelling platform could be explored
Quality of Visualizations 5 nil
Importance of Consistent Visualisations 6 nil