HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2016T1 Charlies-Angels-QA"

From IS480
Jump to navigation Jump to search
Line 90: Line 90:
 
</div>
 
</div>
  
 +
<div style="background:#ffffff; padding: 10px">
 +
<b>Date:</b> 05 Aug 2016 - 10 Aug 2016<br/>
 +
<b>Venue:</b> Online<br/>
 +
<b>Duration:</b> At their own timing<br/>
 +
<b>Number of Participants:</b> 10<br/>
 +
<b>Target Audience:</b> Users with Beginners' Investment Background<br/>
 +
<br/>
 +
<hr>
 +
<br/>
 +
 +
<b>Objectives:</b>
 +
<ol>
 +
<li>&nbsp;&nbsp;Identify functionalities and usability issues</li>
 +
<li>&nbsp;&nbsp;Determine is the user interface is intuitive</li>
 +
<li>&nbsp;&nbsp;Discover ways to improve features and functions of the website based on the results of User Testing #1</li>
 +
</ol>
 +
<br/>
 +
<hr>
 +
<br/>
 +
<b>Scope:</b><br/>
 +
Functionalities tested are ones developed between Iteration 3 and 4<br/>
 +
<ol>
 +
<li>&nbsp;&nbsp;Account Management</li>
 +
<ul>
 +
  ''<li>Log In</li>''
 +
  ''<li>Log Out</li>''
 +
  ''<li>Registration</li>''
 +
  ''<li>Change Password</li>''
 +
  ''<li>Forget Password</li>''
 +
</ul>
 +
<li>&nbsp;&nbsp;Search and Display</li>
 +
<ul>
 +
  ''<li>Display Fundamental Information (Live Data)</li>''
 +
  ''<li>Display Financial Information (Live Data)</li>''
 +
</ul>
 +
<li>&nbsp;&nbsp; iStockTrade</li>
 +
<ul>
 +
  ''<li>Add/Delete Stock</li>''
 +
  ''<li>Create/Delete Portfolio</li>''
 +
  ''<li>Delete Transactions</li>''
 +
</ul>
 +
<li>&nbsp;&nbsp; StockBook Portfolio Stocks</li>
 +
<ul>
 +
  ''<li>Display Fundamental, Financial Information (Live Data) & Transaction History of the owned stocks</li>''
 +
</ul>
 +
<li>&nbsp;&nbsp; StockBook Portfolio Summary</li>
 +
<ul>
 +
  ''<li>Display a summary of user's portfolio</li>''
 +
</ul>
 +
</ol>
 +
<br/>
 +
<hr>
 +
<br/>
 +
 +
<b>Procedure:</b>
 +
<ol>
 +
<li>&nbsp;&nbsp;A UAT document with instructions on how to test the website have been given to the testers</li>
 +
<li>&nbsp;&nbsp;Participants will log down the testing outcomes & time taken per task in the sheet</li>
 +
<li>&nbsp;&nbsp;Participants are welcomed to type their general comments and feedback into the feedback textbox provided at the end of the test plan document</li>
 +
</ol>
 +
<br/>
 +
<hr>
 +
<br/>
 +
<b>Tasks: </b>
 +
<br/>
 +
The UAT document requests participants to perform the following task(s):
 +
<ol>
 +
<li>Registration</li>
 +
<li>Login</li>
 +
<li>Logout</li>
 +
<li>Change Password</li>
 +
<li>Forget Password</li>
 +
<li>Create a Portfolio</li>
 +
<li>Add (''Buy'') Few Stocks to the Portfolio</li>
 +
<li>Remove (''Sell'') a Stock from the Portfolio</li>
 +
<li>Delete Portfolio</li>
 +
</ol>
 +
<br/>
 +
For every task, participants were required to document down the following information:
 +
<ul>
 +
<li>Execution of Task ''(Successful or Unsuccessful)'' </li>
 +
<li>Outcome</li>
 +
<li>Time Taken</li>
 +
</ul>
 +
<br/>
 +
At the end of the test plan, we also asked the participants the following questions:
 +
<ul>
 +
<li>Do you have investment knowledge prior to using this application?</li>
 +
<li>Any Comments?</li>
 +
</ul>
 +
<br/>
 +
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff">  Results</font>
 +
</div>
 +
For UAT #1, we tasked participants to perform the testing online, without assistance from the team, to best determine the state of the application
 +
{| class="wikitable" style="background: white;"
 +
|-
 +
! style="background: #000000; color: white; font-weight: bold; text-align: center;" | S/N
 +
! style="background: #000000; color: white; font-weight: bold; text-align: center;" | Objective
 +
! style="background: #000000; color: white; font-weight: bold; text-align: center;" | Achieved?
 +
! style="background: #000000; color: white; font-weight: bold; text-align: center;" | % of Participants that found this task easy or very easy
 +
|-
 +
| 1 || Participants should be able to register for an account || <font style="color: #009900">Yes</font> || <font style="color: #009900">100%</font>
 +
|-
 +
| 2 || Participants should be able to login  || <font style="color: #009900">Yes</font>  || <font style="color: #009900">100%</font>
 +
|-
 +
| 3 || Participants should be able to change their password || <font style="color: #009900">Yes</font>  || <font style="color: #009900">100%</font>
 +
|-
 +
| 4 || Participants should be able to create a new portfolio || <font style="color: #ff6600">Partially</font> || <font style="color: #ff6600">66.67%</font>
 +
|-
 +
| 5 || Participants should be able to add three stocks of their choice|| <font style="color: #ff6600"> Partially </font>  ||<font style="color: #ff6600">50%</font>
 +
|-
 +
| 6 || Participants should be able to delete a stock from their portfolio || <font style="color: #ff6600">No</font>  || <font style="color: #ff6600">25%</font>
 +
|-
 +
| 7 || Participants should be able to delete their portfolio || <font style="color: #009900">Yes</font>  || <font style="color: #009900">100%</font>
 +
|-
 +
| 8 || Participants should be able to log out || <font style="color: #009900">Yes</font>  || <font style="color: #009900">100%</font>
 +
|}
 +
{| class="wikitable" style="background: white; width: 570px;"
 +
|-
 +
|}
 +
<br/>
 +
<div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Key Findings</font>
 +
</div>
 +
<br/>
 +
<b>Overall Findings</b>
 +
<ul>
 +
<li>The website has a very clean and modern design</li>
 +
<li>The website is intuitive</li>
 +
<li>Nothing new about what has been created so far from what is out there</li>
 +
<li>Some functions are still breaking, need to ensure fully fixed before testing</li>
 +
</ul>
 +
<br/>
 +
<hr>
 +
<b>Key Improvements to be made</b>
 +
<ul>
 +
<li>Ensure that the application does not break before deployed for testing</li>
 +
<li>There is nothing unique of this application as yet. However, we recognise that this is because the foundation of the application needs to come first</li>
 +
<li>Interface looks good, can continue adding colour schemes to make the UI more intuitive</li>
 +
</ul>
 +
<br/>
 
</div>
 
</div>

Revision as of 16:57, 28 August 2016


Charlies Angels Logo.png


Charlies Angels Home.png  HOME

 

Charlies Angels About Us.png  ABOUT US

 

Charlies Angels Project Overview.png  PROJECT OVERVIEW

 

Charlies Angels Project Management.png  PROJECT MANAGEMENT

 

Charlies Angels Project Documentation.png  DOCUMENTATION

 
Technical Documents Wireframes Charlies Angels Current Stage.png Quality Assurance Meeting Minutes Deliverables
Regression Testing
Results of Internal Unit Testing
Iteration No. Date Results
3 06 JUL 2016 33/36; Bug Metrics of 7 - Hitting 1 High Impact & 2 Low Impact
4 27 JUL 2016 69/74; Bug Metrics of 9 - Hitting 1 High Impact & 4 Low Impact
5 10 AUG 2016 87/90; Bug Metrics of 7 - Hitting 1 High Impact & 2 Low Impact
UAT Results & Findings

Date: 05 Aug 2016 - 10 Aug 2016
Venue: Online
Duration: At their own timing
Number of Participants: 10
Target Audience: Users with Beginners' Investment Background



Objectives:

  1.   Identify functionalities and usability issues
  2.   Determine is the user interface is intuitive
  3.   Discover ways to improve features and functions of the website based on the results of User Testing #1




Scope:
Functionalities tested are ones developed between Iteration 3 and 4

  1.   Account Management
    • Log In
    • Log Out
    • Registration
    • Change Password
    • Forget Password
  2.   Search and Display
    • Display Fundamental Information (Live Data)
    • Display Financial Information (Live Data)
  3.    iStockTrade
    • Add/Delete Stock
    • Create/Delete Portfolio
    • Delete Transactions
  4.    StockBook Portfolio Stocks
    • Display Fundamental, Financial Information (Live Data) & Transaction History of the owned stocks
  5.    StockBook Portfolio Summary
    • Display a summary of user's portfolio




Procedure:

  1.   A UAT document with instructions on how to test the website have been given to the testers
  2.   Participants will log down the testing outcomes & time taken per task in the sheet
  3.   Participants are welcomed to type their general comments and feedback into the feedback textbox provided at the end of the test plan document




Tasks:
The UAT document requests participants to perform the following task(s):

  1. Registration
  2. Login
  3. Logout
  4. Change Password
  5. Forget Password
  6. Create a Portfolio
  7. Add (Buy) Few Stocks to the Portfolio
  8. Remove (Sell) a Stock from the Portfolio
  9. Delete Portfolio


For every task, participants were required to document down the following information:

  • Execution of Task (Successful or Unsuccessful)
  • Outcome
  • Time Taken


At the end of the test plan, we also asked the participants the following questions:

  • Do you have investment knowledge prior to using this application?
  • Any Comments?


Results

For UAT #1, we tasked participants to perform the testing online, without assistance from the team, to best determine the state of the application

S/N Objective Achieved? % of Participants that found this task easy or very easy
1 Participants should be able to register for an account Yes 100%
2 Participants should be able to login Yes 100%
3 Participants should be able to change their password Yes 100%
4 Participants should be able to create a new portfolio Partially 66.67%
5 Participants should be able to add three stocks of their choice Partially 50%
6 Participants should be able to delete a stock from their portfolio No 25%
7 Participants should be able to delete their portfolio Yes 100%
8 Participants should be able to log out Yes 100%


Key Findings


Overall Findings

  • The website has a very clean and modern design
  • The website is intuitive
  • Nothing new about what has been created so far from what is out there
  • Some functions are still breaking, need to ensure fully fixed before testing



Key Improvements to be made

  • Ensure that the application does not break before deployed for testing
  • There is nothing unique of this application as yet. However, we recognise that this is because the foundation of the application needs to come first
  • Interface looks good, can continue adding colour schemes to make the UI more intuitive