Difference between revisions of "IS480 Team wiki: 2016T1 Charlies-Angels-QA"
Jump to navigation
Jump to search
Xwzheng.2014 (talk | contribs) |
Xwzheng.2014 (talk | contribs) |
||
Line 90: | Line 90: | ||
</div> | </div> | ||
+ | <div style="background:#ffffff; padding: 10px"> | ||
+ | <b>Date:</b> 05 Aug 2016 - 10 Aug 2016<br/> | ||
+ | <b>Venue:</b> Online<br/> | ||
+ | <b>Duration:</b> At their own timing<br/> | ||
+ | <b>Number of Participants:</b> 10<br/> | ||
+ | <b>Target Audience:</b> Users with Beginners' Investment Background<br/> | ||
+ | <br/> | ||
+ | <hr> | ||
+ | <br/> | ||
+ | |||
+ | <b>Objectives:</b> | ||
+ | <ol> | ||
+ | <li> Identify functionalities and usability issues</li> | ||
+ | <li> Determine is the user interface is intuitive</li> | ||
+ | <li> Discover ways to improve features and functions of the website based on the results of User Testing #1</li> | ||
+ | </ol> | ||
+ | <br/> | ||
+ | <hr> | ||
+ | <br/> | ||
+ | <b>Scope:</b><br/> | ||
+ | Functionalities tested are ones developed between Iteration 3 and 4<br/> | ||
+ | <ol> | ||
+ | <li> Account Management</li> | ||
+ | <ul> | ||
+ | ''<li>Log In</li>'' | ||
+ | ''<li>Log Out</li>'' | ||
+ | ''<li>Registration</li>'' | ||
+ | ''<li>Change Password</li>'' | ||
+ | ''<li>Forget Password</li>'' | ||
+ | </ul> | ||
+ | <li> Search and Display</li> | ||
+ | <ul> | ||
+ | ''<li>Display Fundamental Information (Live Data)</li>'' | ||
+ | ''<li>Display Financial Information (Live Data)</li>'' | ||
+ | </ul> | ||
+ | <li> iStockTrade</li> | ||
+ | <ul> | ||
+ | ''<li>Add/Delete Stock</li>'' | ||
+ | ''<li>Create/Delete Portfolio</li>'' | ||
+ | ''<li>Delete Transactions</li>'' | ||
+ | </ul> | ||
+ | <li> StockBook Portfolio Stocks</li> | ||
+ | <ul> | ||
+ | ''<li>Display Fundamental, Financial Information (Live Data) & Transaction History of the owned stocks</li>'' | ||
+ | </ul> | ||
+ | <li> StockBook Portfolio Summary</li> | ||
+ | <ul> | ||
+ | ''<li>Display a summary of user's portfolio</li>'' | ||
+ | </ul> | ||
+ | </ol> | ||
+ | <br/> | ||
+ | <hr> | ||
+ | <br/> | ||
+ | |||
+ | <b>Procedure:</b> | ||
+ | <ol> | ||
+ | <li> A UAT document with instructions on how to test the website have been given to the testers</li> | ||
+ | <li> Participants will log down the testing outcomes & time taken per task in the sheet</li> | ||
+ | <li> Participants are welcomed to type their general comments and feedback into the feedback textbox provided at the end of the test plan document</li> | ||
+ | </ol> | ||
+ | <br/> | ||
+ | <hr> | ||
+ | <br/> | ||
+ | <b>Tasks: </b> | ||
+ | <br/> | ||
+ | The UAT document requests participants to perform the following task(s): | ||
+ | <ol> | ||
+ | <li>Registration</li> | ||
+ | <li>Login</li> | ||
+ | <li>Logout</li> | ||
+ | <li>Change Password</li> | ||
+ | <li>Forget Password</li> | ||
+ | <li>Create a Portfolio</li> | ||
+ | <li>Add (''Buy'') Few Stocks to the Portfolio</li> | ||
+ | <li>Remove (''Sell'') a Stock from the Portfolio</li> | ||
+ | <li>Delete Portfolio</li> | ||
+ | </ol> | ||
+ | <br/> | ||
+ | For every task, participants were required to document down the following information: | ||
+ | <ul> | ||
+ | <li>Execution of Task ''(Successful or Unsuccessful)'' </li> | ||
+ | <li>Outcome</li> | ||
+ | <li>Time Taken</li> | ||
+ | </ul> | ||
+ | <br/> | ||
+ | At the end of the test plan, we also asked the participants the following questions: | ||
+ | <ul> | ||
+ | <li>Do you have investment knowledge prior to using this application?</li> | ||
+ | <li>Any Comments?</li> | ||
+ | </ul> | ||
+ | <br/> | ||
+ | <div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Results</font> | ||
+ | </div> | ||
+ | For UAT #1, we tasked participants to perform the testing online, without assistance from the team, to best determine the state of the application | ||
+ | {| class="wikitable" style="background: white;" | ||
+ | |- | ||
+ | ! style="background: #000000; color: white; font-weight: bold; text-align: center;" | S/N | ||
+ | ! style="background: #000000; color: white; font-weight: bold; text-align: center;" | Objective | ||
+ | ! style="background: #000000; color: white; font-weight: bold; text-align: center;" | Achieved? | ||
+ | ! style="background: #000000; color: white; font-weight: bold; text-align: center;" | % of Participants that found this task easy or very easy | ||
+ | |- | ||
+ | | 1 || Participants should be able to register for an account || <font style="color: #009900">Yes</font> || <font style="color: #009900">100%</font> | ||
+ | |- | ||
+ | | 2 || Participants should be able to login || <font style="color: #009900">Yes</font> || <font style="color: #009900">100%</font> | ||
+ | |- | ||
+ | | 3 || Participants should be able to change their password || <font style="color: #009900">Yes</font> || <font style="color: #009900">100%</font> | ||
+ | |- | ||
+ | | 4 || Participants should be able to create a new portfolio || <font style="color: #ff6600">Partially</font> || <font style="color: #ff6600">66.67%</font> | ||
+ | |- | ||
+ | | 5 || Participants should be able to add three stocks of their choice|| <font style="color: #ff6600"> Partially </font> ||<font style="color: #ff6600">50%</font> | ||
+ | |- | ||
+ | | 6 || Participants should be able to delete a stock from their portfolio || <font style="color: #ff6600">No</font> || <font style="color: #ff6600">25%</font> | ||
+ | |- | ||
+ | | 7 || Participants should be able to delete their portfolio || <font style="color: #009900">Yes</font> || <font style="color: #009900">100%</font> | ||
+ | |- | ||
+ | | 8 || Participants should be able to log out || <font style="color: #009900">Yes</font> || <font style="color: #009900">100%</font> | ||
+ | |} | ||
+ | {| class="wikitable" style="background: white; width: 570px;" | ||
+ | |- | ||
+ | |} | ||
+ | <br/> | ||
+ | <div style="margin-top:10px; background:#000000; padding: 10px; line-height: 1em; text-indent: 10px; border-left: #FFDF00 solid 32px; font-size: 18px"><font face="Century Gothic" color="#ffffff"> Key Findings</font> | ||
+ | </div> | ||
+ | <br/> | ||
+ | <b>Overall Findings</b> | ||
+ | <ul> | ||
+ | <li>The website has a very clean and modern design</li> | ||
+ | <li>The website is intuitive</li> | ||
+ | <li>Nothing new about what has been created so far from what is out there</li> | ||
+ | <li>Some functions are still breaking, need to ensure fully fixed before testing</li> | ||
+ | </ul> | ||
+ | <br/> | ||
+ | <hr> | ||
+ | <b>Key Improvements to be made</b> | ||
+ | <ul> | ||
+ | <li>Ensure that the application does not break before deployed for testing</li> | ||
+ | <li>There is nothing unique of this application as yet. However, we recognise that this is because the foundation of the application needs to come first</li> | ||
+ | <li>Interface looks good, can continue adding colour schemes to make the UI more intuitive</li> | ||
+ | </ul> | ||
+ | <br/> | ||
</div> | </div> |
Revision as of 16:57, 28 August 2016
Technical Documents | Wireframes | Quality Assurance | Meeting Minutes | Deliverables |
Regression Testing
Results of Internal Unit Testing | ||
---|---|---|
Iteration No. | Date | Results |
3 | 06 JUL 2016 | 33/36; Bug Metrics of 7 - Hitting 1 High Impact & 2 Low Impact |
4 | 27 JUL 2016 | 69/74; Bug Metrics of 9 - Hitting 1 High Impact & 4 Low Impact |
5 | 10 AUG 2016 | 87/90; Bug Metrics of 7 - Hitting 1 High Impact & 2 Low Impact |
UAT Results & Findings
Date: 05 Aug 2016 - 10 Aug 2016
Venue: Online
Duration: At their own timing
Number of Participants: 10
Target Audience: Users with Beginners' Investment Background
Objectives:
- Identify functionalities and usability issues
- Determine is the user interface is intuitive
- Discover ways to improve features and functions of the website based on the results of User Testing #1
Scope:
Functionalities tested are ones developed between Iteration 3 and 4
- Account Management
- Log In
- Log Out
- Registration
- Change Password
- Forget Password
- Search and Display
- Display Fundamental Information (Live Data)
- Display Financial Information (Live Data)
- iStockTrade
- Add/Delete Stock
- Create/Delete Portfolio
- Delete Transactions
- StockBook Portfolio Stocks
- Display Fundamental, Financial Information (Live Data) & Transaction History of the owned stocks
- StockBook Portfolio Summary
- Display a summary of user's portfolio
Procedure:
- A UAT document with instructions on how to test the website have been given to the testers
- Participants will log down the testing outcomes & time taken per task in the sheet
- Participants are welcomed to type their general comments and feedback into the feedback textbox provided at the end of the test plan document
Tasks:
The UAT document requests participants to perform the following task(s):
- Registration
- Login
- Logout
- Change Password
- Forget Password
- Create a Portfolio
- Add (Buy) Few Stocks to the Portfolio
- Remove (Sell) a Stock from the Portfolio
- Delete Portfolio
For every task, participants were required to document down the following information:
- Execution of Task (Successful or Unsuccessful)
- Outcome
- Time Taken
At the end of the test plan, we also asked the participants the following questions:
- Do you have investment knowledge prior to using this application?
- Any Comments?
Results
For UAT #1, we tasked participants to perform the testing online, without assistance from the team, to best determine the state of the application
S/N | Objective | Achieved? | % of Participants that found this task easy or very easy |
---|---|---|---|
1 | Participants should be able to register for an account | Yes | 100% |
2 | Participants should be able to login | Yes | 100% |
3 | Participants should be able to change their password | Yes | 100% |
4 | Participants should be able to create a new portfolio | Partially | 66.67% |
5 | Participants should be able to add three stocks of their choice | Partially | 50% |
6 | Participants should be able to delete a stock from their portfolio | No | 25% |
7 | Participants should be able to delete their portfolio | Yes | 100% |
8 | Participants should be able to log out | Yes | 100% |
Key Findings
Overall Findings
- The website has a very clean and modern design
- The website is intuitive
- Nothing new about what has been created so far from what is out there
- Some functions are still breaking, need to ensure fully fixed before testing
Key Improvements to be made
- Ensure that the application does not break before deployed for testing
- There is nothing unique of this application as yet. However, we recognise that this is because the foundation of the application needs to come first
- Interface looks good, can continue adding colour schemes to make the UI more intuitive