Difference between revisions of "IS480 Team wiki: 2013T1 Bankrevels Testing"
Line 40: | Line 40: | ||
<br> | <br> | ||
</center> | </center> | ||
− | + | = 4>User Testing 1 (UT 1)</font></div>==== | |
− | + | ||
=====Objective===== | =====Objective===== | ||
The objectives of UT 1 are to understand the intuitiveness, ease of using the application, as well as to get feedback from users on the design and layout of the application on all two platforms (Android and web). | The objectives of UT 1 are to understand the intuitiveness, ease of using the application, as well as to get feedback from users on the design and layout of the application on all two platforms (Android and web). | ||
Line 49: | Line 49: | ||
# Samsung Note 2 | # Samsung Note 2 | ||
# LG Optimus G | # LG Optimus G | ||
+ | |||
+ | =====Documents===== | ||
+ | * [[Media:BR_UT_1_Plan.pdf|UT 1 Execution Plan]] | ||
+ | * [[Media:BR_Observation_sheet_-_android.pdf|Observation Sheet (Android)]] | ||
+ | * [[Media:BR_Observation_sheet_-_internet.pdf|Observation Sheet (Internet)]] | ||
+ | * [[Media:BR_RMB_collated_results.pdf|Raw Results (Android)]] | ||
+ | * [[Media:BR_RIB_collated_results.pdf|Raw Results (Internet)]] | ||
+ | * [[Media:BR_UT1_results.pdf|Summary of UT 1 results]] | ||
=====Purpose===== | =====Purpose===== | ||
Line 195: | Line 203: | ||
=====Participants, Timing and Venue held===== | =====Participants, Timing and Venue held===== | ||
− | Number of participants: | + | Number of participants: '''45''' students from the Retail Banking class <br/> |
Date and Time held: 2 October 2013 (8.15am - 9.30am)<br/> | Date and Time held: 2 October 2013 (8.15am - 9.30am)<br/> | ||
Venue: SMU | Venue: SMU |
Revision as of 21:28, 8 October 2013
Contents
4>User Testing 1 (UT 1)===
Objective
The objectives of UT 1 are to understand the intuitiveness, ease of using the application, as well as to get feedback from users on the design and layout of the application on all two platforms (Android and web).
Devices tested for Android
- Samsung S3
- Samsung Note 2
- LG Optimus G
Documents
- UT 1 Execution Plan
- Observation Sheet (Android)
- Observation Sheet (Internet)
- Raw Results (Android)
- Raw Results (Internet)
- Summary of UT 1 results
Purpose
The purpose of the UT 1 is to find out the following from the users:
- How does user find the login 2FA using QR code instead of the conventional hardware token?
- Is the QuikPay function intuitive enough?
- Can the user use the Fund Transfer function with ease?
- How easy it is for the user to navigate through the whole application?
- How does the user feel about the layout and design of our application?
- What are the user's emotions when using the application?
- What are the user's general impressions of the application?
Data Collected
Qualitative Data | Quantitative Data |
---|---|
Questionnaire
Observation sheet
For RMB only
|
Questionnaire
For RMB only
Observation Sheet
For RMB only
|
Participants, Timing and Venue held
Number of participants: 20
Date and Time held: 19 - 20 September 2013 (10am - 7pm)
Venue: SMU
Implementation
Participants will be welcomed to the user testing by the facilitator. Thereafter, participants will be given a brief overview of the application and given a list of tasks they need to complete. Participants will be required to complete all tasks, without the guidance of the facilitator. However, the participants can ask the facilitator for help should they face any problems and such instances will be recorded down on the Observation Sheet provided.
After going through the user testing of the application, participants are required to do an evaluation of the application on the Questionnaire provided. Participants are encouraged to discuss any problems they encounter with the facilitator.
The User Testing will end after the participants complete the Questionnaire. The facilitator will then thank the participants for their time and feedback provided.
Functions Tested
No. | Functions Tested |
---|---|
1 | Login 2FA |
2 | View account information |
3 | View transaction history |
4 | Fund Transfer |
5 | QuikPay |
6 | Add new payee |
7 | Remove existing payee |
Results and Follow Up
Data will be collected using the Questionnaire provided by the team which participants are required to fill it up after going through the application. After the collection of all the data required, the team will collate and organize the raw data into appropriate tables and give a summary of the results of this user testing. A team meeting will be held to discuss the changes to be made.
Key Findings
Mobile Banking
- Most users have given positive feedback about using QR code such as increased convenience and ease of use. However, several users also point out the lack of security of QR code as it does not generate a dynamic password unlike the hardware token.
- Almost all users find using QR code for login 2FA easy
- No issue in usability for Account Summary and Transaction History
- Almost all users have no problems using QuikPay, Standard Funds Transfer and Adding a new payee
- Some users mentioned the lack of intuitiveness and instructions required for the delete payee function
- Navigation of the whole application is easy among the users
- Users had feedback that the application is easy to use and navigate and commented that they like the bright colour scheme of the application
- For points that users dislike, many users reflect that they had problems deleting the payee as the function is not obvious. Security issue is another point brought up by users for the usage of QR code login 2FA
- The general impression of users is our application is relatively easy to use and is able to navigate without any major issues. Some commented that they like the trendy feel the application gives
Internet Banking
- A variety of feedbacks from users on Account Summary were collected. The difficulty in reading grey fonts stood out the most among the other feedbacks collected
- A variety of feedbacks from users on Transaction History were collected. The inappropriate font size stood out the most among the other feedbacks collected. Users commented that font size used is too small to read
- No major issue in usability for Standard Funds Transfer, Adding a payee and Deleting a payee
- Navigation through the whole application is deemed to be moderately difficult among users. Users commented that the segments of the web application are unclear
- For points that users like, many users commented that it is easy to navigate the web application. The basic neat design is well-liked by the users
- For points that users dislike, some users reflect that they had problems reading the font due to its size and it being grey in colour. Few users reflect that there is too much white space for some pages
- The general impression of the application is that it is relatively easy to use
Deployment exercise
Objective
The objectives of the deployment exercise is to carry out stress testing of the our application (web and android) and to identify any bugs present in our application that we have not surfaced out during our own testing.
Participants, Timing and Venue held
Number of participants: 45 students from the Retail Banking class
Date and Time held: 2 October 2013 (8.15am - 9.30am)
Venue: SMU
Implementation
Participants are required to go through a Retail Banking Lab that involves the mobile and internet banking functions. 2 of the members will be facilitators of the exercise to help the participants should they face any problems with the application.
After going through the lab exercise, participants are encouraged to give any feedback to the facilitators.
Functions Tested
Internet Banking
No. | Functions Tested |
---|---|
1 | Login 2FA |
2 | View account information |
3 | View transaction history |
4 | Fund Transfer |
5 | Set up Customer Preferences |
Mobile Banking
No. | Functions Tested |
---|---|
1 | Login 2FA |
2 | View account information |
3 | View transaction history |
4 | Fund Transfer |
Follow Up
The facilitators will collect the feedback and communicate to the members of the group to make any necessary changes to the application (Android and web).