Difference between revisions of "2012T1 Team Verendus Project Documentation User Test 2"
(48 intermediate revisions by 5 users not shown) | |||
Line 51: | Line 51: | ||
<Center> [[Image:Verendus_uat_1.png |500px]]</Center> | <Center> [[Image:Verendus_uat_1.png |500px]]</Center> | ||
− | + | == Overview == | |
− | + | The purpose of the User Testing 2 is to collect feedbacks on the various user types, namely: <b>Individual(Facebook and Normal Login)</b> and <b>Business Member</b>. Through this testing, we hope to gather feedbacks on the usability of the web application. | |
− | |||
− | The purpose of the User Testing 2 is to | ||
<br><br> | <br><br> | ||
− | + | === Test Participants === | |
[[Image:Verendus_UT2_Participants.png |700px]] | [[Image:Verendus_UT2_Participants.png |700px]] | ||
<br> | <br> | ||
− | + | === Devices Used for Testing === | |
* iPhone 5 (iOS 6) | * iPhone 5 (iOS 6) | ||
* iPhone 4S (iOS 5.1.1) | * iPhone 4S (iOS 5.1.1) | ||
Line 80: | Line 78: | ||
− | + | === Browsers Used === | |
* Google Chrome | * Google Chrome | ||
* Mozilla Firefox | * Mozilla Firefox | ||
Line 86: | Line 84: | ||
* Andriod Default Web Browser | * Andriod Default Web Browser | ||
− | + | === Test Pre-Requisites === | |
* QR Code Scanner | * QR Code Scanner | ||
− | + | === Test Plans === | |
* Test Plans for Business Member: | * Test Plans for Business Member: | ||
− | ** Business Member 1: [[ | + | ** Business Member 1: [[Media:Verendus_uat2_business1.docx| Test Plan for Business Member 1]] |
− | ** Business Member 2: [[ | + | ** Business Member 2: [[Media:Verendus_uat2_business2.docx| Test Plan for Business Member 2]] |
− | ** Business Member 3: [[ | + | ** Business Member 3: [[Media:Verendus_uat2_business3.docx| Test Plan for Business Member 3]] |
− | ** Business Member 4: [[ | + | ** Business Member 4: [[Media:Verendus_uat2_business4.docx| Test Plan for Business Member 4]] |
− | ** Business Member 5: [[ | + | ** Business Member 5: [[Media:Verendus_uat2_business5.docx| Test Plan for Business Member 5]] |
− | ** Business Member 6: [[ | + | ** Business Member 6: [[Media:Verendus_uat2_business6.docx| Test Plan for Business Member 6]] |
* Test Plans for Individual Users: | * Test Plans for Individual Users: | ||
− | ** Normal Login: [[ | + | ** Normal Login: [[Media:Verendus_uat2_individual1.docx| Test Plan for Individual User - Normal Login 1]] |
− | ** Normal Login: [[ | + | ** Normal Login: [[Media:Verendus_uat2_individual2.docx| Test Plan for Individual User - Normal Login 2]] |
− | ** Normal Login: [[ | + | ** Normal Login: [[Media:Verendus_uat2_individual3.docx| Test Plan for Individual User - Normal Login 3]] |
− | ** Normal Login: [[ | + | ** Normal Login: [[Media:Verendus_uat2_individual4.docx| Test Plan for Individual User - Normal Login 4]] |
− | ** Normal Login: [[ | + | ** Normal Login: [[Media:Verendus_uat2_individual5.docx| Test Plan for Individual User - Normal Login 5]] |
− | ** Normal Login: [[ | + | ** Normal Login: [[Media:Verendus_uat2_individual6.docx| Test Plan for Individual User - Normal Login 6]] |
− | ** Facebook Login: [[ | + | ** Facebook Login: [[Media:Verendus_uat2_individual_fb1.docx| Test Plan for Individual User with Facebook Login 1]] |
− | ** Facebook Login: [[ | + | ** Facebook Login: [[Media:Verendus_uat2_individual_fb2.docx| Test Plan for Individual User with Facebook Login 2]] |
− | ** Facebook Login: [[ | + | ** Facebook Login: [[Media:Verendus_uat2_individual_fb3.docx| Test Plan for Individual User with Facebook Login 3]] |
− | ** Facebook Login: [[ | + | ** Facebook Login: [[Media:Verendus_uat2_individual_fb4.docx| Test Plan for Individual User with Facebook Login 4]] |
− | ** Facebook Login: [[ | + | ** Facebook Login: [[Media:Verendus_uat2_individual_fb5.docx| Test Plan for Individual User with Facebook Login 5]] |
− | ** Facebook Login: [[ | + | ** Facebook Login: [[Media:Verendus_uat2_individual_fb6.docx| Test Plan for Individual User with Facebook Login 6]] |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | [[Image: | + | === Overview of Test Results === |
− | + | [[Image:verendus_uat2_overalltestresult.png|700px|alt="Overall Test Result"]]<br> | |
+ | [[Image:verendus_uat2_overall.png|700px|alt="Overview of Test Results"]]<br> | ||
− | + | === Photographs === | |
− | + | Some pictures took during our User Testing 2! | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
<Center> | <Center> | ||
{| class="wikitable" border="0" cellpadding="1" width=100% | {| class="wikitable" border="0" cellpadding="1" width=100% | ||
Line 142: | Line 121: | ||
! style="border: 0px solid white; background: white"| | ! style="border: 0px solid white; background: white"| | ||
− | [[Image: | + | [[Image:verendus_uat2_1.jpg|500px|alt="Pei Wen observing our tester"]]<br> |
− | + | Pei Wen observing our tester | |
! style="border: 0px solid white; background: white"| | ! style="border: 0px solid white; background: white"| | ||
− | [[Image: | + | [[Image:verendus_uat2_2.jpg|500px|alt="Tester reflecting her feedbacks on our site"]]<br> |
− | + | Tester reflecting her feedbacks on our site | |
|- | |- | ||
! style="border: 0px solid white; background: white"| | ! style="border: 0px solid white; background: white"| | ||
− | [[Image: | + | [[Image:verendus_uat2_3.jpg|500px|alt="Mardiana with Tester"]]<br> |
− | + | Mardiana with Tester | |
! style="border: 0px solid white; background: white"| | ! style="border: 0px solid white; background: white"| | ||
− | [[Image: | + | [[Image:verendus_uat2_4.jpg|500px|alt="International Student from Czech Republic"]]<br> |
− | + | International Student from Czech Republic | |
|- | |- | ||
! style="border: 0px solid white; background: white"| | ! style="border: 0px solid white; background: white"| | ||
− | [[Image: | + | [[Image:verendus_uat2_5.jpg|500px|alt="Tester deeply engaged with our site"]]<br> |
− | + | Tester deeply engaged with our site | |
! style="border: 0px solid white; background: white"| | ! style="border: 0px solid white; background: white"| | ||
− | [[Image: | + | [[Image:verendus_uat2_6.jpg|500px|alt="Do not disturb! Test in progress!"]]<br> |
− | + | Do not disturb! Test in progress! | |
|- | |- | ||
Line 172: | Line 151: | ||
===<b> Guided User Testing - Normal Login </b><br>=== | ===<b> Guided User Testing - Normal Login </b><br>=== | ||
− | <p>Total number of testers: 15</p> | + | <p>Total number of testers: <b>15</b></p> |
{| border="1" | {| border="1" | ||
Line 291: | Line 270: | ||
|} | |} | ||
− | + | <b>Overall Results:</b><br> | |
− | [[Image:Verendus Individual_tabulation.jpg| | + | [[Image:Verendus Individual_tabulation.jpg|500px|alt="Overall Test Result"|"Guided User Testing- Normal Login"]] |
=== <b> Guided User Testing - Facebook Login </b><br> === | === <b> Guided User Testing - Facebook Login </b><br> === | ||
Line 301: | Line 280: | ||
|- style="filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#5D2A0F', endColorstr='#5D2A0F');background: -webkit-gradient(linear, left top, left bottom, from(#5D2A0F), to(#5D2A0F)); background: -moz-linear-gradient(top, #5D2A0F, #5D2A0F); color:White" | |- style="filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#5D2A0F', endColorstr='#5D2A0F');background: -webkit-gradient(linear, left top, left bottom, from(#5D2A0F), to(#5D2A0F)); background: -moz-linear-gradient(top, #5D2A0F, #5D2A0F); color:White" | ||
|width="225" align="center"|'''Functions''' | |width="225" align="center"|'''Functions''' | ||
− | |width=" | + | |width="100" align="center"|'''Passes''' |
− | |width=" | + | |width="100" align="center"|'''Passes With Comments''' |
− | |width=" | + | |width="100" align="center"|'''Failures''' |
|- | |- | ||
|width="225" align="center"| 1. Create New User | |width="225" align="center"| 1. Create New User | ||
− | |width=" | + | |width="100" align="center"| 14 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 2.1 Newsfeed - Comments Function | |width="225" align="center"| 2.1 Newsfeed - Comments Function | ||
− | |width=" | + | |width="100" align="center"| 13 |
− | |width=" | + | |width="100" align="center"| 1 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 2.2 Newsfeed - Like Function | |width="225" align="center"| 2.2 Newsfeed - Like Function | ||
− | |width=" | + | |width="100" align="center"| 14 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 2.3 Newsfeed - Share Function | |width="225" align="center"| 2.3 Newsfeed - Share Function | ||
− | |width=" | + | |width="100" align="center"| 13 |
− | |width=" | + | |width="100" align="center"| 1 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 2.4 Newsfeed - Filter Function | |width="225" align="center"| 2.4 Newsfeed - Filter Function | ||
− | |width=" | + | |width="100" align="center"| 14 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 2.5 Newsfeed - Instruction Function | |width="225" align="center"| 2.5 Newsfeed - Instruction Function | ||
− | |width=" | + | |width="100" align="center"| 13 |
− | |width=" | + | |width="100" align="center"| 1 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 2.5 Newsfeed - Load More Feeds Function | |width="225" align="center"| 2.5 Newsfeed - Load More Feeds Function | ||
− | |width=" | + | |width="100" align="center"| 13 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 1 |
|- | |- | ||
|width="225" align="center"| 3.1 Check In | |width="225" align="center"| 3.1 Check In | ||
− | |width=" | + | |width="100" align="center"| 9 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 5 |
|- | |- | ||
|width="225" align="center"| 3.2 Check In - View Nearby Business Vicinity Function | |width="225" align="center"| 3.2 Check In - View Nearby Business Vicinity Function | ||
− | |width=" | + | |width="100" align="center"| 9 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 5 |
|- | |- | ||
|width="225" align="center"| 3.3 Check In - Instruction Function | |width="225" align="center"| 3.3 Check In - Instruction Function | ||
− | |width=" | + | |width="100" align="center"| 14 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 4.1 Impact | |width="225" align="center"| 4.1 Impact | ||
− | |width=" | + | |width="100" align="center"| 14 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 4.2 Impact - Instruction Function | |width="225" align="center"| 4.2 Impact - Instruction Function | ||
− | |width=" | + | |width="100" align="center"| 14 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 5.1 Logout | |width="225" align="center"| 5.1 Logout | ||
− | |width=" | + | |width="100" align="center"| 13 |
− | |width=" | + | |width="100" align="center"| 1 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 6.1 Support | |width="225" align="center"| 6.1 Support | ||
− | |width=" | + | |width="100" align="center"| 9 |
− | |width=" | + | |width="100" align="center"| 3 |
− | |width=" | + | |width="100" align="center"| 2 |
|- | |- | ||
|width="225" align="center"| 6.2 Support - Spamming of Support By Same User | |width="225" align="center"| 6.2 Support - Spamming of Support By Same User | ||
− | |width=" | + | |width="100" align="center"| 9 |
− | |width=" | + | |width="100" align="center"| 2 |
− | |width=" | + | |width="100" align="center"| 3 |
|- | |- | ||
|width="225" align="center"| 7.1 Impact - Verify Supported Project | |width="225" align="center"| 7.1 Impact - Verify Supported Project | ||
− | |width=" | + | |width="100" align="center"| 11 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 3 |
|- | |- | ||
|width="225" align="center"| 8.1 Account Management - Change Password | |width="225" align="center"| 8.1 Account Management - Change Password | ||
− | |width=" | + | |width="100" align="center"| 12 |
− | |width=" | + | |width="100" align="center"| 1 |
− | |width=" | + | |width="100" align="center"| 1 |
|- | |- | ||
|width="225" align="center"| 8.2 Account Management - Invite Facebook Friends | |width="225" align="center"| 8.2 Account Management - Invite Facebook Friends | ||
− | |width=" | + | |width="100" align="center"| 14 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
Line 423: | Line 402: | ||
<br/><p>Total number of passes, passes with comments and failures:</p> | <br/><p>Total number of passes, passes with comments and failures:</p> | ||
− | [[Image:Verendus_UT2_Guided_User_-_Facebook_Login_Graph.jpg| | + | [[Image:Verendus_UT2_Guided_User_-_Facebook_Login_Graph.jpg|500px|alt="Overall Test Result"|"Guided User - Facebook Login"]] |
===<b> Guided Business Member Testing </b><br>=== | ===<b> Guided Business Member Testing </b><br>=== | ||
Line 432: | Line 411: | ||
|- style="filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#5D2A0F', endColorstr='#5D2A0F');background: -webkit-gradient(linear, left top, left bottom, from(#5D2A0F), to(#5D2A0F)); background: -moz-linear-gradient(top, #5D2A0F, #5D2A0F); color:White" | |- style="filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#5D2A0F', endColorstr='#5D2A0F');background: -webkit-gradient(linear, left top, left bottom, from(#5D2A0F), to(#5D2A0F)); background: -moz-linear-gradient(top, #5D2A0F, #5D2A0F); color:White" | ||
|width="225" align="center"|'''Functions''' | |width="225" align="center"|'''Functions''' | ||
− | |width=" | + | |width="100" align="center"|'''Passes''' |
− | |width=" | + | |width="100" align="center"|'''Passes With Comments''' |
− | |width=" | + | |width="100" align="center"|'''Failures''' |
|- | |- | ||
|width="225" align="center"| 1. Login | |width="225" align="center"| 1. Login | ||
− | |width=" | + | |width="100" align="center"| 12 |
− | |width=" | + | |width="100" align="center"| 2 |
− | |width=" | + | |width="100" align="center"| 1 |
|- | |- | ||
|width="225" align="center"| 2.1 Projects Function | |width="225" align="center"| 2.1 Projects Function | ||
− | |width=" | + | |width="100" align="center"| 8 |
− | |width=" | + | |width="100" align="center"| 7 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 2.2 Projects - Instruction Function | |width="225" align="center"| 2.2 Projects - Instruction Function | ||
− | |width=" | + | |width="100" align="center"| 13 |
− | |width=" | + | |width="100" align="center"| 2 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 3.1 Newsfeed - Comments Function | |width="225" align="center"| 3.1 Newsfeed - Comments Function | ||
− | |width=" | + | |width="100" align="center"| 14 |
− | |width=" | + | |width="100" align="center"| 1 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 3.2 Newsfeed - Like Function | |width="225" align="center"| 3.2 Newsfeed - Like Function | ||
− | |width=" | + | |width="100" align="center"| 14 |
− | |width=" | + | |width="100" align="center"| 1 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 3.3 Newsfeed - Share Function | |width="225" align="center"| 3.3 Newsfeed - Share Function | ||
− | |width=" | + | |width="100" align="center"| 11 |
− | |width=" | + | |width="100" align="center"| 3 |
− | |width=" | + | |width="100" align="center"| 1 |
|- | |- | ||
|width="225" align="center"| 3.4 Newsfeed - Filter Function | |width="225" align="center"| 3.4 Newsfeed - Filter Function | ||
− | |width=" | + | |width="100" align="center"| 15 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 3.5 Newsfeed - Instruction Function | |width="225" align="center"| 3.5 Newsfeed - Instruction Function | ||
− | |width=" | + | |width="100" align="center"| 15 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 3.6 Newsfeed - Load More Feeds | |width="225" align="center"| 3.6 Newsfeed - Load More Feeds | ||
− | |width=" | + | |width="100" align="center"| 13 |
− | |width=" | + | |width="100" align="center"| 2 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 4.1 Results - Individual users have shown support to the public projects listed | |width="225" align="center"| 4.1 Results - Individual users have shown support to the public projects listed | ||
− | |width=" | + | |width="100" align="center"| 5 |
− | |width=" | + | |width="100" align="center"| 5 |
− | |width=" | + | |width="100" align="center"| 5 |
|- | |- | ||
|width="225" align="center"| 4.2 Results - Instruction Function | |width="225" align="center"| 4.2 Results - Instruction Function | ||
− | |width=" | + | |width="100" align="center"| 12 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 3 |
|- | |- | ||
|width="225" align="center"| 5.1 Summary | |width="225" align="center"| 5.1 Summary | ||
− | |width=" | + | |width="100" align="center"| 11 |
− | |width=" | + | |width="100" align="center"| 1 |
− | |width=" | + | |width="100" align="center"| 3 |
|- | |- | ||
|width="225" align="center"| 5.2 Impact - Instruction Function | |width="225" align="center"| 5.2 Impact - Instruction Function | ||
− | |width=" | + | |width="100" align="center"| 15 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|width="225" align="center"| 6.1 Logout | |width="225" align="center"| 6.1 Logout | ||
− | |width=" | + | |width="100" align="center"| 15 |
− | |width=" | + | |width="100" align="center"| 0 |
− | |width=" | + | |width="100" align="center"| 0 |
|- | |- | ||
|} | |} | ||
<br> | <br> | ||
Total number of passes, passes with comments and failures: <br> | Total number of passes, passes with comments and failures: <br> | ||
− | [[Image:Verendus UT2 Guided User - Business Member Graph.png | | + | [[Image:Verendus UT2 Guided User - Business Member Graph.png |500px|alt="Overall Test Result"| Verendus UT2 Guided User - Business Member Graph]] |
=== <b> Unguided User Testing </b><br> === | === <b> Unguided User Testing </b><br> === | ||
+ | The following table shows the comments and/or questions that we had gathered for the various functionalities of B1G1 Connect, as well as general comments from our 3-day User Testing. | ||
+ | {| border="1" | ||
+ | |- style="filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#5D2A0F', endColorstr='#5D2A0F');background: -webkit-gradient(linear, left top, left bottom, from(#5D2A0F), to(#5D2A0F)); background: -moz-linear-gradient(top, #5D2A0F, #5D2A0F); color:White" | ||
+ | |width="150" align="center"|'''Functions''' | ||
+ | |width="225" align="center"|'''Comments/Questions Asked''' | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| General | ||
+ | |width="700" | | ||
+ | * User did not seem to notice the support button. | ||
+ | * It is not obvious that the user name can be clicked | ||
+ | * Users want to see the list of projects available in B1G1 Connect | ||
+ | * Some images are not displayed, broken image etc. | ||
+ | * The application is hard to navigate as the user need to keep scrolling | ||
+ | * The application disables zoom function. Users suggest giving an option to enlarge the screen | ||
+ | * Cannot see sub navigation bar at the Quick Tour page | ||
+ | * Suggestion to use javascript class for indication to show that the page is loading because they dunno whether it is processing/disable post button | ||
+ | * If something is clicked, users do not know whether it is clicked. | ||
+ | * Design is too dull - should be more colourful. Color implies something – brown gives people a feeling of color of land. Gives people the feel of the need to do worth causes/social working. | ||
+ | * Twitter message should be personalised. | ||
+ | * "Why limit the no of support? The users won't spam and it's not clear about the non-spamming part." | ||
+ | * When the user (assuming he/she has not used B1G1 Connect app at all) clicks on a B1G1 user's url (which is shared thru Twitter/Facebook), it is a hassle for the user to log in/register just to see the other user's contribution. Perhaps, it is possible to allow public view the user's contribution w/o logging in. | ||
+ | * Words appear too small on some screens - hence, results in mistyping. | ||
+ | * There is no giving trend in Singapore, so the users are afraid that users here may not participate in giving, as B1G1 is not a well-known brand in Singapore. | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| Location | ||
+ | |width="700" | | ||
+ | * Map is not shown even though location is on | ||
+ | * Do not know that location needs to be enabled in order for it to work | ||
+ | * Users did not seem to notice the blue pins | ||
+ | * Some browsers (Opera Mini for example) do not support geolocation | ||
+ | * Google Map shows "1 Orchard Road" - quite far off. Different time login provides different location. | ||
+ | * What is this location based service does? | ||
+ | * Viewing nearby businesses take awhile. | ||
+ | * What's the purpose of checking in? | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| Business Profile Page | ||
+ | |width="700" | | ||
+ | * Overlapping of the QR code and "Support Projects" button | ||
+ | * The page is too wordy - not advisable especially for users on the move. | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| Like | ||
+ | |width="700" | | ||
+ | * After liking a particular post, the user is redirected to the newsfeed page: Suggests that it should stay at the comments page as it is more user-friendly. | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| Quick Tour | ||
+ | |width="700" | | ||
+ | * Quick tour write up requires side scrolling | ||
+ | * Images are not obvious | ||
+ | * The tour is quite useful - to inform the users how to use. | ||
+ | * The image is already not scaled and it is pretty small words. And if you fix the resolution, the text will be smaller. Might be good if there is something to click, pop up, then show instructions | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| Support | ||
+ | |width="700" | | ||
+ | * The users did not know that they are supposed to click the support button when thumbsup has been clicked. | ||
+ | * "Why cannot select more than one project to support?" | ||
+ | * Users did not seem to know how many projects to support at one time. It is not clear that users can only select one project at a time. They are on assumption that they can select more than one. | ||
+ | * Don’t know that they need to sign in for the user to support. Thus, we need to make the default page more obvious | ||
+ | * The thumbs up icons are not aligned. | ||
+ | * "Shouldn't they be given a choice to contribute twice?" | ||
+ | * (when the business profile page shows 1 project) The user clicks on "Support Projects", she expects that she already supported the project. When she was asked to log in, she was unsure why there is a need to support again. And when she has selected a project (by clicking on the thumbup button), she assume that the thumbup already registered her support. She felt that the support button is redundant. | ||
+ | * The support flow is confusing. | ||
+ | * No words appear on the support.php for the instruction. | ||
+ | * Users thought that click the project means support already (no need click support button) | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| Instruction | ||
+ | |width="700" | | ||
+ | * ? icon: Many thought that it is a help button, so not many people will click. | ||
+ | * The ? icon is not obvious. And when it is clicked, the instruction pop-up is too big that it covers the entire screen. | ||
+ | * Suggests that the instructions pop up box scale to the size of the TEXT instead. | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| Login | ||
+ | |width="700" | | ||
+ | * Need to logging again and again - very troublesome | ||
+ | * After sharing, users were prompted to relogin - troublesome | ||
+ | * The user feels that the "Join B1G1" button is misleading. He keyed in his particulars and clicks the button, expecting that he will be registered automatically. | ||
+ | * Require re-login after invites friends. | ||
+ | * Too much login procedures. | ||
+ | * Email shown not valid despite multiple tries | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| Newsfeed | ||
+ | |width="700" | | ||
+ | * "Why isnt there notification when there are comments to my personal posts - then how do ppl know that there are comments?" | ||
+ | * "Is everything posted appear on Twitter/Facebook or on the newsfeed itself?" | ||
+ | * "Is there an option to hide posts for privacy sake?" | ||
+ | * Users intuitively thought "My Newsfeed" will show all the activites tht she has made (comments, likes). | ||
+ | * There is no standardisation - when the user likes, the user is redirected to the newsfeed. But the user was not redirected to the newsfeed when the user comments. | ||
+ | * The user prefers not to be redirected to the newsfeed after liking. | ||
+ | * Instead of just removing comment, can implement edit function as well. | ||
+ | * The users wishes to see a particular user's contributions | ||
+ | * The user wishes to see another user's impact page via the application. | ||
+ | * Suggest to provide an indication on whether the user is on "My Newsfeed" or "All Newsfeed". | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| QR Code | ||
+ | |width="700" | | ||
+ | * Need to know Know which qr code browsers they have - else the web layout will be misaligned | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| Projects | ||
+ | |width="700" | | ||
+ | * Are these the projects that the member is supporting?" | ||
+ | * Users will like to see the details of the company/business the users have helped | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| Account | ||
+ | |width="700" | | ||
+ | * The user finds the account page hard to locate | ||
+ | * The user wishes that, when the user click on another user's fb profile pic, to show the projects that they support | ||
+ | * Uploading picture seems redundant | ||
+ | * No instruction on account page | ||
+ | * "Why iphone users cannot change picture?" | ||
+ | * The profile picture is not scaled to fit after uploading. | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| Business Profile | ||
+ | |width="700" | | ||
+ | * The business profile page is too wordy - especially on the move. | ||
+ | * Overlapping UI on the business profile page. | ||
+ | * "If I scanned QR code and supported a project already, why can't I get to see the projects page again?" | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| Impact | ||
+ | |width="700" | | ||
+ | * A user suggests that the team should not write it as "Impact" as he would thought he would be looking at how many people supporting so far for the projects supported thus far. Some people might support depends on the impact results, then go support least amount of supporters of a particular project. | ||
+ | * Show distribution of projects amount as individual wants to know. | ||
+ | * The user wishes to see if the amount of supports - no. of supports for a particular cause. | ||
+ | * The user wishes to see the no. of contribution. | ||
+ | * The users wishes to see what other users have contributed for a specified time period. | ||
+ | * Impact page help function: "friends and friends". | ||
+ | * When the users share her impact on Twitter, the message shows impact url. She commented that when another user clicks on the url, it wont direct to her impact page, but to the other user's impact instead. Hence, she recommended to customize the message or to use the "get" parameter to pass the correct url. For the impact page, to share via Twitter/Facebook, to use specified url for other users to see her impact page. | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| Load More Feeds | ||
+ | |width="700" | | ||
+ | * The preloader should be above load more feeds button as it makes more sense. | ||
+ | * Load more feeds spam clicks a lot of preloaders. Thus, it is better to use ajax to like function - preference. | ||
+ | |- | ||
+ | |||
+ | |width="150" align="center"| Comments | ||
+ | |width="700" | | ||
+ | * Comment page - ? has nothing. If have nothing, jus remove. | ||
+ | * "Why comment page never show no. of likes since newsfeed shown?" | ||
+ | |- | ||
+ | |||
+ | |} | ||
=== <b> Course of Action </b><br> === | === <b> Course of Action </b><br> === | ||
+ | Our team had discussed that the following actions to be taken after reviewing the comments that we had received from our users. | ||
+ | |||
+ | <b>For Individual Functions:</b> | ||
+ | {| border="1" | ||
+ | |- style="filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#5D2A0F', endColorstr='#5D2A0F');background: -webkit-gradient(linear, left top, left bottom, from(#5D2A0F), to(#5D2A0F)); background: -moz-linear-gradient(top, #5D2A0F, #5D2A0F); color:White" | ||
+ | |width="250" align="center"|'''Comments by Users''' | ||
+ | |width="350" align="center"|'''Action taken by the Team''' | ||
+ | |- | ||
+ | |width="250" align="center"|More vibrant and lively colors to be used to appeal to the users. | ||
+ | |width="250" align="center"|In discussion with the Client for new color changes. | ||
+ | |- | ||
+ | |width="250" align="center"|Finds check-in function meaningless and hard to search for businesses on the map. | ||
+ | |width="250" align="center"|Removed check-in function for individual users' current locations. Major changes to location function - Now it allows users to search for businesses using the drop down menus and to check-in at the businesses' locations. | ||
+ | |- | ||
+ | |width="250" align="center"|Impact page can provide more information of the projects such as the number of beneficiaries they have impacted. | ||
+ | |width="250" align="center"|Adding of a new tab "Projects" for the users to view more information on the projects which they have supported. Impact page will show the impact of their supports once the business members have given. | ||
+ | |- | ||
+ | |width="250" align="center"|Prefer to look at the public project of the business members rather than the business profiles after the QR code is scanned. | ||
+ | |width="250" align="center"|Allow users to reach the support projects page instead of the business profile page once they have scanned the QR code. If the user is interested to find out more about the businesses, they can click on the more information link which would redirect them to the business profile page. | ||
+ | |- | ||
+ | |-} |
Latest revision as of 09:22, 16 October 2012
Home | Our Team | Project Overview | Project Management | Project Documentation | LOMS & Reflections |
Use Case | Use Case Description | Giving Process | Storyboard | Diagrams | Minutes Repository | Presentations | UAT |
Contents
Overview
The purpose of the User Testing 2 is to collect feedbacks on the various user types, namely: Individual(Facebook and Normal Login) and Business Member. Through this testing, we hope to gather feedbacks on the usability of the web application.
Test Participants
Devices Used for Testing
- iPhone 5 (iOS 6)
- iPhone 4S (iOS 5.1.1)
- iPhone 3GS (iOS 5.1.1)
- iPad (iOS 5.1.1)
- iPad 2nd Gen (iOS 5.1.1)
- Samsung Galaxy Note
- Samsung Galaxy Ace
- Samsung Galaxy Wonder
- Samsung Galaxy S2
- Samsung Galaxy S3
- Samsung Galaxy Tab
- HTC CHA CHA
- HTC One V
- HTC Sensation
- HTC Sensation XE
- Sony Tab S
- Blackberry 9780
Browsers Used
- Google Chrome
- Mozilla Firefox
- Safari
- Andriod Default Web Browser
Test Pre-Requisites
- QR Code Scanner
Test Plans
- Test Plans for Business Member:
- Business Member 1: Test Plan for Business Member 1
- Business Member 2: Test Plan for Business Member 2
- Business Member 3: Test Plan for Business Member 3
- Business Member 4: Test Plan for Business Member 4
- Business Member 5: Test Plan for Business Member 5
- Business Member 6: Test Plan for Business Member 6
- Test Plans for Individual Users:
- Normal Login: Test Plan for Individual User - Normal Login 1
- Normal Login: Test Plan for Individual User - Normal Login 2
- Normal Login: Test Plan for Individual User - Normal Login 3
- Normal Login: Test Plan for Individual User - Normal Login 4
- Normal Login: Test Plan for Individual User - Normal Login 5
- Normal Login: Test Plan for Individual User - Normal Login 6
- Facebook Login: Test Plan for Individual User with Facebook Login 1
- Facebook Login: Test Plan for Individual User with Facebook Login 2
- Facebook Login: Test Plan for Individual User with Facebook Login 3
- Facebook Login: Test Plan for Individual User with Facebook Login 4
- Facebook Login: Test Plan for Individual User with Facebook Login 5
- Facebook Login: Test Plan for Individual User with Facebook Login 6
Overview of Test Results
Photographs
Some pictures took during our User Testing 2!
Result Analysis
Summary
Guided User Testing - Normal Login
Total number of testers: 15
Functions | Passes | Passes With Comments | Failures |
1. Create New User | 13 | 2 | 0 |
2.1 Newsfeed - Comments Function | 15 | 0 | 0 |
2.2 Newsfeed - Like Function | 15 | 0 | 0 |
2.3 Newsfeed - Share Function | 15 | 0 | 0 |
2.4 Newsfeed - Filter Function | 15 | 0 | 0 |
2.5 Newsfeed - Instruction Function | 15 | 0 | 0 |
2.5 Newsfeed - Load More Feeds Function | 14 | 0 | 1 |
3.1 Check In | 13 | 0 | 2 |
3.2 Check In - View Nearby Business Vicinity Function | 12 | 1 | 2 |
3.3 Check In - Instruction Function | 15 | 0 | 0 |
4.1 Impact | 15 | 0 | 0 |
4.2 Impact - Instruction Function | 15 | 0 | 0 |
5.1 Logout | 15 | 0 | 0 |
6.1 Support | 12 | 1 | 2 |
6.2 Support - Spamming of Support By Same User | 11 | 2 | 2 |
7.1 Impact - Verify Supported Project | 15 | 0 | 0 |
8.1 Account Management - Change Password | 14 | 0 | 1 |
8.2 Account Management - Change Profile Picture | 5 | 0 | 1 |
Guided User Testing - Facebook Login
Total number of testers: 14
Functions | Passes | Passes With Comments | Failures |
1. Create New User | 14 | 0 | 0 |
2.1 Newsfeed - Comments Function | 13 | 1 | 0 |
2.2 Newsfeed - Like Function | 14 | 0 | 0 |
2.3 Newsfeed - Share Function | 13 | 1 | 0 |
2.4 Newsfeed - Filter Function | 14 | 0 | 0 |
2.5 Newsfeed - Instruction Function | 13 | 1 | 0 |
2.5 Newsfeed - Load More Feeds Function | 13 | 0 | 1 |
3.1 Check In | 9 | 0 | 5 |
3.2 Check In - View Nearby Business Vicinity Function | 9 | 0 | 5 |
3.3 Check In - Instruction Function | 14 | 0 | 0 |
4.1 Impact | 14 | 0 | 0 |
4.2 Impact - Instruction Function | 14 | 0 | 0 |
5.1 Logout | 13 | 1 | 0 |
6.1 Support | 9 | 3 | 2 |
6.2 Support - Spamming of Support By Same User | 9 | 2 | 3 |
7.1 Impact - Verify Supported Project | 11 | 0 | 3 |
8.1 Account Management - Change Password | 12 | 1 | 1 |
8.2 Account Management - Invite Facebook Friends | 14 | 0 | 0 |
Total number of passes, passes with comments and failures:
Guided Business Member Testing
Total number of testers: 15
Functions | Passes | Passes With Comments | Failures |
1. Login | 12 | 2 | 1 |
2.1 Projects Function | 8 | 7 | 0 |
2.2 Projects - Instruction Function | 13 | 2 | 0 |
3.1 Newsfeed - Comments Function | 14 | 1 | 0 |
3.2 Newsfeed - Like Function | 14 | 1 | 0 |
3.3 Newsfeed - Share Function | 11 | 3 | 1 |
3.4 Newsfeed - Filter Function | 15 | 0 | 0 |
3.5 Newsfeed - Instruction Function | 15 | 0 | 0 |
3.6 Newsfeed - Load More Feeds | 13 | 2 | 0 |
4.1 Results - Individual users have shown support to the public projects listed | 5 | 5 | 5 |
4.2 Results - Instruction Function | 12 | 0 | 3 |
5.1 Summary | 11 | 1 | 3 |
5.2 Impact - Instruction Function | 15 | 0 | 0 |
6.1 Logout | 15 | 0 | 0 |
Total number of passes, passes with comments and failures:
Unguided User Testing
The following table shows the comments and/or questions that we had gathered for the various functionalities of B1G1 Connect, as well as general comments from our 3-day User Testing.
Functions | Comments/Questions Asked |
General |
|
Location |
|
Business Profile Page |
|
Like |
|
Quick Tour |
|
Support |
|
Instruction |
|
Login |
|
Newsfeed |
|
QR Code |
|
Projects |
|
Account |
|
Business Profile |
|
Impact |
|
Load More Feeds |
|
Comments |
|
Course of Action
Our team had discussed that the following actions to be taken after reviewing the comments that we had received from our users.
For Individual Functions:
Comments by Users | Action taken by the Team |
More vibrant and lively colors to be used to appeal to the users. | In discussion with the Client for new color changes. |
Finds check-in function meaningless and hard to search for businesses on the map. | Removed check-in function for individual users' current locations. Major changes to location function - Now it allows users to search for businesses using the drop down menus and to check-in at the businesses' locations. |
Impact page can provide more information of the projects such as the number of beneficiaries they have impacted. | Adding of a new tab "Projects" for the users to view more information on the projects which they have supported. Impact page will show the impact of their supports once the business members have given. |
Prefer to look at the public project of the business members rather than the business profiles after the QR code is scanned. | Allow users to reach the support projects page instead of the business profile page once they have scanned the QR code. If the user is interested to find out more about the businesses, they can click on the more information link which would redirect them to the business profile page. |