Difference between revisions of "IS480 Team wiki: 2016T1 Stark Documentation Testing User Testing 3"
Line 97: | Line 97: | ||
*ONLY computers are acceptable to test the platform. | *ONLY computers are acceptable to test the platform. | ||
<br> | <br> | ||
+ | |||
+ | ==Summary Charts (Demographics)== | ||
+ | [[File:Education.JPG|thumbnail]] | ||
==Summary and Results:== | ==Summary and Results:== |
Revision as of 20:44, 17 November 2016
USER TESTING 1 | USER TESTING 2 | USER TESTING 3 |
---|
Contents
Summary of User Testing 3 (THE LAST!)
Time Period: 31st October 2016 - 11th November 2016
Total Number of Users: 32
Venue: Off-Site (At respective members' discretion)
Duration: 30 Minutes/user - Refer to UT3 Doc
Manner of Conduct: Face-to-face with users/Over Skype, while monitoring them.
Objectives:
- Identify key usability issues in current application (As guided by experienced users of similar C2C platforms)
- Gather feedback from key demographics about the viability of our application (in contrast to available platforms)
- Improve current application if any bugs/critical flaws are spotted
- Access interest from users about utilizing MaiMai in the future
- Improve upon the design, speed and usability of the application
Scope:
- Login
- Withdrawal (Transaction)
- Listing (Seller)
- Agreements (Normal + New features - Location + Time/Date)
- Counter-Offer
- Notifications
- Review (Brief)
- Dispute Reply and Management
Certain basics are presumed - Chat etc. Learning curve at the start might be pretty high for new users. The process has been highly evolved from previous user tests to monitor key functionalities rather than a full-suite test.
Recruiting:
A total of 32 users were recruited from friends and family members. These users are mostly validated to have some experience dealing with C2C (and possibly) B2C platforms. Most were repeat users from the previous testings (discussed below)
Environment:
- Users are tested off-site face-to-face between testers and testees. Only in very special circumstances are they tested over a video communication platform (like skype) to guide users and observe them while they do the UAT. Each user process takes 30 minutes.
- ONLY computers are acceptable to test the platform.
Summary Charts (Demographics)
Summary and Results:
The top issues highlighted in the RawData were: | |||||
---|---|---|---|---|---|
No: | Issue: | Number of Users: | Key Category: | ||
1. | Notifications were not easily recognized by users | 16 | Notification/Chat Notification | ||
2 | Edit Profile very Unintuitive | 10 | Editing of profile/settings | ||
3 | Add button is not intuitive | 8 | Picture adding/upload (3 sections - chat, listing, dispute) | ||
4 | Agreements button cannot find/Cannot find offer as on agreements page | 7 | Chat display | ||
5 | Picture Uploading | 6 | Picture |
Good Points highlighted: | |||||
---|---|---|---|---|---|
No: | Point: | Number of users: | |||
1 | Agreements function good idea | 3 | |||
2 | Good as many e-commerce face difficulties | 2 | |||
3 | Overall experience is good, simplistic and easy | 1 | |||
4 | Private and public section is good | 1 | |||
5 | Chat is simple and nice | 1 | |||
6 | Login and Register were simple | 1 | |||
7 | Dashboard simplistic, allows easy navigation | 1 | |||
8 | Notification does show multiple interests | 1 | |||
9 | Overall colour chosen, the font size and every design are good | 1 |
Main Issues with each category: | |||||
---|---|---|---|---|---|
Accounts/Login: | |||||
Issue: | Number of Users: | Suggestions: | |||
Edit Profile very unintuitive | 10 |
| |||
Listing (Seller): | |||||
Issue: | Number of Users: | Suggestions: | |||
Add button is not intuitive | 8 |
| |||
Communication/Chat: | |||||
Issue: | Number of Users: | Suggestions: | |||
Agreements button cannot find | 4 |
| |||
Dispute: | |||||
Issue: | Number of Users: | Suggestions: | |||
Hard to file a dispute, unintuitive | 3 |
| |||
Dispute has no explanation | 4 |
| |||
Buyer (Transaction): | |||||
Issue: | Number of Users: | Suggestions: | |||
Buyer may not understand the nuances to what he is agreeing to in agreement | 2 |
| |||
Review: | |||||
Issue: | Number of Users: | Suggestions: | |||
Efficiency is not a good review category | 5 |
| |||
Overall: | |||||
Issue: | Number of Users: | Suggestions: | |||
Notifications are not easily recognized by user | 16 |
|
Other features to note: | |||||
---|---|---|---|---|---|
Issue: | Number of Users: | Suggestions: | Category: | ||
Unable to adjust picture | 5 |
|
Image Detail | ||
User should be redirected to dashboard or login page after registration | 2 |
|
Login/Registration | ||
Search Function implementations | 1 |
|
Search | ||
Need to report user for inadequate behaviour | 1 |
|
Reporting | ||
Price Issues | 6 |
|
Listing Prices | ||
Offering of Prices | 3 |
|
Transaction/Offer | ||
Agreements issues | 3 |
|
Agreement Issues | ||
6 digit number code prompt is not obvious | 1 |
|
Validation | ||
Design issues | 17 | Chat: | Design | ||
| |||||
Listing: | |||||
| |||||
Review: | |||||
| |||||
Dispute: | |||||
| |||||
Overall: | |||||
| |||||
Create badges and gamify the application | 2 |
|
Gamefication | ||
Hand clicking cursor to indicate to user that the button can be pressed | 1 | Support | |||
Adding details to image | 3 |
|
Image Detail | ||
Guide needed to support user (Links with the other errors) | 4 |
|
Guide | ||
Dashboard/Home page/Side bar got issues (Combined) | 14 |
|
Front Page | ||
Review categories | 1 |
|
Review Category | ||
Filtering System | 1 |
|
Filtering | ||
Review Summary | 1 |
|
Profile Details | ||
Finding review is not clear | 1 |
|
Review Filing | ||
Pages | 1 |
|
Review Pages | ||
Unintuitive Error Msg | 1 |
|
Error Msg | ||
Placeholder | 1 |
|
Dispute Filing | ||
History of updating | 1 |
|
History | ||
Dispute Category | 2 |
|
Dispute Category | ||
Generate Picture | 3 |
|
Capture Function | ||
Freezing of pages | 1 |
|
Dispute Freezing | ||
Drag and Drop | 1 |
|
Chat functions | ||
No redirection of certain "intuitive" links | 1 |
|
Redirection | ||
Scrolling in chat page | 1 |
|
Scrolling | ||
Product Categorization | 1 |
|
Filtering | ||
New listing | 1 |
|
Header | ||
Picture Uploading | 6 |
|
Picture | ||
Likes | 1 |
|
Likes |
Summary Charts
Option A vs Option B?
Option A | Option B |
Action Plan
- Fix all integration issues
- Prepare for the release 1.0 of MaiMai
- Improve upon UAT2