Difference between revisions of "IS480 Team wiki: 2015T2 EcoCo User Testing 3"
Jump to navigation
Jump to search
Gwtay.2013 (talk | contribs) |
Gwtay.2013 (talk | contribs) |
||
(8 intermediate revisions by the same user not shown) | |||
Line 93: | Line 93: | ||
[[Media: UT3_Task.pdf| Click Here To View Study Task Document]] | [[Media: UT3_Task.pdf| Click Here To View Study Task Document]] | ||
− | ==<div style="background: #4DB870; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px;letter-spacing:-0.08em;font-size:20px"><font color=#FFFFF>User Testing 3 | + | ==<div style="background: #4DB870; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px;letter-spacing:-0.08em;font-size:20px"><font color=#FFFFF>User Testing 3 Results</font></div>== |
+ | <br> | ||
+ | [[Media: EcoCo_UT3_Data.xlsx| Click Here To View User Testing 3 Raw Data]] | ||
+ | <br> | ||
+ | <!--CHANGES TABLE--> | ||
+ | {| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;" | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:450px" | Study Goal | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:450px" | Results | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Goal Achieved? | ||
+ | |- | ||
+ | |1. Users should be able to complete all tasks without any guidance from facilitators | ||
+ | |All users were able to complete all tasks without any help from the facilitators. | ||
+ | |Yes | ||
+ | |- | ||
+ | |2. Users should be able to register for an account/login with Facebook successfully. | ||
+ | |All users were able to log in without any issues. | ||
+ | |Yes | ||
+ | |- | ||
+ | |3. Users should find it easy to navigate from page to page when completing the tasks. | ||
+ | |Many users had trouble finding the Activity/Redemption History page, as they find it not intuitive. | ||
+ | |No | ||
+ | |- | ||
+ | |4. Users should be able to submit an Eco Action under the provided Activity Types. | ||
+ | |All users were able to submit their Eco Actions without any help from the facilitators. | ||
+ | |Yes | ||
+ | |- | ||
+ | |5. Users should find the News and Events informative and aesthetically pleasing. | ||
+ | |All users believe that there is sufficient information for Events and News, and they think that the display was rather pleasing (Simplistic design) | ||
+ | |Yes | ||
+ | |- | ||
+ | |6. Users should be able to view a catalog of rewards that they can redeem. | ||
+ | |All users were able to find the reward catalog and redeem rewards that they were able to redeem with the points that they were awarded with. | ||
+ | |Yes | ||
+ | |- | ||
+ | |7. Users should be able to update his/her profile without assistance from facilitators. | ||
+ | |All users were able to find and update their profile within one click, but some did feedback that it could have been made more obvious. | ||
+ | |Yes | ||
+ | |- | ||
+ | |} | ||
+ | <br> | ||
+ | <br> | ||
+ | <h3>Task 1</h3> | ||
+ | [[Image:Task1TimeTaken.png|center|900px]] | ||
+ | <!--CHANGES TABLE--> | ||
+ | {| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;" | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total Time Taken (seconds) | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average Time Taken (seconds) | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of Time Taken (seconds) | ||
+ | |- | ||
+ | |947 | ||
+ | |94.7 | ||
+ | |61.5354 | ||
+ | |- | ||
+ | |} | ||
+ | [[Image:NaviTask1.png|center|900px]] | ||
+ | <br> | ||
+ | <h3>Task 2</h3> | ||
+ | [[Image:Task2TotalTime.png|center|900px]] | ||
+ | <!--CHANGES TABLE--> | ||
+ | {| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;" | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total Time Taken (seconds) | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average Time Taken (seconds) | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of Time Taken (seconds) | ||
+ | |- | ||
+ | |433 | ||
+ | |43.3 | ||
+ | |32.9486 | ||
+ | |- | ||
+ | |} | ||
+ | <br> | ||
+ | [[Image:Task2TotalClicks.png|center|900px]] | ||
+ | <!--CHANGES TABLE--> | ||
+ | {| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;" | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total No. of Clicks | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average No. of Clicks | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of No. of Clicks | ||
+ | |- | ||
+ | |19 | ||
+ | |1.9 | ||
+ | |2.7 | ||
+ | |- | ||
+ | |} | ||
+ | <br> | ||
+ | <h3>Task 3</h3> | ||
+ | [[Image:Task3TotalTime.png|center|900px]] | ||
+ | <!--CLICKS TABLE--> | ||
+ | {| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;" | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total Time Taken (seconds) | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average Time Taken (seconds) | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of Time Taken (seconds) | ||
+ | |- | ||
+ | |426 | ||
+ | |42.6 | ||
+ | |31.5379 | ||
+ | |- | ||
+ | |} | ||
+ | <br> | ||
+ | <!--CHANGES TABLE--> | ||
+ | [[Image:Task3TotalClicks.png|center|900px]] | ||
+ | {| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;" | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total No. of Clicks | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average No. of Clicks | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of No. of Clicks | ||
+ | |- | ||
+ | |24 | ||
+ | |2.4 | ||
+ | |1.2806 | ||
+ | |- | ||
+ | |} | ||
+ | [[Image:NaviTask3.png|center|900px]] | ||
+ | <br> | ||
+ | <h3>Task 4</h3> | ||
+ | [[Image:Task4TotalTime.png|center|900px]] | ||
+ | <!--CHANGES TABLE--> | ||
+ | {| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;" | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total Time Taken (seconds) | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average Time Taken (seconds) | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of Time Taken (seconds) | ||
+ | |- | ||
+ | |320 | ||
+ | |32 | ||
+ | |16.3524 | ||
+ | |- | ||
+ | |} | ||
+ | <br> | ||
+ | <h3>Task 5</h3> | ||
+ | [[Image:Task5TotalTime.png|center|900px]] | ||
+ | <!--CHANGES TABLE--> | ||
+ | {| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;" | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total Time Taken (seconds) | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average Time Taken (seconds) | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of Time Taken (seconds) | ||
+ | |- | ||
+ | |458 | ||
+ | |45.8 | ||
+ | |42.7196 | ||
+ | |- | ||
+ | |} | ||
+ | [[Image:Task5TotalClicks.png|center|900px]] | ||
+ | <!--CHANGES TABLE--> | ||
+ | {| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;" | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total No. of Clicks | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average No. of Clicks | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of No. of Clicks | ||
+ | |- | ||
+ | |22 | ||
+ | |2.2 | ||
+ | |1.6 | ||
+ | |- | ||
+ | |} | ||
+ | [[Image:NaviTask5.png|center|900px]] | ||
<br> | <br> | ||
− | {| class="wikitable" style="margin: auto;width: | + | <h3>Task 6</h3> |
− | ! style="background: #4DB870; color: white; font-weight: bold; width: | + | [[Image:Task6TotalTime.png|center|900px]] |
− | ! style="background: #4DB870; color: white; font-weight: bold; width: | + | <!--CHANGES TABLE--> |
− | ! style="background: #4DB870; color: white; font-weight: bold; width: | + | {| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;" |
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total Time Taken (seconds) | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average Time Taken (seconds) | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of Time Taken (seconds) | ||
|- | |- | ||
− | + | |22 | |
− | | | + | |2.2 |
− | | | + | |2.0396 |
|- | |- | ||
− | ! style="background: #4DB870; color: white; font-weight: bold; width: | + | |} |
− | | | + | [[Image:NaviTask6.png|center|900px]] |
− | | | + | <br> |
+ | <h3>Task 7</h3> | ||
+ | [[Image:Task7TotalTime.png|center|900px]] | ||
+ | <!--CHANGES TABLE--> | ||
+ | {| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;" | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total Time Taken (seconds) | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average Time Taken (seconds) | ||
+ | ! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of Time Taken (seconds) | ||
+ | |- | ||
+ | |330 | ||
+ | |33 | ||
+ | |30.1828 | ||
|- | |- | ||
|} | |} | ||
+ | <br> | ||
+ | |||
+ | ==<div style="background: #4DB870; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px;letter-spacing:-0.08em;font-size:20px"><font color=#FFFFF>User Testing 3 Feedback</font></div>== | ||
<br> | <br> | ||
{| class="wikitable" style="margin: auto;width:50%; text-align:center; background: white;" | {| class="wikitable" style="margin: auto;width:50%; text-align:center; background: white;" | ||
− | ! style="background: #4DB870; color: white; font-weight: bold; width:50px" | As | + | ! style="background: #4DB870; color: white; font-weight: bold; width:50px" | As A User |
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Likes | ! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Likes | ||
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Dislikes | ! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Dislikes | ||
|- | |- | ||
− | ! style="background: #4DB870; color: white; font-weight: bold; width:50px" | | + | ! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Usability |
− | | 1. | + | | 1. The web application is easy to use.<br>2. The web application is generally easy to navigate. |
− | | 1. The | + | | 1. The web application could be more intuitive, especially for the Actions History<br>2. Actions History button is not very obvious.<br>3. Users do not know what is "Pathfinder" (Rank). |
|- | |- | ||
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Functionality | ! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Functionality | ||
− | | 1. | + | | 1. The news is very informative, and the display is rather appealing.<br>2. The web application |
− | | 1. | + | | 1. For the events, there should be some categorization to make it easier to find certain events.<br> |
|- | |- | ||
|} | |} | ||
Line 130: | Line 297: | ||
<!--CHANGES TABLE--> | <!--CHANGES TABLE--> | ||
{| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;" | {| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;" | ||
− | ! style="background: #4DB870; color: white; font-weight: bold; width: | + | ! style="background: #4DB870; color: white; font-weight: bold; width:200px" | Changes Made |
! style="background: #4DB870; color: white; font-weight: bold; width:450px" | Remarks | ! style="background: #4DB870; color: white; font-weight: bold; width:450px" | Remarks | ||
|- | |- | ||
− | | | + | |"Rank Button" has been replaced by "View History" button so Users will be able to find their "History" page easily. |
− | |[[ | + | |Before<br>[[Image:UT3_1a.PNG|500px]]<br>After<br>[[Image:UT3_11.PNG|500px]] |
|- | |- | ||
− | | | + | |Users will be able to view their Current Points, and they will know what their rank is in "View History" page. |
− | |[[File: | + | |Before<br>[[File:UT3_2a.PNG|500px]]<br>After<br>[[File:UT3_21.PNG|500px]] |
|- | |- | ||
+ | |Events can now be filtered and categorized based on Event Type and Organization. | ||
+ | |Before<br>[[File:UT3_3.PNG|500px]]<br>After<br>[[File:UT3_3a.PNG|500px]] | ||
|- | |- | ||
|} | |} |
Latest revision as of 20:26, 17 April 2016
Personas and Scenario | Diagrams | Meeting Minutes | Testing |
Contents
User Testing 3 Details
- Date: 19 March 2016
- Venue: National Library, informatics Lab
User Testing 3 Objective
- Determine if user interface is intuitive after making the changes from UT2
- Discover usability problem which users might face after changes from UT2
Click Here To View Study Design Document
Scope of UT 3
- User
- Register for an account/Login via Facebook
- Update user profile
- Submit "As A Consumer" Eco Action
- View news
- View events
- View Eco Action history
- View Reward Catalogue
- Claim reward
- Logout of account
User Testing 3 Participant
- Eco Singapore Volunteers
User Testing 3 Study Task
- The participants were asked to complete the following as a User:
- Login via Facebook
- Edit his Profile Page
- Submit an Eco Action
- View Actions History
- Claim a reward
- Check status of reward claimed
- View Events in the Event page
- View News in the News page
- Logout of account.
Click Here To View Study Task Document
User Testing 3 Results
Click Here To View User Testing 3 Raw Data
Study Goal | Results | Goal Achieved? |
---|---|---|
1. Users should be able to complete all tasks without any guidance from facilitators | All users were able to complete all tasks without any help from the facilitators. | Yes |
2. Users should be able to register for an account/login with Facebook successfully. | All users were able to log in without any issues. | Yes |
3. Users should find it easy to navigate from page to page when completing the tasks. | Many users had trouble finding the Activity/Redemption History page, as they find it not intuitive. | No |
4. Users should be able to submit an Eco Action under the provided Activity Types. | All users were able to submit their Eco Actions without any help from the facilitators. | Yes |
5. Users should find the News and Events informative and aesthetically pleasing. | All users believe that there is sufficient information for Events and News, and they think that the display was rather pleasing (Simplistic design) | Yes |
6. Users should be able to view a catalog of rewards that they can redeem. | All users were able to find the reward catalog and redeem rewards that they were able to redeem with the points that they were awarded with. | Yes |
7. Users should be able to update his/her profile without assistance from facilitators. | All users were able to find and update their profile within one click, but some did feedback that it could have been made more obvious. | Yes |
Task 1
Total Time Taken (seconds) | Average Time Taken (seconds) | Standard Deviation of Time Taken (seconds) |
---|---|---|
947 | 94.7 | 61.5354 |
Task 2
Total Time Taken (seconds) | Average Time Taken (seconds) | Standard Deviation of Time Taken (seconds) |
---|---|---|
433 | 43.3 | 32.9486 |
Total No. of Clicks | Average No. of Clicks | Standard Deviation of No. of Clicks |
---|---|---|
19 | 1.9 | 2.7 |
Task 3
Total Time Taken (seconds) | Average Time Taken (seconds) | Standard Deviation of Time Taken (seconds) |
---|---|---|
426 | 42.6 | 31.5379 |
Total No. of Clicks | Average No. of Clicks | Standard Deviation of No. of Clicks |
---|---|---|
24 | 2.4 | 1.2806 |
Task 4
Total Time Taken (seconds) | Average Time Taken (seconds) | Standard Deviation of Time Taken (seconds) |
---|---|---|
320 | 32 | 16.3524 |
Task 5
Total Time Taken (seconds) | Average Time Taken (seconds) | Standard Deviation of Time Taken (seconds) |
---|---|---|
458 | 45.8 | 42.7196 |
Total No. of Clicks | Average No. of Clicks | Standard Deviation of No. of Clicks |
---|---|---|
22 | 2.2 | 1.6 |
Task 6
Total Time Taken (seconds) | Average Time Taken (seconds) | Standard Deviation of Time Taken (seconds) |
---|---|---|
22 | 2.2 | 2.0396 |
Task 7
Total Time Taken (seconds) | Average Time Taken (seconds) | Standard Deviation of Time Taken (seconds) |
---|---|---|
330 | 33 | 30.1828 |
User Testing 3 Feedback
As A User | Likes | Dislikes |
---|---|---|
Usability | 1. The web application is easy to use. 2. The web application is generally easy to navigate. |
1. The web application could be more intuitive, especially for the Actions History 2. Actions History button is not very obvious. 3. Users do not know what is "Pathfinder" (Rank). |
Functionality | 1. The news is very informative, and the display is rather appealing. 2. The web application |
1. For the events, there should be some categorization to make it easier to find certain events. |
Changes Implemented
Changes Made | Remarks |
---|---|
"Rank Button" has been replaced by "View History" button so Users will be able to find their "History" page easily. | Before After |
Users will be able to view their Current Points, and they will know what their rank is in "View History" page. | Before After |
Events can now be filtered and categorized based on Event Type and Organization. | Before After 500px |