HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2015T2 EcoCo User Testing 3"

From IS480
Jump to navigation Jump to search
 
(7 intermediate revisions by the same user not shown)
Line 95: Line 95:
 
==<div style="background: #4DB870; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px;letter-spacing:-0.08em;font-size:20px"><font color=#FFFFF>User Testing 3 Results</font></div>==
 
==<div style="background: #4DB870; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px;letter-spacing:-0.08em;font-size:20px"><font color=#FFFFF>User Testing 3 Results</font></div>==
 
<br>
 
<br>
[[Media: .pdf| Click Here To View User Testing 3 Results]]
+
[[Media: EcoCo_UT3_Data.xlsx| Click Here To View User Testing 3 Raw Data]]
 
+
<br>
==<div style="background: #4DB870; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px;letter-spacing:-0.08em;font-size:20px"><font color=#FFFFF>User Testing 3 Feedback</font></div>==
+
<!--CHANGES TABLE-->
 +
{| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;"
 +
! style="background: #4DB870; color: white; font-weight: bold; width:450px" | Study Goal
 +
! style="background: #4DB870; color: white; font-weight: bold; width:450px" | Results
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Goal Achieved?
 +
|-
 +
|1. Users should be able to complete all tasks without any guidance from facilitators
 +
|All users were able to complete all tasks without any help from the facilitators.
 +
|Yes
 +
|-
 +
|2. Users should be able to register for an account/login with Facebook successfully.
 +
|All users were able to log in without any issues.
 +
|Yes
 +
|-
 +
|3. Users should find it easy to navigate from page to page when completing the tasks.
 +
|Many users had trouble finding the Activity/Redemption History page, as they find it not intuitive.
 +
|No
 +
|-
 +
|4. Users should be able to submit an Eco Action under the provided Activity Types.
 +
|All users were able to submit their Eco Actions without any help from the facilitators.
 +
|Yes
 +
|-
 +
|5. Users should find the News and Events informative and aesthetically pleasing.
 +
|All users believe that there is sufficient information for Events and News, and they think that the display was rather pleasing (Simplistic design)
 +
|Yes
 +
|-
 +
|6. Users should be able to view a catalog of rewards that they can redeem.
 +
|All users were able to find the reward catalog and redeem rewards that they were able to redeem with the points that they were awarded with.
 +
|Yes
 +
|-
 +
|7. Users should be able to update his/her profile without assistance from facilitators.
 +
|All users were able to find and update their profile within one click, but some did feedback that it could have been made more obvious.
 +
|Yes
 +
|-
 +
|}
 +
<br>
 +
<br>
 +
<h3>Task 1</h3>
 +
[[Image:Task1TimeTaken.png|center|900px]]
 +
<!--CHANGES TABLE-->
 +
{| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;"
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total Time Taken (seconds)
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average Time Taken (seconds)
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of Time Taken (seconds)
 +
|-
 +
|947
 +
|94.7
 +
|61.5354
 +
|-
 +
|}
 +
[[Image:NaviTask1.png|center|900px]]
 +
<br>
 +
<h3>Task 2</h3>
 +
[[Image:Task2TotalTime.png|center|900px]]
 +
<!--CHANGES TABLE-->
 +
{| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;"
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total Time Taken (seconds)
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average Time Taken (seconds)
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of Time Taken (seconds)
 +
|-
 +
|433
 +
|43.3
 +
|32.9486
 +
|-
 +
|}
 +
<br>
 +
[[Image:Task2TotalClicks.png|center|900px]]
 +
<!--CHANGES TABLE-->
 +
{| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;"
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total No. of Clicks
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average No. of Clicks
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of No. of Clicks
 +
|-
 +
|19
 +
|1.9
 +
|2.7
 +
|-
 +
|}
 +
<br>
 +
<h3>Task 3</h3>
 +
[[Image:Task3TotalTime.png|center|900px]]
 +
<!--CLICKS TABLE-->
 +
{| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;"
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total Time Taken (seconds)
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average Time Taken (seconds)
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of Time Taken (seconds)
 +
|-
 +
|426
 +
|42.6
 +
|31.5379
 +
|-
 +
|}
 +
<br>
 +
<!--CHANGES TABLE-->
 +
[[Image:Task3TotalClicks.png|center|900px]]
 +
{| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;"
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total No. of Clicks
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average No. of Clicks
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of No. of Clicks
 +
|-
 +
|24
 +
|2.4
 +
|1.2806
 +
|-
 +
|}
 +
[[Image:NaviTask3.png|center|900px]]
 +
<br>
 +
<h3>Task 4</h3>
 +
[[Image:Task4TotalTime.png|center|900px]]
 +
<!--CHANGES TABLE-->
 +
{| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;"
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total Time Taken (seconds)
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average Time Taken (seconds)
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of Time Taken (seconds)
 +
|-
 +
|320
 +
|32
 +
|16.3524
 +
|-
 +
|}
 +
<br>
 +
<h3>Task 5</h3>
 +
[[Image:Task5TotalTime.png|center|900px]]
 +
<!--CHANGES TABLE-->
 +
{| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;"
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total Time Taken (seconds)
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average Time Taken (seconds)
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of Time Taken (seconds)
 +
|-
 +
|458
 +
|45.8
 +
|42.7196
 +
|-
 +
|}
 +
[[Image:Task5TotalClicks.png|center|900px]]
 +
<!--CHANGES TABLE-->
 +
{| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;"
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total No. of Clicks
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average No. of Clicks
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of No. of Clicks
 +
|-
 +
|22
 +
|2.2
 +
|1.6
 +
|-
 +
|}
 +
[[Image:NaviTask5.png|center|900px]]
 
<br>
 
<br>
{| class="wikitable" style="margin: auto;width:50%; text-align:center; background: white;"
+
<h3>Task 6</h3>
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | As A User
+
[[Image:Task6TotalTime.png|center|900px]]
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Likes
+
<!--CHANGES TABLE-->
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Dislikes
+
{| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;"
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total Time Taken (seconds)
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average Time Taken (seconds)
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of Time Taken (seconds)
 
|-
 
|-
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | User Interface
+
|22
| 1. Overall look of the site is appealing<br>
+
|2.2
| 1. The font is very disliked<br>2. Events are hard to read.<br>3. Fonts make the words look very compact.
+
|2.0396
 
|-
 
|-
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Functionality
+
|}
| 1. It's really a one stop solution to saving the environment.<br>2. Good to have so many Eco actions that can be done at home.
+
[[Image:NaviTask6.png|center|900px]]
| 1. A lot of scrolling when selecting Country for profile setup.<br>2. When looking at news, there is too much scrolling.<br>3. When looking at events, there is also too much scrolling.<br>4. The events are not listed in order, and they are randomly listed.
+
<br>
 +
<h3>Task 7</h3>
 +
[[Image:Task7TotalTime.png|center|900px]]
 +
<!--CHANGES TABLE-->
 +
{| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;"
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Total Time Taken (seconds)
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Average Time Taken (seconds)
 +
! style="background: #4DB870; color: white; font-weight: bold; width:100px" | Standard Deviation of Time Taken (seconds)
 +
|-
 +
|330
 +
|33
 +
|30.1828
 
|-
 
|-
 
|}
 
|}
 +
<br>
 +
 +
==<div style="background: #4DB870; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px;letter-spacing:-0.08em;font-size:20px"><font color=#FFFFF>User Testing 3 Feedback</font></div>==
 
<br>
 
<br>
 
{| class="wikitable" style="margin: auto;width:50%; text-align:center; background: white;"
 
{| class="wikitable" style="margin: auto;width:50%; text-align:center; background: white;"
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | As An Admin
+
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | As A User
 
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Likes
 
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Likes
 
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Dislikes
 
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Dislikes
 
|-
 
|-
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | User Interface
+
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Usability
|  1. Overall look of the site is appealing<br>
+
|  1. The web application is easy to use.<br>2. The web application is generally easy to navigate.
|  1. The font is not appealing<br>2. Events and News hard to read.
+
|  1. The web application could be more intuitive, especially for the Actions History<br>2. Actions History button is not very obvious.<br>3. Users do not know what is "Pathfinder" (Rank).
 
|-
 
|-
 
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Functionality
 
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Functionality
| 1. It's really a one stop solution to saving the environment.<br>2. Good to have so many Eco actions that can be done at home.
+
| 1. The news is very informative, and the display is rather appealing.<br>2. The web application
| 1. When rejecting an Eco Action, the user will not know why his action is rejected.<br>2. When a user has submitted an action with the wrong input, Admin is not able to edit it and has to reject it.
+
| 1. For the events, there should be some categorization to make it easier to find certain events.<br>
 
|-
 
|-
 
|}
 
|}
Line 134: Line 297:
 
<!--CHANGES TABLE-->
 
<!--CHANGES TABLE-->
 
{| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;"
 
{| class="wikitable" style="margin: auto;width:60%; text-align:center; background: white;"
! style="background: #4DB870; color: white; font-weight: bold; width:50px" | Changes Made
+
! style="background: #4DB870; color: white; font-weight: bold; width:200px" | Changes Made
 
! style="background: #4DB870; color: white; font-weight: bold; width:450px" | Remarks
 
! style="background: #4DB870; color: white; font-weight: bold; width:450px" | Remarks
 
|-
 
|-
|Admin can leave a remark when rejecting an action
+
|"Rank Button" has been replaced by "View History" button so Users will be able to find their "History" page easily.
|[[File:UT1.1a.png|700px]]<br>[[File:reject.png|700px]]
+
|Before<br>[[Image:UT3_1a.PNG|500px]]<br>After<br>[[Image:UT3_11.PNG|500px]]
 
|-
 
|-
|Admin can now edit the user's submission
+
|Users will be able to view their Current Points, and they will know what their rank is in "View History" page.
|[[File:UT1.1a.png|700px]]<br>[[File:UT1.1a1.png|700px]]
+
|Before<br>[[File:UT3_2a.PNG|500px]]<br>After<br>[[File:UT3_21.PNG|500px]]
 
|-
 
|-
 +
|Events can now be filtered and categorized based on Event Type and Organization.
 +
|Before<br>[[File:UT3_3.PNG|500px]]<br>After<br>[[File:UT3_3a.PNG|500px]]
 
|-
 
|-
 
|}
 
|}

Latest revision as of 20:26, 17 April 2016

EcoCo.png


Home.png   HOME

 

About Us.png   ABOUT US

 

Overview.png   PROJECT OVERVIEW

 

Project Management.png   PROJECT MANAGEMENT

 

EcoCo Documentation.png   DOCUMENTATION

 

 Personas and Scenario   Diagrams   Meeting Minutes   Testing 


User Testing 3 Details


  • Date: 19 March 2016
  • Venue: National Library, informatics Lab

User Testing 3 Objective


  • Determine if user interface is intuitive after making the changes from UT2
  • Discover usability problem which users might face after changes from UT2

Click Here To View Study Design Document

Scope of UT 3

  • User
    • Register for an account/Login via Facebook
    • Update user profile
    • Submit "As A Consumer" Eco Action
    • View news
    • View events
    • View Eco Action history
    • View Reward Catalogue
    • Claim reward
    • Logout of account

User Testing 3 Participant


  • Eco Singapore Volunteers

UT31.jpg UT32.jpg UT33.jpg UT34.jpg

User Testing 3 Study Task


  • The participants were asked to complete the following as a User:
    • Login via Facebook
    • Edit his Profile Page
    • Submit an Eco Action
    • View Actions History
    • Claim a reward
    • Check status of reward claimed
    • View Events in the Event page
    • View News in the News page
    • Logout of account.

Click Here To View Study Task Document

User Testing 3 Results


Click Here To View User Testing 3 Raw Data

Study Goal Results Goal Achieved?
1. Users should be able to complete all tasks without any guidance from facilitators All users were able to complete all tasks without any help from the facilitators. Yes
2. Users should be able to register for an account/login with Facebook successfully. All users were able to log in without any issues. Yes
3. Users should find it easy to navigate from page to page when completing the tasks. Many users had trouble finding the Activity/Redemption History page, as they find it not intuitive. No
4. Users should be able to submit an Eco Action under the provided Activity Types. All users were able to submit their Eco Actions without any help from the facilitators. Yes
5. Users should find the News and Events informative and aesthetically pleasing. All users believe that there is sufficient information for Events and News, and they think that the display was rather pleasing (Simplistic design) Yes
6. Users should be able to view a catalog of rewards that they can redeem. All users were able to find the reward catalog and redeem rewards that they were able to redeem with the points that they were awarded with. Yes
7. Users should be able to update his/her profile without assistance from facilitators. All users were able to find and update their profile within one click, but some did feedback that it could have been made more obvious. Yes



Task 1

Task1TimeTaken.png
Total Time Taken (seconds) Average Time Taken (seconds) Standard Deviation of Time Taken (seconds)
947 94.7 61.5354
NaviTask1.png


Task 2

Task2TotalTime.png
Total Time Taken (seconds) Average Time Taken (seconds) Standard Deviation of Time Taken (seconds)
433 43.3 32.9486


Task2TotalClicks.png
Total No. of Clicks Average No. of Clicks Standard Deviation of No. of Clicks
19 1.9 2.7


Task 3

Task3TotalTime.png
Total Time Taken (seconds) Average Time Taken (seconds) Standard Deviation of Time Taken (seconds)
426 42.6 31.5379


Task3TotalClicks.png
Total No. of Clicks Average No. of Clicks Standard Deviation of No. of Clicks
24 2.4 1.2806
NaviTask3.png


Task 4

Task4TotalTime.png
Total Time Taken (seconds) Average Time Taken (seconds) Standard Deviation of Time Taken (seconds)
320 32 16.3524


Task 5

Task5TotalTime.png
Total Time Taken (seconds) Average Time Taken (seconds) Standard Deviation of Time Taken (seconds)
458 45.8 42.7196
Task5TotalClicks.png
Total No. of Clicks Average No. of Clicks Standard Deviation of No. of Clicks
22 2.2 1.6
NaviTask5.png


Task 6

Task6TotalTime.png
Total Time Taken (seconds) Average Time Taken (seconds) Standard Deviation of Time Taken (seconds)
22 2.2 2.0396
NaviTask6.png


Task 7

Task7TotalTime.png
Total Time Taken (seconds) Average Time Taken (seconds) Standard Deviation of Time Taken (seconds)
330 33 30.1828


User Testing 3 Feedback


As A User Likes Dislikes
Usability 1. The web application is easy to use.
2. The web application is generally easy to navigate.
1. The web application could be more intuitive, especially for the Actions History
2. Actions History button is not very obvious.
3. Users do not know what is "Pathfinder" (Rank).
Functionality 1. The news is very informative, and the display is rather appealing.
2. The web application
1. For the events, there should be some categorization to make it easier to find certain events.


Changes Implemented


Changes Made Remarks
"Rank Button" has been replaced by "View History" button so Users will be able to find their "History" page easily. Before
UT3 1a.PNG
After
UT3 11.PNG
Users will be able to view their Current Points, and they will know what their rank is in "View History" page. Before
UT3 2a.PNG
After
UT3 21.PNG
Events can now be filtered and categorized based on Event Type and Organization. Before
UT3 3.PNG
After
500px