HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2010T1 The Green Reapers: Usability Testing"

From IS480
Jump to navigation Jump to search
Line 1: Line 1:
=<div style="width: 95%; filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#f6ffe9', endColorstr='#bfff64'); background: -webkit-gradient(linear, left top, left bottom, from(#f6ffe9), to(#bfff64)); background: -moz-linear-gradient(top,  #f6ffe9,  #bfff64); padding: 15px; font-weight: bold; margin-top: 35px; line-height: 1.4em">      Methodology      </div>=
+
=<div style="width: 95%; filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#eaf7ff', endColorstr='#b9e6ff'); background: -webkit-gradient(linear, left top, left bottom, from(#eaf7ff), to(#b9e6ff)); background: -moz-linear-gradient(top,  #eaf7ff,  #b9e6ff); padding: 15px; font-weight: bold; margin-top: 35px; line-height: 1.4em">      Methodology      </div>=
  
 
<ul style="line-height: 180%;">
 
<ul style="line-height: 180%;">
 
<li>2 rounds of testing</li>
 
<li>2 rounds of testing</li>
 +
<ul style="line-height: 180%;">
 +
<li>Iteration 6: 24 - 26 October</li>
 +
<li>Iteration 7: 12 - 15 November</li>
 +
</ul>
 
<li>Task-based tests:
 
<li>Task-based tests:
 
<ul style="line-height: 180%;">
 
<ul style="line-height: 180%;">
Line 23: Line 27:
  
  
=<div style="width: 95%; filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#f6ffe9', endColorstr='#bfff64'); background: -webkit-gradient(linear, left top, left bottom, from(#f6ffe9), to(#bfff64)); background: -moz-linear-gradient(top,  #f6ffe9,  #bfff64); padding: 15px; font-weight: bold; margin-top: 35px; line-height: 1.4em">      Test Questions      </div>=
+
=<div style="width: 95%; filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#eaf7ff', endColorstr='#b9e6ff'); background: -webkit-gradient(linear, left top, left bottom, from(#eaf7ff), to(#b9e6ff)); background: -moz-linear-gradient(top,  #eaf7ff,  #b9e6ff); padding: 15px; font-weight: bold; margin-top: 35px; line-height: 1.4em">      Test Questions      </div>=
  
  
Line 29: Line 33:
  
 
{| class="wikitable" style="margin: auto"
 
{| class="wikitable" style="margin: auto"
! colspan="3" | IntelliCrops Feedback - Analytics
+
! colspan="3" style="background: black; color: white" | IntelliCrops Feedback - Analytics
 
|-
 
|-
 
| colspan="2" | Please head over to http://www.intellicrops.com/analytics/ and create 3 different charts that show
 
| colspan="2" | Please head over to http://www.intellicrops.com/analytics/ and create 3 different charts that show
Line 61: Line 65:
  
 
{| class="wikitable" style="margin: auto"
 
{| class="wikitable" style="margin: auto"
! colspan="3" | IntelliCrops Feedback - Interactive Voice Response
+
! colspan="3" style="background: black; color: white" | IntelliCrops Feedback - Interactive Voice Response
 
|-
 
|-
 
| colspan="2" | (Requires a Skype account)
 
| colspan="2" | (Requires a Skype account)
Line 100: Line 104:
  
 
{| class="wikitable" style="margin: auto"
 
{| class="wikitable" style="margin: auto"
! colspan="3" | IntelliCrops Feedback - Knowledge Navigator
+
! colspan="3" style="background: black; color: white" | IntelliCrops Feedback - Knowledge Navigator
 
|-
 
|-
 
| colspan="2" | Please head over to http://www.intellicrops.com/ivr/knowledgenavigator.php
 
| colspan="2" | Please head over to http://www.intellicrops.com/ivr/knowledgenavigator.php
Line 130: Line 134:
  
  
=<div style="width: 95%; filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#f6ffe9', endColorstr='#bfff64'); background: -webkit-gradient(linear, left top, left bottom, from(#f6ffe9), to(#bfff64)); background: -moz-linear-gradient(top,  #f6ffe9,  #bfff64); padding: 15px; font-weight: bold; margin-top: 35px; line-height: 1.4em">      Results and Action Plan      </div>=
+
=<div style="width: 95%; filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#eaf7ff', endColorstr='#b9e6ff'); background: -webkit-gradient(linear, left top, left bottom, from(#eaf7ff), to(#b9e6ff)); background: -moz-linear-gradient(top,  #eaf7ff,  #b9e6ff); padding: 15px; font-weight: bold; margin-top: 35px; line-height: 1.4em">      Results and Action Plan      </div>=
  
 
== Analytics ==
 
== Analytics ==
  
 
{| class="wikitable" style="margin: auto"
 
{| class="wikitable" style="margin: auto"
! colspan="3" | Usability Testing Round 1
+
! colspan="3" style="background: black; color: white" | Usability Testing Round 1
 
|-
 
|-
 
| [[Image:IntelliCrops-Usability-Round_1-Analytics-Complete.png‎|230px]]
 
| [[Image:IntelliCrops-Usability-Round_1-Analytics-Complete.png‎|230px]]
Line 144: Line 148:
  
 
{| class="wikitable" style="margin: auto"
 
{| class="wikitable" style="margin: auto"
! colspan="3" | Usability Testing Round 2
+
! colspan="3" style="background: black; color: white" | Usability Testing Round 2
 
|-
 
|-
 
| [[Image:IntelliCrops-Usability-Round_2-Analytics-Complete.png‎|230px]]
 
| [[Image:IntelliCrops-Usability-Round_2-Analytics-Complete.png‎|230px]]
Line 155: Line 159:
  
 
{| class="wikitable" style="margin: auto"
 
{| class="wikitable" style="margin: auto"
! colspan="3" | Usability Testing Round 1
+
! colspan="3" style="background: black; color: white" | Usability Testing Round 1
 
|-
 
|-
 
| [[Image:IntelliCrops-Usability-Round_1-IVR-Completion.png‎|230px]]
 
| [[Image:IntelliCrops-Usability-Round_1-IVR-Completion.png‎|230px]]
Line 164: Line 168:
  
 
{| class="wikitable" style="margin: auto"
 
{| class="wikitable" style="margin: auto"
! colspan="3" | Usability Testing Round 2
+
! colspan="3" style="background: black; color: white" | Usability Testing Round 2
 
|-
 
|-
 
| [[Image:IntelliCrops-Usability-Round_2-IVR-Completion.png‎|230px]]
 
| [[Image:IntelliCrops-Usability-Round_2-IVR-Completion.png‎|230px]]
Line 176: Line 180:
  
 
{| class="wikitable" style="margin: auto"
 
{| class="wikitable" style="margin: auto"
! colspan="2" | Usability Testing Round 1
+
! colspan="2" style="background: black; color: white" | Usability Testing Round 1
 
|-
 
|-
 
| [[Image:IntelliCrops-Usability-Round_1-KN-Complete.png‎|230px]]
 
| [[Image:IntelliCrops-Usability-Round_1-KN-Complete.png‎|230px]]
Line 184: Line 188:
  
 
{| class="wikitable" style="margin: auto"
 
{| class="wikitable" style="margin: auto"
! colspan="2" | Usability Testing Round 2
+
! colspan="2" style="background: black; color: white" | Usability Testing Round 2
 
|-
 
|-
 
| [[Image:IntelliCrops-Usability-Round_2-KN-Complete.png‎|230px]]
 
| [[Image:IntelliCrops-Usability-Round_2-KN-Complete.png‎|230px]]
 
| [[Image:IntelliCrops-Usability-Round_2-KN-Easy.png|230px]]
 
| [[Image:IntelliCrops-Usability-Round_2-KN-Easy.png|230px]]
 
|}
 
|}

Revision as of 11:02, 28 November 2010

Methodology

  • 2 rounds of testing
    • Iteration 6: 24 - 26 October
    • Iteration 7: 12 - 15 November
  • Task-based tests:
    • Unassisted as far as possible
    • Model real-life task goals
    • Focused on usability & discoverability
  • Mixed background of users
    • 75% non-technical
    • Mix of male and female, young and old




Test Questions

Analytics

IntelliCrops Feedback - Analytics
Please head over to http://www.intellicrops.com/analytics/ and create 3 different charts that show

1) the total number of calls that come from each country (pie) 2) the different average monthly call durations of each country (clustered columns) 3) the different average daily call durations of each country (clustered columns)

IntelliCrops-Usability-Analytics-Form.png
Question Type
Were you able to create the graphs successfully? Yes / No
How easy was it to create the graphs? Scale of (1) difficult - (7) easy
How easy was it to view the graphs? Scale of (1) bad - (7) good
Did you encounter any problems while using the IVR System? Textarea
Any other comments Textarea


Interactive Voice Response

IntelliCrops Feedback - Interactive Voice Response
(Requires a Skype account)

Please head over to http://www.intellicrops.com/wordpress/ and click on the Skype icon to start dialing

1) Find the factsheet on Organic Rice that tells us what to consider in producing organic rice

Press 0# to return to the main menu

2) Get a diagnosis for poor grain germination

IntelliCrops-Usability-IVR-Form.png
Question Type
Were you able to find the answers using the IVR system? Yes / No
Did you encounter any problems while using the IVR System? Textarea
How easy was it to use the IVR? Scale of (1) difficult - (7) easy
How was the quality of the voice? Scale of (1) bad - (7) good
Were the answers too lengthy? Yes / No
Any other comments Textarea


Knowledge Navigator

IntelliCrops Feedback - Knowledge Navigator
Please head over to http://www.intellicrops.com/ivr/knowledgenavigator.php

1) Find the factsheet on Organic Rice that tells us what to consider in producing organic rice

2) Get a diagnosis for poor grain germination

IntelliCrops-Usability-KN-Form.png
Question Type
Were you able to find the answers using the Knowledge Navigator? Yes / No
How easy was it to use the Knowledge Navigator? Scale of (1) difficult - (7) easy
Did you encounter any problems while using the Knowledge Navigator? Textarea
Any other comments Textarea




Results and Action Plan

Analytics

Usability Testing Round 1
IntelliCrops-Usability-Round 1-Analytics-Complete.png IntelliCrops-Usability-Round 1-Analytics-Easy.png IntelliCrops-Usability-Round 1-Analytics-View.png


Usability Testing Round 2
IntelliCrops-Usability-Round 2-Analytics-Complete.png IntelliCrops-Usability-Round 2-Analytics-Easy.png IntelliCrops-Usability-Round 2-Analytics-View.png


Interactive Voice Response

Usability Testing Round 1
IntelliCrops-Usability-Round 1-IVR-Completion.png IntelliCrops-Usability-Round 1-IVR-Easy.png IntelliCrops-Usability-Round 1-IVR-Quality.png


Usability Testing Round 2
IntelliCrops-Usability-Round 2-IVR-Completion.png IntelliCrops-Usability-Round 2-IVR-Easy.png IntelliCrops-Usability-Round 2-IVR-Quality.png


Knowledge Navigator

Usability Testing Round 1
IntelliCrops-Usability-Round 1-KN-Complete.png IntelliCrops-Usability-Round 1-KN-Easy.png


Usability Testing Round 2
IntelliCrops-Usability-Round 2-KN-Complete.png IntelliCrops-Usability-Round 2-KN-Easy.png