IS480 Team wiki: 2010T1 The Green Reapers: Usability Testing
To complement functional testing with our mentors at IRRI, we also pushed hard to improve the usability of our features. We reached out to untrained users to see how well they might take to the functions without any prompting.
Contents
Methodology
- 2 rounds of testing
- Iteration 6: 24 - 26 October
- Iteration 7: 12 - 15 November
- Task-based tests:
- Unassisted as far as possible
- Model real-life task goals
- Focused on usability & discoverability
- Mixed background of users
- 75% non-technical
- Mix of male and female, young and old
Test Questions
Analytics
IntelliCrops Feedback - Analytics | ||
---|---|---|
Please head over to http://www.intellicrops.com/analytics/ and create 3 different charts that show
1) the total number of calls that come from each country (pie) 2) the different average monthly call durations of each country (clustered columns) 3) the different average daily call durations of each country (clustered columns) |
||
Question | Type | |
Were you able to create the graphs successfully? | Yes / No | |
How easy was it to create the graphs? | Scale of (1) difficult - (7) easy | |
How easy was it to view the graphs? | Scale of (1) bad - (7) good | |
Did you encounter any problems while using the IVR System? | Textarea | |
Any other comments | Textarea |
Interactive Voice Response
IntelliCrops Feedback - Interactive Voice Response | ||
---|---|---|
(Requires a Skype account)
Please head over to http://www.intellicrops.com/wordpress/ and click on the Skype icon to start dialing 1) Find the factsheet on Organic Rice that tells us what to consider in producing organic rice Press 0# to return to the main menu 2) Get a diagnosis for poor grain germination |
||
Question | Type | |
Were you able to find the answers using the IVR system? | Yes / No | |
Did you encounter any problems while using the IVR System? | Textarea | |
How easy was it to use the IVR? | Scale of (1) difficult - (7) easy | |
How was the quality of the voice? | Scale of (1) bad - (7) good | |
Were the answers too lengthy? | Yes / No | |
Any other comments | Textarea |
IntelliCrops Feedback - Knowledge Navigator | ||
---|---|---|
Please head over to http://www.intellicrops.com/ivr/knowledgenavigator.php
1) Find the factsheet on Organic Rice that tells us what to consider in producing organic rice 2) Get a diagnosis for poor grain germination |
||
Question | Type | |
Were you able to find the answers using the Knowledge Navigator? | Yes / No | |
How easy was it to use the Knowledge Navigator? | Scale of (1) difficult - (7) easy | |
Did you encounter any problems while using the Knowledge Navigator? | Textarea | |
Any other comments | Textarea |
Results and Action Plan
Analytics
Usability Testing Round 1 | ||
---|---|---|
Improved Results Observed During Usability Testing Round 2 | ||
---|---|---|
Discussion | |
---|---|
Issue | Fix |
Labels and values vague and ambiguous. |
|
Interactive Voice Response
Usability Testing Round 2 | ||
---|---|---|
Improved Results Observed During Usability Testing Round 2 | ||
---|---|---|
Discussion | |
---|---|
Issue | Fix |
Pressing the numbers didn’t seem to work |
|
Poor help provided |
|
Cannot really hear the menu options. Quite muffled |
|
Usability Testing Round 1 | |
---|---|
Improved Results Observed During Usability Testing Round 2 | |
---|---|
Discussion | |
---|---|
Issue | Fix |
Browser-specific display bug that prevented the content from showing up |
|
Content displayed all bunched-up together |
|