HeaderSIS.jpg

IS480 Team wiki: 2016T2 Team Sirius User Tests

From IS480
Revision as of 16:20, 13 January 2016 by Kathy.boey.2013 (talk | contribs)
Jump to navigation Jump to search

Sirius home icon.png   HOME

 

Sirius aboutus icon.png   ABOUT US

 

Sirius projectoverview icon.png   PROJECT OVERVIEW

 

Sirius projectmgmt icon.png   PROJECT MANAGEMENT

 

Sirius doc icon.png   DOCUMENTATION

 


User Test 1

We have recruited our product owner and sponsor from IDA as our participants.

User Test 1

Venue: IDA
Date: 30 Oct 2015, Friday
Time: 3.00pm
Duration: ~25 minutes
Number of Participant(s): 2

Objectives

  • To gather feedback on usability of the user interface from existing users</l1>
  • Identify usability issues user might face

Scope for User Testing 1

  • Create an experiment
  • Edit an existing experiment
  • Start/Stop an experiment
  • Preview an existing experiment

Participants

We have recruited our product owner and sponsor from IDA as our participants.

Goals and Results

S/N Goals Reached/Reached?
1 Participants should be able complete task #1 without any guidance from our test facilitator Goal partially reached. Both participants were confused about the process (navigating from page to page), unsure about what the inputs were for.
2 Participants should be able to edit an existing experiment Goal reached. Both participants were able to complete the tasks. One of the participants had a lower rating and took a longer time to complete the task.
3 Participants should be able to understand the experiment results Goal reached. Both participants were able to complete the tasks. However, both participants rated the usability as difficult as the labels were confusing.
4 Participants should able to find goals of from existing experiments Goal reached. Both participants were able to complete the tasks.
5 Participants should be able to start and stop the experiment easily Goal reached. Both participants were able to complete the tasks.

Key Findings

Overall Findings Summary
Quantitative Analysis When adding a new experiment, one participant was unsure whether to click on ‘load’ or ‘next’ button to proceed to the next step.
The participants were confused by the input for “jQuery code” and “CSS selector”. The participants does not understand what are these inputs for.
Participants took a longer time to edit the existing experiment.
The header of the result table was confusing. Participants find it hard to understand the result
Possible changes before User Testing 2 Revise the editing experiments page to reduce the number of clicks required.
Revise the labels on the adding of a new experiment or adding more explanation text/information.
Revise the labels on the result page.
Revise the inputs placeholders to be more obvious.
Revise the “Adding of new experiment” interface to be more obvious as it is a multi step process.

Detailed Findings

Goal #1 - Participants should be able complete task #1 without any guidance from our test facilitator Goal #1 was partially reached
  • All participants rated the usability of this function as very easy to use.
  • However, from our observation, the participants seem to be rather confused about the naming of the labels.
  • One of the participant stated that the preview of the experiment is not obvious. The position of the preview was placed at the bottom of the page that the participant did not noticed that the experiment was loaded. Unnecessary scrolling was required
  • One of the participant stated that there is a lack of information on the terminologies and parameters used. If the user is using the function for the first time, the user might not understand what he/she was doing. The participant suggested that we should change the terminologies or provide more instruction/information to guide the user.
Participants should be able to edit an existing experiment      Goal #2 was reached
  • All participants rated the usability of this function no less than neutral.
Participants should be able to understand the experiment results Goal #3 was reached
  • All participants rated the usability of this function as difficult to use.
  • All participants seem to be confused by the labels used (Total completions and Total views). They took a longer time trying to understand what do the labels mean.
  • One of the participant navigated between the home page and result page twice. The participant was unclear whether he was on the wrong page.
  • However, all participants still managed to answer the question correctly and complete the task without any guidance from the test facilitator.
Participants should able to find goals of from existing experiments Goal #4 was reached
  • All participants completed the task quickly and rated the usability of the application no less than neutral.
Participants should be able to start and stop the experiment easily Goal #5 was reached
  • All participants rated the usability of this function as very easy to use.
  • All participants used the start and stop buttons on the home page.
  • All participants did not used the stop button on the “view experiment” page.