HeaderSIS.jpg

IS480 Team wiki: 2016T2 ProgneSIS User Testing 1

From IS480
Jump to navigation Jump to search
Progensis.png
Team Prognesis Icon Home.png

HOME

  Team Prognesis Icon AboutUs.png

ABOUT US

  Team Prognesis Icon Overview.png

PROJECT OVERVIEW

  Team Prognesis Icon ProjectManagement.png

PROJECT MANAGEMENT

  Team Prognesis Icon Documentation.png

DOCUMENTATION

Technical Documents Design Documents Test Documents Meetings Minutes Project Deliverables


User Testing 1

  • Date: 30-31 January 2016
  • Venue: Respective offices of our potential users

User Testing 1 Design Document

User Testing 1 Objectives

  • Find out if user interface is intuitive
  • Identify usability problem(s) which users might face

Participants

  • Business owner of Logistics SMEs

User Testing 1 Tasks

User Testing 1 task forms were given to the participants. These study tasks were designed to find out if users are able to navigate from one page to another without specific instructions as we want to find out if information display is clear and concise.

User Testing 1 Results

Study Goal Results Goal Achieved/Not
1. Users should find it easy to navigate from page to page when completing the tasks Expected average number of navigation errors was 3 while the real average number of navigation errors is 0.67. Goal Achieved
2. Users should find it easy to identify overall figures in Task 1 All participants filled in the right answers for all the blanks in Task 1. Goal Achieved
3. Users should complete all tasks without guidance from facilitator All participants filled in the right answers for all the blanks in Task 1 to Task 3 and managed to log out successfully within 5 minute. Goal Achieved
4. Users should find it the application useful Expected average rating for the usefulness of systems features is 8, and the actual rating was 8.17. However, there is room for improvement in the qualitative aspect. Goal Achieved


Team ProgneSIS Navigation Error Graph.png
Total No. of Navigation Errors Average No. of Navigation Errors Standard Deviation of Navigation Errors Median of Navigation Errors Expected No. of Navigation Errors
7 0.67 0.52 1 3


Team ProgneSIS Time Taken Graph.png
Participant 1 Participant 2 Participant 3 Participant 4 Participant 5 Participant 6
Description of Navigation Errors Clicked on Delivery Fulfilment Rate Tile to look at for Drivers' information Clicked on Delivery Fulfilment Rate Tile to look at for Drivers' information - Clicked on Delivery Fulfilment Rate Tile to look at for Drivers' information - Clicked on Delivery Fulfilment Rate Tile to look at for Drivers' information
Overall Summary There's a gap between first time user's mental model and designer's mental model. This can be resolved with familiarisation with frequent usage.


Team ProgneSIS Usefulness Rating Graph.png
Average Usefulness of Function Rating Expected Usefulness of Function Rating
8.17 8


Likes Dislikes
Clear overview of company's delivery performance How values are calculated is unclear
Calculations are done for us, so we can focus on pinpointing issues affecting the punctuality of deliveries Deliveries are not known to be late by much
The app helps us narrow down possible factors affecting timeliness of deliveries A clearer reminder for which time period's data I am looking at is needed
Provides calculated data to support promises made for company's delivery performance Median line is given but its value is absent

Changes Implemented

Before After
Unclear how values for each column is calculated Included tooltip to define formula used to calculate values
Deliveries are only known to be late but not by how much Included a column to describe how late the deliveries are
Reminder needed for users to know which time period's information they are looking at Included a description under time period to remind users
Median lines do not indicate what median values are Included values on median lines