HeaderSIS.jpg

IS480 Team wiki: 2016T2 ProgneSIS User Testing 3

From IS480
Jump to navigation Jump to search
Progensis.png
Team Prognesis Icon Home.png

HOME

  Team Prognesis Icon AboutUs.png

ABOUT US

  Team Prognesis Icon Overview.png

PROJECT OVERVIEW

  Team Prognesis Icon ProjectManagement.png

PROJECT MANAGEMENT

  Team Prognesis Icon Documentation.png

DOCUMENTATION

Technical Documents Design Documents Test Documents Meetings Minutes Project Deliverables


User Testing 3

  • Date: 10, 17, 24, 31 March 2016
  • Venue: Respective offices of logistics companies

User Testing 3 Design Document

User Testing 3 Objectives

  • Reaffirm the user-friendliness of our application
  • Reaffirm the usefulness our of application to logistics users
  • Reaffirm the applicability of our application to logistics users

Participants

  • Business owner of Logistics SMEs

User Testing 3 Tasks

Prior to User Testing 3, Pre-User Testing 3 questionnaires were given out to find out which spectrum of logistics do the companies lie in. User Testing 3 task forms were given to the participants. These study tasks were designed to find out if users are able to navigate from one page to another and identify the information required to find out if user interface is user-friendly and information display is clear. After the user testing, users were handed Post User Testing 3 Questionnaires to help us reaffirm the applicability of our application to logistics companies and identify areas of improvements that our clients could look out for after the handover.

User Testing 3 Results

Study Goal Results Goal Achieved/Not
1. Users should find it easy to understand dashboard Expected average time taken was 30 secs for task 1 while the actual average time taken for task 1 is 8.60s. Goal Achieved
2. Users should find it easy to navigate through the application Expected average time taken was 60 secs for task 2 and task 3 while the actual average time taken for task 2 and task 3 is 24.20s. Goal Achieved
3. Users should complete all tasks without guidance from facilitator Expected average of total time taken to fill up all tasks is 70secs while the actual average of total time taken for all tasks is 32.80s.

Expected average rating of user-friendliness is 6 while the actual rating is 6.60.
Expected average rating of ease of navigation is 6 while the actual rating is 6.80.

Goal Achieved
4. Users should find the system useful Expected average rating of applicability is 6 while the actual rating is 6.20.

Expected average rating of likelihood to use is 6 while the actual rating is 6.20.

Goal Achieved


Team ProgneSIS TTFT1.png
Average Time taken to complete task 1 (in seconds) Standard Deviation of Time taken to complete task 1 (in seconds) Median of Time taken to complete task 1 (in seconds) Expected Amount of Time taken to complete task 1 (in seconds)
8.60 1.14 9 30


Team ProgneSIS TTFT2&3.png
Average Time taken to complete task 2 & 3 (in seconds) Standard Deviation of Time taken to complete task 2 & 3 (in seconds) Median of Time taken to complete task 2 & 3(in seconds) Expected Amount of Time taken to complete task 2 & 3 (in seconds)
24.20 4.02 24 60


Team ProgneSIS TTTFAT.png
Average Time taken to complete all task (in seconds) Standard Deviation of Time taken to complete all tasks (in seconds) Median of Time taken to complete all tasks (in seconds) Expected Amount of Time taken to complete all tasks (in seconds)
32.80 4.55 33 90


Team ProgneSIS NNEM.png
Total No. of Navigation Errors Average No. of Navigation Errors Standard Deviation of Navigation Errors Median of Navigation Errors Expected No. of Navigation Errors
0 0 0 0 4


Team ProgneSIS UF.png
Average User-friendliness Rating Expected User-friendliness Rating
6.60 6


Team ProgneSIS EN.png
Average Ease of Navigation Rating Expected Ease of Navigation Rating
6.80 6


Team ProgneSIS A.png
Average Applicability Rating Expected Applicability Rating
6.20 6


Team ProgneSIS LTU.png
Average Likelihood to Use Rating Expected Likelihood to Use Rating
6.20 6


Feedback/Comments
Clear overview of company's delivery performance
Simple and easily understandable user interface
Inform me when your product goes live!
More applicable to companies where business owners have no ground visibility

Changes Implemented

Before After
Manual logging in to VersaFleet account to retrieve API key and secret to pull data from VersaFleet API Screen scrape enables retrieval of data from VersaFleet API