HeaderSIS.jpg

IS480 Team wiki: 2016T2 ProgneSIS User Testing 4

From IS480
Revision as of 23:32, 10 April 2016 by Karen.lim.2013 (talk | contribs) (→‎User Testing 4 Results)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search
Progensis.png
Team Prognesis Icon Home.png

HOME

  Team Prognesis Icon AboutUs.png

ABOUT US

  Team Prognesis Icon Overview.png

PROJECT OVERVIEW

  Team Prognesis Icon ProjectManagement.png

PROJECT MANAGEMENT

  Team Prognesis Icon Documentation.png

DOCUMENTATION

Technical Documents Design Documents Test Documents Meetings Minutes Project Deliverables


User Testing 4

  • Date: 7 April 2016
  • Venue: JTC Launchpad The Meeting Point

User Testing 4 Design Document

User Testing 4 Objectives

  • Reaffirm the user-friendliness of our application
  • Reaffirm the usefulness our of application to logistics users
  • Reaffirm the applicability of our application to logistics users

Participants

  • Existing VersaFleet users

User Testing 4 Tasks

User Testing 4 task forms were given to the participants. These user testing tasks were designed to find out if users are able to navigate from one page to another and identify the information required to find out if user interface is user-friendly and information display is clear. After the user testing, users were handed Post User Testing 4 Questionnaires to help us reaffirm the applicability of our application to logistics companies and identify areas of improvements that our clients could look out for after the handover.

User Testing 4 Results

Study Goal Results Goal Achieved/Not
1. Users should find it easy to understand dashboard Expected average time taken was 10 secs for task 1 while the actual average time taken for task 1 is 4.63s. Goal Achieved
2. Users should find it easy to navigate through the application Expected average time taken was 60 secs for task 2 and task 3 while the actual average time taken for task 2 and task 3 is 22.13s. Goal Achieved
3. Users should complete all tasks without guidance from facilitator Expected average of total time taken to fill up all tasks is 70secs while the actual average of total time taken for all tasks is 27.25s.

Expected average rating of user-friendliness is 6 while the actual rating is 6.75.
Expected average rating of ease of navigation is 6 while the actual rating is 6.88.

Goal Achieved
4. Users should find the system useful Expected average rating of applicability is 6 while the actual rating is 6.75.

Expected average rating of likelihood to use is 6 while the actual rating is 6.88.

Goal Achieved


Team ProgneSIS TTFT1 UT4.png
Average Time taken to complete task 1 (in seconds) Standard Deviation of Time taken to complete task 1 (in seconds) Median of Time taken to complete task 1 (in seconds) Expected Amount of Time taken to complete task 1 (in seconds)
4.63 0.74 4.5 10


Team ProgneSIS TTFT2&3 UT4.png
Average Time taken to complete task 2 & 3 (in seconds) Standard Deviation of Time taken to complete task 2 & 3 (in seconds) Median of Time taken to complete task 2 & 3(in seconds) Expected Amount of Time taken to complete task 2 & 3 (in seconds)
22.13 1.73 21.5 60


Team ProgneSIS TTTFAT UT4.png
Average Time taken to complete all task (in seconds) Standard Deviation of Time taken to complete all tasks (in seconds) Median of Time taken to complete all tasks (in seconds) Expected Amount of Time taken to complete all tasks (in seconds)
27.25 1.75 27.5 70


Team ProgneSIS NNEM UT4.png
Total No. of Navigation Errors Average No. of Navigation Errors Standard Deviation of Navigation Errors Median of Navigation Errors Expected No. of Navigation Errors
0 0 0 0 2


Team ProgneSIS UF UT4.png
Average User-friendliness Rating Expected User-friendliness Rating
6.75 6


Team ProgneSIS EN UT4.png
Average Ease of Navigation Rating Expected Ease of Navigation Rating
6.88 6


Team ProgneSIS A UT4.png
Average Applicability Rating Expected Applicability Rating
6.75 6


Team ProgneSIS LTU UT4.png
Average Likelihood to Use Rating Expected of Likelihood to Use Rating
6.88 6


Feedback/Comments
Much clearer overview of company's operational performance
Simple and easily understandable user interface
Definitely helps save time from calculation and more productive work can be done
Increased accuracy and reliability of delivery performance
Helps us in investigating possible causes of poor delivery
Could include vehicle utilisation information
Include how delivery fulfilment rate is derived, otherwise if the planned pickup and delivery time spans a long time frame, definitely DFR would be high