IS480 Team wiki: 2016T2 ProgneSIS User Testing 3
Technical Documents  Design Documents  Test Documents  Meetings Minutes  Project Deliverables 
Contents

Study Goal  Results  Goal Achieved/Not 

1. Users should find it easy to understand dashboard  Expected average time taken was 30 secs for task 1 while the actual average time taken for task 1 is 8.60s.  Goal Achieved 
2. Users should find it easy to navigate through the application  Expected average time taken was 60 secs for task 2 and task 3 while the actual average time taken for task 2 and task 3 is 24.20s.  Goal Achieved 
3. Users should complete all tasks without guidance from facilitator  Expected average of total time taken to fill up all tasks is 70secs while the actual average of total time taken for all tasks is 32.80s. Expected average rating of userfriendliness is 6 while the actual rating is 6.60. 
Goal Achieved 
4. Users should find the system useful  Expected average rating of applicability is 6 while the actual rating is 6.20. Expected average rating of likelihood to use is 6 while the actual rating is 6.20. 
Goal Achieved 
Average Time taken to complete task 1 (in seconds)  Standard Deviation of Time taken to complete task 1 (in seconds)  Median of Time taken to complete task 1 (in seconds)  Expected Amount of Time taken to complete task 1 (in seconds) 

8.60  1.14  9  30 
Average Time taken to complete task 2 & 3 (in seconds)  Standard Deviation of Time taken to complete task 2 & 3 (in seconds)  Median of Time taken to complete task 2 & 3(in seconds)  Expected Amount of Time taken to complete task 2 & 3 (in seconds) 

24.20  4.02  24  60 
Average Time taken to complete all task (in seconds)  Standard Deviation of Time taken to complete all tasks (in seconds)  Median of Time taken to complete all tasks (in seconds)  Expected Amount of Time taken to complete all tasks (in seconds) 

32.80  4.55  33  90 
Total No. of Navigation Errors  Average No. of Navigation Errors  Standard Deviation of Navigation Errors  Median of Navigation Errors  Expected No. of Navigation Errors 

0  0  0  0  4 
Average Userfriendliness Rating  Expected Userfriendliness Rating 

6.60  6 
Average Ease of Navigation Rating  Expected Ease of Navigation Rating 

6.80  6 
Average Applicability Rating  Expected Applicability Rating 

6.20  6 
Average Likelihood to Use Rating  Expected Likelihood to Use Rating 

6.20  6 
Feedback/Comments 

Clear overview of company's delivery performance 
Simple and easily understandable user interface 
Inform me when your product goes live! 
More applicable to companies where business owners have no ground visibility 
Changes Implemented
Before  After 

Manual logging in to VersaFleet account to retrieve API key and secret to pull data from VersaFleet API  Screen scrape enables retrieval of data from VersaFleet API 