HeaderSIS.jpg

IS480 Team wiki: 2011T2 Team Members User Testing 2

From IS480
Jump to navigation Jump to search

Home   Project Members   Project Overview   Project Documentation   Project Management   Learning Avenue   Progress Summary

 

  Use Cases   UI Mockups & Screenshots   Deployment   Technical Challenges   Testing

 

System Testing | User Testing 1 | User Testing 2

 

User Testing 2

Test Plan

The main objective of our second user test was to obtain feedback for the newly integrated function – Playmaker, as well as to conduct a final usability test of the rest of the functions. The changes made for this round of testing were to be submitted as a version update to the App Store with the newly integrated Playmaker function.

The user test took place at the sponsor's premises and as an incentive to attract customers of The Cage to help us out with the user test, our sponsor had kindly offered free shoe bags as free gifts for helping to complete the user test.

 

Shoebag.jpg

 

With the help of the shoe bag giveaway, we have managed to gather a total of 30 users (customers) to perform the test.

 

Scope
The scope of the test included 6 main functions of the application:

  • Book a pitch
  • Alert Me!
  • What’s New!
  • Playmaker
  • Snap a Photo
  • Scoreboard

There was a task to be performed for every function and each task was outlined with a scenario of the situation where the application could possibly be used.

 

Quantitative Measures
The members of our team were to use 2 quantitative metrics to observe the users while they were doing the user test – the time taken for the users to perform each task and the number of times help was rendered. Through this, we hope to gather an average time taken for the users to perform each application and determine if the application was easy to navigate around through the number of times they asked for help.

 

Click to view our Test Plan!

 

Test Procedure

  1. Complete scenario-based tasks
  2. Fill in feedback form

The users were given tasks to complete and in each task, a scenario is given. The scenario provides the users with a situation they can possibly use the application, and they are given a head start with the starting point they should begin with and an endpoint that is briefly described in the scenario. Test data that was to be entered into the application was also provided. When the user completed the tasks, they were asked to complete a feedback form to give a general feedback of the application.

 

Click to view our User Task Sheet!

 

Test Observation
The role of our team in this user test was to observe the time taken by the users to complete each task and take down the number of times they offered help to the user who required assistance.

 

Test Results

Quantitative

Function Time taken (seconds) No. of times help was rendered
Book a pitch 192 1.29
Alert Me! 49 0.4
What's New! 32 0.4
Playmaker 83 0.82
Snap a Photo 26 0.31
Scoreboard 42 0.2

 

Qualiitative

TeamMembers UT2 Nav.png

 

From our feedback, 93.33% of the users found it easy to navigate around our app.

 

 

TeamMembers UT2 Menu.png

 

83.33% of the users agreed that the user menu is clearly categorized and organized on the screen.

 

 

TeamMembers UT2 Yes.png

 

We are proud to announce that, 100% of the users will use this application to make a facility booking with our sponsor!

 

Click to view our User Testing Results!

 

Insights

The application has been very well received for this round of user testing we were very happy to receive a 100% consensus from the users for their willingness to use the application. This is a very positive acknowledgement of the receptiveness of The Cage App when it is published to the public. We could have done better for both our user testings, however we have gained an invaluable experience of being able to interact and test the application with customers who are very likely real users of the application in the future. The lessons and changes learnt from the execution of user testing 1 and 2 has helped us realise the real benefits and usefulness of a user test and the perspectives that comes from the customer that helps us to better our app.
Click to take a look at our final user interfaces!

 

Test Documents

Area Document
User Tasks User Task Sheet
Task Observation User Test Observation Template
User Feedback User Feedback Form