HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2012T1 M.O.O.T/Technical Applications/UT2"

From IS480
Jump to navigation Jump to search
Line 118: Line 118:
 
[[Image:MOOTUT2useagain.png | 450px]]
 
[[Image:MOOTUT2useagain.png | 450px]]
  
 
+
The majority of the people were supportive of our application; they do not mind using it again and would also recommend it to their friends and family.
  
 
[[Image:MOOTUT2instructions.png | 450px]]
 
[[Image:MOOTUT2instructions.png | 450px]]

Revision as of 18:44, 18 November 2012

Home

Team/Project Partners

Project Overview

Project Management

Design Specifications

Technical Applications


User Testing 1 User Testing 2 Development Technologies Hardware

Project Management & Documentation

Primary Research Secondary Research

User Testing 2

Our User Testing 2 (UT2) took place on 5 November from 12pm to 6pm.

Objectives

  • Verify if users can react to AlterSense without prompting
  • Test the intuitiveness of our user interface (photo taking) and hand gestures
  • Gather user opinion about using AlterSense in a mall setting
  • Test the accuracy of gender recognition in a mall setting

Location

  • Level 4 of new extension between Plaza Singapura and Dhoby Ghaut
MOOT UT2 setup.jpg
MOOT UT2 setup2.jpg

Unlike our previous user testing UT1, there would not be any demarcation marking the recommended standing position for shopper (about 4 metres away from the Kinect sensor) on the floor. AlterSense has been improved to use real world values; hence it does not matter where the shopper stands as long as the shopper’s whole figure is captured by Kinect.

Testers

  • General public
  • We had a total of 53 testers - 29 females and 24 males.
MOOTUT2genderoftesters.png MOOTUT2ageoftesters.png

Execution Flow

1. Ask shopper if they have a smartphone and to download Microsoft Tag if they have one. If they are unwilling to download, we lend them our phones
2. Let user use AlterSense by himself/herself
3. Observe user if he/she has any difficulties responding to AlterSense
4. Measure the time taken for user to raise his/her right hand and to scan the Microsoft tag
5. Let user complete a survey form

Qualitative metric

Facilitators will be observing for errors or problems that the testers faced. Upon completion of all the tasks, the tester will be presented a survey form in which he/she will be asked about their opinion and satisfaction level of the application.

Quantitative metric

  • Time taken for shopper to raise both hands
  • Time taken to choose a hat
  • Time taken to raise right hand
  • No. of failed detections of raising of both hands
  • No. of failed detections of choosing a hat
  • No. of failed detections of raising his/her right hand
  • Whether male shoppers had picked the top hat and female shoppers had pick the ladies’ hat
  • Whether shopper has been able to complete the whole flow (i.e. shopper did not leave halfway)
  • Response time to scan the Microsoft Tag
  • No. of failed attempts to scan the Microsoft Tag

Observation Form: Main Findings


MOOTUT2timetaken.png

Time taken to choose a door is relatively longer than the rest because of the following reasons:

  • Some people enjoyed interacting with the stickman and continued to stand there, hence increasing their time taken to choose a door
  • Instruction to choose a door by walking to the left or right was not very clear for some people
  • Some, especially the older generation, are not very familiar with following the instructions on the screen
  • Some are not used to using hand gestures to make a choice

But the majority of the people eventually got the hang of it and became quicker in following instructions.

Survey Form: Main Findings

MOOTUT2overallexperience.png

Many people found the user interface of AlterSense to be quite presentable. Most of the people were quite pleased with their overall experience with AlterSense and found it to be rather fun.

MOOTUT2useagain.png

The majority of the people were supportive of our application; they do not mind using it again and would also recommend it to their friends and family.

MOOTUT2instructions.png

MOOTUT2gestures.png

Supporting Documents

Category Links
Pre-Testing Test Plan
Location of UT2
During testing Observation Form
Survey Form

Photos from Photo Taking

MOOTKinectSnapshot-00-42-55.png MOOTKinectSnapshot-03-17-09.png MOOTKinectSnapshot-03-30-22.png
Fellow SMU student giving us his support Shoppers amused with the Kinect Shopper having fun
MOOTKinectSnapshot-04-20-44.png MOOTKinectSnapshot-04-17-13.png MOOTKinectSnapshot-04-41-02.png
Shopper finding the hat too big for her Another round of photo taking; now with her friend Lawrence & Esther (the one on the right) from CMA came over too
MOOTKinectSnapshot-05-21-31.png MOOTKinectSnapshot-05-06-51.png MOOTKinectSnapshot-05-33-09.png
Shopper smiling brightly for the camera Couple shot Team shot with Zhennan from CMA (Kenny had to leave halfway through though as he had lessons)

Photos

MOOTUT2image4.png MOOTUT2image5.png MOOTUT2image6.png
MOOTUT2image7.png MOOTUT2image8.png MOOTUT2image9.png
MOOTUT2image10.png MOOTUT2image11.png MOOTUT2image12.png
MOOTUT2image13.png MOOTUT2image14.png MOOTUT2image15.png
MOOTUT2inez.png MOOTUT2image16.png MOOTUT2image17.png
MOOTUT2image1.png MOOTUT2image2.png MOOTUT2image3.png
Tired but happy faces. Many thanks to Zhennan for helping us carry the heavy box back to SMU Russell's not tired, still has the energy to look at the camera Walking back to SMU