IS480 Team wiki: 2012T1 M.O.O.T/Project Overview/GR Metrics

From IS480
Jump to navigation Jump to search


Team/Project Partners

Project Overview

Project Management

Design Specifications

Technical Applications

Project Description Project Goals Client's Requirements Deliverables Learning Outcomes Gender Recognition Metrics

Gender Recognition Metrics

As gender recognition using Kinect is a newly-ventured area and there is no API available in the Kinect SDK that is able to detect gender, it is essential for us to use some form of metrics to gauge the progress of our gender recognition algorithm. To ensure a fair test, we made sure our testers included a good mix of males and females of different body proportions and wearing different kinds of clothes.

We plan to have 30 testers – 15 males and 15 females and will record a short video of all 30 individuals standing in front of AlterSense using Kinect Studio. As Kinect Studio is a tool that allows the recording of a session with the kinect and playing back of the recorded session, we could replay the videos on Kinect Studio each time we have made progress on our gender recognition algorithm. The usage of the same testers for each testing ensures that we can have a good comparison on the before and after of our algorithm.

How We Detect Gender

Currently, we have 5 parameters to determine gender:

  • Height

It is widely known that males are generally taller than females. Also, as East Asians tend to be of a smaller build than Caucasians, we took 1.7m to differentiate between males and females i.e. majority of females tend to be shorter than 1.7m while many males tend to be taller than 1.7m. There are exceptions to this as there exists several females who are taller than 1.7m and males shorter than 1.7m, hence we have taken other factors into consideration.

  • Presence of bag

It is observed that only females would carry their bags on their elbow. Thus when it is detected that a person is carrying a bag on the elbow, it is highly possible that the person is a female.

  • Presence of long hair

The majority of people who have long hair in Singapore are normally female. There may be a few exceptions but it is very very rare. By calculating the width of a person’s neck, we can be quite sure that the outline of a person with wider neck than usual is a female as the long hair is the one contributing to the width of the neck.

  • Presence of long skirt

Currently, females are the only ones who would wear a skirt in Singapore. By calculating the width of the hem of the skirt and the slope of the skirt, we can distinguish skirts from shorts and pants as shorts and pants do not have a significant slope compared to skirts. Unfortunately, it is not possible to differentiate shorts and pants from a tight-fitting skirt.

  • Shoulder width & Center of moment

Based on our research, males are proven to have a larger center of moment value than females given similar height and weight. This is because males tend to have broader shoulder than females while females generally have wider hips than males. Based on this, we attempt to differentiate a male from a female of similar build, has short hair and does not wear a skirt nor carry a bag on her elbow by their center of moment value.

Testers' profile

Based on the 5 parameters listed above, we pick our testers in the following way:

Female Male
Height 5 below 1.6m
5 above 1.6m, below 1.7m
5 above 1.7m
5 below 1.7m
5 above 1.7m, below 1.8m
5 above 1.8m
Bag 5 carrying small bag on their elbow
5 carrying big bag on their elbow
5 not carrying bag on their elbow
Hair 7 with short hair (does not touch the shoulders)
8 with shoulder-length or longer hair
Skirt 5 not wearing skirt
5 wearing short skirt
5 wearing long skirt
Center of moment (COM) We will attempt to find ≥5 pairs of females and males that have similar height and similar body proportions Same as left side


Version Changes made to algorithm Accuracy of presence of bag Accuracy of presence of hair Accuracy of presence of skirt Accuracy of presence of COM Overall accuracy of gender detected Comment
1 All 5 parameters are up
Only long skirt can be detected
2 Included slope of skirt
Overall accuracy Action plan
Accuracy < 40% Hold team meeting to consider dropping gender recognition if accuracy still does not improve after several iterations
40% ≤ Accuracy ≤ 70% Search for more ways to improve the accuracy either by improving the current methods used to detect gender or look for new parameters that prove useful for gender recognition
Accuracy > 70% May consider improvising gender recognition algorithm but not deemed necessary