Difference between revisions of "IS480 Team wiki: 2012T1 M.O.O.T/Project Overview/GR Metrics"
(5 intermediate revisions by 2 users not shown) | |||
Line 41: | Line 41: | ||
| style="font-size:90%; text-align:center; background-color:#C71585;" width="10%" |[[ IS480 Team wiki: 2012T1 M.O.O.T/Project Overview/GR Metrics|<font color="#ffffff"><b>Gender Recognition Metrics</b></font>]] | | style="font-size:90%; text-align:center; background-color:#C71585;" width="10%" |[[ IS480 Team wiki: 2012T1 M.O.O.T/Project Overview/GR Metrics|<font color="#ffffff"><b>Gender Recognition Metrics</b></font>]] | ||
− | |||
− | |||
− | |||
− | |||
|} | |} | ||
Line 52: | Line 48: | ||
<p>We plan to have 30 testers – 15 males and 15 females and will record a short video of all 30 individuals standing in front of AlterSense using Kinect Studio. As Kinect Studio is a tool that allows the recording of a session with the kinect and playing back of the recorded session, we could replay the videos on Kinect Studio each time we have made progress on our gender recognition algorithm. The usage of the same testers for each testing ensures that we can have a good comparison on the before and after of our algorithm. | <p>We plan to have 30 testers – 15 males and 15 females and will record a short video of all 30 individuals standing in front of AlterSense using Kinect Studio. As Kinect Studio is a tool that allows the recording of a session with the kinect and playing back of the recorded session, we could replay the videos on Kinect Studio each time we have made progress on our gender recognition algorithm. The usage of the same testers for each testing ensures that we can have a good comparison on the before and after of our algorithm. | ||
− | ==== How | + | ==== How We Detect Gender ==== |
Currently, we have 5 parameters to determine gender: | Currently, we have 5 parameters to determine gender: | ||
* <b>Height</b> | * <b>Height</b> | ||
Line 72: | Line 68: | ||
* <b>Shoulder width & Center of moment</b> | * <b>Shoulder width & Center of moment</b> | ||
− | Based on our [[ | + | Based on our [[ Team wiki: 2012T1 M.O.O.T/Technical Applications/SecondaryResearch| research]], males are proven to have a larger center of moment value than females given similar height and weight. This is because males tend to have broader shoulder than females while females generally have wider hips than males. Based on this, we attempt to differentiate a male from a female of similar build, has short hair and does not wear a skirt nor carry a bag on her elbow by their center of moment value. |
==== Testers' profile ==== | ==== Testers' profile ==== | ||
Line 80: | Line 76: | ||
|- | |- | ||
| style="background: #808080; color: #FFFFFF; width: 8%;" | | | style="background: #808080; color: #FFFFFF; width: 8%;" | | ||
− | | style="background: #808080; color: #FFFFFF; width: 30%;" | <b>Female</b> | + | | style="background: #808080; color: #FFFFFF; width: 30%; text-align:center;" | <b>Female</b> |
− | | style="background: #808080; color: #FFFFFF; width: 30%;" | <b>Male</b> | + | | style="background: #808080; color: #FFFFFF; width: 30%; text-align:center;" | <b>Male</b> |
|- | |- | ||
| Height | | Height | ||
Line 107: | Line 103: | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
− | | style="background: #808080; color: #FFFFFF; width: 5%;" | <b>Version</b> | + | | style="background: #808080; color: #FFFFFF; width: 5%; text-align:center;" | <b>Version</b> |
− | | style="background: #808080; color: #FFFFFF; width: 20%;" | <b>Changes made to algorithm</b> | + | | style="background: #808080; color: #FFFFFF; width: 20%; text-align:center;" | <b>Changes made to algorithm</b> |
| style="background: #808080; color: #FFFFFF; width: 10%; text-align:center;" | <b>Accuracy of presence of bag</b> | | style="background: #808080; color: #FFFFFF; width: 10%; text-align:center;" | <b>Accuracy of presence of bag</b> | ||
| style="background: #808080; color: #FFFFFF; width: 10%; text-align:center;" | <b>Accuracy of presence of hair</b> | | style="background: #808080; color: #FFFFFF; width: 10%; text-align:center;" | <b>Accuracy of presence of hair</b> | ||
Line 146: | Line 142: | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
− | | style="background: #808080; color: #FFFFFF; width: 10%;" | <b>Overall accuracy</b> | + | | style="background: #808080; color: #FFFFFF; width: 10%; text-align:center;" | <b>Overall accuracy</b> |
− | | style="background: #808080; color: #FFFFFF; width: 30%;" | <b>Action plan</b> | + | | style="background: #808080; color: #FFFFFF; width: 30%; text-align:center;" | <b>Action plan</b> |
|- | |- | ||
| Accuracy < 40% | | Accuracy < 40% | ||
| Hold team meeting to consider dropping gender recognition if accuracy still does not improve after several iterations | | Hold team meeting to consider dropping gender recognition if accuracy still does not improve after several iterations | ||
|- | |- | ||
− | | 40% | + | | 40% ≤ Accuracy ≤ 70% |
| Search for more ways to improve the accuracy either by improving the current methods used to detect gender or look for new parameters that prove useful for gender recognition | | Search for more ways to improve the accuracy either by improving the current methods used to detect gender or look for new parameters that prove useful for gender recognition | ||
|- | |- |
Latest revision as of 18:05, 22 September 2012
Project Description | Project Goals | Client's Requirements | Deliverables | Learning Outcomes | Gender Recognition Metrics |
Gender Recognition Metrics
As gender recognition using Kinect is a newly-ventured area and there is no API available in the Kinect SDK that is able to detect gender, it is essential for us to use some form of metrics to gauge the progress of our gender recognition algorithm. To ensure a fair test, we made sure our testers included a good mix of males and females of different body proportions and wearing different kinds of clothes.
We plan to have 30 testers – 15 males and 15 females and will record a short video of all 30 individuals standing in front of AlterSense using Kinect Studio. As Kinect Studio is a tool that allows the recording of a session with the kinect and playing back of the recorded session, we could replay the videos on Kinect Studio each time we have made progress on our gender recognition algorithm. The usage of the same testers for each testing ensures that we can have a good comparison on the before and after of our algorithm.
How We Detect Gender
Currently, we have 5 parameters to determine gender:
- Height
It is widely known that males are generally taller than females. Also, as East Asians tend to be of a smaller build than Caucasians, we took 1.7m to differentiate between males and females i.e. majority of females tend to be shorter than 1.7m while many males tend to be taller than 1.7m. There are exceptions to this as there exists several females who are taller than 1.7m and males shorter than 1.7m, hence we have taken other factors into consideration.
- Presence of bag
It is observed that only females would carry their bags on their elbow. Thus when it is detected that a person is carrying a bag on the elbow, it is highly possible that the person is a female.
- Presence of long hair
The majority of people who have long hair in Singapore are normally female. There may be a few exceptions but it is very very rare. By calculating the width of a person’s neck, we can be quite sure that the outline of a person with wider neck than usual is a female as the long hair is the one contributing to the width of the neck.
- Presence of long skirt
Currently, females are the only ones who would wear a skirt in Singapore. By calculating the width of the hem of the skirt and the slope of the skirt, we can distinguish skirts from shorts and pants as shorts and pants do not have a significant slope compared to skirts. Unfortunately, it is not possible to differentiate shorts and pants from a tight-fitting skirt.
- Shoulder width & Center of moment
Based on our research, males are proven to have a larger center of moment value than females given similar height and weight. This is because males tend to have broader shoulder than females while females generally have wider hips than males. Based on this, we attempt to differentiate a male from a female of similar build, has short hair and does not wear a skirt nor carry a bag on her elbow by their center of moment value.
Testers' profile
Based on the 5 parameters listed above, we pick our testers in the following way:
Female | Male | |
Height | 5 below 1.6m 5 above 1.6m, below 1.7m 5 above 1.7m |
5 below 1.7m 5 above 1.7m, below 1.8m 5 above 1.8m |
Bag | 5 carrying small bag on their elbow 5 carrying big bag on their elbow 5 not carrying bag on their elbow |
N.A |
Hair | 7 with short hair (does not touch the shoulders) 8 with shoulder-length or longer hair |
N.A |
Skirt | 5 not wearing skirt 5 wearing short skirt 5 wearing long skirt |
N.A |
Center of moment (COM) | We will attempt to find ≥5 pairs of females and males that have similar height and similar body proportions | Same as left side |
Metrics
Version | Changes made to algorithm | Accuracy of presence of bag | Accuracy of presence of hair | Accuracy of presence of skirt | Accuracy of presence of COM | Overall accuracy of gender detected | Comment |
1 | All 5 parameters are up Only long skirt can be detected |
||||||
2 | Included slope of skirt | ||||||
3 |
Overall accuracy | Action plan |
Accuracy < 40% | Hold team meeting to consider dropping gender recognition if accuracy still does not improve after several iterations |
40% ≤ Accuracy ≤ 70% | Search for more ways to improve the accuracy either by improving the current methods used to detect gender or look for new parameters that prove useful for gender recognition |
Accuracy > 70% | May consider improvising gender recognition algorithm but not deemed necessary |