Difference between revisions of "ISSS608 2017-18 T3 Assign Tong Wen Liang Samuel Data Preparation"
(Created page with "<div style=background:#00a2d0 border:#00bcf0> <b><font size = 6; color="#ffffff"> VAST Challenge 2018: "Cheep" Shots? </font></b> </div> <!--MAIN HEADER --> {|style="backgrou...") |
|||
(10 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
− | <div style=background:#00a2d0 border:#00bcf0> | + | <div style=background:#00a2d0 border:#00bcf0> |
+ | [[Image:Blue_Pipit.png|165px]] | ||
<b><font size = 6; color="#ffffff"> VAST Challenge 2018: "Cheep" Shots? </font></b> | <b><font size = 6; color="#ffffff"> VAST Challenge 2018: "Cheep" Shots? </font></b> | ||
</div> | </div> | ||
<!--MAIN HEADER --> | <!--MAIN HEADER --> | ||
{|style="background-color:#00bcf0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" | | {|style="background-color:#00bcf0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" | | ||
− | | style="font-family:Century Gothic; font-size:100%; solid #000000; background:#00bcf0; text-align:center;" width=" | + | | style="font-family:Century Gothic; font-size:100%; solid #000000; background:#00bcf0; text-align:center;" width="20%" | |
; | ; | ||
− | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel|<b><font size=" | + | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel|<b><font size="2"><font color="#ffffff">Background</font></font></b>]] |
− | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#00bcf0; text-align:center;" width=" | + | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#00bcf0; text-align:center;" width="20%" | |
; | ; | ||
− | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel_Data_Preparation|<b><font size=" | + | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel_Data_Preparation|<b><font size="2"><font color="#ffffff">Methodology</font></font></b>]] |
− | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#00bcf0; text-align:center;" width=" | + | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#00bcf0; text-align:center;" width="20%" | |
; | ; | ||
− | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel_Visualization|<b><font size=" | + | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel_Visualization|<b><font size="2"><font color="#ffffff">Insights</font></font></b>]] |
− | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#00bcf0; text-align:center;" width=" | + | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#00bcf0; text-align:center;" width="20%" | |
; | ; | ||
− | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel_Conclusion| <b><font size=" | + | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel_Conclusion| <b><font size="2"><font color="#ffffff">Conclusion</font></font></b>]] |
+ | |||
+ | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#00bcf0; text-align:center;" width="20%" | | ||
+ | ; | ||
+ | [[Assignment Dropbox G1| <b><font size="2"><font color="#FFFFFF"> Link to Dropbox </font></font></b>]] | ||
| | | | ||
Line 26: | Line 31: | ||
<font size="5"><font color="#5c5c5c">'''Methodology'''</font></font> | <font size="5"><font color="#5c5c5c">'''Methodology'''</font></font> | ||
− | == | + | ==Our Approach== |
+ | <b> To Examine Blue Pipit Spatial Distribution Prior to and After Alleged Dumping </b> | ||
<table> | <table> | ||
<table border='1'> | <table border='1'> | ||
Line 34: | Line 40: | ||
</tr> | </tr> | ||
<tr> | <tr> | ||
− | <td> | + | <td><b> 1. Alleged Dumping Site </b> |
− | <b> 1. Alleged Dumping Site </b> | ||
<br>The location of the alleged dumping site was indicated as (148, 159). By marking the location on the map, it allows us to identify the spatial-temporal patterns of the affected Rose-Crested Blue Pipits in the Preserve prior to and after the alleged dumping of the process waste. | <br>The location of the alleged dumping site was indicated as (148, 159). By marking the location on the map, it allows us to identify the spatial-temporal patterns of the affected Rose-Crested Blue Pipits in the Preserve prior to and after the alleged dumping of the process waste. | ||
</td> | </td> | ||
− | <td>[[File: | + | <td>[[File:The Alleged Dumping Site.png|500px|center|border]]</td> |
</tr> | </tr> | ||
<tr> | <tr> | ||
<td><b> 2. Time Period (Years) and Alleged Date of Dumping </b> | <td><b> 2. Time Period (Years) and Alleged Date of Dumping </b> | ||
− | The number of months taken to record the vocalization of the birds in the Preserves over the years were not consistent. Only some years have recordings for all months – Year 2009 and 2011 to 2017. | + | <p>The number of months taken to record the vocalization of the birds in the Preserves over the years were not consistent. Only some years have recordings for all months – Year 2009 and 2011 to 2017.</P> |
+ | |||
− | Additionally, in accordance with the details obtained from VAST Challenged 2017, the alleged date of the chemical dumping was on 15th February 2015 as indicated in the orange arrow below: | + | <p>Additionally, in accordance with the details obtained from VAST Challenged 2017, the alleged date of the chemical dumping was on 15th February 2015 as indicated in the orange arrow below:</P> |
− | [[File: | + | [[File:1.2 Alleged Date of Dumping.png|500px|center|border]] |
<br>Therefore, in order to facilitate in our analysis of the spatial-temporal patterns of the birds in the Preserve, we will use only year 2011 to 2017 for our data visualization of the distribution of birds prior to the dumping and after the dumping. | <br>Therefore, in order to facilitate in our analysis of the spatial-temporal patterns of the birds in the Preserve, we will use only year 2011 to 2017 for our data visualization of the distribution of birds prior to the dumping and after the dumping. | ||
</td> | </td> | ||
− | <td>[[File: | + | <td>[[File:Time Period of Bird Vocalizations Recorded.png|500px|center|border]]</td> |
</tr> | </tr> | ||
Line 60: | Line 66: | ||
</td> | </td> | ||
<td> | <td> | ||
− | + | [[File:1.3. Geog Dist of Blue Pipits from 2011 to 2017.gif |500px|center|border]] | |
− | [[File: | + | |
− | |||
− | |||
</tr> | </tr> | ||
Line 70: | Line 74: | ||
<br>The number of Rose-crested Blue Pipit recorded peaked at 45 in 2015, just when the dumping took place. Thereafter, the number of Rose-crested Blue Pipit recorded dropped to 27 in 2016 and to 16 in 2017. | <br>The number of Rose-crested Blue Pipit recorded peaked at 45 in 2015, just when the dumping took place. Thereafter, the number of Rose-crested Blue Pipit recorded dropped to 27 in 2016 and to 16 in 2017. | ||
</td> | </td> | ||
− | <td>[[File: | + | <td>[[File:1.4. Number of Rose-Crested Blue Pipit Recorded from 2011 to 2017.png |500px|center|border]]</td> |
</tr> | </tr> | ||
+ | </table> | ||
+ | <br> | ||
+ | <b> To identify distribution of Blue Pipits by Vocalization Type from 2013 to 2015 </b> | ||
+ | <table> | ||
+ | <table border='1'> | ||
<tr> | <tr> | ||
− | < | + | <th>Description</th> |
− | <b> 1. Vocalization Type </b> | + | <th>Illustration</th> |
+ | </tr> | ||
+ | <tr> | ||
+ | <td><b> 1. Vocalization Type </b> | ||
<br>With multiple types of vocalizations, we want to focus mainly on the two major categories of vocalization, which is produced by the vocal organ of the birds – Call and Song. | <br>With multiple types of vocalizations, we want to focus mainly on the two major categories of vocalization, which is produced by the vocal organ of the birds – Call and Song. | ||
Additionally, we will also exclude the Vocalization Type “call, song”, as we want to be specific about which vocalization type we are analysing. | Additionally, we will also exclude the Vocalization Type “call, song”, as we want to be specific about which vocalization type we are analysing. | ||
</td> | </td> | ||
− | + | <td>[[File:2.1_Vocal_type.png|500px|center|border]]</td> | |
</tr> | </tr> | ||
Line 87: | Line 99: | ||
<br>We want to plot the distribution of Blue Pipits by Vocalization Types “Call” and “Song” from 2011 to 2017 to examine if there are any significant spatial pattern relating to the alleged process waste dump in 2015. | <br>We want to plot the distribution of Blue Pipits by Vocalization Types “Call” and “Song” from 2011 to 2017 to examine if there are any significant spatial pattern relating to the alleged process waste dump in 2015. | ||
</td> | </td> | ||
− | <td>[[File: | + | <td>[[File:2.2._Distribution_of_Blue_Pipits_by_Vocal_Type_from_2011_to_2017.png|500px|center|border]]</td> |
</tr> | </tr> | ||
+ | </table> | ||
+ | <br> | ||
+ | <b> To Compare Spatial Distribution Between Blue Pipits and Other Birds </b> | ||
+ | <table> | ||
+ | <table border='1'> | ||
+ | <tr> | ||
+ | <th>Description</th> | ||
+ | <th>Illustration</th> | ||
+ | </tr> | ||
<tr> | <tr> | ||
− | <td> | + | <td><b>1. Geographical Distribution of All Birds from 2011 to 2017</b> |
− | <b> 1. Geographical Distribution of All Birds from 2011 to 2017 </b> | ||
− | |||
<br>From 2011 to 2017, we can see that there are typically four major nesting areas for all birds – North-East, represented by the Green rectangle, North-West, represented by the Red rectangle, South-West, represented by the Purple rectangle, and South-East, represented by the Blue rectangle. | <br>From 2011 to 2017, we can see that there are typically four major nesting areas for all birds – North-East, represented by the Green rectangle, North-West, represented by the Red rectangle, South-West, represented by the Purple rectangle, and South-East, represented by the Blue rectangle. | ||
Line 99: | Line 118: | ||
</td> | </td> | ||
− | <td>[[File: | + | <td> |
+ | <br> <b>Spatial Distribution of All Birds from 2011 to 2017</b> | ||
+ | [[File:3.1_Distribution_of_all_birds_2011-2017.gif|500px|center|border]] | ||
+ | <br> <b>Four Major Nesting Areas</b> | ||
+ | [[File:3.1_4_areas_of_geog_distribution.png|500px|center|border]] | ||
+ | </td> | ||
</tr> | </tr> | ||
Line 107: | Line 131: | ||
</td> | </td> | ||
− | <td>[[File: | + | <td>[[File:3.2_No._of_all_bird_recroded_from_2011_to_2017.png|500px|center|border]]</td> |
</tr> | </tr> | ||
+ | </table> | ||
+ | <br> | ||
+ | <b> To Compare Test Blue Pipits Locations Against Actual Blue Pipits Locations </b> | ||
+ | <table> | ||
+ | <table border='1'> | ||
+ | <tr> | ||
+ | <th>Description</th> | ||
+ | <th>Illustration</th> | ||
+ | </tr> | ||
<tr> | <tr> | ||
− | <td> | + | <td><b> 1. Distribution of Rose-Crested Blue Pipits Recording Locations</b> |
− | <b> 1. Distribution of Rose-Crested Blue Pipits Recording Locations </b> | ||
− | |||
<br>In order to back up their claim that the Rose-crested Blue Pipits population has not reduced, Kasios has provided a set of Pipit bird calls, recently recorded across the Preserve, with locations of where they were recorded. | <br>In order to back up their claim that the Rose-crested Blue Pipits population has not reduced, Kasios has provided a set of Pipit bird calls, recently recorded across the Preserve, with locations of where they were recorded. | ||
Line 119: | Line 150: | ||
</td> | </td> | ||
− | <td>[[File: | + | <td>[[File:4.1_Dis_of_Blue_Pipits_Recording_Locations.png|500px|center|border]]</td> |
</tr> | </tr> | ||
+ | </table> | ||
+ | <br> | ||
+ | <b> To Select Samples of Actual Recordings for Analysis </b> | ||
+ | <table> | ||
+ | <table border='1'> | ||
<tr> | <tr> | ||
− | < | + | <th>Description</th> |
− | <b> 1. Number of Records by Quality and | + | <th>Illustration</th> |
+ | </tr> | ||
+ | <tr> | ||
+ | <td><b> 1. Number of Records by Quality and Vocalisation Type </b> | ||
<br>There are 51 recordings of Rose-crested Blue Pipits that are of grade A. 29 of them are calls, while 22 of them are songs. | <br>There are 51 recordings of Rose-crested Blue Pipits that are of grade A. 29 of them are calls, while 22 of them are songs. | ||
Line 131: | Line 170: | ||
</td> | </td> | ||
− | <td>[[File: | + | <td>[[File:5.1._No._of_Records_by_Quality_and_Vocal_Type.png|500px|center|border]]</td> |
</tr> | </tr> | ||
Line 151: | Line 190: | ||
</td> | </td> | ||
− | <td>[[File: | + | <td> |
+ | [[File:5.2._Dist_of_Blue_Pipit_Grade_A_Song.png|500px|center|border]] | ||
+ | [[File:5.2._Dist_of_Blue_Pipit_Grade_A_Call.png|500px|center|border]] | ||
+ | </td> | ||
</tr> | </tr> | ||
+ | </table> | ||
+ | <br> | ||
+ | <b> To Determine Authenticity of Test Recordings: Analyse Patterns Between Test Recordings and Actual Recordings </b> | ||
+ | <table> | ||
+ | <table border='1'> | ||
+ | <tr> | ||
+ | <th>Description</th> | ||
+ | <th>Illustration</th> | ||
+ | </tr> | ||
<tr> | <tr> | ||
− | <td> | + | <td><b> 1. Samples of Actual Song and Call Recordings</b> |
− | <b> 1. Samples of Actual Song and Call Recordings</b> | ||
− | |||
<br>Upon selecting our samples of actual recordings, we will attempt to visualise these audio files by utilising the ‘tuneR’ package in R. | <br>Upon selecting our samples of actual recordings, we will attempt to visualise these audio files by utilising the ‘tuneR’ package in R. | ||
</td> | </td> | ||
− | <td>[[File: | + | <td> |
+ | <br><b> Green Song </b> | ||
+ | <br>[[File:Green_Song_1.png|225px|border]] | ||
+ | [[File:Green_Song_2.png|225px|border]] | ||
+ | [[File:Green_Song_3.png|225px|border]] | ||
+ | [[File:Green_Song_4.png|225px|border]] | ||
+ | [[File:Green_Song_5.png|225px|border]] | ||
+ | <br><b> Green Call </b> | ||
+ | <br>[[File:Green_Call_1.png|225px|border]] | ||
+ | [[File:Green_Call_2.png|225px|border]] | ||
+ | [[File:Green_Call_3.png|225px|border]] | ||
+ | [[File:Green_Call_4.png|225px|border]] | ||
+ | [[File:Green_Call_5.png|225px|border]] | ||
+ | <br><b> Red Song </b> | ||
+ | <br>[[File:Red_Song_1.png|225px|border]] | ||
+ | [[File:Red_Song_2.png|225px|border]] | ||
+ | [[File:Red_Song_3.png|225px|border]] | ||
+ | <br><b> Red Call </b> | ||
+ | <br>[[File:Red_Call_1.png|225px|border]] | ||
+ | [[File:Red_Call_2.png|225px|border]] | ||
+ | [[File:Red_Call_3.png|225px|border]] | ||
+ | <br><b> Purple Song </b> | ||
+ | <br>[[File:Purple_Song_1.png|225px|border]] | ||
+ | [[File:Purple_Song_2.png|225px|border]] | ||
+ | <br><b> Purple Call </b> | ||
+ | <br>[[File:Purple_Call_1.png|225px|border]] | ||
+ | </td> | ||
</tr> | </tr> | ||
Line 169: | Line 244: | ||
</td> | </td> | ||
− | <td>[[File: | + | <td> |
+ | <br><b> Green Test Recordings </b> | ||
+ | <br>[[File:Test_Green_1.png|225px|border]] | ||
+ | [[File:Test_Green_6.png|225px|border]] | ||
+ | [[File:Test_Green_11.png|225px|border]] | ||
+ | [[File:Test_Green_15.png|225px|border]] | ||
+ | <br><b> Red Test Recordings </b> | ||
+ | <br>[[File:Test_Red_2.png|225px|border]] | ||
+ | [[File:Test_Red_3.png|225px|border]] | ||
+ | [[File:Test_Red_4.png|225px|border]] | ||
+ | [[File:Test_Red_7.png|225px|border]] | ||
+ | [[File:Test_Red_9.png|225px|border]] | ||
+ | [[File:Test_Red_13.png|225px|border]] | ||
+ | [[File:Test_Red_14.png|225px|border]] | ||
+ | <br><b> Purple Test Recordings </b> | ||
+ | <br>[[File:Test_Purple_5.png|225px|border]] | ||
+ | [[File:Test_Purple_8.png|225px|border]] | ||
+ | [[File:Test_Purple_10.png|225px|border]] | ||
+ | [[File:Test_Purple_12.png|225px|border]] | ||
+ | </td> | ||
</tr> | </tr> | ||
Line 175: | Line 269: | ||
==Dashboard Design== | ==Dashboard Design== | ||
− | View the interactive Tableau design here: [https://public.tableau.com/ | + | View the interactive Tableau design here: [https://public.tableau.com/views/WorkingFile080718/PitifulPipitsVisualizingBluePipitsPlight?:embed=y&:display_count=yes&publish=yes Link to tableau dashboard] |
<br> | <br> | ||
1.<b>Blue Pipit Spatial Distribution Prior and After Alleged Dumping</b> | 1.<b>Blue Pipit Spatial Distribution Prior and After Alleged Dumping</b> | ||
− | <p>[[File: | + | <p>[[File:Dashboard_-_1.png|900px|center|border]]</p> |
2.<b>Distribution of Blue Pipits by Vocalization Type from 2013 to 2015</b> | 2.<b>Distribution of Blue Pipits by Vocalization Type from 2013 to 2015</b> | ||
− | <p>[[File: | + | <p>[[File:Dashboard_-_2.png|900px|center|border]]</p> |
3.<b>Comparison of Spatial Distribution Between Blue Pipits and All Other Birds</b> | 3.<b>Comparison of Spatial Distribution Between Blue Pipits and All Other Birds</b> | ||
− | <p>[[File: | + | <p>[[File:Dashboard_-_3.png|900px|center|border]]</p> |
4.<b>Comparison of Test Blue Pipits Locations Against Actual Blue Pipits Locations</b> | 4.<b>Comparison of Test Blue Pipits Locations Against Actual Blue Pipits Locations</b> | ||
− | <p>[[File: | + | <p>[[File:Dashboard_-_4.png|900px|center|border]]</p> |
5. <b>Selecting Samples of Actual Recordings for Analysis </b> | 5. <b>Selecting Samples of Actual Recordings for Analysis </b> | ||
− | <p>[[File: | + | <p>[[File:Dashboard_-_5.png|900px|center|border]]</p> |
6. <b>Determining Authenticity of Test Recordings: Analysing Patterns Between Test Recordings and Actual Recordings</b> | 6. <b>Determining Authenticity of Test Recordings: Analysing Patterns Between Test Recordings and Actual Recordings</b> | ||
− | <p>[[File: | + | <br><p>[[File:Dashboard_-_6.1.png|900px|center|border]]</p> |
+ | <br><p>[[File:Dashboard_-_6.2.png|900px|center|border]]</p> | ||
+ | <br><p>[[File:Dashboard_-_6.3.png|900px|center|border]]</p> | ||
+ | <br><p>[[File:Dashboard_-_6.4.png|900px|center|border]]</p> | ||
+ | <br><p>[[File:Dashboard_-_6.5.png|900px|center|border]]</p> | ||
+ | <br><p>[[File:Dashboard_-_6.6.png|900px|center|border]]</p> |
Latest revision as of 23:31, 8 July 2018
|
|
|
|
|
Methodology
Our Approach
To Examine Blue Pipit Spatial Distribution Prior to and After Alleged Dumping
Description | Illustration |
---|---|
1. Alleged Dumping Site
|
|
2. Time Period (Years) and Alleged Date of Dumping
The number of months taken to record the vocalization of the birds in the Preserves over the years were not consistent. Only some years have recordings for all months – Year 2009 and 2011 to 2017.
Additionally, in accordance with the details obtained from VAST Challenged 2017, the alleged date of the chemical dumping was on 15th February 2015 as indicated in the orange arrow below:
|
|
3. Geographical Distribution of Rose-crested Blue Pipit from 2011 to 2017
From 2011 to 2017, we want to identify the spatial distribution of the Rose-Crested Blue Pipits by plotting the location of where the recordings were taken over time. |
|
4. Number of Rose-Crested Blue Pipit Recorded from 2011 to 2017
|
To identify distribution of Blue Pipits by Vocalization Type from 2013 to 2015
Description | Illustration |
---|---|
1. Vocalization Type
Additionally, we will also exclude the Vocalization Type “call, song”, as we want to be specific about which vocalization type we are analysing. |
|
2. Distribution of Blue Pipits by Vocalization Type from 2011 to 2017
|
To Compare Spatial Distribution Between Blue Pipits and Other Birds
Description | Illustration |
---|---|
1. Geographical Distribution of All Birds from 2011 to 2017
We want to map out the nesting areas for the other birds to be compared against the nesting area for the Blue Pipits to identify any possible spatial relationship between them. |
|
2. Number of All Birds Recorded from 2011 to 2017
|
To Compare Test Blue Pipits Locations Against Actual Blue Pipits Locations
Description | Illustration |
---|---|
1. Distribution of Rose-Crested Blue Pipits Recording Locations
There are 15 test recordings in total, with the spatial distribution of where these recordings were allegedly plotted onto the graph to the right. |
To Select Samples of Actual Recordings for Analysis
Description | Illustration |
---|---|
1. Number of Records by Quality and Vocalisation Type
To ensure that we will be able to accurately analyse the patterns of the actual recordings to be compared against that of the Test Recordings, it is essential that we only analyse recordings that are of Grade A. |
|
2. Distribution of Rose-crested Blue Pipits Grade A Song and Call Recordings
Since the Test Recordings have no indication of vocalization type – Whether they are song or call vocalization, we will pick the maximum of 25% samples of the population in each coloured zones, or the total population in each coloured zones if the population is less than or equals to 5. The selected actual recordings will thus be segregated into the following categories: 1. Green Song 2. Green Call 3. Red Song 4. Red Call 5. Purple Song 6. Purple Call The designated colours attached to each recording category corresponds with the coloured areas to the right. |
To Determine Authenticity of Test Recordings: Analyse Patterns Between Test Recordings and Actual Recordings
Dashboard Design
View the interactive Tableau design here: Link to tableau dashboard
1.Blue Pipit Spatial Distribution Prior and After Alleged Dumping
2.Distribution of Blue Pipits by Vocalization Type from 2013 to 2015
3.Comparison of Spatial Distribution Between Blue Pipits and All Other Birds
4.Comparison of Test Blue Pipits Locations Against Actual Blue Pipits Locations
5. Selecting Samples of Actual Recordings for Analysis
6. Determining Authenticity of Test Recordings: Analysing Patterns Between Test Recordings and Actual Recordings