Difference between revisions of "ISSS608 2017-18 T3 Assign Tong Wen Liang Samuel Data Preparation"
(4 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
− | <div style=background:#00a2d0 border:#00bcf0> | + | <div style=background:#00a2d0 border:#00bcf0> |
+ | [[Image:Blue_Pipit.png|165px]] | ||
<b><font size = 6; color="#ffffff"> VAST Challenge 2018: "Cheep" Shots? </font></b> | <b><font size = 6; color="#ffffff"> VAST Challenge 2018: "Cheep" Shots? </font></b> | ||
</div> | </div> | ||
<!--MAIN HEADER --> | <!--MAIN HEADER --> | ||
{|style="background-color:#00bcf0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" | | {|style="background-color:#00bcf0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" | | ||
− | | style="font-family:Century Gothic; font-size:100%; solid #000000; background:#00bcf0; text-align:center;" width=" | + | | style="font-family:Century Gothic; font-size:100%; solid #000000; background:#00bcf0; text-align:center;" width="20%" | |
; | ; | ||
− | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel|<b><font size=" | + | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel|<b><font size="2"><font color="#ffffff">Background</font></font></b>]] |
− | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#00bcf0; text-align:center;" width=" | + | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#00bcf0; text-align:center;" width="20%" | |
; | ; | ||
− | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel_Data_Preparation|<b><font size=" | + | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel_Data_Preparation|<b><font size="2"><font color="#ffffff">Methodology</font></font></b>]] |
− | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#00bcf0; text-align:center;" width=" | + | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#00bcf0; text-align:center;" width="20%" | |
; | ; | ||
− | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel_Visualization|<b><font size=" | + | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel_Visualization|<b><font size="2"><font color="#ffffff">Insights</font></font></b>]] |
− | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#00bcf0; text-align:center;" width=" | + | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#00bcf0; text-align:center;" width="20%" | |
; | ; | ||
− | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel_Conclusion| <b><font size=" | + | [[ISSS608_2017-18_T3_Assign_Tong_Wen_Liang_Samuel_Conclusion| <b><font size="2"><font color="#ffffff">Conclusion</font></font></b>]] |
+ | |||
+ | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#00bcf0; text-align:center;" width="20%" | | ||
+ | ; | ||
+ | [[Assignment Dropbox G1| <b><font size="2"><font color="#FFFFFF"> Link to Dropbox </font></font></b>]] | ||
| | | | ||
Line 26: | Line 31: | ||
<font size="5"><font color="#5c5c5c">'''Methodology'''</font></font> | <font size="5"><font color="#5c5c5c">'''Methodology'''</font></font> | ||
− | == | + | ==Our Approach== |
<b> To Examine Blue Pipit Spatial Distribution Prior to and After Alleged Dumping </b> | <b> To Examine Blue Pipit Spatial Distribution Prior to and After Alleged Dumping </b> | ||
<table> | <table> | ||
Line 38: | Line 43: | ||
<br>The location of the alleged dumping site was indicated as (148, 159). By marking the location on the map, it allows us to identify the spatial-temporal patterns of the affected Rose-Crested Blue Pipits in the Preserve prior to and after the alleged dumping of the process waste. | <br>The location of the alleged dumping site was indicated as (148, 159). By marking the location on the map, it allows us to identify the spatial-temporal patterns of the affected Rose-Crested Blue Pipits in the Preserve prior to and after the alleged dumping of the process waste. | ||
</td> | </td> | ||
− | <td>[[File:The Alleged Dumping Site.png|500px|center]]</td> | + | <td>[[File:The Alleged Dumping Site.png|500px|center|border]]</td> |
</tr> | </tr> | ||
Line 48: | Line 53: | ||
<p>Additionally, in accordance with the details obtained from VAST Challenged 2017, the alleged date of the chemical dumping was on 15th February 2015 as indicated in the orange arrow below:</P> | <p>Additionally, in accordance with the details obtained from VAST Challenged 2017, the alleged date of the chemical dumping was on 15th February 2015 as indicated in the orange arrow below:</P> | ||
− | [[File:1.2 Alleged Date of Dumping.png|500px|center]] | + | [[File:1.2 Alleged Date of Dumping.png|500px|center|border]] |
<br>Therefore, in order to facilitate in our analysis of the spatial-temporal patterns of the birds in the Preserve, we will use only year 2011 to 2017 for our data visualization of the distribution of birds prior to the dumping and after the dumping. | <br>Therefore, in order to facilitate in our analysis of the spatial-temporal patterns of the birds in the Preserve, we will use only year 2011 to 2017 for our data visualization of the distribution of birds prior to the dumping and after the dumping. | ||
</td> | </td> | ||
− | <td>[[File:Time Period of Bird Vocalizations Recorded.png|500px|center]]</td> | + | <td>[[File:Time Period of Bird Vocalizations Recorded.png|500px|center|border]]</td> |
</tr> | </tr> | ||
Line 61: | Line 66: | ||
</td> | </td> | ||
<td> | <td> | ||
− | [[File:1.3. Geog Dist of Blue Pipits from 2011 to 2017.gif |500px|center]] | + | [[File:1.3. Geog Dist of Blue Pipits from 2011 to 2017.gif |500px|center|border]] |
</tr> | </tr> | ||
Line 69: | Line 74: | ||
<br>The number of Rose-crested Blue Pipit recorded peaked at 45 in 2015, just when the dumping took place. Thereafter, the number of Rose-crested Blue Pipit recorded dropped to 27 in 2016 and to 16 in 2017. | <br>The number of Rose-crested Blue Pipit recorded peaked at 45 in 2015, just when the dumping took place. Thereafter, the number of Rose-crested Blue Pipit recorded dropped to 27 in 2016 and to 16 in 2017. | ||
</td> | </td> | ||
− | <td>[[File:1.4. Number of Rose-Crested Blue Pipit Recorded from 2011 to 2017.png |500px|center]]</td> | + | <td>[[File:1.4. Number of Rose-Crested Blue Pipit Recorded from 2011 to 2017.png |500px|center|border]]</td> |
</tr> | </tr> | ||
</table> | </table> | ||
Line 87: | Line 92: | ||
Additionally, we will also exclude the Vocalization Type “call, song”, as we want to be specific about which vocalization type we are analysing. | Additionally, we will also exclude the Vocalization Type “call, song”, as we want to be specific about which vocalization type we are analysing. | ||
</td> | </td> | ||
− | <td>[[File:2.1_Vocal_type.png|500px|center]]</td> | + | <td>[[File:2.1_Vocal_type.png|500px|center|border]]</td> |
</tr> | </tr> | ||
Line 94: | Line 99: | ||
<br>We want to plot the distribution of Blue Pipits by Vocalization Types “Call” and “Song” from 2011 to 2017 to examine if there are any significant spatial pattern relating to the alleged process waste dump in 2015. | <br>We want to plot the distribution of Blue Pipits by Vocalization Types “Call” and “Song” from 2011 to 2017 to examine if there are any significant spatial pattern relating to the alleged process waste dump in 2015. | ||
</td> | </td> | ||
− | <td>[[File:2.2._Distribution_of_Blue_Pipits_by_Vocal_Type_from_2011_to_2017.png|500px|center]]</td> | + | <td>[[File:2.2._Distribution_of_Blue_Pipits_by_Vocal_Type_from_2011_to_2017.png|500px|center|border]]</td> |
</tr> | </tr> | ||
</table> | </table> | ||
Line 115: | Line 120: | ||
<td> | <td> | ||
<br> <b>Spatial Distribution of All Birds from 2011 to 2017</b> | <br> <b>Spatial Distribution of All Birds from 2011 to 2017</b> | ||
− | [[File:3.1_Distribution_of_all_birds_2011-2017.gif|500px|center]] | + | [[File:3.1_Distribution_of_all_birds_2011-2017.gif|500px|center|border]] |
<br> <b>Four Major Nesting Areas</b> | <br> <b>Four Major Nesting Areas</b> | ||
− | [[File:3.1_4_areas_of_geog_distribution.png|500px|center]] | + | [[File:3.1_4_areas_of_geog_distribution.png|500px|center|border]] |
</td> | </td> | ||
</tr> | </tr> | ||
Line 126: | Line 131: | ||
</td> | </td> | ||
− | <td>[[File:3.2_No._of_all_bird_recroded_from_2011_to_2017.png|500px|center]]</td> | + | <td>[[File:3.2_No._of_all_bird_recroded_from_2011_to_2017.png|500px|center|border]]</td> |
</tr> | </tr> | ||
</table> | </table> | ||
Line 145: | Line 150: | ||
</td> | </td> | ||
− | <td>[[File:4.1_Dis_of_Blue_Pipits_Recording_Locations.png|500px|center]]</td> | + | <td>[[File:4.1_Dis_of_Blue_Pipits_Recording_Locations.png|500px|center|border]]</td> |
</tr> | </tr> | ||
</table> | </table> | ||
Line 165: | Line 170: | ||
</td> | </td> | ||
− | <td>[[File:5.1._No._of_Records_by_Quality_and_Vocal_Type.png|500px|center]]</td> | + | <td>[[File:5.1._No._of_Records_by_Quality_and_Vocal_Type.png|500px|center|border]]</td> |
</tr> | </tr> | ||
Line 186: | Line 191: | ||
</td> | </td> | ||
<td> | <td> | ||
− | [[File:5.2._Dist_of_Blue_Pipit_Grade_A_Song.png|500px|center]] | + | [[File:5.2._Dist_of_Blue_Pipit_Grade_A_Song.png|500px|center|border]] |
− | [[File:5.2._Dist_of_Blue_Pipit_Grade_A_Call.png|500px|center]] | + | [[File:5.2._Dist_of_Blue_Pipit_Grade_A_Call.png|500px|center|border]] |
</td> | </td> | ||
</tr> | </tr> | ||
Line 207: | Line 212: | ||
<td> | <td> | ||
<br><b> Green Song </b> | <br><b> Green Song </b> | ||
− | <br>[[File:Green_Song_1.png|225px]] | + | <br>[[File:Green_Song_1.png|225px|border]] |
− | [[File:Green_Song_2.png|225px]] | + | [[File:Green_Song_2.png|225px|border]] |
− | [[File:Green_Song_3.png|225px]] | + | [[File:Green_Song_3.png|225px|border]] |
− | [[File:Green_Song_4.png|225px]] | + | [[File:Green_Song_4.png|225px|border]] |
− | [[File:Green_Song_5.png|225px]] | + | [[File:Green_Song_5.png|225px|border]] |
<br><b> Green Call </b> | <br><b> Green Call </b> | ||
− | <br>[[File:Green_Call_1.png|225px]] | + | <br>[[File:Green_Call_1.png|225px|border]] |
− | [[File:Green_Call_2.png|225px]] | + | [[File:Green_Call_2.png|225px|border]] |
− | [[File:Green_Call_3.png|225px]] | + | [[File:Green_Call_3.png|225px|border]] |
− | [[File:Green_Call_4.png|225px]] | + | [[File:Green_Call_4.png|225px|border]] |
− | [[File:Green_Call_5.png|225px]] | + | [[File:Green_Call_5.png|225px|border]] |
<br><b> Red Song </b> | <br><b> Red Song </b> | ||
− | <br>[[File:Red_Song_1.png|225px]] | + | <br>[[File:Red_Song_1.png|225px|border]] |
− | [[File:Red_Song_2.png|225px]] | + | [[File:Red_Song_2.png|225px|border]] |
− | [[File:Red_Song_3.png|225px]] | + | [[File:Red_Song_3.png|225px|border]] |
<br><b> Red Call </b> | <br><b> Red Call </b> | ||
− | <br>[[File:Red_Call_1.png|225px]] | + | <br>[[File:Red_Call_1.png|225px|border]] |
− | [[File:Red_Call_2.png|225px]] | + | [[File:Red_Call_2.png|225px|border]] |
− | [[File:Red_Call_3.png|225px]] | + | [[File:Red_Call_3.png|225px|border]] |
<br><b> Purple Song </b> | <br><b> Purple Song </b> | ||
− | <br>[[File:Purple_Song_1.png|225px]] | + | <br>[[File:Purple_Song_1.png|225px|border]] |
− | [[File:Purple_Song_2.png|225px]] | + | [[File:Purple_Song_2.png|225px|border]] |
<br><b> Purple Call </b> | <br><b> Purple Call </b> | ||
− | <br>[[File:Purple_Call_1.png|225px]] | + | <br>[[File:Purple_Call_1.png|225px|border]] |
</td> | </td> | ||
</tr> | </tr> | ||
Line 241: | Line 246: | ||
<td> | <td> | ||
<br><b> Green Test Recordings </b> | <br><b> Green Test Recordings </b> | ||
− | <br>[[File:Test_Green_1.png|225px]] | + | <br>[[File:Test_Green_1.png|225px|border]] |
− | [[File:Test_Green_6.png|225px]] | + | [[File:Test_Green_6.png|225px|border]] |
− | [[File:Test_Green_11.png|225px]] | + | [[File:Test_Green_11.png|225px|border]] |
− | [[File:Test_Green_15.png|225px]] | + | [[File:Test_Green_15.png|225px|border]] |
<br><b> Red Test Recordings </b> | <br><b> Red Test Recordings </b> | ||
− | <br>[[File:Test_Red_2.png|225px]] | + | <br>[[File:Test_Red_2.png|225px|border]] |
− | [[File:Test_Red_3.png|225px]] | + | [[File:Test_Red_3.png|225px|border]] |
− | [[File:Test_Red_4.png|225px]] | + | [[File:Test_Red_4.png|225px|border]] |
− | [[File:Test_Red_7.png|225px]] | + | [[File:Test_Red_7.png|225px|border]] |
− | [[File:Test_Red_9.png|225px]] | + | [[File:Test_Red_9.png|225px|border]] |
− | [[File:Test_Red_13.png|225px]] | + | [[File:Test_Red_13.png|225px|border]] |
− | [[File:Test_Red_14.png|225px]] | + | [[File:Test_Red_14.png|225px|border]] |
<br><b> Purple Test Recordings </b> | <br><b> Purple Test Recordings </b> | ||
− | <br>[[File:Test_Purple_5.png|225px]] | + | <br>[[File:Test_Purple_5.png|225px|border]] |
− | [[File:Test_Purple_8.png|225px]] | + | [[File:Test_Purple_8.png|225px|border]] |
− | [[File:Test_Purple_10.png|225px]] | + | [[File:Test_Purple_10.png|225px|border]] |
− | [[File:Test_Purple_12.png|225px]] | + | [[File:Test_Purple_12.png|225px|border]] |
</td> | </td> | ||
</tr> | </tr> | ||
Line 264: | Line 269: | ||
==Dashboard Design== | ==Dashboard Design== | ||
− | View the interactive Tableau design here: [https://public.tableau.com/ | + | View the interactive Tableau design here: [https://public.tableau.com/views/WorkingFile080718/PitifulPipitsVisualizingBluePipitsPlight?:embed=y&:display_count=yes&publish=yes Link to tableau dashboard] |
<br> | <br> | ||
1.<b>Blue Pipit Spatial Distribution Prior and After Alleged Dumping</b> | 1.<b>Blue Pipit Spatial Distribution Prior and After Alleged Dumping</b> | ||
− | <p>[[File:Dashboard_-_1.png|900px|center]]</p> | + | <p>[[File:Dashboard_-_1.png|900px|center|border]]</p> |
2.<b>Distribution of Blue Pipits by Vocalization Type from 2013 to 2015</b> | 2.<b>Distribution of Blue Pipits by Vocalization Type from 2013 to 2015</b> | ||
− | <p>[[File:Dashboard_-_2.png|900px|center]]</p> | + | <p>[[File:Dashboard_-_2.png|900px|center|border]]</p> |
3.<b>Comparison of Spatial Distribution Between Blue Pipits and All Other Birds</b> | 3.<b>Comparison of Spatial Distribution Between Blue Pipits and All Other Birds</b> | ||
− | <p>[[File:Dashboard_-_3.png|900px|center]]</p> | + | <p>[[File:Dashboard_-_3.png|900px|center|border]]</p> |
4.<b>Comparison of Test Blue Pipits Locations Against Actual Blue Pipits Locations</b> | 4.<b>Comparison of Test Blue Pipits Locations Against Actual Blue Pipits Locations</b> | ||
− | <p>[[File:Dashboard_-_4.png|900px|center]]</p> | + | <p>[[File:Dashboard_-_4.png|900px|center|border]]</p> |
5. <b>Selecting Samples of Actual Recordings for Analysis </b> | 5. <b>Selecting Samples of Actual Recordings for Analysis </b> | ||
− | <p>[[File:Dashboard_-_5.png|900px|center]]</p> | + | <p>[[File:Dashboard_-_5.png|900px|center|border]]</p> |
6. <b>Determining Authenticity of Test Recordings: Analysing Patterns Between Test Recordings and Actual Recordings</b> | 6. <b>Determining Authenticity of Test Recordings: Analysing Patterns Between Test Recordings and Actual Recordings</b> | ||
− | <br><p>[[File:Dashboard_-_6.1.png|900px|center]]</p> | + | <br><p>[[File:Dashboard_-_6.1.png|900px|center|border]]</p> |
− | <br><p>[[File:Dashboard_-_6.2.png|900px|center]]</p> | + | <br><p>[[File:Dashboard_-_6.2.png|900px|center|border]]</p> |
− | <br><p>[[File:Dashboard_-_6.3.png|900px|center]]</p> | + | <br><p>[[File:Dashboard_-_6.3.png|900px|center|border]]</p> |
− | <br><p>[[File:Dashboard_-_6.4.png|900px|center]]</p> | + | <br><p>[[File:Dashboard_-_6.4.png|900px|center|border]]</p> |
− | <br><p>[[File:Dashboard_-_6.5.png|900px|center]]</p> | + | <br><p>[[File:Dashboard_-_6.5.png|900px|center|border]]</p> |
− | <br><p>[[File:Dashboard_-_6.6.png|900px|center]]</p> | + | <br><p>[[File:Dashboard_-_6.6.png|900px|center|border]]</p> |
Latest revision as of 23:31, 8 July 2018
|
|
|
|
|
Methodology
Our Approach
To Examine Blue Pipit Spatial Distribution Prior to and After Alleged Dumping
Description | Illustration |
---|---|
1. Alleged Dumping Site
|
|
2. Time Period (Years) and Alleged Date of Dumping
The number of months taken to record the vocalization of the birds in the Preserves over the years were not consistent. Only some years have recordings for all months – Year 2009 and 2011 to 2017.
Additionally, in accordance with the details obtained from VAST Challenged 2017, the alleged date of the chemical dumping was on 15th February 2015 as indicated in the orange arrow below:
|
|
3. Geographical Distribution of Rose-crested Blue Pipit from 2011 to 2017
From 2011 to 2017, we want to identify the spatial distribution of the Rose-Crested Blue Pipits by plotting the location of where the recordings were taken over time. |
|
4. Number of Rose-Crested Blue Pipit Recorded from 2011 to 2017
|
To identify distribution of Blue Pipits by Vocalization Type from 2013 to 2015
Description | Illustration |
---|---|
1. Vocalization Type
Additionally, we will also exclude the Vocalization Type “call, song”, as we want to be specific about which vocalization type we are analysing. |
|
2. Distribution of Blue Pipits by Vocalization Type from 2011 to 2017
|
To Compare Spatial Distribution Between Blue Pipits and Other Birds
Description | Illustration |
---|---|
1. Geographical Distribution of All Birds from 2011 to 2017
We want to map out the nesting areas for the other birds to be compared against the nesting area for the Blue Pipits to identify any possible spatial relationship between them. |
|
2. Number of All Birds Recorded from 2011 to 2017
|
To Compare Test Blue Pipits Locations Against Actual Blue Pipits Locations
Description | Illustration |
---|---|
1. Distribution of Rose-Crested Blue Pipits Recording Locations
There are 15 test recordings in total, with the spatial distribution of where these recordings were allegedly plotted onto the graph to the right. |
To Select Samples of Actual Recordings for Analysis
Description | Illustration |
---|---|
1. Number of Records by Quality and Vocalisation Type
To ensure that we will be able to accurately analyse the patterns of the actual recordings to be compared against that of the Test Recordings, it is essential that we only analyse recordings that are of Grade A. |
|
2. Distribution of Rose-crested Blue Pipits Grade A Song and Call Recordings
Since the Test Recordings have no indication of vocalization type – Whether they are song or call vocalization, we will pick the maximum of 25% samples of the population in each coloured zones, or the total population in each coloured zones if the population is less than or equals to 5. The selected actual recordings will thus be segregated into the following categories: 1. Green Song 2. Green Call 3. Red Song 4. Red Call 5. Purple Song 6. Purple Call The designated colours attached to each recording category corresponds with the coloured areas to the right. |
To Determine Authenticity of Test Recordings: Analyse Patterns Between Test Recordings and Actual Recordings
Dashboard Design
View the interactive Tableau design here: Link to tableau dashboard
1.Blue Pipit Spatial Distribution Prior and After Alleged Dumping
2.Distribution of Blue Pipits by Vocalization Type from 2013 to 2015
3.Comparison of Spatial Distribution Between Blue Pipits and All Other Birds
4.Comparison of Test Blue Pipits Locations Against Actual Blue Pipits Locations
5. Selecting Samples of Actual Recordings for Analysis
6. Determining Authenticity of Test Recordings: Analysing Patterns Between Test Recordings and Actual Recordings