Difference between revisions of "ISSS608 2017-18 T3 Assign Anthony Theodore Method"

From Visual Analytics and Applications
Jump to navigation Jump to search
(add methodology)
(added methodology)
Line 27: Line 27:
 
</div>  
 
</div>  
 
This assignment mainly use tableau for the dashboard creation and exploration analysis. SAS JMP Pro is also used for the initial data understanding part.<br>  
 
This assignment mainly use tableau for the dashboard creation and exploration analysis. SAS JMP Pro is also used for the initial data understanding part.<br>  
−
R is used only for the audio visualization. The following list is the R library used:<br>
+
Python is used only for the audio visualization. The following list is the Python library used:<br>
−
LIBRARY
+
<div style="margin:0px; padding: 2px; border-radius: 1px; text-align:left">
 +
{| class="wikitable" style="background-color:#FFFFFF;" width="100%"
 +
|-
 +
|
 +
*os - listdir
 +
*pydub - AudioSegment
 +
*matplotlib.pyplot
 +
*numpy
 +
*wave
 +
*sys
 +
*glob
 +
*scipy
 +
|}
 +
</div>
  
−
<br>
 
 
The approach taken for this assignment consists of:
 
The approach taken for this assignment consists of:
 
#Data understanding
 
#Data understanding
Line 53: Line 65:
 
Data Understanding
 
Data Understanding
 
||
 
||
−
#Use SAS JMP Pro to open the metadata and check the validity of the data.<br>Since the data is relatively clean, there is no need to perform data cleaning.
+
#Use SAS JMP Pro to open the metadata and check the validity of the data.
−
#Insert the coordinate of the dumping site into the Kasios's test bird metadata.<br>As mention in the assignment description, the coordinate for the dumping site is in (148,159).\
+
#*Since the data is relatively clean, there is no need to perform data cleaning.
−
#Import both of the metadata into Tableau.<br>Set both relationship to union. This way, all data will be accessible from the same sheets.
+
#Insert the coordinate of the dumping site into the Kasios's test bird metadata.
 +
#*As mention in the assignment description, the coordinate for the dumping site is in <b>(148,159)</b>.
 +
#Import both metadata into Tableau.
 +
#*Set both relationship to union. This way, all data will be accessible from the same sheets.
 
|-
 
|-
 
|  
 
|  
Line 62: Line 77:
 
Geospatial Visualization
 
Geospatial Visualization
 
||
 
||
−
#Using the Lekagul Preserve Map image, load the image in Tableau as a background image.  
+
#Using the Lekagul Preserve Map image, load the image in Tableau as a background image.<br>
 +
#Plot in tableau using <i>X</i> and ''Y'' from both birds metadata into Rows and Columns.
 +
#Using <b>Size</b> Parameter and <b>Colour</b> parameter, add the <i>English Name</i> from sensor bird metadata and <i>Table Source</i> from union relationship
 +
#*This resulted in distribution of all the birds inside Lekagul Preserve along with Kasios test bird coordinate.
 +
#Use the filter to differentiate birds position.
 
|-
 
|-
 
|  
 
|  
Line 69: Line 88:
 
Dashboard Creation
 
Dashboard Creation
 
||
 
||
−
 
+
#Create 3 new sheet. This 3 sheets will be used for mapping individual year.
 +
#*Put <i>Date</i> into the Column along with <i>X</i> and <i>Y</i> into the Rows.
 +
#*
 +
#Using another new sheet, add the line graph for <i>Vocalization Type</i> into Rows and year into column.
 +
#*Filter other visualization type and use only Call and Song. This is to give user better depth for comparison between sound and call.
 +
#Create another sheet to add the line graph for total of sound detected by year.
 
|-
 
|-
 
|
 
|
Line 76: Line 100:
 
Audio Processing
 
Audio Processing
 
||
 
||
−
 
+
#Converting all 2081 Sensor bird sound and 15 Kasios test bird sound from .MP3 format into .WAV format.
 +
#*We use Python to do this task. Library used is both pydub and ffmpeg. Pydub is a package that allow audio manipulation. Detail about pydub: https://github.com/jiaaro/pydub
 +
#**Note that ffmpeg need to be installed first before pydub can be used.
 +
#
 
|-
 
|-
 
|
 
|
Line 97: Line 124:
 
<font size = 3; color="#FFFFFF"><span style="font-family:Century Gothic;">Dashboard Design</span></font>   
 
<font size = 3; color="#FFFFFF"><span style="font-family:Century Gothic;">Dashboard Design</span></font>   
 
</div>
 
</div>
−
 
+
The finalize dashboard design that will be uploaded into tableau public is:<br>
−
Below is the list of all the data that used in this analysis:
+
IMAGE<br>
−
 
+
Link for dashboard in tableau public:
−
Data and Assignment source: http://www.vacommunity.org/VAST+Challenge+2018+MC1
 

Revision as of 14:44, 6 July 2018

American Pipit b57-13-007 V.jpg Mysterious Disappearance at Wildlife Preserve

Overview

Approach & Design

Findings

Conclusion



Tools and Approach

This assignment mainly use tableau for the dashboard creation and exploration analysis. SAS JMP Pro is also used for the initial data understanding part.
Python is used only for the audio visualization. The following list is the Python library used:

  • os - listdir
  • pydub - AudioSegment
  • matplotlib.pyplot
  • numpy
  • wave
  • sys
  • glob
  • scipy

The approach taken for this assignment consists of:

  1. Data understanding
  2. Geospatial visualization
  3. Creating Dashboard
  4. Audio processing
  5. Audio visualization
  6. Audio comparison

No.

Approach

Description

1.

Data Understanding

  1. Use SAS JMP Pro to open the metadata and check the validity of the data.
    • Since the data is relatively clean, there is no need to perform data cleaning.
  2. Insert the coordinate of the dumping site into the Kasios's test bird metadata.
    • As mention in the assignment description, the coordinate for the dumping site is in (148,159).
  3. Import both metadata into Tableau.
    • Set both relationship to union. This way, all data will be accessible from the same sheets.

2.

Geospatial Visualization

  1. Using the Lekagul Preserve Map image, load the image in Tableau as a background image.
  2. Plot in tableau using X and Y from both birds metadata into Rows and Columns.
  3. Using Size Parameter and Colour parameter, add the English Name from sensor bird metadata and Table Source from union relationship
    • This resulted in distribution of all the birds inside Lekagul Preserve along with Kasios test bird coordinate.
  4. Use the filter to differentiate birds position.

3.

Dashboard Creation

  1. Create 3 new sheet. This 3 sheets will be used for mapping individual year.
    • Put Date into the Column along with X and Y into the Rows.
  2. Using another new sheet, add the line graph for Vocalization Type into Rows and year into column.
    • Filter other visualization type and use only Call and Song. This is to give user better depth for comparison between sound and call.
  3. Create another sheet to add the line graph for total of sound detected by year.

4

Audio Processing

  1. Converting all 2081 Sensor bird sound and 15 Kasios test bird sound from .MP3 format into .WAV format.
    • We use Python to do this task. Library used is both pydub and ffmpeg. Pydub is a package that allow audio manipulation. Detail about pydub: https://github.com/jiaaro/pydub
      • Note that ffmpeg need to be installed first before pydub can be used.

5

Audio Visualization

6

Audio Comparison

Dashboard Design

The finalize dashboard design that will be uploaded into tableau public is:
IMAGE
Link for dashboard in tableau public:

Retrieved from ‘https://wiki.smu.edu.sg/1718t3isss608/index.php?title=ISSS608_2017-18_T3_Assign_Anthony_Theodore_Method&oldid=3462’