Difference between revisions of "ISSS608 2017-18 T3 Assign Kalai Selvi Data Preparation"
Kalaisr.2017 (talk | contribs) |
Kalaisr.2017 (talk | contribs) |
||
Line 1: | Line 1: | ||
+ | <div style=background:#0000FF border:#A3BFB1> | ||
+ | [[File:MC2 2018.jpg|400 px]] | ||
+ | <b><font size = 6; color="#F5FDFF"> VAST Challenge 2018 MC2: Like a Duck to Water </font></b> | ||
+ | </div> | ||
+ | |||
+ | <!--MAIN HEADER --> | ||
+ | {|style="background-color: #5588ff;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" | | ||
+ | | style="font-family: Calibri; font-size:120%; text-align:center;" width="25%" | | ||
+ | |||
+ | [[ISSS608_2017-18_T3_Assign_Kalai Selvi| <font color="#FFFFFF">Problem Background</font>]] | ||
+ | |||
+ | | style="font-family: Calibri; font-size:120%; text-align:center;" width="25%" | | ||
+ | [[ISSS608_2017-18_T3_Assign_Kalai Selvi_Data_Preparation| <font color="#FFFFFF">Data Preparation</font>]] | ||
+ | |||
+ | | style="font-family: Calibri; font-size:120%; text-align:center;" width="25%" | | ||
+ | [[ISSS608_2017-18_T3_Assign_Kalai Selvi_Methodology and Dashboard Design| <font color="#FFFFFF">Methodology and Dashboard Design</font>]] | ||
+ | |||
+ | | style="font-family: Calibri; font-size:120%; text-align:center;" width="25%" | | ||
+ | [[ISSS608_2017-18_T3_Assign_Kalai Selvi_Insights| <font color="#FFFFFF">Insights</font>]] | ||
+ | |||
+ | | style="font-family: Calibri; font-size:120%; text-align:center;" width="25%" | | ||
+ | [[ISSS608_2017-18_T3_Assign_Kalai Selvi_Conclusion| <font color="#FFFFFF">Conclusion</font>]] | ||
+ | | | ||
+ | |} | ||
+ | |||
==Check for Missing Records== | ==Check for Missing Records== | ||
The Boonsong Lekagul waterways readings.csv data consists of the 5 fields: id, value, location, sample and measure. Vlookup function is used in the Boonsong Lekagul waterways readings to add the ‘unit’ from the chemical units of measure.csv data. Hence, now the waterway readings data now also consists of the unit field. | The Boonsong Lekagul waterways readings.csv data consists of the 5 fields: id, value, location, sample and measure. Vlookup function is used in the Boonsong Lekagul waterways readings to add the ‘unit’ from the chemical units of measure.csv data. Hence, now the waterway readings data now also consists of the unit field. |
Revision as of 20:44, 7 July 2018
Contents
Check for Missing Records
The Boonsong Lekagul waterways readings.csv data consists of the 5 fields: id, value, location, sample and measure. Vlookup function is used in the Boonsong Lekagul waterways readings to add the ‘unit’ from the chemical units of measure.csv data. Hence, now the waterway readings data now also consists of the unit field.
The Boonsong Lekagul waterways readings data was imported into JMP to check for missing records. There were 1,273 records with missing units and these are for the Macrozoobenthos chemical. Macrozoobenthos is a type of animal species and a unit of measurement is not required for this Macrozoobenthos measure.
Check for Chemical Measures with 0 values
There are 9,700 measures with 0 values. Records with 0 chemical reading value are deleted from the data as these are treated as incorrect entries. There were 127,124 records in the Final Boonsong Lekagul waterways readings after deleting the 9,700 records.
Create Locations.csv data and find x,y coordinates
A new excel file, Locations.csv is created and the fields are the Locations, X and Y coordinates.
The Location data was imported into Tableau. Using the Background Image tab, Waterways Final.jpg image was imported. After editing the background image, X is dragged into Column shelf and Y is dragged into Rows shelf as shown below.
Each location in the image is annotated as a point to find the (x,y) coordinate respectively. An example of the annotation for Boonsri is as below. After finding all the (x,y) coordinates for each location, the X and Y coordinates are updated in the Locations data.
Join Tables
Boonsong Lekagul waterways readings.csv and Locations.csv data are imported into Tableau and joined using the common key, location in both datasets.