Difference between revisions of "IS428 AY2019-20T1 Assign Chye Soon Hang Data Cleaning"

From Visual Analytics for Business Intelligence
Jump to navigation Jump to search
(Created page with "<div style=background:#f4c20d border:#fff> <center><font size = 5; color="#fff"><b>VAST Challenge 2019 MC 2: Managing Radiation Together As A Nation</center></b></font> </div...")
 
Line 30: Line 30:
 
<p>This dashboard is supported by the following 4 datasets, given in CSV and SHP formats:</p>
 
<p>This dashboard is supported by the following 4 datasets, given in CSV and SHP formats:</p>
 
<ul>
 
<ul>
<li>StaticSensorLocations.csv – contains locations of the static sensors</li
+
<li>StaticSensorLocations.csv – contains locations of the static sensors</li>
 
<li>StaticSensorReadings.csv – contains readings from 9 static sensors that are situated either around hospitals if not somewhere near to Always Safe Nuclear Power Plant</li>
 
<li>StaticSensorReadings.csv – contains readings from 9 static sensors that are situated either around hospitals if not somewhere near to Always Safe Nuclear Power Plant</li>
 
<li>MobileSensorReadings.csv - contains readings from 50 mobile sensors that are attached to cars</li>
 
<li>MobileSensorReadings.csv - contains readings from 50 mobile sensors that are attached to cars</li>
Line 41: Line 41:
 
<li>Join StaticSensorLocations.csv and StaticSensorReadings.csv via the Join function</li>
 
<li>Join StaticSensorLocations.csv and StaticSensorReadings.csv via the Join function</li>
 
<ul>
 
<ul>
<li>Set Join type to be Inner Join and Join Clause to be matching Sensor-id</li>
+
<li>Set Join type to be Inner Join and Join Clause to be matching Sensor-id
 +
[[File:JoinStatic.png|100px]]
 +
</li>
 
<li>This will help to give each static sensor record its respective locations (Long, Lat)</li>
 
<li>This will help to give each static sensor record its respective locations (Long, Lat)</li>
 
<li>Due to conflicting sensor ids with mobile sensors, I have change all the static sensor id to start from 60 to 68.</li>
 
<li>Due to conflicting sensor ids with mobile sensors, I have change all the static sensor id to start from 60 to 68.</li>
 
</ul>
 
</ul>
 
</ol>
 
</ol>

Revision as of 12:33, 13 October 2019

VAST Challenge 2019 MC 2: Managing Radiation Together As A Nation

Problem & Motivation

 

Data Cleaning

 

Dashboard

 

Observations

 

References

Data Cleaning

This dashboard is supported by the following 4 datasets, given in CSV and SHP formats:

  • StaticSensorLocations.csv – contains locations of the static sensors
  • StaticSensorReadings.csv – contains readings from 9 static sensors that are situated either around hospitals if not somewhere near to Always Safe Nuclear Power Plant
  • MobileSensorReadings.csv - contains readings from 50 mobile sensors that are attached to cars
  • StHimark.shp – contains geometry and sensor id for individual neighborhood

Data Transformation on Tableau Prep

  1. Import all CSV files on to Tableau Prep
  2. Join StaticSensorLocations.csv and StaticSensorReadings.csv via the Join function
    • Set Join type to be Inner Join and Join Clause to be matching Sensor-id JoinStatic.png
    • This will help to give each static sensor record its respective locations (Long, Lat)
    • Due to conflicting sensor ids with mobile sensors, I have change all the static sensor id to start from 60 to 68.