Difference between revisions of "IS428 AY2019-20T1 Assign Fresi"

From Visual Analytics for Business Intelligence
Jump to navigation Jump to search
(Created page with "== Problem & Motivation == <p>St. Himark is a vibrant community with a population of 246,839 people located in the Oceanus Sea. It also home to the Always Safe nuclear power p...")
 
Line 10: Line 10:
  
 
== Dataset Analysis & Transformation Process ==
 
== Dataset Analysis & Transformation Process ==
The data zip folder contains 1 shapefile folder, 4 maps of St Himark city, and 3 CSV files.
+
<p>The data zip folder contains 1 shapefile folder, 4 maps of St Himark city, and 3 CSV files.</p>
The 3 CSV files are:
+
<p>The 3 CSV files are:</p>
 
* StaticSensorLocations.csv
 
* StaticSensorLocations.csv
 
* StaticSensorReadings.csv
 
* StaticSensorReadings.csv
 
* MobileSensorReadings.csv
 
* MobileSensorReadings.csv
 +
 +
=== Static Sensors ===
 +
<p>There are 9 static sensors in St. Himark based on the picture above, where one sensor (sensor-id 15) is placed at the entrance to the Always Safe nuclear power plant and eight dispersed around the city. These detectors provide near-real-time monitoring in the unlikely event of a radiological emergency. </p>
 +
 +
[[File:Fresi_DC_1.png|600px|center]]
 +
<p>Looking on the static sensor location data, we notice a problem.</p>
 +
<p>'''Issue:''' The StaticSensorReadings lacks of location-id and the neighbourhood attributes</p>
 +
<p>'''Solution:''' Using the StaticSensorLocations and Figure 1, we update the record by adding additional 2 column which are (1) location-id and (2) neighbourhood.</p>
 +
[[File:Fresi_DC_2.png|600px|center]]
 +
 +
=== Mobile Sensors ===
 +
<p>There are 50 mobile sensors attached to the vehicles. The timestamps are reported in 5-second intervals. The locations travelled by the mobile sensors are based on the longitude and latitude values. </p>
 +
[[File:Fresi_DC_3.png|600px|center]]
 +
<p>'''Issue:''' Like StaticSensorLocations.csv’s problem, the MobileSensorReadings.csv only has Longitude and Latitude attributes to match the vehicle with its location.</p>
 +
<p>'''Solution:''' Combine the MobileSensorReading.csv to St.Himark.sph by using inner join function in Tableau.</p>
 +
[[File:Fresi_DC_4.png|600px|center]]
 +
<p>We use inner join (Intersects) between Join calculation of MAKEPOINT([Lat], [Long]) on MobileSensorReadings.csv and Geometry on St.Himark.shp.</p>
 +
[[File:Fresi_DC_5.png|600px|center]]
 +
<p>Once done, Tableau will produce three additional attributes, which are (1) Id – neighbourhood id number, (2) Neighbourhood, and (3) Geometry.</p>
 +
 +
=== Combining Static and Mobile Data ===
 +
<p>Next, we need to combine the static and the mobile sensor data together. The structure of the captured data by both the static sensor and mobile sensor is similar. However, the static sensor doesn’t have a longitude and latitude attributes and therefore unable to identify the exact location of the sensor. Below image shows the main differences of attributes between static and mobile data captured:</p>
 +
[[File:Fresi_DC_6.png|600px|center]]
 +
<p>The following section illustrates the issues faced in the data analysis phase and the data transformation needed to create the desired data structure used for insight generation. </p>
 +
<p>'''Issue: ''' The details of Longitude and Latitude of the static sensor is presented in the StaticSensorLocation instead of StaticSensorReading. We need to combine the two data together to enable the visualization of static sensor location on the St. Himark’s map. </p>
 +
[[File:Fresi_DC_7.png|600px|center]]
 +
<p> '''Solution: ''' Combine the StaticSensorLocation file with the StaticSensorReading file by using inner joint of sensor-id in Tableau Prep.  </p>
 +
[[File:Fresi_DC_8.png|600px|center]]
 +
<p>Once the data is joined, there will be a duplicate of Sensor-id1 attributes which we removed afterwards through the cleaning process. At the end in the Output 2 (picture below), we have the StaticSensorReading with the Latitude and Longitude attributes.</p>
 +
[[File:Fresi_DC_9.png|600px|center]]
 +
<p>'''Issue: ''' The details of Longitude and Latitude of the static sensor is presented in the StaticSensorLocation instead of StaticSensorReading. We need to combine the two data together to enable the visualization of static sensor location on the St. Himark’s map. </p>
 +
[[File:Fresi_DC_7.png|600px|center]]
 +
<p> '''Solution: ''' Combine the StaticSensorLocation file with the StaticSensorReading file by using inner joint of sensor-id in Tableau Prep.  </p>
 +
[[File:Fresi_DC_8.png|600px|center]]

Revision as of 16:58, 12 October 2019

Problem & Motivation

St. Himark is a vibrant community with a population of 246,839 people located in the Oceanus Sea. It also home to the Always Safe nuclear power plant, a 200 Megawatts electric (MWe) pressurized water reactor (PWR). The Always Safe nuclear power plant provides 72% of the city’s electricity and provides jobs for 700 highly skilled professionals. It has always been the pride of the city, yet it was not quite built to be compliant with the recommended safety standards developed by international organizations and is now ageing.

The nuclear plant sustained moderate (but not life-threatening) damage during the earthquake resulting in some contamination being released. Further, a coolant leak sprayed employees’ cars and contaminated them at varying levels. The city has installed stationary sensors which could be used to determine affected areas, but they don’t cover all parts of the city. Luckily, the Himark Science Society has stepped in with citizen scientists to help crowdsource this important task. Utilize these various sensors to understand which parts of the city are most affected. Meanwhile, mayor Jordan, city officials, and emergency services are overwhelmed and are desperate for assistance in understanding the true situation on the ground and how best to deploy the limited resources available to this relatively small community.

With the huge amount of contamination data collected from the sensors reading, there is a need to build an interactive comprehensive visualization platform to monitor which parts of the city are the most affected.

The interactive visualization will focus on:

  • The monitoring of Static sensors reading, one at the entrance to the Always Safe nuclear power plant and eight dispersed around the city.
  • The monitoring of 50 mobile sensors that travel in and out of the city.
  • Understanding the observation and identify the anomalies from the static and mobile sensor reading.
  • Identifying the area/s that are heavily affected by the contamination and dispatch necessary help for its citizens.

Dataset Analysis & Transformation Process

The data zip folder contains 1 shapefile folder, 4 maps of St Himark city, and 3 CSV files.

The 3 CSV files are:

  • StaticSensorLocations.csv
  • StaticSensorReadings.csv
  • MobileSensorReadings.csv

Static Sensors

There are 9 static sensors in St. Himark based on the picture above, where one sensor (sensor-id 15) is placed at the entrance to the Always Safe nuclear power plant and eight dispersed around the city. These detectors provide near-real-time monitoring in the unlikely event of a radiological emergency.

Fresi DC 1.png

Looking on the static sensor location data, we notice a problem.

Issue: The StaticSensorReadings lacks of location-id and the neighbourhood attributes

Solution: Using the StaticSensorLocations and Figure 1, we update the record by adding additional 2 column which are (1) location-id and (2) neighbourhood.

Fresi DC 2.png

Mobile Sensors

There are 50 mobile sensors attached to the vehicles. The timestamps are reported in 5-second intervals. The locations travelled by the mobile sensors are based on the longitude and latitude values.

Fresi DC 3.png

Issue: Like StaticSensorLocations.csv’s problem, the MobileSensorReadings.csv only has Longitude and Latitude attributes to match the vehicle with its location.

Solution: Combine the MobileSensorReading.csv to St.Himark.sph by using inner join function in Tableau.

Fresi DC 4.png

We use inner join (Intersects) between Join calculation of MAKEPOINT([Lat], [Long]) on MobileSensorReadings.csv and Geometry on St.Himark.shp.

Fresi DC 5.png

Once done, Tableau will produce three additional attributes, which are (1) Id – neighbourhood id number, (2) Neighbourhood, and (3) Geometry.

Combining Static and Mobile Data

Next, we need to combine the static and the mobile sensor data together. The structure of the captured data by both the static sensor and mobile sensor is similar. However, the static sensor doesn’t have a longitude and latitude attributes and therefore unable to identify the exact location of the sensor. Below image shows the main differences of attributes between static and mobile data captured:

Fresi DC 6.png

The following section illustrates the issues faced in the data analysis phase and the data transformation needed to create the desired data structure used for insight generation.

Issue: The details of Longitude and Latitude of the static sensor is presented in the StaticSensorLocation instead of StaticSensorReading. We need to combine the two data together to enable the visualization of static sensor location on the St. Himark’s map.

Fresi DC 7.png

Solution: Combine the StaticSensorLocation file with the StaticSensorReading file by using inner joint of sensor-id in Tableau Prep.

Fresi DC 8.png

Once the data is joined, there will be a duplicate of Sensor-id1 attributes which we removed afterwards through the cleaning process. At the end in the Output 2 (picture below), we have the StaticSensorReading with the Latitude and Longitude attributes.

Fresi DC 9.png

Issue: The details of Longitude and Latitude of the static sensor is presented in the StaticSensorLocation instead of StaticSensorReading. We need to combine the two data together to enable the visualization of static sensor location on the St. Himark’s map.

Fresi DC 7.png

Solution: Combine the StaticSensorLocation file with the StaticSensorReading file by using inner joint of sensor-id in Tableau Prep.

Fresi DC 8.png