IS428 AY2019-20T1 Assign Ng Kai Ling Bernice

From Visual Analytics for Business Intelligence
Revision as of 15:42, 4 October 2019 by Bernice.ng.2016 (talk | contribs)
Jump to navigation Jump to search

Title ng kai ling bernice va.png


Contents

Problem & Motivation

After major events like earthquakes hits St. Himark, Always Safe nuclear power plant suffers damage resulting in a leak of radioactive contamination. Further, a coolant leak sprayed employees’ cars and contaminated them at varying levels. Therefore, the need to help St. Himark’s emergency management team combine data from the government-operated stationary monitors with data from citizen-operated mobile sensors and data visualizations to help them better understand conditions in the city and identify likely locations that will require further monitoring, cleanup, or even evacuation.

With data visualization in place, it can help analyze the following:

  • Gives users an overview of radiation levels in the area over a period of time.
  • Identifying uncertainties and anomalies in the dataset provided.
  • Allow users to identify location of concern and car contamination.



Dataset Transformation

Before proceeding to explain how data is transformed to prepare for data visualization, we were given 3 datasets in csv format as follows:

  • MobileSensorReadings.csv: contains radiation level measurements from various mobile sensors over a period of time.
  • StaticSensorReadings.csv: contains radiation level measurements from various static sensors placed in specific locations over a period of time.
  • StaticSensorLocations.csv: contains location information on where the static sensors are placed at.

In addition to that, shapefiles which are used for creating custom choropleth map were provided.

Removing Redundant Data

However, in the given data (both MobileSensorReadings and StaticSensorReadings), the "Units" column has "cpm" for all the values as shown below which is not in use.

Mobile Sensors Data

Mobile sensor data - redundant data ng kai ling bernice.png

Static Sensors Data

Static sensor data - redundant data ng kai ling bernice.png

Solution: Hence, by using Tableau Prep Builder, the "Units" column are removed by following the steps shown below.

Steps to remove redundant data ng kai ling bernice.png

Dataset Import Structure & Process

With the dataset analysis and transformation phase completed, the following files will have to be imported into Tableau for analysis:

  • MobileSensorReadings.csv (formatted from data Transformation)
  • StaticSensorReadings.csv (formatted from data Transformation)
  • StaticSensorLocations.csv (formatted from data Transformation)
  • StHimark.shp (shapefile)

Data Connections

  • MobileSensorReadings.csv

    MobileSensorReadings.csv is added as a data connection without any further processing.


  • StaticSensorLocations.csv

    StaticSensorLocations.csv is added as another source inner joined with StaticSensorReadings.csv. Below are the steps to further process the data (refer to the image show below):

  • Import StaticSensorLocations.csv as a data source.
  • Drag StaticSensorReadings.csv from the left panel to th top right panel.
  • Add inner join between these 2 data, mapping "Sensor-id" from StaticSensorLocations.csv connection to "=" with "Sensor-id" from StaticSensorReadings.csv connection

Static readings and location sensor join data ng kai ling bernice.png


  • StHimark.shp

    StHimark.shp is added as another data source inner joined with the MobileSensorReadings.csv. Below are the steps to further process the data (refer to the image show below):

  • Import StHimark.shp as a data source.
  • Import another connection using MobileSensorReadings.csv file.
  • Add inner join between these 2 data source, mapping "Geometry" from StHimark.shp connection to "Intersects" with "MAKEPOINT([Lat],[Long])" from MobileSensorReadings.csv connection.

Shapefile mobile sensor join data ng kai ling bernice.png


Interactive Visualization

The Interactive Radiation Assessment System (IRAS) can be accessed here: https://public.tableau.com/views/MiniCase2Assignment-Bernice/Introduction?:embed=y&:display_count=yes&publish=yes&:origin=viz_share_link

The following sections are divided into individual dashboard pages to elaborate on the interactivity.

Introduction Page

There is a large amount of data captured in the datasets provided. Furthermore, due to the many possible insights that can be driven from the dataset, it is not wise to put all the visual analytics into a single page dashboard. It will also be easier to divide the charts and visual analytics into meaning categories or pages to provide clarity. Flexibility has to be provided for navigation due to multiple pages of the dashboard. To do so, an "Introduction" page is created with a brief introduction and 2 different navigation categories: (1) Overview and (2) Areas of Contamination.

The following shows the introduction dashboard page:

Dashboard - intro ng kai ling bernice.png

Filters/Interactive Feature Rationale
Navigation button To provide users the ease in moving from one dashboard page to another.
  1. Create a dashboard sheet in tableau
  2. Drag "Button" object into the design area
  3. In the popup, change button type to "Text Button", title to "OVERVIEW", change the navigation to overview dashboard page and change the colour under the "Background" field.

Implementation steps - intro page ng kai ling bernice.png

Overview Page

Below depicts the overview dashboard page, showing insights for both static and mobile sensors as follows:

  • Area of contamination across the available time period.
  • Contaminated areas shown per day.
  • Variance of the radiation measurements throughout the whole period of time.

Dashboard - overview ng kai ling bernice.png

Filters/Interactive Feature Rationale Implementation Steps
Navigation button To provide users the ease in moving from one dashboard page to another.

Refer to Home Dashboard for implementation steps

Areas of Contamination Page

Dashboard page shown below allows users to identify the locations and cars contaminated by radiation in detail.

Dashboard - aoc ng kai ling bernice.png

Filters/Interactive Feature Rationale Implementation Steps
Navigation button To provide users the ease in moving from one dashboard page to another.

Refer to Home Dashboard for implementation steps

Filter Radiation per Sensor chart by each sensor

Feature - static sensor filter ng kai ling bernice.png

To allow users to analyze radiation levels for each static sensors, helping them to better identify areas of concern for the government to take actions.
  1. Drag SensorID field from static sensor data to the filter pane.
  2. Select only the first option in the popup.

Implementation steps - aoc filter static sensor 1 ng kai ling bernice.png

  1. Click on the arrow and select show filter.
  2. On the filter, click on the top right arrow and select drop down list.

Implementation steps - aoc filter static sensor ng kai ling bernice.png

Filter locations of cars at a particular time Feature - chart timestamp filter ng kai ling bernice.png

To allow users to identify whether cars are contaminated or not in the other chart while using static data to support it.
  1. Click on the "Worksheet" menu in tableau and select "Actions"
  2. Click on "Add Action" followed by "Filter".
  3. Rename the filter action.
  4. In the source sheet section, choose "Contaminated Areas" dashboard and click on "Average radiation per sensor per second" sheet.
  5. In the target sheet section, choose "Contaminated Areas" dashboard and click on "Car location at specific time" sheet.
  6. Change run action to "Select" and add filter with seconds of the timestamp (with the calendar icon).
  7. Click "OK" to save.

Implementation steps - aoc chart filter ng kai ling bernice.png

Filter cars in the particular area by selecting area Feature - filter cars in particular location ng kai ling bernice.png

To allow users to identify which cars are in which location at which day to assist in showing whether car has left the area or not.
  1. Click on the "Worksheet" menu in tableau and select "Actions"
  2. Click on "Add Action" followed by "Filter".
  3. Rename the filter action.
  4. In the source sheet section, choose "Contaminated Areas" dashboard and click on "Car location at specific time" sheet.
  5. In the target sheet section, choose "Contaminated Areas" dashboard and click on "Car selected and date" sheet.
  6. Change run action to "Select" and add filter with seconds of the timestamp (with the calendar icon) and add user sensor ID (a calculated field to join user ID and sensor ID).
  7. Click "OK" to save.

Implementation steps - aoc filter cars ng kai ling bernice.png

Filter cars on specific day Feature - aoc filter cars leaving ng kai ling bernice.png

To help users identify whether contaminated cars have left the area and through which route.
  1. Drag user sensor ID (a calculated field that joins user ID and sensor ID) and timestamp to the filter pane.
  2. Select the first option for the user sensor ID.

Implementation steps - aoc car leaving filter 1 ng kai ling bernice.png

  1. Select day of timestamp with the "#" icon.
  2. Repeat step 2 for timestamp.
  3. Click on the arrow on the right side of user sensor ID in filter pane and select "Show Filter".
  4. On the filter that appeared on the right side, click on the arrow an choose drop down list.
  5. Repeat step 4 and 5 for timestamp filter.

Implementation steps - aoc car leaving filter 3 ng kai ling bernice.png

Questions & Observations

Q1) Visualize radiation measurement and characterize changes over time.

Visualize radiation measurements (from both static and mobile sensors) to identify areas where radiation over background is detected. Characterize changes over time. (Limit your response to 6 images and 500 words)
  1. Generally, the frequency of radiation increases as in the later part of the available period (refer to Figure 1.1.1).
  2. Radiation measurements fluctuate heavily (refer to Figure 1.1.2) which can be caused by the air movement in certain directions (towards or away from sensors).
  3. The locations with sensor readings of high frequency of radiation level above 75 are potential places of contamination.
  4. Although the average radiation for most places over the entire available period is lower than 75 cpm (refer to Figure 1.1.3), it does not mean that the location is not contaminated. This is because, by looking at Figure 1.1.1, you can still see that the sensors did detect high levels of radiation every now and then.

Q2) Use visual analytics to represent and analyze uncertainty in the measurement of radiation across the city.

(Limit your responses to 12 images and 1000 words)

A) Compare uncertainty of the static sensors to the mobile sensors. What anomalies can you see? Are there sensors that are too uncertain to trust?

Uncertainty of static sensors:

  1. Only records the radiation level within receivable area where the sensors are places and hence not representative of the level of radiation in the area. This is especially so where sensors are placed nearer to the borders of the area (refer to Figure 2.1.1).
  2. Only 9 static sensors are installed. This means that certain areas’ radiation is not measured (refer to Figure 2.1.1).


Uncertainty of mobile sensors:

  1. Unable to measure the radiation level changes in a single location as the sensors are moving to different areas. Unless it is placed at a location without moving.
  2. Because it is a moving target, it can bring radiation to the various locations, contaminating the area without being able to measure it.

Anomalies:

  1. The static sensors have sudden increase and decrease in radiation measurement in a matter of a minute. These measurements should not fluctuate with such big difference (refer to Figure 2.1.2). This makes it difficult to understand the real areas of concerns.

B) Which regions of the city have greater uncertainty of radiation measurement? Use visual analytics to explain your rationale.

The top 3 cities that have greater uncertainty of radiation measurements are Broadview, Old Town followed by Jade Bridge. This is because that they have the biggest population variance value as compared to the rest of the cities (refer to Figure 2.2.1) which means that there is a bigger difference in the fluctuated radiation values measured.

C) What effects do you see in the sensor readings after the earthquake and other major events? What effect do these events have on uncertainty?

Earthquakes could have contributed to the movement of the air, causing the fluctuations of radiation measurement (refer to Figure 1.1.1). With these, it can cause uncertainties on areas of concerns and what actions to take.

Q3) Given the uncertainty you observed in question 2, are the radiation measurements reliable enough to locate areas of concern?

(Limit your responses to 12 images and 1000 words)

A) Highlight potential locations of contamination, including the locations of contaminated cars. Should St. Himark officials be worried about contaminated cars moving around the city?

Contaminated by cars:

  • Downtown
  • Old Town
  • Broadview

Contaminated locations:

  • Jade Bridge
  • Palace Hills
  • Southwest
  • Safe Town
  • Cheddarford
  • Wilson Forest

St. Himark officials should be worried about contaminated cars moving around the city. This is because, there is a possibility that cars can carry radiation with them wherever it goes. Using the sensors to measure radiation in cpm, you will not know the strength of the radiation as well. From Figure 3.1.1, we can see that when the static sensor in Downtown first measured radiation above 75 cpm, ProfessorSievert’s car was nearby. Thereafter, there wasn’t much cars nearby and the values started to fluctuate even more frequently till the end of available period. This shows that there is a potential that contaminated cars can potentially contaminate the area it went as well.
As for the contaminated locations identified, it was done by checking frequencies of fluctuations and if there were any cars nearby (refer to Figure 3.1.2).

B) Estimate how many cars may have been contaminated when coolant leaked from the Always Safe plant. Use visual analysis of radiation measurements to determine if any have left the area.

Estimated 4 cars to be contaminated. Specifically, Ckimball (car with sensor ID 46), CitizenScientist (car with sensor ID 19, 20, 25) and MySensor (car with sensor ID 7) cars. From Figure 3.1.1, you can see that the very first radiation measurement took a sudden increase, CitizenScientist’s car with sensor ID 19 and 20 were nearby Downtown city. The same goes to CitizenScientist’s car with sensor ID 25 being nearby to Broadview, and MySensor’s car with sensor ID 7 near Old Town city. There are instances where contaminated cars left by Wilson Forest Highway (CitizenScientist’s car with sensor ID 25), Jade Bridge (Ckimball’s and MySensor’s car with sensor IDs 46 and 7 respectively). Taking Figure 3.2.1 as an example, there is measurements of radiation moving towards each of the mentioned above and coming back after a few hours. Hence a possibility that the contaminated car could have left the area and brought the contamination to other areas.

C) Indicated where you would deploy more sensors to improve radiation monitoring in the city. Would you recommend more static sensors or more mobile sensors or both? Use your visualization of radiation measurement uncertainty to justify your recommendation.

Since mobile sensors can move from one place to another, it will be difficult to measure changes over time. You can also refer to Figure 1.1.1 to see how the radiation level can fluctuate over time which might be due to wind directions and so having static sensors are not enough. Hence, I would suggest the use of both static and mobile sensors. I would place 1 – 3 static sensors to areas depending on the size of the area. For example, I would put 3 static sensors spread out in areas like Broadview and Safe Town. Also, place the sensors not near the borders but spread out. By doing so can improve coverage of the area. This can also help to monitor the radiation levels over time. I would also use 1 – 2 mobile sensors to even improve on the coverage in each area. However, I would only dispatch mobile sensors to move within the area only as there could be a risk of contaminated cars contaminating the area with radiation as well (refer to Figure 3.1.1). For example, mobile sensor 1 can only move within Palace Hills.

Q4) Summarize radiation measurement and compare static sensor network to mobile sensor network.

Summarize the state of radiation measurements at the end of the available period. Use your novel visualizations and analysis approaches to suggest a course of action for the city. Use visual analytics to compare the static sensor network to the mobile sensor network. What are the strengths and weaknesses of each approach? How do they support each other? (Limit your response to 6 images and 800 words)

Evacuate those who need medical help to hospitals in Terrapin Springs and Southon as these 2 areas are not suspected to be heavily contaminated by radiation. Meanwhile, modify the sensor network allocation to improve the monitoring. As mentioned in question 3, the course of action would be dispatching 1 – 2 mobile sensors within each area and deploy 1- 3 static sensors in each area depending on the size of the areas.
If we have a static sensor network all over the country, it will be difficult to get an accurate gauge of the area’s condition as static sensors cannot get the measurement of certain parts of the area (refer to Figure 1.1.1 for the fluctuated measurement of radiation). However, if we have mobile sensor network all over the country, it will be difficult to understand the radiation changes over time of a part of the area. Furthermore, as mentioned previously, cars can potentially get contaminated and cause the area it went to, to be contaminated as well (refer to Figure 3.1.1). However, having a combination of both can help provide data to support each other. With the static data, it can give an overview of the radiation changes over time. On the other hand, mobile data can help to see if other parts of the area radiation level. Having these 2 in place, you can use mobile data to identify cars that are contaminated while justifying whether the static data is reliable or not. With this hybrid sensor network in place, it can help to identify the areas of concern and actionable to the situation.

Q5) The data for this challenge can be analyzed either as a static collection or as a dynamic stream of data, as it would occur in a real emergency. Describe how you analyzed the data - as a static collection or a stream. How do you think this choice affected your analysis?

(Limit your response to 200 words and 3 images)



Appendix

Figure 1.1.1 Radiation measurement fluctuation

F1.1.1 ng kai ling bernice.png


Figure 1.1.2 Population variance of radiation fluctuation per location (mobile sensors)

F1.1.2 ng kai ling bernice.png


Figure 1.1.3 Average radiation across a period of time

F1.1.3 ng kai ling bernice.png


Figure 2.1.1 Location of all static sensors

F2.1.1 ng kai ling bernice.png


Figure 2.1.2 Population variance of radiation fluctuation per location (static sensors)

F2.1.2 ng kai ling bernice.png


Figure 2.2.1 Average radiation across a period of time

F2.2.1 ng kai ling bernice.png


Figure 3.1.1 Radiation contaminated cars

F3.1.1 ng kai ling bernice.png


Figure 3.1.2 No cars nearby static sensors when measured high radiation

F3.1.2 ng kai ling bernice.png


Figure 3.2.1 Contaminated car exits area

F3.2.1 ng kai ling bernice.png

References

Comments