Difference between revisions of "IS428 AY2019-20T1 Assign Jessica Yuen Chui Shan"
Csyuen.2016 (talk | contribs) (Created page with "=== To be a Visual Detective - VAST Challenge 2019: Mini-Challenge 2 === '''Assignment Details''' One of St. Himark’s largest employers is the Always Safe nuclear power plan...") |
Csyuen.2016 (talk | contribs) |
||
(36 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
− | = | + | <font size="5">'''To be a Visual Detective - VAST Challenge 2019: Mini-Challenge 2'''</font> |
− | '''Assignment Details | + | |
− | One of St. Himark’s largest employers is the Always Safe nuclear power plant. The pride of the city, it produces power for St. Himark’s needs and exports the excess to the mainland providing a steady revenue stream. However, the plant was not compliant with international standards when it was constructed and is now aging. As part of its outreach to the broader community, Always Safe agreed to provide funding for a set of carefully calibrated professional radiation monitors at fixed locations throughout the city. Additionally, a group of citizen scientists led by the members of the Himark Science Society started an education initiative to build and deploy lower cost homemade sensors, which people can attach to their cars. The sensors upload data to the web by connecting through the user’s cell phone. The goal of the project was to engage the community and demonstrate that the nuclear plant’s operations were not significantly changing the region’s natural background levels of radiation. | + | =Overview Assignment Details= |
+ | One of St. Himark’s largest employers is the Always Safe nuclear power plant. The pride of the city, it produces power for St. Himark’s needs and exports the excess to the | ||
+ | mainland providing a steady revenue stream. However, the plant was not compliant with international standards when it was constructed and is now aging. As part of its outreach | ||
+ | to the broader community, Always Safe agreed to provide funding for a set of carefully calibrated professional radiation monitors at fixed locations throughout the city. | ||
+ | Additionally, a group of citizen scientists led by the members of the Himark Science Society started an education initiative to build and deploy lower cost homemade sensors, which people can attach to their cars. The sensors upload data to the web by connecting through the user’s cell phone. The goal of the project was to engage the community and demonstrate that the nuclear plant’s operations were not significantly changing the region’s natural background levels of radiation. | ||
When an earthquake strikes St. Himark, the nuclear power plant suffers damage resulting in a leak of radioactive contamination. Further, a coolant leak sprayed employees’ cars and contaminated them at varying levels. Now, the city’s government and emergency management officials are trying to understand if there is a risk to the public while also responding to other emerging crises related to the earthquake as well as satisfying the public’s concern over radiation. | When an earthquake strikes St. Himark, the nuclear power plant suffers damage resulting in a leak of radioactive contamination. Further, a coolant leak sprayed employees’ cars and contaminated them at varying levels. Now, the city’s government and emergency management officials are trying to understand if there is a risk to the public while also responding to other emerging crises related to the earthquake as well as satisfying the public’s concern over radiation. | ||
Note: reviewing the city description document may be helpful to understanding the landscape and character of the city. | Note: reviewing the city description document may be helpful to understanding the landscape and character of the city. | ||
− | + | =Problem, Motivation, Objectives= | |
Dataset Import Structure & Process | Dataset Import Structure & Process | ||
Tasks Instruction & Interactive Visualization | Tasks Instruction & Interactive Visualization | ||
− | Your task, as supported by visual analytics that you apply, is to help St. Himark’s emergency management team combine data from the government-operated stationary monitors with data from citizen-operated mobile sensors to help them better understand conditions in the city and identify likely locations that will require further monitoring, cleanup, or even evacuation. Will data from citizen scientists clarify the situation or make it more uncertain? Use visual analytics to develop responses to the questions below. Novel visualizations of uncertainty are especially interesting for this mini-challenge. | + | Your task, as supported by visual analytics that you apply, is to help St. Himark’s emergency management team combine data from the government-operated stationary monitors with data from citizen-operated mobile sensors to help them better understand conditions in the city and identify likely locations that will require further monitoring, cleanup, or even evacuation. Will data from citizen scientists clarify the situation or make it more uncertain? Use visual analytics to develop responses to the questions below. Novel visualizations of uncertainty are especially interesting for this mini-challenge.<br> |
− | Task 1: Visualize radiation measurements over time from both static and mobile sensors to identify areas where radiation over background is detected. Characterize changes over time. | + | <br> |
− | Limit your response to 6 images and 500 words. | + | <b>Task 1</b>: Visualize radiation measurements over time from both static and mobile sensors to identify areas where radiation over background is detected. Characterize changes over time.<br> |
− | Task 2: Use visual analytics to represent and analyze uncertainty in the measurement of radiation across the city. | + | Limit your response to 6 images and 500 words.<br> |
− | a. Compare uncertainty of the static sensors to the mobile sensors. What anomalies can you see? Are there sensors that are too uncertain to trust? | + | <br> |
− | b. Which regions of the city have greater uncertainty of radiation measurement? Use visual analytics to explain your rationale. | + | <b>Task 2</b>: Use visual analytics to represent and analyze uncertainty in the measurement of radiation across the city.<br> |
− | c. What effects do you see in the sensor readings after the earthquake and other major events? What effect do these events have on uncertainty? | + | a. Compare uncertainty of the static sensors to the mobile sensors. What anomalies can you see? Are there sensors that are too uncertain to trust?<br> |
− | Limit your responses to 12 images and 1000 words. | + | b. Which regions of the city have greater uncertainty of radiation measurement? Use visual analytics to explain your rationale.<br> |
− | Task 3: Given the uncertainty you observed in question 2, are the radiation measurements reliable enough to locate areas of concern? | + | c. What effects do you see in the sensor readings after the earthquake and other major events? What effect do these events have on uncertainty?<br> |
− | a. Highlight potential locations of contamination, including the locations of contaminated cars. Should St. Himark officials be worried about contaminated cars moving around the city? | + | Limit your responses to 12 images and 1000 words.<br> |
− | b. Estimate how many cars may have been contaminated when coolant leaked from the Always Safe plant. Use visual analysis of radiation measurements to determine if any have left the area. | + | <br> |
− | c. Indicated where you would deploy more sensors to improve radiation monitoring in the city. Would you recommend more static sensors or more mobile sensors or both? Use your visualization of radiation measurement uncertainty to justify your recommendation. | + | <b>Task 3</b>: Given the uncertainty you observed in question 2, are the radiation measurements reliable enough to locate areas of concern?<br> |
− | Limit your responses to 12 images and 1000 words | + | a. Highlight potential locations of contamination, including the locations of contaminated cars. Should St. Himark officials be worried about contaminated cars moving around the city?<br> |
− | Task 4: Summarize the state of radiation measurements at the end of the available period. Use your novel visualizations and analysis approaches to suggest a course of action for the city. Use visual analytics to compare the static sensor network to the mobile sensor network. What are the strengths and weaknesses of each approach? How do they support each other? | + | b. Estimate how many cars may have been contaminated when coolant leaked from the Always Safe plant. Use visual analysis of radiation measurements to determine if any have left the area.<br> |
− | Limit your response to 6 images and 800 words. | + | c. Indicated where you would deploy more sensors to improve radiation monitoring in the city. Would you recommend more static sensors or more mobile sensors or both? Use your visualization of radiation measurement uncertainty to justify your recommendation.<br> |
− | Task 5: The data for this challenge can be analyzed either as a static collection or as a dynamic stream of data, as it would occur in a real emergency. Describe how you analyzed the data - as a static collection or a stream. How do you think this choice affected your analysis? Limit your response to 200 words and 3 images. | + | Limit your responses to 12 images and 1000 words<br> |
+ | <br> | ||
+ | <b>Task 4</b>: Summarize the state of radiation measurements at the end of the available period. Use your novel visualizations and analysis approaches to suggest a course of action for the city. Use visual analytics to compare the static sensor network to the mobile sensor network. What are the strengths and weaknesses of each approach? How do they support each other?<br> | ||
+ | Limit your response to 6 images and 800 words.<br> | ||
+ | <br> | ||
+ | <b>Task 5</b>: The data for this challenge can be analyzed either as a static collection or as a dynamic stream of data, as it would occur in a real emergency. Describe how you analyzed the data - as a static collection or a stream. How do you think this choice affected your analysis? Limit your response to 200 words and 3 images.<br> | ||
+ | <br> | ||
+ | =Data Preparation= | ||
+ | In the zipped folder, we were given 3 raw datasets namely:<br> | ||
+ | 1) MobileSensorReadings.csv - contains mobile sensor readings from various user IDs from 6 April 2020 0000 to 10 April 2020 2359 and its coordinates (longitude & latitude)<br> | ||
+ | 2) StaticSensorLocations.csv - contains sensor readings of 9 different sensor IDs with the coordinates (longitude & latitude) <br> | ||
+ | 3) StaticSensorReadings.csv - contains static sensor readings from various user IDs from 6 April 2020 0000 to 10 April 2020 2359 and its coordinates (longitude & latitude)<br> | ||
+ | |||
+ | <b>Removing Redundant Data</b><br> | ||
+ | In both MobileSensorReadings.csv and StaticSensorReadings.csv, there is a column named "Units" that were not used in the data pre-processing. Hence, I decided to remove it when I was importing the csv files into Tableau. To do so, | ||
+ | <ul>1. Add StaticSensorReadings.csv into the Panel.</ul> | ||
+ | [[Image:1.png|500px]] | ||
+ | <ul>2. Right click on the column "Units" and click "Hide" for both StaticSensorReadings.csv and MobileSensorReadings.csv<ul> | ||
+ | [[Image:2jess.PNG|500px]]<br> | ||
+ | <br> | ||
+ | <b>Merging StaticSensorReadings.csv and StaticSensorLocations.csv</b><br> | ||
+ | To make the data more accurate and meaningful, I decided to merge StaticSensorReadings.csv with StaticSensorLocations.csv.<br> | ||
+ | [[Image:3jess.PNG|500px]]<br> | ||
+ | I would then save the data from StaticSensorReadings and StaticSensorLocations in a new CSV file. I have named it as SensorReadings.csv<br> | ||
+ | <br> | ||
+ | <b>Merging SensorReadings.csv and MobileSensorReadings.csv</b><br> | ||
+ | Similar to the StaticSensor CSV files, I decided to merge SensorREadings.csv with MobileSensorReadings.csv.<br> | ||
+ | Bear in mind that we need to remove "Units" column in MobileSensorReadings.csv too<br> | ||
+ | <br> | ||
+ | <b>Concat "Static"/"Mobile" with Sensor ID</b><br> | ||
+ | As both MobileSensorReadings.csv and SensorReadings.csv has Sensor ID, I decided to add a "Static" or "Mobile" behind each sensor ID so that it would be clearer for me to understand the data. Hence, I decided to do it to avoid any confusion.<br> | ||
+ | [[Image:4jess.PNG|500px]]<br> | ||
+ | |||
+ | |||
+ | =Interactive Visualization= | ||
+ | The interactive visualization could be found here: | ||
+ | |||
+ | <br> | ||
+ | <b>Home Page</b><br> | ||
+ | I decided to separate the visualizations with tabs labelled <b>Mobile Sensor Visualizations</b> and <b>Static Sensor Visualizations</b>. This helps to give a more user-friendly visualization for the user.<br> | ||
+ | The following is a screenshot of the homepage.<br> | ||
+ | [[Image:Homepagejess.PNG|800px]]<br> | ||
+ | |||
+ | <b>Mobile Sensor Visualization</b><br> | ||
+ | In this visualization, readers would be able to see where the mobile sensors were placed in the map, and using the animated trail, they would be able to see the path that the sensor took based on the timestamp.<br> | ||
+ | [[Image:5.PNG|500px]]<br> | ||
+ | |||
+ | <b>Static Sensor Visualization</b><br> | ||
+ | In this visualization, readers would be able to tell where the static sensors were placed, observe how the readings change over time and readers would be able to observe any patterns of the readings in a glance. | ||
+ | [[Image:5a.PNG|500px]]<br> | ||
+ | |||
+ | To have a better visualization of the data, I decided to customize interactive elements to help the users analyze the data better. The following elements were used: | ||
+ | |||
+ | <table style="text-align: center; width: 100%;" cellspacing="0"> | ||
+ | <tr style="background-color: #3f3f95; color: #fff; border-spacing: 0px;"> | ||
+ | <td style="border: 1px solid #a7a2a2;">Filters/Interactive Feature</td> | ||
+ | <td style="border: 1px solid #a7a2a2;">Rationale</td> | ||
+ | <td style="border: 1px solid #a7a2a2;">Implementation Steps</td> | ||
+ | </tr> | ||
+ | <tr> | ||
+ | <td style="border: 1px solid #a7a2a2;">[[Image:Rationale1jess.PNG|200px]]</td> | ||
+ | <td style="border: 1px solid #a7a2a2;">To allow users to be able to filter based on the desired date.</td> | ||
+ | <td style="border: 1px solid #a7a2a2; text-align: center;"> | ||
+ | <ul>1. Drag Timestamp to "Filter" section.</ul> | ||
+ | <ul>2. In the "Filter Field" popup box, select the format: Month/Date/Year.</ul> | ||
+ | <ul>3. Click Next and you should be able to see the checkboxes.</ul> | ||
+ | </td> | ||
+ | |||
+ | <tr> | ||
+ | <td style="border: 1px solid #a7a2a2;">[[Image:Rationale2jess.PNG|200px]]</td> | ||
+ | <td style="border: 1px solid #a7a2a2;">Users would be able to see an animated trail of mobile sensor movement.</td> | ||
+ | <td style="border: 1px solid #a7a2a2; text-align: center;"> | ||
+ | <ul>1. Drag the Timestamp in Pages section.</ul> | ||
+ | <ul>2. Click on the down arrow key and change the format of timestamp to "Minutes" and custom option of "Date Value".</ul> | ||
+ | </td> | ||
+ | |||
+ | <tr> | ||
+ | <td style="border: 1px solid #a7a2a2;">[[Image:Rationale3jess.PNG|200px]]</td> | ||
+ | <td style="border: 1px solid #a7a2a2;">Allow the user to tell the different mobile/static sensors based on the color code.</td> | ||
+ | <td style="border: 1px solid #a7a2a2; text-align: center;"> | ||
+ | <ul>1. Drag Mobile/Static Sensor to "Colour" under "Marks" section.</ul> | ||
+ | </td> | ||
+ | |||
+ | <tr> | ||
+ | <td style="border: 1px solid #a7a2a2; ">[[Image:Rationale4jess.PNG|200px]]</td> | ||
+ | <td style="border: 1px solid #a7a2a2;">To provide users a better insight of how the different mobile/static sensors progress and changes.</td> | ||
+ | <td style="border: 1px solid #a7a2a2; text-align: center;"> | ||
+ | <ul>After Sensor ID has been dragged into "Marks" section, click on the down arrow key and select "Show Highlighter"</ul> | ||
+ | </td> | ||
+ | |||
+ | <tr> | ||
+ | <td style="border: 1px solid #a7a2a2;"><b>Marking out an animated trail</b></td> | ||
+ | <td style="border: 1px solid #a7a2a2;">To map out the trail that the mobile sensor data has travelled throughout the day.</td> | ||
+ | <td style="border: 1px solid #a7a2a2; text-align: center;"> | ||
+ | Select the following screenshot options.<br> | ||
+ | [[Image:Rationale5jess.png|200px]]<br> | ||
+ | </td> | ||
+ | </tr> | ||
+ | </table> | ||
+ | =Objectives= | ||
+ | This section aims to answer the 5 tasks.<br> | ||
+ | 1) | ||
+ | <b> Mobile Sensors</b><br> | ||
+ | The frequency of mobile sensors were quite consistent for majority of the mobile sensors. However, for <b>mobile sensor 12</b>, there was a significant jump of value at <b>9 April 2020, 2:43:25 AM.</b> This might be a sign that there was an earthquake at where mobile sensor 12 was. <br> | ||
+ | [[Image:1ajess.png|500px]]<br><br><br> | ||
+ | Also, there were missing values for few of the mobile sensors. Below is a screenshot of missing values for <b>mobile sensor 18</b> and <b>mobile sensor 20</b>.<br> | ||
+ | [[Image:1bjess.png|500px]]<br><br><br> | ||
+ | Additionally, we received data of 0 for <b>mobile sensor 25</b> on <b>8 April 2020, 4:27:35 AM</b> till <b>8 April 2020, 9:05:35 AM</b> before it started recording values above 0.<br> | ||
+ | [[Image:1cjess.png|500px]]<br><br><br><br> | ||
+ | |||
+ | <b> Static Sensors </b><br> | ||
+ | As for the static sensors, there were more fluctuation of readings for <b>8 April 2020</b> till <b>10 April 2020</b>. The highest reading received was on <b>9 April 2020, 2:52:35 PM</b> by <b>static sensor 9</b>. <br> | ||
+ | [[Image:1djess.png|500px]]<br><br><br> | ||
+ | The lowest reading received was on <b>10 April 2020, 12:11:10 PM</b> by <b>static sensor 14</b>.<br> | ||
+ | [[Image:1ejess.png|500px]]<br><br><br> | ||
+ | Similar to mobile sensors, there were missing values for <b>static sensor 15</b> on <b>9 April 2020</b> till mid of <b>10 April 2020</b>.<br> | ||
+ | [[Image:1fjess.png|500px]]<br><br><br><br> | ||
+ | |||
+ | 2a) | ||
+ | The following is a screenshot for the static sensor readings from <b>6 April 2020</b> to <b>10 April 2020</b>.<br> | ||
+ | [[Image:StaticTimelinejess.PNG|500px]]<br><br><br> | ||
+ | The following is a screenshot for the mobile sensor readings from <b>6 April 2020</b> to <b>10 April 2020</b>.<br> | ||
+ | [[Image:1jess.PNG|500px]]<br><br><br> | ||
+ | |||
+ | Comparing on both screenshots, the readings for mobile sensors seemed to be quite consistent for 6 April 2020 and 7 April 2020 while static sensors had occasional spikes for some sensors on the first 2 days. However, from 8 April 2020 till 10 April 2020, there had been more consistent spikes which might indicate that an earthquake happened on 8 April 2020. I believe that there are not much uncertainty for static sensors as the data were quite consistent. However, there had been missing data for static sensor 15 for 9 April 2020 and mid of 10 April 2020, hence there are some anomaly. <br> | ||
+ | |||
+ | On the other hand, mobile sensors had been consistent readings apart from mobile sensor 5, 6, 9, 14, 18, 19, 20, 21, 22, 23, 24, 25, 27, 28, 29, 30, 48 and 49. I believe that they had missing data was probably due that the mobile had moved out of the map, hence it was unable to record any readings. <br><br> | ||
+ | [[Image:2ajess.png|500px]]<br><br><br> | ||
+ | Mobile sensor 18 data was only captured ocassionally, and on 6 April 2020, 5:00:10 PM till 7 April 2020, 12:56:00 PM, no data was being recorded. This could be further proved after running the animation during that period of time.<br><br> | ||
+ | [[Image:2bjess.png|500px]]<br> | ||
+ | Additionally, there are only 9 static sensors being recorded in the whole map, so happenings around West Parton, East Parton, Oak Willow and Easton might not be captured. Some sensors also had sudden spikes hence, would be difficult to understand the problems of regions around that sensor. <br> | ||
+ | |||
+ | b) Based on the following screenshot, the regions of city that have greater uncertainty of radiation measurements would be Broadview, Old Town and Jade Bridge. By measuring it based on the highest population variance would mean that these areas would be more likely to have a greater fluctuation values. <br><br> | ||
+ | [[Image:2c.png|500px]] | ||
+ | [[Image:2djess.png|500px]] | ||
+ | [[Image:2ejess.png|500px]]<br><br><br> | ||
+ | |||
+ | c) With reference from both screenshots, there should be an earthquake on 8 April 2020 in late afternoon approximately at around 4.35pm onwards. However, the spikes were not continuous and it started decreasing shortly after the spike had happened. This data hence, might not be credible and left the readers uncertain.<br>[[Image:StaticTimelinejess.PNG|500px]]<br><br><br> | ||
+ | [[Image:1jess.PNG|500px]]<br><br><br> | ||
+ | |||
+ | |||
+ | 3a) | ||
+ | Based on the screenshot below, the biggest area of contamination location would be at Old Town that was caused by Mobile Sensor 12, and the path that was led from Jade Bridge that was caused by Mobile sensor 10. Wilson Forest is also caused by mobile sensor 29. With visualization based on contaminated cars, Downtown and Broadview are potential locations of contamination as user-ids such as HSS has drove through the potential contaminated areas caused by the mobile sensors.<br> | ||
+ | [[Image:3a.PNG|500px]]<br><br><br> | ||
+ | [[Image:3b.PNG|500px]]<br><br><br> | ||
+ | St Himark officals should be worried with regards to the contaminated cars moving around the city as these cars might bring the radiation to areas that were not previously affected. It would be great if these officials take precaution before the radiation spreads to the unaffected areas of St Himark.<br> | ||
+ | <br> | ||
+ | b) | ||
+ | The cars that were contaminated by the coolant leaked are:<br> | ||
+ | <ul>Ckimball, with mobile sensor 46,</ul><br> | ||
+ | <ul>MySensor, with mobile sensor 7,</ul><br> | ||
+ | <ul>CitizenScientist, with mobile sensors 19, 20, and 25</ul><br> | ||
+ | <br> | ||
+ | [[Image:3cjess.PNG|500px]] | ||
+ | [[Image:3d.PNG|500px]] | ||
+ | [[Image:3e.PNG|500px]] | ||
+ | <br><br><br> | ||
+ | Ckimball had drove through with Mobile sensor 46 at Jade Bridge, while CitizenScientist had drove through with Mobile sensor 19, 20, 25 at Downtown and Wilson Forest respectively. Additionally, MySensor had drove through with Mobile sensor 7 at Old Town city. By viewing the path that these 3 cars had taken, it was very likely that they had brought the contamination to other parts of St Himark.<br> | ||
+ | |||
+ | <br> | ||
+ | c) While Static sensors meant that they would not be shifted to any other locations, mobile sensors on the other hand, would be difficult for me to gauge as it is constantly changing its location. I would hence, advise to put 2-3 more static sensors around the map, specifically at the nuclear plant area (Safe Town). This is to ensure that cars that drove past Safe Town would be less likely to get contaminated and hence, bring the radiation to other parts of St. Himark. There could be more static sensors build near Wilson Forest as it was the 2nd highest potential area for contamination. Another alternative would be having 2 static sensors on each of the highway - so as to tackle any cars that are contaminated when they travel in/out of the map. <br> | ||
+ | [[Image:3f.png|500px]]<br><br><br> | ||
+ | 4) As seen from the graphs below, Jade Bridge and Old Town seemed to have the most severe contamination as compared to other regions. Therefore, the management should focus on decominating the 2 areas first before proceeding with other static sensor areas. Likewise, mobile sensor areas of 22, 24, 28, 27, 25, 21, 45, 29 (Terrapin Springs, Wilson Forest, Broadview) should be the priority of decomination as these areas seemed to have a higher contamination as compared to other mobile sensor areas. | ||
+ | [[Image:4a.PNG|500px]] | ||
+ | [[Image:4b.PNG|500px]]<br><br><br> | ||
+ | |||
+ | 5) The data that was given were static collection, however I decided to use the dynamic stream approach as the main idea of this challenge is to allow the management have a better visualization of where they should place their sensors to better monitor the situation in St. Himark. Animation could be used too, to keep track of real time movements as it allows readers to have a better user experience. Hence, this will allow the management to have a quicker response time when any problem arises.<br><br><br> | ||
+ | [[Image:5.PNG|500px]] | ||
+ | [[Image:5a.PNG|500px]]<br><br><br> | ||
− | + | ==References== | |
− | + | 1. https://vast-challenge.github.io/2019/MC2.html | |
− |
Latest revision as of 01:38, 12 October 2019
To be a Visual Detective - VAST Challenge 2019: Mini-Challenge 2
Contents
Overview Assignment Details
One of St. Himark’s largest employers is the Always Safe nuclear power plant. The pride of the city, it produces power for St. Himark’s needs and exports the excess to the mainland providing a steady revenue stream. However, the plant was not compliant with international standards when it was constructed and is now aging. As part of its outreach to the broader community, Always Safe agreed to provide funding for a set of carefully calibrated professional radiation monitors at fixed locations throughout the city. Additionally, a group of citizen scientists led by the members of the Himark Science Society started an education initiative to build and deploy lower cost homemade sensors, which people can attach to their cars. The sensors upload data to the web by connecting through the user’s cell phone. The goal of the project was to engage the community and demonstrate that the nuclear plant’s operations were not significantly changing the region’s natural background levels of radiation. When an earthquake strikes St. Himark, the nuclear power plant suffers damage resulting in a leak of radioactive contamination. Further, a coolant leak sprayed employees’ cars and contaminated them at varying levels. Now, the city’s government and emergency management officials are trying to understand if there is a risk to the public while also responding to other emerging crises related to the earthquake as well as satisfying the public’s concern over radiation. Note: reviewing the city description document may be helpful to understanding the landscape and character of the city.
Problem, Motivation, Objectives
Dataset Import Structure & Process
Tasks Instruction & Interactive Visualization
Your task, as supported by visual analytics that you apply, is to help St. Himark’s emergency management team combine data from the government-operated stationary monitors with data from citizen-operated mobile sensors to help them better understand conditions in the city and identify likely locations that will require further monitoring, cleanup, or even evacuation. Will data from citizen scientists clarify the situation or make it more uncertain? Use visual analytics to develop responses to the questions below. Novel visualizations of uncertainty are especially interesting for this mini-challenge.
Task 1: Visualize radiation measurements over time from both static and mobile sensors to identify areas where radiation over background is detected. Characterize changes over time.
Limit your response to 6 images and 500 words.
Task 2: Use visual analytics to represent and analyze uncertainty in the measurement of radiation across the city.
a. Compare uncertainty of the static sensors to the mobile sensors. What anomalies can you see? Are there sensors that are too uncertain to trust?
b. Which regions of the city have greater uncertainty of radiation measurement? Use visual analytics to explain your rationale.
c. What effects do you see in the sensor readings after the earthquake and other major events? What effect do these events have on uncertainty?
Limit your responses to 12 images and 1000 words.
Task 3: Given the uncertainty you observed in question 2, are the radiation measurements reliable enough to locate areas of concern?
a. Highlight potential locations of contamination, including the locations of contaminated cars. Should St. Himark officials be worried about contaminated cars moving around the city?
b. Estimate how many cars may have been contaminated when coolant leaked from the Always Safe plant. Use visual analysis of radiation measurements to determine if any have left the area.
c. Indicated where you would deploy more sensors to improve radiation monitoring in the city. Would you recommend more static sensors or more mobile sensors or both? Use your visualization of radiation measurement uncertainty to justify your recommendation.
Limit your responses to 12 images and 1000 words
Task 4: Summarize the state of radiation measurements at the end of the available period. Use your novel visualizations and analysis approaches to suggest a course of action for the city. Use visual analytics to compare the static sensor network to the mobile sensor network. What are the strengths and weaknesses of each approach? How do they support each other?
Limit your response to 6 images and 800 words.
Task 5: The data for this challenge can be analyzed either as a static collection or as a dynamic stream of data, as it would occur in a real emergency. Describe how you analyzed the data - as a static collection or a stream. How do you think this choice affected your analysis? Limit your response to 200 words and 3 images.
Data Preparation
In the zipped folder, we were given 3 raw datasets namely:
1) MobileSensorReadings.csv - contains mobile sensor readings from various user IDs from 6 April 2020 0000 to 10 April 2020 2359 and its coordinates (longitude & latitude)
2) StaticSensorLocations.csv - contains sensor readings of 9 different sensor IDs with the coordinates (longitude & latitude)
3) StaticSensorReadings.csv - contains static sensor readings from various user IDs from 6 April 2020 0000 to 10 April 2020 2359 and its coordinates (longitude & latitude)
Removing Redundant Data
In both MobileSensorReadings.csv and StaticSensorReadings.csv, there is a column named "Units" that were not used in the data pre-processing. Hence, I decided to remove it when I was importing the csv files into Tableau. To do so,
- 1. Add StaticSensorReadings.csv into the Panel.
- 2. Right click on the column "Units" and click "Hide" for both StaticSensorReadings.csv and MobileSensorReadings.csv
Merging StaticSensorReadings.csv and StaticSensorLocations.csv
To make the data more accurate and meaningful, I decided to merge StaticSensorReadings.csv with StaticSensorLocations.csv.
I would then save the data from StaticSensorReadings and StaticSensorLocations in a new CSV file. I have named it as SensorReadings.csv
Merging SensorReadings.csv and MobileSensorReadings.csv
Similar to the StaticSensor CSV files, I decided to merge SensorREadings.csv with MobileSensorReadings.csv.
Bear in mind that we need to remove "Units" column in MobileSensorReadings.csv too
Concat "Static"/"Mobile" with Sensor ID
As both MobileSensorReadings.csv and SensorReadings.csv has Sensor ID, I decided to add a "Static" or "Mobile" behind each sensor ID so that it would be clearer for me to understand the data. Hence, I decided to do it to avoid any confusion.
Interactive Visualization
The interactive visualization could be found here:
Home Page
I decided to separate the visualizations with tabs labelled Mobile Sensor Visualizations and Static Sensor Visualizations. This helps to give a more user-friendly visualization for the user.
The following is a screenshot of the homepage.
Mobile Sensor Visualization
In this visualization, readers would be able to see where the mobile sensors were placed in the map, and using the animated trail, they would be able to see the path that the sensor took based on the timestamp.
Static Sensor Visualization
In this visualization, readers would be able to tell where the static sensors were placed, observe how the readings change over time and readers would be able to observe any patterns of the readings in a glance.
To have a better visualization of the data, I decided to customize interactive elements to help the users analyze the data better. The following elements were used:
Objectives
This section aims to answer the 5 tasks.
1)
Mobile Sensors
The frequency of mobile sensors were quite consistent for majority of the mobile sensors. However, for mobile sensor 12, there was a significant jump of value at 9 April 2020, 2:43:25 AM. This might be a sign that there was an earthquake at where mobile sensor 12 was.
Also, there were missing values for few of the mobile sensors. Below is a screenshot of missing values for mobile sensor 18 and mobile sensor 20.
Additionally, we received data of 0 for mobile sensor 25 on 8 April 2020, 4:27:35 AM till 8 April 2020, 9:05:35 AM before it started recording values above 0.
Static Sensors
As for the static sensors, there were more fluctuation of readings for 8 April 2020 till 10 April 2020. The highest reading received was on 9 April 2020, 2:52:35 PM by static sensor 9.
The lowest reading received was on 10 April 2020, 12:11:10 PM by static sensor 14.
Similar to mobile sensors, there were missing values for static sensor 15 on 9 April 2020 till mid of 10 April 2020.
2a)
The following is a screenshot for the static sensor readings from 6 April 2020 to 10 April 2020.
The following is a screenshot for the mobile sensor readings from 6 April 2020 to 10 April 2020.
Comparing on both screenshots, the readings for mobile sensors seemed to be quite consistent for 6 April 2020 and 7 April 2020 while static sensors had occasional spikes for some sensors on the first 2 days. However, from 8 April 2020 till 10 April 2020, there had been more consistent spikes which might indicate that an earthquake happened on 8 April 2020. I believe that there are not much uncertainty for static sensors as the data were quite consistent. However, there had been missing data for static sensor 15 for 9 April 2020 and mid of 10 April 2020, hence there are some anomaly.
On the other hand, mobile sensors had been consistent readings apart from mobile sensor 5, 6, 9, 14, 18, 19, 20, 21, 22, 23, 24, 25, 27, 28, 29, 30, 48 and 49. I believe that they had missing data was probably due that the mobile had moved out of the map, hence it was unable to record any readings.
Mobile sensor 18 data was only captured ocassionally, and on 6 April 2020, 5:00:10 PM till 7 April 2020, 12:56:00 PM, no data was being recorded. This could be further proved after running the animation during that period of time.
Additionally, there are only 9 static sensors being recorded in the whole map, so happenings around West Parton, East Parton, Oak Willow and Easton might not be captured. Some sensors also had sudden spikes hence, would be difficult to understand the problems of regions around that sensor.
b) Based on the following screenshot, the regions of city that have greater uncertainty of radiation measurements would be Broadview, Old Town and Jade Bridge. By measuring it based on the highest population variance would mean that these areas would be more likely to have a greater fluctuation values.
c) With reference from both screenshots, there should be an earthquake on 8 April 2020 in late afternoon approximately at around 4.35pm onwards. However, the spikes were not continuous and it started decreasing shortly after the spike had happened. This data hence, might not be credible and left the readers uncertain.
3a)
Based on the screenshot below, the biggest area of contamination location would be at Old Town that was caused by Mobile Sensor 12, and the path that was led from Jade Bridge that was caused by Mobile sensor 10. Wilson Forest is also caused by mobile sensor 29. With visualization based on contaminated cars, Downtown and Broadview are potential locations of contamination as user-ids such as HSS has drove through the potential contaminated areas caused by the mobile sensors.
St Himark officals should be worried with regards to the contaminated cars moving around the city as these cars might bring the radiation to areas that were not previously affected. It would be great if these officials take precaution before the radiation spreads to the unaffected areas of St Himark.
b)
The cars that were contaminated by the coolant leaked are:
- Ckimball, with mobile sensor 46,
- MySensor, with mobile sensor 7,
- CitizenScientist, with mobile sensors 19, 20, and 25
Ckimball had drove through with Mobile sensor 46 at Jade Bridge, while CitizenScientist had drove through with Mobile sensor 19, 20, 25 at Downtown and Wilson Forest respectively. Additionally, MySensor had drove through with Mobile sensor 7 at Old Town city. By viewing the path that these 3 cars had taken, it was very likely that they had brought the contamination to other parts of St Himark.
c) While Static sensors meant that they would not be shifted to any other locations, mobile sensors on the other hand, would be difficult for me to gauge as it is constantly changing its location. I would hence, advise to put 2-3 more static sensors around the map, specifically at the nuclear plant area (Safe Town). This is to ensure that cars that drove past Safe Town would be less likely to get contaminated and hence, bring the radiation to other parts of St. Himark. There could be more static sensors build near Wilson Forest as it was the 2nd highest potential area for contamination. Another alternative would be having 2 static sensors on each of the highway - so as to tackle any cars that are contaminated when they travel in/out of the map.
4) As seen from the graphs below, Jade Bridge and Old Town seemed to have the most severe contamination as compared to other regions. Therefore, the management should focus on decominating the 2 areas first before proceeding with other static sensor areas. Likewise, mobile sensor areas of 22, 24, 28, 27, 25, 21, 45, 29 (Terrapin Springs, Wilson Forest, Broadview) should be the priority of decomination as these areas seemed to have a higher contamination as compared to other mobile sensor areas.
5) The data that was given were static collection, however I decided to use the dynamic stream approach as the main idea of this challenge is to allow the management have a better visualization of where they should place their sensors to better monitor the situation in St. Himark. Animation could be used too, to keep track of real time movements as it allows readers to have a better user experience. Hence, this will allow the management to have a quicker response time when any problem arises.