Difference between revisions of "IS428 AY2019-20T1 Assign He Yicheng: Observations"

From Visual Analytics for Business Intelligence
Jump to navigation Jump to search
 
(18 intermediate revisions by the same user not shown)
Line 4: Line 4:
 
{|style="background-color:#f0f0f0; color:#000000; padding: 10 0 10 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" |
 
{|style="background-color:#f0f0f0; color:#000000; padding: 10 0 10 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" |
 
| style="padding:0.3em; font-size:100%; background-color:#f0f0f0;  font-weight:300;font-size:14px;border-bottom:0px solid #000000; text-align:center; color:#000000" width="19%" |  
 
| style="padding:0.3em; font-size:100%; background-color:#f0f0f0;  font-weight:300;font-size:14px;border-bottom:0px solid #000000; text-align:center; color:#000000" width="19%" |  
[[IS428 AY2019-20T1 Assign Heyc|<font color="#000000">Background</font>]]
+
[[IS428 AY2019-20T1 Assign He Yicheng|<font color="#000000">Background</font>]]
  
 
| style="border-bottom:0px solid #f0f0f0; background:none;" width="1%" |
 
| style="border-bottom:0px solid #f0f0f0; background:none;" width="1%" |
 
| style="padding:0.3em; font-size:100%; background-color:#f0f0f0;  font-weight:300;font-size:14px;border-bottom:0px solid #000000; text-align:center; color:#000000" width="19%" |  
 
| style="padding:0.3em; font-size:100%; background-color:#f0f0f0;  font-weight:300;font-size:14px;border-bottom:0px solid #000000; text-align:center; color:#000000" width="19%" |  
[[IS428_AY2019-20T1_Assign_He Yicheng: Dataset Processing|<font color="#000000">Dataset Processing</font>]]
+
[[IS428_AY2019-20T1_Assign_He Yicheng: Preparation|<font color="#000000">Preparation</font>]]
  
 
| style="border-bottom:0px solid #f0f0f0; background:none;" width="1%" |
 
| style="border-bottom:0px solid #f0f0f0; background:none;" width="1%" |
Line 25: Line 25:
 
<!-- Header End -->
 
<!-- Header End -->
  
<div style="font-weight:300;padding: 10px 13px 20px 13px; line-height:10px;font-family:HelveticaNeue-Light, Helvetica Neue Light, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:40px">Observations</font></div>
+
<div style="font-weight:300;padding: 10px 13px 20px 13px; line-height:30px;font-family:HelveticaNeue-Light, Helvetica Neue Light, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:40px">Observations<br></font></div>
 +
 
 +
== <div style="font-weight:300;padding: 10px 13px 20px 13px; line-height:30px;font-family:HelveticaNeue-Light, Helvetica Neue Light, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:25px">Question 1</font></div>==
 +
 
 +
<div style="font-weight:300;margin-bottom: 60px;margin-top:15px;max-width:700px;margin-left:15px;font-family:HelveticaNeue-Light, Helvetica Neue Light, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:17px;>
 +
Visualize radiation measurements over time from both static and mobile sensors to identify areas where radiation over background is detected. Characterize changes over time.
 +
 
 +
[[File:yc mc q1 00.png|800px]]<br>
 +
[[File:yc mc q1 01.png|800px]]<br>
 +
 
 +
Before Wednesday afternoon, the static sensors’ readings remained calm with some random spikes from time to time. There were signs of more frequent reading spikes from sensors 12, 13, 14 and 15. Sensor 12, near the Power Plant shows ever increasing readings from 18:00 onwards. This is followed by increased readings at sensor 11 (Broadview Community Hospital) and Sensor 9 (Broadview). Sensor 15 (Weston) stopped working after 22:06 on Wednesday.
 +
 
 +
[[File:yc mc 00.png|800px]]<br>
 +
 
 +
The graph above shows the mobile sensor readings on Thursday at 7:59. From the graph, we can see big bubbles such as Sensor 39, 42, 33 and 35 which surround the Power Plant. Surprisingly, Sensor 1, which is far away from the plant, is having a reading as high as those sensors that are closer to the plant.
 +
</div>
 +
 
 +
== <div style="font-weight:300;padding: 10px 13px 20px 13px; line-height:30px;font-family:HelveticaNeue-Light, Helvetica Neue Light, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:25px">Question 2</font></div>==
 +
 
 +
<div style="font-weight:300;margin-bottom: 60px;margin-top:15px;max-width:700px;margin-left:15px;font-family:HelveticaNeue-Light, Helvetica Neue Light, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:17px;>
 +
 
 +
2a. Compare uncertainty of the Static sensor to the Mobile sensor. What anomalies can you see? Are there sensors that are too uncertain to trust?
 +
 
 +
[[File:yc mc 01.png|700px]]<br>
 +
 
 +
For the static sensors, the sensors are generally consistent in the readings. However, Sensor 15 stopped working from Wednesday 22:00 to Friday 21:00. Despite the random spikes from time to time, the overall readings from all sensors seem in sync. From the running total graph above, we can see the ultimate consistency of readings across all the static sensors from Monday to Evening of Wednesday. Afterwards, readings from sensor 12 and 11 and 9 started to raise faster than rest sensors, standing out in the running total graph. Interestingly, sensor is relatively far from the plant yet having readings that grow faster than many other sensors.
 +
 
 +
For the mobile sensors, it is obvious to spot the huge inconsistency across the 50 sensors with many irregular readings as well as missing readings.
 +
 
 +
[[File:yc mc 03.png|700px]]<br>
 +
 
 +
Take the sensor 5 and 6 as an example. From the graph above, we can spot obvious differences in their patterns.
 +
 
 +
[[File:yc mc 02.png|700px]]<br>
 +
[[File:yc mc 04.png|700px]]<br>
 +
[[File:yc mc 05.png|700px]]<br>
 +
[[File:yc mc 09.png|700px]]<br>
 +
The graphs above shows that those sensors have missing readings with unknown reasons.
 +
 
 +
[[File:yc mc 08.png|700px]]<br>
 +
Sensor 27, 28 and 29 have similar consistent readings, but end with missing readings as well.
 +
 
 +
[[File:yc mc 06.png|700px]]<br>
 +
Sensor 18 has one of the most irregular readings with many pauses of readings across the week.
 +
 
 +
Sensors mentioned above should be treated with caution.
 +
 
 +
[[File:yc mc 10.png|700px]]<br>
 +
From the running total graph above, we can see some patterns across the sensors with 3 clusters and a few outliers.
 +
 
 +
 
 +
 
 +
2b. Which regions of the city have greater uncertainty of radiation measurement? Use visual analytics to explain your rationale.
 +
[[File:yc mc 11.png|700px]]<br>
 +
 
 +
To see the regions with high uncertainty, filter the sensors on the map to only show those with high uncertainty patterns.
 +
 
 +
[[File:yc mc 13.png|700px]]<br>
 +
 
 +
Referring to the map graph above, the areas that may have greater uncertainty will be around the North East of Safe Town, near the power plant, North region such as Old Town as well as West region such as Northwest and Palace Hills.
 +
 
 +
2c. What effects do you see in the sensor readings after the earthquake and other major events? What effect do these events have on uncertainty?
 +
 
 +
[[File:yc mc q1 00.png|700px]]<br>
 +
 
 +
As mentioned in Question 1, for static sensors, most of the readings remained calm until frequent spikes started to appear from sensor 12, 13, 14 and 15. This happened on Wednesday afternoon, hinting that a quake might have happened during that time.
 +
 
 +
[[File:yc mc 15.png|700px]]<br>
 +
 
 +
For the mobile sensors, various sensors such as those found in the graph above, have irregular readings and missing values all happened at the same time. This raises up the doubt regarding the reliability of the mobile sensors.
 +
</div>
 +
 
 +
== <div style="font-weight:300;padding: 10px 13px 20px 13px; line-height:30px;font-family:HelveticaNeue-Light, Helvetica Neue Light, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:25px">Question 3</font></div>==
 +
 
 +
<div style="font-weight:300;margin-bottom: 60px;margin-top:15px;max-width:700px;margin-left:15px;font-family:HelveticaNeue-Light, Helvetica Neue Light, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:17px;>
 +
 
 +
3a. Highlight potential locations of contamination, including the locations of contaminated cars. Should St. Himark officials be worried about contaminated cars moving around the city?
 +
 
 +
Yes. Potential locations of contaminated cars include mobile sensor 10 (Wilson Forest 9 April 18:00 to 10 April 6:00) and sensor 29 (Jade Bridge 8 April 16:00 to 22:00). Despite the unreliable readings from some of the mobile sensors, further investigation is necessary. Areas such Safetown, Oldtown and Pepper Mill should be focused because of its proximity to the plant.
 +
 
 +
3b. Estimate how many cars may have been contaminated when coolant leaked from the Always Safe plant. Use visual analysis of radiation measurements to determine if any have left the area.
 +
 
 +
[[File:yc mc 10.png|700px]]<br>
 +
 
 +
According to the running total graph above, again, cluster 1 is highly suspicious with their readings increasing drastically as compared with other cars. Those sensors are 21, 22, 24, 25, 27, 28, 29 and 45. Most of the vehicles are from Scenic Vista except 29, which is from Terrapin Springs towards the Highway.
 +
 
 +
[[File:yc mc 08.png|700px]]<br>
 +
 
 +
Sensor 30 did not leave the area and stays throughout the days.
 +
 
 +
3c. Indicate where you would deploy more sensors to improve radiation monitoring in the city. Would you recommend more static sensors or more mobile sensors or both? Use your visualization of radiation measurement uncertainty to justify your recommendation.
 +
 
 +
[[File:yc mc 11.png|700px]]<br>
 +
 
 +
I would deploy more static sensors around regions where static sensors are missing, such as Old Town, Northwest and Southwest. The reason that I choose static sensors over mobile is because mobile sensors are less reliable and there's a higher chance of getting cross contaminated when a car travels from one region to another. The government has little control on the flow of the cars.
 +
 
 +
Besides that, I also recommend to put static sensors at the exit/entrance of each bridge so that each car is monitored effectively with traceable radioactive information.
 +
 
 +
</div>
 +
 
 +
== <div style="font-weight:300;padding: 10px 13px 20px 13px; line-height:30px;font-family:HelveticaNeue-Light, Helvetica Neue Light, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:25px">Question 4</font></div>==
 +
 
 +
<div style="font-weight:300;margin-bottom: 60px;margin-top:15px;max-width:700px;margin-left:15px;font-family:HelveticaNeue-Light, Helvetica Neue Light, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:17px;>
 +
 
 +
Summarize the state of radiation measurements at the end of the available period. Use your novel visualizations and analysis approaches to suggest a course of action for the city. Use visual analytics to compare the static sensor network to the mobile sensor network. What are the strengths and weaknesses of each approach? How do they support each other?
 +
 
 +
[[File:yc mc 01.png|350px]][[File:yc mobile running 03.png|350px]]<br>
 +
 
 +
The running total graph summarises the readings through out the period. A raised background radiation level persists throughout the region. This approximately doubles the normal background radiation level.
 +
 
 +
Two hotspots persist at Jade Bridge and Old Town. To deal with the emergency, temporarily shut off Jade Bridge for decontamination works.
 +
 
 +
Regions that work with sensor 21, 22, 24, 25, 27, 28, 29 and 45, as mentioned previously, should be the priority for decontamination.
 +
 
 +
<table>
 +
<tr>
 +
<th></th>
 +
<th>Static Sensors</th>
 +
<th>Mobile Sensors</th>
 +
</tr>
 +
<tr>
 +
<th>Pros</th>
 +
<td>More consistent readings across the sensors</td>
 +
<td>Able to reach places where static sensors are unreachable</td>
 +
</tr>
 +
<tr>
 +
<th>Cons</th>
 +
<td>Limited coverage with limited locations</td>
 +
<td>Limited accuracy with tendency of being cross contaminated</td>
 +
</tr>
 +
</table>
 +
 
 +
</div>
 +
 
 +
== <div style="font-weight:300;padding: 10px 13px 20px 13px; line-height:30px;font-family:HelveticaNeue-Light, Helvetica Neue Light, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:25px">Question 5</font></div>==
 +
 
 
<div style="font-weight:300;margin-bottom: 60px;margin-top:15px;max-width:700px;margin-left:15px;font-family:HelveticaNeue-Light, Helvetica Neue Light, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:17px;>
 
<div style="font-weight:300;margin-bottom: 60px;margin-top:15px;max-width:700px;margin-left:15px;font-family:HelveticaNeue-Light, Helvetica Neue Light, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:17px;>
 +
 +
The data for this challenge can be analyzed either as a static collection or as a dynamic stream of data, as it would occur in a real emergency. Describe how you analyzed the data - as a static collection or a stream. How do you think this choice affected your analysis?
 +
 +
I analysed the data as a static collection because the data given is not live. A live stream of data requires more robust data processing as well as an expandable visual design.
 +
 +
Currently, the main visuals are map graphs and running totals. Both are time series based, which is a good thing because it allows live stream data to be added seamlessly.
 +
 +
[[File:yc mc 00.png|600px]]
 +
 +
For example, the map graph can be used to showcase real time radioactive level across the different regions. The slider plays an important role of animating the changes of the readings from sensors.
  
  
 
</div>
 
</div>

Latest revision as of 18:25, 13 October 2019

Yc mc2 heading wide.jpg

Background

Preparation

Visualisation

Observations

References


Observations

Question 1

Visualize radiation measurements over time from both static and mobile sensors to identify areas where radiation over background is detected. Characterize changes over time.

Yc mc q1 00.png
Yc mc q1 01.png

Before Wednesday afternoon, the static sensors’ readings remained calm with some random spikes from time to time. There were signs of more frequent reading spikes from sensors 12, 13, 14 and 15. Sensor 12, near the Power Plant shows ever increasing readings from 18:00 onwards. This is followed by increased readings at sensor 11 (Broadview Community Hospital) and Sensor 9 (Broadview). Sensor 15 (Weston) stopped working after 22:06 on Wednesday.

Yc mc 00.png

The graph above shows the mobile sensor readings on Thursday at 7:59. From the graph, we can see big bubbles such as Sensor 39, 42, 33 and 35 which surround the Power Plant. Surprisingly, Sensor 1, which is far away from the plant, is having a reading as high as those sensors that are closer to the plant.

Question 2

2a. Compare uncertainty of the Static sensor to the Mobile sensor. What anomalies can you see? Are there sensors that are too uncertain to trust?

Yc mc 01.png

For the static sensors, the sensors are generally consistent in the readings. However, Sensor 15 stopped working from Wednesday 22:00 to Friday 21:00. Despite the random spikes from time to time, the overall readings from all sensors seem in sync. From the running total graph above, we can see the ultimate consistency of readings across all the static sensors from Monday to Evening of Wednesday. Afterwards, readings from sensor 12 and 11 and 9 started to raise faster than rest sensors, standing out in the running total graph. Interestingly, sensor is relatively far from the plant yet having readings that grow faster than many other sensors.

For the mobile sensors, it is obvious to spot the huge inconsistency across the 50 sensors with many irregular readings as well as missing readings.

Yc mc 03.png

Take the sensor 5 and 6 as an example. From the graph above, we can spot obvious differences in their patterns.

Yc mc 02.png
Yc mc 04.png
Yc mc 05.png
Yc mc 09.png
The graphs above shows that those sensors have missing readings with unknown reasons.

Yc mc 08.png
Sensor 27, 28 and 29 have similar consistent readings, but end with missing readings as well.

Yc mc 06.png
Sensor 18 has one of the most irregular readings with many pauses of readings across the week.

Sensors mentioned above should be treated with caution.

Yc mc 10.png
From the running total graph above, we can see some patterns across the sensors with 3 clusters and a few outliers.


2b. Which regions of the city have greater uncertainty of radiation measurement? Use visual analytics to explain your rationale. Yc mc 11.png

To see the regions with high uncertainty, filter the sensors on the map to only show those with high uncertainty patterns.

Yc mc 13.png

Referring to the map graph above, the areas that may have greater uncertainty will be around the North East of Safe Town, near the power plant, North region such as Old Town as well as West region such as Northwest and Palace Hills.

2c. What effects do you see in the sensor readings after the earthquake and other major events? What effect do these events have on uncertainty?

Yc mc q1 00.png

As mentioned in Question 1, for static sensors, most of the readings remained calm until frequent spikes started to appear from sensor 12, 13, 14 and 15. This happened on Wednesday afternoon, hinting that a quake might have happened during that time.

Yc mc 15.png

For the mobile sensors, various sensors such as those found in the graph above, have irregular readings and missing values all happened at the same time. This raises up the doubt regarding the reliability of the mobile sensors.

Question 3

3a. Highlight potential locations of contamination, including the locations of contaminated cars. Should St. Himark officials be worried about contaminated cars moving around the city?

Yes. Potential locations of contaminated cars include mobile sensor 10 (Wilson Forest 9 April 18:00 to 10 April 6:00) and sensor 29 (Jade Bridge 8 April 16:00 to 22:00). Despite the unreliable readings from some of the mobile sensors, further investigation is necessary. Areas such Safetown, Oldtown and Pepper Mill should be focused because of its proximity to the plant.

3b. Estimate how many cars may have been contaminated when coolant leaked from the Always Safe plant. Use visual analysis of radiation measurements to determine if any have left the area.

Yc mc 10.png

According to the running total graph above, again, cluster 1 is highly suspicious with their readings increasing drastically as compared with other cars. Those sensors are 21, 22, 24, 25, 27, 28, 29 and 45. Most of the vehicles are from Scenic Vista except 29, which is from Terrapin Springs towards the Highway.

Yc mc 08.png

Sensor 30 did not leave the area and stays throughout the days.

3c. Indicate where you would deploy more sensors to improve radiation monitoring in the city. Would you recommend more static sensors or more mobile sensors or both? Use your visualization of radiation measurement uncertainty to justify your recommendation.

Yc mc 11.png

I would deploy more static sensors around regions where static sensors are missing, such as Old Town, Northwest and Southwest. The reason that I choose static sensors over mobile is because mobile sensors are less reliable and there's a higher chance of getting cross contaminated when a car travels from one region to another. The government has little control on the flow of the cars.

Besides that, I also recommend to put static sensors at the exit/entrance of each bridge so that each car is monitored effectively with traceable radioactive information.

Question 4

Summarize the state of radiation measurements at the end of the available period. Use your novel visualizations and analysis approaches to suggest a course of action for the city. Use visual analytics to compare the static sensor network to the mobile sensor network. What are the strengths and weaknesses of each approach? How do they support each other?

Yc mc 01.pngYc mobile running 03.png

The running total graph summarises the readings through out the period. A raised background radiation level persists throughout the region. This approximately doubles the normal background radiation level.

Two hotspots persist at Jade Bridge and Old Town. To deal with the emergency, temporarily shut off Jade Bridge for decontamination works.

Regions that work with sensor 21, 22, 24, 25, 27, 28, 29 and 45, as mentioned previously, should be the priority for decontamination.

Static Sensors Mobile Sensors
Pros More consistent readings across the sensors Able to reach places where static sensors are unreachable
Cons Limited coverage with limited locations Limited accuracy with tendency of being cross contaminated

Question 5

The data for this challenge can be analyzed either as a static collection or as a dynamic stream of data, as it would occur in a real emergency. Describe how you analyzed the data - as a static collection or a stream. How do you think this choice affected your analysis?

I analysed the data as a static collection because the data given is not live. A live stream of data requires more robust data processing as well as an expandable visual design.

Currently, the main visuals are map graphs and running totals. Both are time series based, which is a good thing because it allows live stream data to be added seamlessly.

Yc mc 00.png

For example, the map graph can be used to showcase real time radioactive level across the different regions. The slider plays an important role of animating the changes of the readings from sensors.