Difference between revisions of "IS428 AY2019-20T1 Parth Goda Rajesh"
Parthrg.2017 (talk | contribs) |
Parthrg.2017 (talk | contribs) |
||
Line 1: | Line 1: | ||
== Background == | == Background == | ||
− | Welcome to St. Himark! A fictional city that will is being used in this visual case study. It is a city of 19 neighborhoods, all of which have their unique characteristics and amenities. St. Himark has a population of 246,839 people and it's located in the Oceanus Sea. It is also home to the world-renowned St. Himark Museum, beautiful beaches, and the Wilson Forest Nature Preserve. It is one of the best cities to raise a family and work. Always Safe Nuclear Power Plant provides the majority of the power in the city and jobs in the Safe Town. Mayor Jordan and the city council current govern the city. | + | Welcome to St. Himark! A fictional city that will is being used in this visual case study. It is a city of 19 neighborhoods, all of which have their unique characteristics and amenities. St. Himark has a population of 246,839 people, and it's located in the Oceanus Sea. It is also home to the world-renowned St. Himark Museum, beautiful beaches, and the Wilson Forest Nature Preserve. It is one of the best cities to raise a family and work. Always Safe Nuclear Power Plant provides the majority of the power in the city and jobs in the Safe Town. Mayor Jordan and the city council current govern the city. |
The runs in the following utilities: | The runs in the following utilities: | ||
Line 42: | Line 42: | ||
To gather the information the city official's need. They launched an app where the citizens can report the intensity of shake and level of damage done to utility infrastructure. The officials can use this tool to record data provided by citizens. The citizens use the app to note down the level of damage seen on a utility/infrastructure building in a Neighbourhood. They can also record the shake intensity in the neighborhood. The data is stored every 5 mins. They may also be some data loss or delay due to power shortages. | To gather the information the city official's need. They launched an app where the citizens can report the intensity of shake and level of damage done to utility infrastructure. The officials can use this tool to record data provided by citizens. The citizens use the app to note down the level of damage seen on a utility/infrastructure building in a Neighbourhood. They can also record the shake intensity in the neighborhood. The data is stored every 5 mins. They may also be some data loss or delay due to power shortages. | ||
− | With all this data, visualizations were created to understand the data faster. Recommendations and decisions can be churned out | + | With all this data, visualizations were created to understand the data faster. Recommendations and decisions can be churned out more quickly to get help to people faster. |
The following questions also have to be answered: | The following questions also have to be answered: | ||
− | # Emergency responders will base their initial response on the earthquake shake map. Use visual analytics to determine how their response should change based on damage reports from citizens on the ground. How would you prioritize neighborhoods for the | + | # Emergency responders will base their initial response on the earthquake shake map. Use visual analytics to determine how their response should change based on damage reports from citizens on the ground. How would you prioritize neighborhoods for the reaction? Which parts of the city are the hardest hit? |
# Use visual analytics to show uncertainty in the data. Compare the reliability of neighborhood reports. Which neighborhoods are providing reliable reports? Provide a rationale for your response. | # Use visual analytics to show uncertainty in the data. Compare the reliability of neighborhood reports. Which neighborhoods are providing reliable reports? Provide a rationale for your response. | ||
# How do conditions change over time? How does uncertainty in change over time? Describe the key changes you see. | # How do conditions change over time? How does uncertainty in change over time? Describe the key changes you see. | ||
Line 56: | Line 56: | ||
The headers were: | The headers were: | ||
# Time: A timestamp of the report made by a citizen. The format is in DD/MM/YY HH:MM:SS | # Time: A timestamp of the report made by a citizen. The format is in DD/MM/YY HH:MM:SS | ||
− | # sewer_and_water: Damage recorded on the sewer and water systems in the neighborhood and at the timestamp. 0 is the lowest level of damage while 10 is the highest | + | # sewer_and_water: Damage recorded on the sewer and water systems in the neighborhood and at the timestamp. 0 is the lowest level of damage, while 10 is the highest |
− | # power: Damage recorded on the power generation systems in the neighborhood and at the timestamp. 0 is the lowest level of damage while 10 is the highest | + | # power: Damage recorded on the power generation systems in the neighborhood and at the timestamp. 0 is the lowest level of damage, while 10 is the highest |
− | # roads_and_bridges: Damage recorded on the roads and bridges in the neighborhood and at the timestamp. 0 is the lowest level of damage while 10 is the highest | + | # roads_and_bridges: Damage recorded on the roads and bridges in the neighborhood and at the timestamp. 0 is the lowest level of damage, while 10 is the highest |
− | # medical: Damage recorded on the medical facilities in the neighborhood and at the timestamp. 0 is the lowest level of damage while 10 is the highest | + | # medical: Damage recorded on the medical facilities in the neighborhood and at the timestamp. 0 is the lowest level of damage, while 10 is the highest |
− | # buildings: Damage recorded on the buildings in the neighborhood and at the timestamp. 0 is the lowest level of damage while 10 is the highest | + | # buildings: Damage recorded on the buildings in the neighborhood and at the timestamp. 0 is the lowest level of damage, while 10 is the highest |
# shake_intensity: How violent the shaking was in the neighborhood and at the timestamp. | # shake_intensity: How violent the shaking was in the neighborhood and at the timestamp. | ||
− | # location: Id of the | + | # location: Id of the neighborhood for which the citizen is reporting his readings. (This will be matched to the neighborhood data in the map file) |
= Cleaning up the data = | = Cleaning up the data = | ||
Line 69: | Line 69: | ||
=== Pivoting === | === Pivoting === | ||
− | To start, I first pivot the medical, power, road_and_bridges, sewer_and_water, buildings and shake_intensity on the dashboard. The utilities are called "Source of reading" and values are called "Readings" | + | To start, I first pivot the medical, power, road_and_bridges, sewer_and_water, buildings, and shake_intensity on the dashboard. The utilities are called "Source of reading," and values are called "Readings." |
[[File:Screenshot 2019-10-12 at 6.34.55 PM.png|1000px|thumb|center|Step 1: Pivoting the dashboard]] | [[File:Screenshot 2019-10-12 at 6.34.55 PM.png|1000px|thumb|center|Step 1: Pivoting the dashboard]] | ||
Line 93: | Line 93: | ||
[[File:Screenshot 2019-10-12 at 10.41.40 PM.png|700px|thumb|center|Step 3: Inner Join the two worksheets]] | [[File:Screenshot 2019-10-12 at 10.41.40 PM.png|700px|thumb|center|Step 3: Inner Join the two worksheets]] | ||
− | This was the result | + | This was the result. |
[[File:Screenshot 2019-10-12 at 10.52.34 PM.png|700px|thumb|center|Final Result of Data Transformation]] | [[File:Screenshot 2019-10-12 at 10.52.34 PM.png|700px|thumb|center|Final Result of Data Transformation]] | ||
Line 102: | Line 102: | ||
# Based on each neighborhood in St. Himark | # Based on each neighborhood in St. Himark | ||
− | # Based on each reading source. E.g. Building or Medical damage | + | # Based on each reading source. E.g., Building or Medical damage |
− | # Based on the Map of St. Himark progression through the | + | # Based on the Map of St. Himark progression through the six days |
− | This design has implemented the idea that when city officials turn to this dashboard to look for data on how to allocate resources, they can start to form their decisions based on either neighborhood, a utility that they want to work on or see the timeline of the whole incident. | + | This design has implemented the idea that when city officials turn to this dashboard to look for data on how to allocate resources, they can start to form their decisions based on either neighborhood, a utility that they want to work on, or see the timeline of the whole incident. |
{| class="wikitable" | {| class="wikitable" | ||
Line 147: | Line 147: | ||
# Source of reading | # Source of reading | ||
− | Using these two filters the users can find specific information and make decisions about things they are interested in. On this dashboard, the main filter is the map filter on the right called "Map reference" | + | Using these two filters, the users can find specific information and make decisions about things they are interested in. On this dashboard, the main filter is the map filter on the right called "Map reference." By choosing one area, they can see the timeline, bar graphs, and heat maps about everything reported in that area. He can also apply a second filter from the "Source of reading" to get more information. |
[[File:Screenshot 2019-10-13 at 4.34.34 PM.png|700px|thumb|center|The two filters available on the neighborhood dashboard]] | [[File:Screenshot 2019-10-13 at 4.34.34 PM.png|700px|thumb|center|The two filters available on the neighborhood dashboard]] | ||
Line 161: | Line 161: | ||
# Bar graphs over a timeline | # Bar graphs over a timeline | ||
[[File:Screenshot 2019-10-13 at 4.58.32 PM.png|700px|thumb|center|All the charts used in the neighbourhood dashboard]] | [[File:Screenshot 2019-10-13 at 4.58.32 PM.png|700px|thumb|center|All the charts used in the neighbourhood dashboard]] | ||
+ | |} | ||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
+ | {| class="wikitable" | ||
+ | |- | ||
+ | ! style="font-weight: bold;background: #536a87;color:#ffffff;width: 20%;" | Utility Dashboard | ||
+ | |- | ||
+ | | <b>Purpose / Description</b><br> This dashboard is designed to understand how each utility affects each neighbourhood. When the user first lands on the page, all the charts show data for all sources of readings and ranks how badly damaged the neighborhoods are. When the user filters the data by selecting one of the buttons on the Source of the readings list, clearer data is shown where the ranking is now based on the selected source of reading. The purpose of this is for the use case where city officials need to allocate specific resources like emergency power or building repairs. They can see what the most reported neighborhoods and what is the total/average readings that are being reported. They can also see all the filtered data on a timeline, to understand when and how much was reported. | ||
+ | [[File:Screenshot 2019-10-13 at 5.38.57 PM.png|700px|thumb|center|All the charts used in the neighbourhood dashboard]] | ||
+ | |} | ||
+ | |- | ||
+ | | <b>Interactive Technique</b><br> | ||
+ | <ol> | ||
+ | <li>Tooltips </li> | ||
+ | A user can put his cursor over any data point or visual elements in the charts to find out specific details about that data point. A small box will appear with relevant information. | ||
+ | <br> | ||
+ | <li>Filter</li> | ||
+ | There are two filters on this dashboard: | ||
+ | # Neighborhood | ||
+ | # Source of reading | ||
+ | |||
+ | Using these two filters the users can find specific information and make decisions about things they are interested in. On this dashboard, the main filter is the source of readings filter on the right called "Select Source of Reading". By choosing one reading type, they can see the timeline, bar graphs and choropleth map report information on that source of reading. They can also apply a second filter from the "Select Neighbourhood(s)" to get more area-specific | ||
+ | |||
+ | <li>Connect</li> | ||
+ | These four graphs are all connected by hovering the cursor over them. The neighborhood that is under your cursor will be highlighted in all four charts. The users can now track the neighborhood place on all four charts. They can know its rank in both total and avg in the comparison charts and the maps | ||
+ | |||
+ | </ol> | ||
+ | |- | ||
+ | | <b>Types of Charts used</b><br> | ||
+ | There are three types of charts used: | ||
+ | # Bar graphs | ||
+ | # Heat Maps | ||
+ | # Bar graphs over a timeline | ||
+ | # Choropleth map | ||
|} | |} | ||
=== Use Cases === | === Use Cases === | ||
− | Lets say a city official wants to know about what going on in a | + | Lets say a city official wants to know about what going on in a particular neighborhood. He will start on the home page |
Revision as of 18:07, 13 October 2019
Contents
Background
Welcome to St. Himark! A fictional city that will is being used in this visual case study. It is a city of 19 neighborhoods, all of which have their unique characteristics and amenities. St. Himark has a population of 246,839 people, and it's located in the Oceanus Sea. It is also home to the world-renowned St. Himark Museum, beautiful beaches, and the Wilson Forest Nature Preserve. It is one of the best cities to raise a family and work. Always Safe Nuclear Power Plant provides the majority of the power in the city and jobs in the Safe Town. Mayor Jordan and the city council current govern the city.
The runs in the following utilities:
- Water and Sewage
- Road and Bridge
- Gas
- Garbage
- Power
There is always construction going on in the above utilities.
St. Himark is segregated into 19 neighborhoods:
- PALACE HILLS
- NORTHWEST
- OLD TOWN
- SAFE TOWN
- SOUTHWEST
- DOWNTOWN
- WILSON FOREST
- SCENIC VISTA
- BROADVIEW
- CHAPPARAL
- TERRAPIN SPRINGS
- PEPPER MILL
- CHEDDARFORD
- EASTON
- WESTON
- SOUTHTOWN
- OAK WILLOW
- EAST PARTON
- WEST PARTON
Problem
There was an earthquake northwest of St. Himark. It occurred between 6 April 2020 and 8 April 2020. The city's officials needed to collect data immediately to understand the extent of the damage. Then can then allocate resources efficiently to the areas of town where it's needed and dispatch their emergency services.
At first, they only have the seismic readings of the earthquake and used that for their first round of dispatch. Now, however, they need more information to get a better gauge of what is going on on the ground level.
Purpose
To gather the information the city official's need. They launched an app where the citizens can report the intensity of shake and level of damage done to utility infrastructure. The officials can use this tool to record data provided by citizens. The citizens use the app to note down the level of damage seen on a utility/infrastructure building in a Neighbourhood. They can also record the shake intensity in the neighborhood. The data is stored every 5 mins. They may also be some data loss or delay due to power shortages.
With all this data, visualizations were created to understand the data faster. Recommendations and decisions can be churned out more quickly to get help to people faster.
The following questions also have to be answered:
- Emergency responders will base their initial response on the earthquake shake map. Use visual analytics to determine how their response should change based on damage reports from citizens on the ground. How would you prioritize neighborhoods for the reaction? Which parts of the city are the hardest hit?
- Use visual analytics to show uncertainty in the data. Compare the reliability of neighborhood reports. Which neighborhoods are providing reliable reports? Provide a rationale for your response.
- How do conditions change over time? How does uncertainty in change over time? Describe the key changes you see.
Data Gathering and Clean up
The data provided in an mc1-reports-data.csv file with the following data:
The headers were:
- Time: A timestamp of the report made by a citizen. The format is in DD/MM/YY HH:MM:SS
- sewer_and_water: Damage recorded on the sewer and water systems in the neighborhood and at the timestamp. 0 is the lowest level of damage, while 10 is the highest
- power: Damage recorded on the power generation systems in the neighborhood and at the timestamp. 0 is the lowest level of damage, while 10 is the highest
- roads_and_bridges: Damage recorded on the roads and bridges in the neighborhood and at the timestamp. 0 is the lowest level of damage, while 10 is the highest
- medical: Damage recorded on the medical facilities in the neighborhood and at the timestamp. 0 is the lowest level of damage, while 10 is the highest
- buildings: Damage recorded on the buildings in the neighborhood and at the timestamp. 0 is the lowest level of damage, while 10 is the highest
- shake_intensity: How violent the shaking was in the neighborhood and at the timestamp.
- location: Id of the neighborhood for which the citizen is reporting his readings. (This will be matched to the neighborhood data in the map file)
Cleaning up the data
Using Tableau Prep Builder, data from the CSV file was moved around and changed a little to make visualizations better.
Pivoting
To start, I first pivot the medical, power, road_and_bridges, sewer_and_water, buildings, and shake_intensity on the dashboard. The utilities are called "Source of reading," and values are called "Readings."
Cleaning up names
Next, I renamed the following sources of reading and capitalized the rest:
- road_and_bridges into "Road and Bridges"
- sewer_and_water into "Sewer and Water"
- shake_intensity into "Shake Intensity"
Setting up Tableau
To start my visualization journey, I first added a file called StHimark.shp taken form the MC2 VAST Data challenge 2's data files to create the interactive map on a tableau workbook. This file has the following fields:
- ID: Id of the neighborhood
- location: Name of the neighborhood
- Longitude: Longitude coordinate of the neighborhood
- Latitude: Latitude coordinate of the neighborhood
I then dragged and dropped the output file form tableau prep into tableau. I used ID from StHimark.shp and location from mc1-reports-data.csv and inner joined them:
This was the result.
Visualization and Interactive techniques
The visualizations I created was all connected from a simple main page that let the user choose if they want to see either:
- Based on each neighborhood in St. Himark
- Based on each reading source. E.g., Building or Medical damage
- Based on the Map of St. Himark progression through the six days
This design has implemented the idea that when city officials turn to this dashboard to look for data on how to allocate resources, they can start to form their decisions based on either neighborhood, a utility that they want to work on, or see the timeline of the whole incident.
Main Page |
---|
Purpose / Description This is the landing page of the applicant. On this page the user gets a quick summary of what is the purpose of this application and an option to dive into three areas of reporting. I have created this page as a starting point where the user can keep coming back to and navigating away from. i
|
Interactive Technique I also use interesting interactive techniques for the dashboard to be more user friendly.
|
Neighborhood Dashboard |
---|
Purpose / Description This dashboard is designed to understand what is going on in each neighbourhood. When the user first lands on the page, all the charts show data for all the neighborhoods and sources of readings. But when the user filters the data by selecting an area on the map or one of the buttons on the list, the data changes to show the real picture in each neighborhood. The purpose of this is for the use case where city officials need to know what is going on in each neighborhood. They can see what the most reported utility and what is the most reading that is being reported. They can also see all the filtered data on a timeline, to understand when and how much was reported. |
Interactive Technique
|
Types of Charts used There are three types of charts used:
|
Utility Dashboard |
---|
Purpose / Description This dashboard is designed to understand how each utility affects each neighbourhood. When the user first lands on the page, all the charts show data for all sources of readings and ranks how badly damaged the neighborhoods are. When the user filters the data by selecting one of the buttons on the Source of the readings list, clearer data is shown where the ranking is now based on the selected source of reading. The purpose of this is for the use case where city officials need to allocate specific resources like emergency power or building repairs. They can see what the most reported neighborhoods and what is the total/average readings that are being reported. They can also see all the filtered data on a timeline, to understand when and how much was reported. |
|-
| Interactive Technique
- Tooltips A user can put his cursor over any data point or visual elements in the charts to find out specific details about that data point. A small box will appear with relevant information.
- Filter There are two filters on this dashboard:
- Neighborhood
- Source of reading
- Connect These four graphs are all connected by hovering the cursor over them. The neighborhood that is under your cursor will be highlighted in all four charts. The users can now track the neighborhood place on all four charts. They can know its rank in both total and avg in the comparison charts and the maps
|-
| Types of Charts used
There are three types of charts used:
- Bar graphs
- Heat Maps
- Bar graphs over a timeline
- Choropleth map
|}
Use Cases
Lets say a city official wants to know about what going on in a particular neighborhood. He will start on the home page