Difference between revisions of "IS428 AY2019-20T1 Assign Lee Jenny Csm"
Line 125: | Line 125: | ||
|} | |} | ||
+ | |||
+ | {| class="wikitable" | ||
+ | |- | ||
+ | ! Problem #3 || Insufficient Information - Location Name | ||
+ | |- | ||
+ | | Issue || Currently, the data only consists of a location field that is in a numerical format (1 to 19). As such, we are unable to identify the region of the city based on the location data given. Hence, it is important that we include the location name to the visualization so that it is clearer and well represented. | ||
+ | |- | ||
+ | | Solution || Create a Calculated Field to map the ‘Location’ to a new field – ‘Location Name’ . The location name is taken from the StHimarkLabeledMap.png in MC2 | ||
+ | |||
+ | 1. To create a calculated field, click on the ‘+’ sign and select ‘Add Step’. | ||
+ | |||
+ | [[File:P10.png|800px|center]] | ||
+ | |||
+ | 2. Click on the Create Calculated Field button and create a new field – ‘Location Name’ based on the table below. | ||
+ | |||
+ | [[File:P11.png|800px|center]] | ||
+ | |||
+ | |||
+ | [[File:Table2.jpg|500px|center]] | ||
+ | |||
+ | 3. Enter the following statements into the space. After which click on the ‘Apply’ and ‘Save’ button. | ||
+ | |||
+ | IF([location]==1) THEN "Palace Hills" | ||
+ | <br> | ||
+ | ELSEIF([location]==2) THEN "Northwest" | ||
+ | <br> | ||
+ | ELSEIF([location]==3) THEN "Old Town" | ||
+ | <br> | ||
+ | ELSEIF([location]==4) THEN "Safe Town" | ||
+ | <br> | ||
+ | ELSEIF([location]==5) THEN "Southwest" | ||
+ | <br> | ||
+ | ELSEIF([location]==6) THEN "Downtown" | ||
+ | <br> | ||
+ | ELSEIF([location]==7) THEN "Wilson Forest" | ||
+ | <br> | ||
+ | ELSEIF([location]==8) THEN "Scenic Vista" | ||
+ | <br> | ||
+ | ELSEIF([location]==9) THEN "Broadview" | ||
+ | <br> | ||
+ | ELSEIF([location]==10) THEN "Chapparal" | ||
+ | <br> | ||
+ | ELSEIF([location]==11) THEN "Terrapin Springs" | ||
+ | <br> | ||
+ | ELSEIF([location]==12) THEN "Pepper Mill" | ||
+ | <br> | ||
+ | ELSEIF([location]==13) THEN "Cheddarford" | ||
+ | <br> | ||
+ | ELSEIF([location]==14) THEN "Easton" | ||
+ | <br> | ||
+ | ELSEIF([location]==15) THEN "Weston" | ||
+ | <br> | ||
+ | ELSEIF([location]==16) THEN "Southton" | ||
+ | <br> | ||
+ | ELSEIF([location]==17) THEN "Oak Willow" | ||
+ | <br> | ||
+ | ELSEIF([location]==18) THEN "East Parton" | ||
+ | <br> | ||
+ | ELSE "West Parton" | ||
+ | <br> | ||
+ | END | ||
+ | |||
+ | [[File:P12.png|800px|center]] | ||
+ | |||
+ | |||
+ | |} | ||
+ | |||
+ | After solving the 3 problems above, we are done with the data transformation process. To download the data: | ||
+ | |||
+ | 1. Click on the ‘+’ sign and select ‘Add Output’. | ||
+ | |||
+ | [[File:P13.png|800px|center]] | ||
+ | |||
+ | |||
+ | 2. Enter the name of data file – ‘mc1-reports-data’, select location and output type – ‘Comma Separated Values (.csv) and click on the ‘Run Flow’ button. | ||
+ | |||
+ | [[File:P14.png|800px|center]] | ||
+ | |||
+ | |||
+ | The final data file should look like this. As you can see, we have successfully pivoted the 5 columns to 2 columns – ‘Affected Area’ and ‘Damage Values’. Also, the new columns – ‘Location Name’ and ‘Damage Scale’ is added to the data file. | ||
+ | |||
+ | [[File:Dataa.png|800px|center]] | ||
+ | |||
==Dataset Import Structure and Process== | ==Dataset Import Structure and Process== |
Revision as of 23:50, 12 October 2019
Contents
Background
St. Himark has been hit by an earthquake, leaving officials scrambling to determine the extent of the damage and dispatch limited resources to the areas in most need. They quickly receive seismic readings and use those for an initial deployment but realize they need more information to make sure they have a realistic understanding of the true conditions throughout the city.
In a prescient move of community engagement, the city had released a new damage reporting mobile application shortly before the earthquake. This app allows citizens to provide more timely information to the city to help them understand the damage and prioritize their response. With emergency services stretched thin, officials are relying on citizens to provide them with much-needed information about the effects of the quake to help focus recovery efforts.
Objectives & Tasks
With the huge amount of information provided by the citizens, emergency planners are unable to gather insights and discover patterns without any visualization tools. Hence, there is a need to help the emergency planners build an interactive data visualization that allows them to efficiently gather the information that they need and identify areas of concern. The interactive visualization aims to provide emergency planners with the following information:
- Decide how responses (by emergency planners) will change based on damage reports from citizens on the ground
- Prioritize neighbourhoods based on responses given
- The region that experience the hardest hit
- Compare the reliability of neighbourhood reports
- Changes in conditions/uncertainty over time
Data analysis & Transformation Process
This section will elaborate on the dataset analysis and transformation process for each dataset in order to prepare the data for import and analysis on interactive visualization.
There is one zip file provided for this assignment and the dataset is given for this assignment spans the entire length of the event, containing individual reports of shaking/damage by neighbourhood over time. Reports are made by citizens at any time, in 5-minute batches/increments.
There are 5 main areas in the city that was affected by the earthquake: Buildings, Medical, Power, Roads & Bridges and Sewer and Water. Alongside these affected areas are damage values that were reported by the citizens on the ground. Reports are made by citizens at any time; in 5-minute batches/increments.
The format of the captured data for all the affected areas (e.g. buildings, medical, etc) is the same.
The following section illustrates the issues faced in the data analysis phase leading to a need to transform the data into a specified format.
Problem #1 | Format of Data |
---|---|
Issue | As all the affected areas (e.g. buildings, medical, etc) are recorded individually on different columns, we are unable to compare the different affected areas nicely in one visualization because of the following reasons:
|
Solution | The resolution to the above-mentioned issues is to pivot the columns using Tableau Prep Builder. By pivoting the columns, it makes the data easy to use and it allows users to easily analyse data, summarize data and find patterns in data.
1. Open Tableau Prep Builder and drag the data file – ‘mc1-reports-data’ into Tableau Prep Builder. 2. To pivot the columns, click on the ‘+’ sign and select ‘Add Pivot’ 3. Drag the following fields to the Pivoted Fields pane: buildings, medical, power, roads and bridges and sewer and water. Rename the 2 pivot columns to ‘Affected Area’ and ‘Damage Values’.
|
Problem #2 | Insufficient information - Damage Scale |
---|---|
Issue | All reports collected from citizens on the ground are recorded on a scale from 1 to 10 depending on how bad the damage is. Hence, it is hard for us to visualize numbers. All we know is that 0 represents the lowest damage and 10 represents the highest damage. However, the numbers 1 to 9 are not defined. This may cause misinterpretation of the data, leading to an inaccurate result. This is an important issue that must be handled because the visualization is used by various emergency responders and they may analyse the results differently. |
Solution | Create a Calculated Field to map the ‘Damage Value’ to a new field – ‘Damage Scale’ which is an ordinal scale. The scale is taken from the majorquake-shakemap.png.
1. To create a calculated field, click on the ‘+’ sign and select ‘Add Step’. 2. Click on the Create Calculated Field button and create a new field – ‘Damage Scale’ based on the table below.
3. Enter the following statements into the space given. After which click on the ‘Apply’ and ‘Save’ button. IF([Damage Values]==0) THEN "Not Felt"
|
Problem #3 | Insufficient Information - Location Name |
---|---|
Issue | Currently, the data only consists of a location field that is in a numerical format (1 to 19). As such, we are unable to identify the region of the city based on the location data given. Hence, it is important that we include the location name to the visualization so that it is clearer and well represented. |
Solution | Create a Calculated Field to map the ‘Location’ to a new field – ‘Location Name’ . The location name is taken from the StHimarkLabeledMap.png in MC2
1. To create a calculated field, click on the ‘+’ sign and select ‘Add Step’. 2. Click on the Create Calculated Field button and create a new field – ‘Location Name’ based on the table below.
3. Enter the following statements into the space. After which click on the ‘Apply’ and ‘Save’ button. IF([location]==1) THEN "Palace Hills"
|
After solving the 3 problems above, we are done with the data transformation process. To download the data:
1. Click on the ‘+’ sign and select ‘Add Output’.
2. Enter the name of data file – ‘mc1-reports-data’, select location and output type – ‘Comma Separated Values (.csv) and click on the ‘Run Flow’ button.
The final data file should look like this. As you can see, we have successfully pivoted the 5 columns to 2 columns – ‘Affected Area’ and ‘Damage Values’. Also, the new columns – ‘Location Name’ and ‘Damage Scale’ is added to the data file.
Dataset Import Structure and Process
Interactive Visualization/Dashboard Design
The interactive visualization can be accessed here: xxx
The resolution of this interactive visualization is set at the size of 1000 x 800. To get a clear view of the visualization, adjust your screen resolution to the dimension mentioned above.
Throughout all the different dashboards, useful guides/tips are provided to help users navigate through the different filters and actions so that their analysis can be performed smoothly. The following interactivity elements are also used throughout all the dashboards to maintain consistency:
Interactive Technique | Rationale | |
---|---|---|
Image here |
Home Dashboard
A homepage is created with 3 main categories in mind:
- Damage Reports: Damage Reports by citizens on the ground
- Uncertainty: Uncertainty in data and reliability of reports
- Changes overtime: Changes in conditions (damage and shake intensity) overtime
Each of these categories are further broken down into its respective sub-categories for the ease of users to perform their analysis. As such, users can select any of the above categories to gather valuable patterns and insights.
Insights | Visualization |
---|---|
Observations and Insights
Using the interactive visualization as a platform for reporting and analysis, the following aims to provide answers to the questions posed.
Question 1
How responses of emergency responders should change.
xxx
Prioritizing neighborhoods based on responses.
xxx
Regions that experience the hardest hit.
xxx
Question 2
Reliability of neighborhood reports.
xxx
Question 3
Changes in Reports over time.
xxx
Changes in Damage over time.
xxx
Changes in Shake Intensity over time.
xxx