Difference between revisions of "IS428 AY2019-20T1 Assign Ronald Lay Data Transformation"

From Visual Analytics for Business Intelligence
Jump to navigation Jump to search
 
(5 intermediate revisions by the same user not shown)
Line 24: Line 24:
  
 
|}
 
|}
 +
==Data used for Mini Challenge 1==
 +
*mc1-reports-data.csv
 +
*StHimark.shp
  
 
==Pivoting for categories==
 
==Pivoting for categories==
 
===Issue===
 
===Issue===
The categories are represented in columns, which is difficult when performing the visualization in tableau.
+
The categories are represented in columns, which is difficult when performing the filters and charts in tableau.
  
 
===Solution===
 
===Solution===
  
Pivoting the categories - Medical, Power, Road And Bridges, Sewer And Water and shake intensity are pivoted to enable easier filtering in tableau.
+
Using Tableau prep to perform the pivoting of categories - Medical, Power, Road And Bridges, Sewer & Water and shake intensity - into a column called "Category" and "Reported intensity" for the value.
  
 
[[File:Pivoting.png|500px|thumb|center]]
 
[[File:Pivoting.png|500px|thumb|center]]
=====Binning of different intensity level=====
+
==Binning of different intensity level==
The raw data contains categorical data represented by number. However, number representation provides an unclear definition of how each value is perceived by the users. To standardize the definition, alignment of the data 
+
===Issue===
Visual Binning is designed to assist you in the process of creating new variables based on grouping contiguous values of existing variables into a limited number of distinct categories.  
+
The raw data contains categorical data represented by number. However, number representation provides an unclear definition of how each value is perceived by the users.  
[[File:Create_Calculated_Field.png|500px|thumb|center]]
+
===Solution===
First, we add step to clean the data and click "create calculated field"
+
To standardize the definition, visual binning is performed by aligning the intensity value with instrumental intensity into a number of distinct categories.  
 +
[[File:Ronald.Lay.2017_Instrumental_Intensity.PNG|500px|thumb|center]]
 +
Follow the 2-step process
 +
<center><strong>2 steps process</strong></center>
 +
<div><center><ul>
 +
<li style="display: inline-block;" id="F23"> [[File:Ronald.Lay.2017_Create_Calcul.PNG|thumb|center|450px]] </li>
 +
<li style="display: inline-block;" id="F24"> [[File:Ronald.Lay.2017_Shake_Category.PNG|thumb|center|450px]] </li>
 +
</ul></center></div>
 +
</ul>
 +
The output is generated below
 +
<center>mc1-clean-data</center>
 +
[[File:Ronald.Lay.2017_Output.PNG|thumb|center|450px]]
  
[[File:Create_Calculated_Field.png|500px|thumb|center]]
 
  
Here is the code:  
+
==Importing data==
 +
This is the overall picture of importing data process. Mc1-data-clean is merged with stHimark.shp using location and id as common attribute.
 +
[[File:Ronald.Lay.2017_Overall_Process.PNG|thumb|center|450px]]
  
[[File:Intensity_level_category.PNG|500px|thumb|center]]
+
A map is successfully loaded into tableau
 +
[[File:Ronald.Lay.2017_Map.PNG|thumb|center|450px]]

Latest revision as of 22:59, 13 October 2019

Logo VAST Challenge 2019: Mini-Challenge 1

 

Problem & Tasks

 

Data Transformation

Interactive Visualization

 

Answers

Data used for Mini Challenge 1

  • mc1-reports-data.csv
  • StHimark.shp

Pivoting for categories

Issue

The categories are represented in columns, which is difficult when performing the filters and charts in tableau.

Solution

Using Tableau prep to perform the pivoting of categories - Medical, Power, Road And Bridges, Sewer & Water and shake intensity - into a column called "Category" and "Reported intensity" for the value.

Pivoting.png

Binning of different intensity level

Issue

The raw data contains categorical data represented by number. However, number representation provides an unclear definition of how each value is perceived by the users.

Solution

To standardize the definition, visual binning is performed by aligning the intensity value with instrumental intensity into a number of distinct categories.

Ronald.Lay.2017 Instrumental Intensity.PNG

Follow the 2-step process

2 steps process
  • Ronald.Lay.2017 Create Calcul.PNG
  • Ronald.Lay.2017 Shake Category.PNG

The output is generated below

mc1-clean-data
Ronald.Lay.2017 Output.PNG


Importing data

This is the overall picture of importing data process. Mc1-data-clean is merged with stHimark.shp using location and id as common attribute.

Ronald.Lay.2017 Overall Process.PNG

A map is successfully loaded into tableau

Ronald.Lay.2017 Map.PNG