Difference between revisions of "IS428 AY2019-20T1 Assign Lim Zi Yuan Data Analysis Transformation"
(Created page with "<div style=background:#3D5480 border:#A3BFB1> <font size = 5; color="#FFFFFF">VAST 2019 MC2: Citizen Science to the Rescue</font> </div> {|style="background-color:#3D5480;"...") |
|||
(8 intermediate revisions by the same user not shown) | |||
Line 7: | Line 7: | ||
| style="font-family:Century Gothic; font-size:100%; solid #000000; background:#3D5480; text-align:center;" width="20%" | | | style="font-family:Century Gothic; font-size:100%; solid #000000; background:#3D5480; text-align:center;" width="20%" | | ||
; | ; | ||
− | [[IS428_AY2019- | + | [[IS428_AY2019-20T1_Assign_Lim_Zi_yuan| <font color="#FFFFFF">Problem and Motivation</font>]] |
| style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#3D5480; text-align:center;" width="20%" | | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#3D5480; text-align:center;" width="20%" | | ||
; | ; | ||
Line 16: | Line 16: | ||
| style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#3D5480; text-align:center;" width="20%" | | | style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#3D5480; text-align:center;" width="20%" | | ||
− | [[IS428_AY2019- | + | [[IS428_AY2019-20T1_Assign_Lim_Zi_Yuan_1| <font color="#FFFFFF">Observations</font>]] |
; | ; | ||
|} | |} | ||
Line 24: | Line 24: | ||
2) StaticSensorReadings.csv | 2) StaticSensorReadings.csv | ||
3) StaticSensorLocations.csv | 3) StaticSensorLocations.csv | ||
+ | 4) StHimark.shp | ||
+ | |||
+ | For our data preparation, we will use a combination of Tableau Prep and Tableau to format our data the way we want it. | ||
= Data Preparation= | = Data Preparation= | ||
− | Upon | + | Upon inspection of the data source, I am able to see that StaticSensorReadings.csv and StaticSensorLocations.csv share the column "Sensor-id". Using tableau prep I merge the two files together allowing us to extract the value of each sensor at any given location |
+ | |||
+ | 1) Combining Static Locations and Static Readings | ||
+ | |||
+ | |||
+ | [[File:Sensorid.png|500px|centre]] | ||
+ | [[File:Final.png|500px|centre]] | ||
+ | The column Units is not used in our analysis and therefore we can remove it from our tables | ||
+ | |||
+ | 2) Removal of Units Column | ||
+ | [[File:Unit.png|500px|centre]] | ||
+ | |||
+ | Both Mobile and Static data share the column sensor-id. To prevent misunderstanding, we assignment unique names to each column. id-Static and id-Mobile | ||
+ | |||
+ | 3) Changing of Sensor-Id Name | ||
+ | |||
+ | [[File:Staticsensor.png|500px|centre]] | ||
+ | |||
+ | In order to get a sensing of where our mobile sensors pick up radiation levels, we have to combine MobileSensorReadings.csv with StHimark.shp. | ||
+ | |||
+ | 4) Combine Mobile Data with shape file | ||
+ | [[File:Shpfile.png|500px|centre]] |
Latest revision as of 01:16, 11 October 2019
VAST 2019 MC2: Citizen Science to the Rescue
|
|
|
|
Data Provided
Before we conduct any analysis, we have to perform data pre-processing to ensure that the data provided is in an easy to use format. The data provided to us are 1) MobileSensorReadings.csv 2) StaticSensorReadings.csv 3) StaticSensorLocations.csv 4) StHimark.shp
For our data preparation, we will use a combination of Tableau Prep and Tableau to format our data the way we want it.
Data Preparation
Upon inspection of the data source, I am able to see that StaticSensorReadings.csv and StaticSensorLocations.csv share the column "Sensor-id". Using tableau prep I merge the two files together allowing us to extract the value of each sensor at any given location
1) Combining Static Locations and Static Readings
The column Units is not used in our analysis and therefore we can remove it from our tables
2) Removal of Units Column
Both Mobile and Static data share the column sensor-id. To prevent misunderstanding, we assignment unique names to each column. id-Static and id-Mobile
3) Changing of Sensor-Id Name
In order to get a sensing of where our mobile sensors pick up radiation levels, we have to combine MobileSensorReadings.csv with StHimark.shp.
4) Combine Mobile Data with shape file