Difference between revisions of "Data Preparations"

From Visual Analytics and Applications
Jump to navigation Jump to search
 
(8 intermediate revisions by the same user not shown)
Line 1: Line 1:
 +
<div style=background:#2B3856 border:#A3BFB1>
 +
[[Image:JO Smokestack.jpg|250px]]
 +
<font size = 5; color="#FFFFFF">ISSS608 Assign Chen Xiaoqing - MC2 </font>
 +
</div>
 +
<!--MAIN HEADER -->
 +
{|style="background-color:#1B338F;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0"  |
 +
| style="font-family:Century Gothic; font-size:100%; solid #000000; background:#2B3856; text-align:center;" width="25%" |
 +
;
 +
[[Background| <font color="#FFFFFF">Background</font>]]
 +
 +
| style="font-family:Century Gothic; font-size:100%; solid #000000; background:#2B3856; text-align:center;" width="25%" |
 +
;
 +
[[Analytical Results| <font color="#FFFFFF">Analytical Results</font>]]
 +
 +
| style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#2B3856; text-align:center;" width="25%" |
 +
;
 +
[[Data Preparations| <font color="#FFFFFF">Data Preparations and Methods</font>]]
 +
 +
| style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#2B3856; text-align:center;" width="25%" |
 +
;
 +
[[Comments| <font color="#FFFFFF">Comments</font>]]
 +
 +
|  &nbsp;
 +
|}
 +
<br/>
 
=Join Sensor Reading and Meteorological Data=
 
=Join Sensor Reading and Meteorological Data=
 +
 +
We have two datasets, one is the sensor reading and another one is meteorological data.
 +
 +
The Sensor data (provided in an Excel spreadsheet) contains 3 months of readings in the following format:
 +
 +
[[file:4-1.png]]
 +
 +
The Meteorological data represents 3 months of readings in the following format:
 +
 +
[[file:4-2.png|400px]]
 +
 +
First these two data sets need to be joined into one table by “Data Time” = “Date”. (Tool: JMP_PRO, note that it is full join)
 +
 +
[[file:4-3.png|500px]]
 +
 +
After joining two table together, the table looks like:
 +
 +
[[file:4-4.png|600px]]
 +
 +
=Wind Detected Area=
 +
 +
*In order to plot the wind detected area, a triangle, which needs three points in one sensor, here create three same datasets.
 +
Create a new column named “Path” in each dataset. Assign 1, 2 and 3 to them for differentiation.
 +
 +
[[file:4-5.png|400px]][[file:4-6.png|400px]][[file:4-7.png|400px]]
 +
 +
*Concatenate all three tables
 +
 +
[[file:4-8.png]]
 +
 +
Then the rows in whole dataset increase as three times from 79247 to 237741.
 +
 +
                                                [[file:4-9.png]]------------------------->[[file:4-10.png]]
 +
 +
*Import this dataset into Tableau. The data frame looks like:
 +
 +
[[file:4-11.png|600px]]
 +
 +
*Build pre-coordinates using the location of each monitor
 +
 +
[[file:4-12.png|500px]][[file:4-13.png|500px]]
 +
 +
The monitor location is showing left below then add the park map as the background as right show:
 +
 +
[[file:4-14.png|500px|border]]        [[file:4-15.png|500px|border]]
 +
 +
*Building the coordinate for plotting wind
 +
 +
Wind detected area is a triangle, consisting of three points. The original point is from each sensor, two equal sides are the distance decided by wind speed, the middle angle is self-defined due to the unavailability of this data. The angle here is created as a control parameter, which can be changed manually.
 +
 +
[[file:4-16.png|500px]]
 +
 +
The angle’s range is from 0 to 90. The angle is related to the height of chimney in each factory, which is not available in this dataset, so here I assume it is 30。.
 +
 +
The wind triangle’s three points positions are related to the wind direction and wind speed.  The principle is showing below:
 +
 +
[[file:4-17.jpg|600px]]
 +
 +
So the X and Y are defined as below:
 +
 +
[[file:4-18.png|600px]][[file:4-19.png|600px]]
 +
 +
*Put X and Y into column and row
 +
*uncheck the aggregation measure
 +
*filter by hour of the date
 +
*put monitor in the detail 
 +
*select the polygon     
 +
 +
The wind detected area is like:
 +
 +
[[file:4-20.png|600px]]
 +
 +
=Horizon Graph=
 +
 +
Use horizon graph to show the individual reading more clearly. X-axis is the date time while y-axis is the difference between the reading and median along the whole. The density of color coding represents the level of difference. Orange means higher than median while green means lower than median. Then wrap the lower one up to the same horizon of higher one.
 +
Here need to create 5 bands represent different level of difference.
 +
 +
[[file:4-21.png|600px|border]]
 +
 +
The graph is band positive 1, means the reading is higher than median one band size. So on so forth.
 +
 +
The whole design is like:
 +
 +
[[file:4-22.png|800px|border]]
 +
 +
=Other Graphs=
 +
 +
Other graphs are all quite straightforward, just click the following link to see the sheets and dashboards.
 +
 +
https://public.tableau.com/profile/xiaoqing7362#!/vizhome/Assignment_Chen_Xiaoqing/monitorperformance?publish=yes

Latest revision as of 21:37, 13 July 2017

JO Smokestack.jpg ISSS608 Assign Chen Xiaoqing - MC2

Background

Analytical Results

Data Preparations and Methods

Comments

 


Join Sensor Reading and Meteorological Data

We have two datasets, one is the sensor reading and another one is meteorological data.

The Sensor data (provided in an Excel spreadsheet) contains 3 months of readings in the following format:

4-1.png

The Meteorological data represents 3 months of readings in the following format:

4-2.png

First these two data sets need to be joined into one table by “Data Time” = “Date”. (Tool: JMP_PRO, note that it is full join)

4-3.png

After joining two table together, the table looks like:

4-4.png

Wind Detected Area

  • In order to plot the wind detected area, a triangle, which needs three points in one sensor, here create three same datasets.

Create a new column named “Path” in each dataset. Assign 1, 2 and 3 to them for differentiation.

4-5.png4-6.png4-7.png

  • Concatenate all three tables

4-8.png

Then the rows in whole dataset increase as three times from 79247 to 237741.

                                               4-9.png------------------------->4-10.png
  • Import this dataset into Tableau. The data frame looks like:

4-11.png

  • Build pre-coordinates using the location of each monitor
4-12.png4-13.png

The monitor location is showing left below then add the park map as the background as right show:

4-14.png 4-15.png

  • Building the coordinate for plotting wind

Wind detected area is a triangle, consisting of three points. The original point is from each sensor, two equal sides are the distance decided by wind speed, the middle angle is self-defined due to the unavailability of this data. The angle here is created as a control parameter, which can be changed manually.

4-16.png

The angle’s range is from 0 to 90. The angle is related to the height of chimney in each factory, which is not available in this dataset, so here I assume it is 30。.

The wind triangle’s three points positions are related to the wind direction and wind speed. The principle is showing below:

4-17.jpg

So the X and Y are defined as below:

4-18.png4-19.png

  • Put X and Y into column and row
  • uncheck the aggregation measure
  • filter by hour of the date
  • put monitor in the detail
  • select the polygon

The wind detected area is like:

4-20.png

Horizon Graph

Use horizon graph to show the individual reading more clearly. X-axis is the date time while y-axis is the difference between the reading and median along the whole. The density of color coding represents the level of difference. Orange means higher than median while green means lower than median. Then wrap the lower one up to the same horizon of higher one. Here need to create 5 bands represent different level of difference.

4-21.png

The graph is band positive 1, means the reading is higher than median one band size. So on so forth.

The whole design is like:

4-22.png

Other Graphs

Other graphs are all quite straightforward, just click the following link to see the sheets and dashboards.

https://public.tableau.com/profile/xiaoqing7362#!/vizhome/Assignment_Chen_Xiaoqing/monitorperformance?publish=yes