Difference between revisions of "DataCleaning"
| Line 26: | Line 26: | ||
<font size="5">'''Cleaning of sensors data'''</font><br> | <font size="5">'''Cleaning of sensors data'''</font><br> | ||
| − | + | [[File:Dataflow.png|thumb|left]] | |
| − | Dataflow.png| | ||
| − | |||
==Static sensor readings== | ==Static sensor readings== | ||
I would like to append the static sensor readings to the mobile sensor readings. However, the fields of both files have to be the same. The missing data in the static sensor readings is the latitude and longitude of the sensor id, which can be found in the static location data. Hence, first I joined the StaticSensorReadings file to the StaticSensorLocations file. | I would like to append the static sensor readings to the mobile sensor readings. However, the fields of both files have to be the same. The missing data in the static sensor readings is the latitude and longitude of the sensor id, which can be found in the static location data. Hence, first I joined the StaticSensorReadings file to the StaticSensorLocations file. | ||
| − | [[File:Joinstaticlocation.png|thumb]] | + | [[File:Joinstaticlocation.png|thumb|left]] |
| + | |||
| + | To identify the sensor type, I decided to add a column “Sensor Type” to distinguish between static and mobile sensors. | ||
| + | [[File:Staticsensortype.png|thumb|left]] | ||
| + | |||
| + | As both files contain the same format of sensor id and some of the sensor id in the static sensor reading can also be found in the mobile sensor reading file but they are not the same sensor. Thus, a new id has to be generated. For the mobile sensor reading file, I simply concatenated the sensor id with a letter “M” in the front. As for the static reading sensor, I simply concatenated the sensor id with a letter “S” in the front. | ||
| + | |||
| + | [[File:Str s.png|thumb|left]] | ||
Revision as of 11:20, 11 October 2019
St. Hilmark Radiation Analysis
|
|
|
|
|
Cleaning of sensors data
Static sensor readings
I would like to append the static sensor readings to the mobile sensor readings. However, the fields of both files have to be the same. The missing data in the static sensor readings is the latitude and longitude of the sensor id, which can be found in the static location data. Hence, first I joined the StaticSensorReadings file to the StaticSensorLocations file.
To identify the sensor type, I decided to add a column “Sensor Type” to distinguish between static and mobile sensors.
As both files contain the same format of sensor id and some of the sensor id in the static sensor reading can also be found in the mobile sensor reading file but they are not the same sensor. Thus, a new id has to be generated. For the mobile sensor reading file, I simply concatenated the sensor id with a letter “M” in the front. As for the static reading sensor, I simply concatenated the sensor id with a letter “S” in the front.
