Difference between revisions of "ISSS608 2017-18 T3 Assign Miko Tan Mei Jia Visualization"
(Question 1 added) |
|||
Line 123: | Line 123: | ||
</tr> | </tr> | ||
<tr> | <tr> | ||
+ | |||
+ | ==Anomalies in the dataset== | ||
+ | <b>What anomalies do you find in the waterway samples dataset? How do these affect your analysis of potential problems to the environment? Is the Hydrology Department collecting sufficient data to understand the comprehensive situation across the Preserve? What changes would you propose to make in the sampling approach to best understand the situation? Your submission for this question should contain no more than 6 images and 500 words.</b> | ||
+ | <table> | ||
+ | <table border='1'> | ||
+ | <th>Insights</th> | ||
+ | <th>Visualization</th> | ||
+ | <tr> | ||
+ | <td> <b>1. Methylosmolene </b> | ||
+ | <br>There are anomalies found in the sensor readings for methylosmolene. In 2016, the Somchair station detects significantly high, constant readings of 130.5 ug/l. Since the values are the same throughout the year, these readings are most likely anomalies. The sensor could be having issues. </td> | ||
+ | <td>[[File:Methylosmolene2.png|700px|center]]</td> | ||
+ | </tr> | ||
+ | <tr> | ||
+ | <td> <b>2. Rangers Trend </b> | ||
+ | <br>Fig 8 below reveals weekly activity pattern for rangers. In 8.1, the heatmap was configured to show the average stay duration for the rangers at various gates. We noticed the rangers would stay for extended durations at camping 8 (Mondays, 10am to 14pm) as well as gate 2 & rangerstop 1 (Mondays 6am – 11am, Wednesdays 13 – 16pm). The rangers could be doing inspection or maintenance works at this these locations. Looking at the reserve map, we can observe that ranger stop 1 and camping 8 are both located at the “dead ends” of the reserve, with no paths extending beyond them – it is likely that these two locations are surrounded with floras whereby periodic maintenance is required. | ||
+ | |||
+ | <br>In Fig 8.2 we could see the rangers gathered at the rangerbase and gate 8 (which is in close proximity to the ranger base) on Thursdays 14pm. It could be an indication that the weekly ranger meetings were held on Thursdays 14pm at the rangerbase.</td> | ||
+ | <td>[[File:gyf_updated9.png|600px|center]]</td> | ||
+ | </tr> | ||
+ | <tr> | ||
+ | <td> <b>3.Service Trucks</b> | ||
+ | <br>Fig 9 below shows the weekly movement pattern for service trucks at various gates. We noticed that there were a higher number of service trucks moved pass the “connecting path” on Thursdays, at two prominent timings: 1am and 16pm. This might be the scheduled delivery/pick up hours for the service trucks. </td> | ||
+ | <td>[[File:gyf_updated10.png|600px|center]]</td> | ||
+ | </tr> | ||
+ | <tr> | ||
+ | <td> <b>4. Sightseeing coaches</b> | ||
+ | <br> <br>Lastly, Fig 10 shows the weekly movement pattern for sightseeing coaches. The sightseeing coaches seemed to be bringing the visitors to the reserve on fixed days and hours, as the darker blocks on the heatmap tend to appear in regular intervals. For example, the coaches tend to visit the reserve at below timings: | ||
+ | <br>-Fridays & Sundays 3am <br>-Thursdays & Sundays 11am <br>-Sundays 16pm <br>-Mondays 22 pm </td> | ||
+ | <td>[[File:gyf_updated11.png|600px|center]] | ||
+ | </tr> | ||
+ | </table> | ||
+ | |||
+ | ==The Anomalies== | ||
+ | <b>The Movement Anomaly</b> | ||
+ | <br>We first used the “Movement Anomaly” dashboard to discover the anomalies in the visitors’ movements. Each individual movement was represented by a Gantt bar. The Y axis contains all the days in the observation period and X axis shows the hours of the day. Filters allows the users to filter to see the activities at restricted gates, or only the activities by certain type of cars or visitors. Three movement anomalies were observed. | ||
+ | [[File:gyf_updated12.png|700px|center]] | ||
+ | |||
+ | <table> | ||
+ | <table border='1'> | ||
+ | <tr> | ||
+ | <th>Anomalies & Car ID</th> | ||
+ | <th>Visualization</th> | ||
+ | </tr> | ||
+ | <tr> | ||
+ | <td>In 12.1, we filtered away the 2P cars and filtered in only the restricted gates and noticed two types of trespassing behaviours: | ||
+ | <br>a.A group of 6 cars (type 1) entered from entrance 1 trespassing restricted area ranger stop 1 from 10am to 16pm, on 10 July 2015. The sensors at gate2 did not capture any of their activities, most likely they moved to rangerstop1 from the entrance1 directly through the jungles. As discussed earlier on, rangerstop 1 is one of the areas that are frequently maintained by the rangers and floras could be found there. This could be one area where the birds are nesting. | ||
+ | [[File:gyf_updated13.png|600px|center]]</td> | ||
+ | <td>The gif below shows the paths adopted by the suspicious vehicles,the restricted gates are colored in red.[[File:gyf_suspicious2.gif|520px|center]]</td> | ||
+ | </tr> | ||
+ | <tr> | ||
+ | <td>2.b.4 vehicle entered from entrance 3 trespassing restricted areas (gate5,gate6,rangerstop6,gate3 & ranger stop 3) 23 times from 2am to 5 am, only observed on Tuesdays and Thursdays. The trespassing cars followed almost exactly the same paths. This looks like some planned acts which were only performed under the masks of the dark night. Type 4 vehicles are the heavy trucks; they could be transporting some illegal materials in or out of the preserve repeatedly. | ||
+ | [[File:gyf_updated14.png|500px|center]]</td> | ||
+ | <td>The gif below shows the paths adopted by the suspicious vehicles,the restricted gates are colored in red.[[File:gyf_suspicious1.gif|500px|center]]</td> | ||
+ | </tr> | ||
+ | <tr> | ||
+ | <td>In 12.2, we kept only the “extended campers” and included all the gates in the analysis. We noticed some suspicious movements of the extended campers at 0 hours which the rest of the extended campers would not be active at this hour. Interestingly, we noticed all the activity records belong to the car ID 20154519024544-322, which stayed in the preserve for 5 months. </td> | ||
+ | </tr> | ||
+ | </table> | ||
+ | |||
+ | |||
+ | <b>Stay Duration Anomaly</b> | ||
+ | <br>In the “Stay Duration Anomaly” dashboard we introduced two scatter plots for anomaly discovery. | ||
+ | <p>[[File:gyf_updated15.png|800px|center]]</p> | ||
+ | |||
+ | <table> | ||
+ | <table border='1'> | ||
+ | <tr> | ||
+ | <th>Anomalies & Car ID</th> | ||
+ | <th>Visualization</th> | ||
+ | </tr> | ||
+ | <tr> | ||
+ | <td>4.Abnormally high number of stops visited with low average duration | ||
+ | <br> • Car-ID 20154519024544-322 visited total 281 stops in the park and stayed in the park from 19th Jun to 5th Oct (Extended camper). The same car ID appeared under observation 4. | ||
+ | <br> • Car-ID 20154112014114-381 visited 98 stops and stayed from 14th Jun to 26th Jul (Extended camper) | ||
+ | |||
+ | <br>5.Abnormally high average duration in the reserve with low number of stops visited | ||
+ | <br> • 20150105060134-242, 20150420100416-232 visited 4 checkpoints but stayed for over one month in the reserve (Extended camper)</td> | ||
+ | <td>[[File:gyf_3_7.png|500px|center]]</td> | ||
+ | </tr> | ||
+ | <tr> | ||
+ | <td>6.Hiking or sightseeing visitors with abnormally long stay in the park (they are the same group of visitors observed in 1) | ||
+ | <br> 7.Hiking or sightseeing visitors with abnormally long stay in the park, car type4 | ||
+ | [[File:gyf_3_7id.png|200px|center]]</td> | ||
+ | <td>[[File:gyf_3_8.png|500px|center]]</td> | ||
+ | </tr> | ||
+ | </table> |
Revision as of 22:11, 8 July 2018
|
|
|
|
Insights from Viz
Chemical Contamination: Trends of possible interest
Anomalies in the dataset
What anomalies do you find in the waterway samples dataset? How do these affect your analysis of potential problems to the environment? Is the Hydrology Department collecting sufficient data to understand the comprehensive situation across the Preserve? What changes would you propose to make in the sampling approach to best understand the situation? Your submission for this question should contain no more than 6 images and 500 words.
Insights | Visualization |
---|---|
1. Toxic manufacturing chemical - Methylosmolene
|
|
2. Anionic Active Surfactant
|
|
3. Arsenic
|
|
4. Biochemical Oxygen Demand
The filtered dashboard show the spikes in BOD at Tansanee in recent times. |
|
5. Chlorodinine
|
|
6. Chromium
|
|
7. Cyanides
|
|
8. Iron
|
|
9. Lead
|
|
10. Nickel
|
|
Insights | Visualization |
---|---|
1. Methylosmolene
There are anomalies found in the sensor readings for methylosmolene. In 2016, the Somchair station detects significantly high, constant readings of 130.5 ug/l. Since the values are the same throughout the year, these readings are most likely anomalies. The sensor could be having issues. |
|
2. Rangers Trend
In Fig 8.2 we could see the rangers gathered at the rangerbase and gate 8 (which is in close proximity to the ranger base) on Thursdays 14pm. It could be an indication that the weekly ranger meetings were held on Thursdays 14pm at the rangerbase. |
|
3.Service Trucks
Fig 9 below shows the weekly movement pattern for service trucks at various gates. We noticed that there were a higher number of service trucks moved pass the “connecting path” on Thursdays, at two prominent timings: 1am and 16pm. This might be the scheduled delivery/pick up hours for the service trucks. |
|
4. Sightseeing coaches
-Fridays & Sundays 3am -Thursdays & Sundays 11am -Sundays 16pm -Mondays 22 pm |
The Anomalies
The Movement Anomaly
We first used the “Movement Anomaly” dashboard to discover the anomalies in the visitors’ movements. Each individual movement was represented by a Gantt bar. The Y axis contains all the days in the observation period and X axis shows the hours of the day. Filters allows the users to filter to see the activities at restricted gates, or only the activities by certain type of cars or visitors. Three movement anomalies were observed.
Anomalies & Car ID | Visualization |
---|---|
In 12.1, we filtered away the 2P cars and filtered in only the restricted gates and noticed two types of trespassing behaviours:
|
The gif below shows the paths adopted by the suspicious vehicles,the restricted gates are colored in red. |
2.b.4 vehicle entered from entrance 3 trespassing restricted areas (gate5,gate6,rangerstop6,gate3 & ranger stop 3) 23 times from 2am to 5 am, only observed on Tuesdays and Thursdays. The trespassing cars followed almost exactly the same paths. This looks like some planned acts which were only performed under the masks of the dark night. Type 4 vehicles are the heavy trucks; they could be transporting some illegal materials in or out of the preserve repeatedly. | The gif below shows the paths adopted by the suspicious vehicles,the restricted gates are colored in red. |
In 12.2, we kept only the “extended campers” and included all the gates in the analysis. We noticed some suspicious movements of the extended campers at 0 hours which the rest of the extended campers would not be active at this hour. Interestingly, we noticed all the activity records belong to the car ID 20154519024544-322, which stayed in the preserve for 5 months. |
Stay Duration Anomaly
In the “Stay Duration Anomaly” dashboard we introduced two scatter plots for anomaly discovery.
Anomalies & Car ID | Visualization |
---|---|
4.Abnormally high number of stops visited with low average duration
• 20150105060134-242, 20150420100416-232 visited 4 checkpoints but stayed for over one month in the reserve (Extended camper) |
|
6.Hiking or sightseeing visitors with abnormally long stay in the park (they are the same group of visitors observed in 1)
|