Difference between revisions of "1718t1is428T4"

From Visual Analytics for Business Intelligence
Jump to navigation Jump to search
 
(46 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 +
[[File:Drizzle_header.png|1260px|center]]
 +
<br/>
 +
<!--Header-->
 +
{|style="background-color:#F5F5F5; color:#4d79ff; padding: 10 0 10 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" |
  
−
===<div style="background-color:maroon"><font color="white"> Problem and Motivation </font></div>===
+
| style="background:#fff;" width="1%" | &nbsp;
−
The increasing number of food delivery companies, such as FoodPanda, Deliveroo and UberEATS, has provided residents in Singapore with an easy alternative to have their food delivered to their doorstep. The convenience reaped from this service has also gained popularity among the working population and students due to the reduction in time in getting the meal. This is a worrying trend just like the increasing preference for fast food.
+
| style="padding:0.2em; font-size:100%; background-color:#1E90FF; text-align:center; color:#1D1D1D; letter-spacing: 1px;" width="3%" |
 +
[[Image:Drizzle_home.png|center|20px|link=Project_Groups]]
  
−
As how consuming more fast food reduced the time taken to wait for the food, the benefit of food delivery has adversely promoted laziness in the users, whereby the ease of getting food has eliminated the travelling time and effort for the users. This means that one can spend more time enjoying his/her meal and also get more whenever and wherever they want.
+
| style="background:#fff;" width="1%" | &nbsp;
 +
| style="padding:0.2em; font-size:100%; background-color:#4682B4; text-align:center; color:#1D1D1D; letter-spacing: 1px;" width="10%" |
 +
[[1718t1is428T4 |<font color="#fff" size=2 face="Trebuchet MS"><b>Proposal</b></font>]]
  
−
Studies are showing that Singapore will reach a concerning 15% for obesity rate in seven years. Obesity has significant implications such as high blood pressure, type 2 diabetes, heart diseases, strokes, etc. Coming from a generation which focuses on convenience and quickness, we were curious to find out the factors that drive the rate of obesity so that we can propose a solution to combat obesity on a national level.
+
| style="background:#fff;" width="1%" | &nbsp;
 +
| style="padding:0.2em; font-size:100%; background-color:#1E90FF; text-align:center; color:#1D1D1D; letter-spacing: 1px;" width="10%" |
 +
[[1718t1is428T4_Poster|<font color="#fff" size=2 face="Trebuchet MS"><b>Poster</b></font>]]
  
 +
| style="background:#fff;" width="1%" | &nbsp;
 +
| style="padding:0.2em; font-size:100%; background-color:#1E90FF; text-align:center; color:#1D1D1D; letter-spacing: 1px;" width="10%" |
 +
[[1718t1is428T4_Application|<font color="#fff" size=2 face="Trebuchet MS"><b>Application</b></font>]]
  
−
===<div style="background-color:maroon"><font color="white"> Background Survey and Related Works </font></div>===
+
| style="background:#fff;" width="1%" | &nbsp;
 +
| style="padding:0.2em; font-size:100%; background-color:#1E90FF; text-align:center; color:#1D1D1D; letter-spacing: 1px;" width="10%" |
 +
[[1718t1is428T4_Research Paper|<font color="#fff" size=2 face="Trebuchet MS"><b>Research Paper</b></font>]]
 +
|}
 +
<!--/Header-->
 +
 
 +
<!--Content-->
 +
 
 +
===<div style="background: #1E90FF; padding-top: 20px; padding-bottom: 20px; line-height: 0.3em; text-indent: 15px; font-size:18px; font-family:Trebuchet MS; letter-spacing: 1px;"><font color= #fff>Problem, Motivation and Objective</font></div>===
 +
Meteorological Service Singapore (MSS) collects abundant data on the weather in Singapore. There are 63 Automated Weather Stations (AWS) in Singapore, that collect daily rainfall, temperature and wind speed. This data is readily available, yearly since 1980. However, this useful data is not being properly presented, in a way that is the weather trends and patterns can be easily inferred.
 +
 
 +
 
 +
Organisations in Singapore utilise past data from MSS to devise plans for future projects. Although the information is readily available from MSS, there is a strain on resources to extract, clean and analyse the data for specific organisations. Some organisations may be equipped with enough resources to carry out data analysis efficiently and effectively; while some may settle for the simplest analysis. With this application, we will provide a common data visualisation for the various organisations to utilize. As such, they will be able to infer relevant information from our application, without having to employ extra resources to do the same.
 +
 
 +
 
 +
We want to build an application that visualizes the rainfall, temperature and wind speed patterns in Singapore. The visualisation should display the data over time (daily, monthly, yearly), and over location (based on the location of the AWS). By doing so, we believe that various organisations will benefit, based on the patterns observed.
 +
 
 +
===<div style="background: #1E90FF; padding-top: 20px; padding-bottom: 20px; line-height: 0.3em; text-indent: 15px; font-size:18px; font-family:Trebuchet MS; letter-spacing: 1px;"><font color= #fff>Data Collection and Preparation</font></div>===
 +
 
 +
 
 +
====1) Historical daily records of rainfall, temperature and wind speed from the 63 AWSs, from Jan 1980 to Sept 2017.====
 +
 +
:Data source: http://www.weather.gov.sg/climate-historical-daily
 +
 +
 
 +
:Description: Daily rainfall total, highest 30-min rainfall, highest 60-min rainfall, highest 120-min rainfall, mean temperature, maximum temperature, mean wind speed and maximum wind speed by date for each AWS over the time period of January 1980 to September 2017.
 +
 +
 
 +
:Data Preparation:
 +
:Option 1: Use an original code developed by our team, to crawl the data from the MSS website, and clean it into individual CSV files for each year.
 +
:Option 2: Download the individual CSV, by location, month and year for the relevant locations (19 AWS), months and years (September 2007 to September 2017). Combine these :data into a individual CSV files for each year.
 +
 
 +
 +
====2) Location of the 63 AWSs (Automatic Weather Stations)====
 +
 +
 
 +
:Data Source: http://www.weather.gov.sg/wp-content/uploads/2017/02/Annual-Climatological-Report-2016.pdf
 +
:Page 4 & 5, Table 4, Locations of AWSs
 +
 +
 
 +
:Description: Data table including AWS ID, AWS Name, Latitude, Longitude and Elevation above mean sea-level.
 +
 +
 
 +
:Data Preparation: Extract the data relevant to the 63 specified AWSs, and save it as a CSV file.
 +
 
 +
===<div style="background: #1E90FF; padding-top: 20px; padding-bottom: 20px; line-height: 0.3em; text-indent: 15px; font-size:18px; font-family:Trebuchet MS; letter-spacing: 1px;"><font color= #fff>Background Survey and Related Works</font></div>===
 
{| class="wikitable"
 
{| class="wikitable"
 
| '''Survey'''
 
| '''Survey'''
 
| '''Explanation'''
 
| '''Explanation'''
 
|-
 
|-
−
| [[File:bmi.png|center|upright=3.0]]
+
| [[File:Findings1.png|center|600x500px|upright=3.0]]
 +
<br><br>
 +
<div align="center"><font size="1">Source : https://www.climate.gov/maps-data/data-snapshots/totalprecip-monthly-cmb-2017-09-00?theme=Precipitation</font></div>
 +
| This visualisation shows the distribution of precipitation (i.e. rainfall) across the United States. The intensity of color on the map indicates the severity of rainfall at that location,  with a darker color reflecting higher rainfall.
  
−
<div align="center">Source : https://www.hpb.gov.sg/docs/default-source/pdf/obesity-cpg_main_for-online-30-aug.pdf?sfvrsn=2288eb72_0</div>
 
−
| This figure allow us to have an understanding of the residents in Singapore that have a higher potential of high-risk BMI, by breaking it down into three different ethnic group, comprising Chinese, Malay and Indian. Within each group, a further breakdown by gender was carried out, providing us with a clearer view of their diet preferences.
 
 
|-
 
|-
−
| [[File:sgObese.png|center|upright=3.0]]
+
| [[File:Findings2.png|center|600x500px]]
 +
<br><br>
 +
<div align="center"><font size="1">Source: https://climate-explorer.nemac.org/?tp=g_a&center=-9413982.7,3893395.7&zoom=4&p=G&scales=time:20161031000000.0:20171031000000.0,ytd-prcp:0.0:60.0,temp:0.0:100.0&graphs=USC00166686:PRCP_YTD,USC00233838:PRCP_YTD
 +
</font></div>
 +
| This visualisation allows the user to choose 2 or more locations from the map, upon which the rainfall at these locations over the years is displayed as separate graphs for each location. As these graphs are placed side by side and follow similar axes, it is easy to compare the trends in rainfall between the locations selected. This is an easy and interactive way to allow the users to compare the data trends for the specific locations that are of interest to them.
  
−
<div align="center">Source: https://foodindustry.asia/the-state-of-obesity-in-singapore</div>
 
−
| This figure has shown the obesity rate among children and how these habits that was inculcated since young may lead to a lifestyle in their later stage of life. The graph has also included the recommended and actual calories intake by adult on a daily basis. With the alarming rate of obesity among children and adult, the proportion of obese residents in Singapore will reach 15% by 2024, if no action or measures is taken or enforced.
 
 
|-
 
|-
−
| [[File:riskFac.png|center|upright=3.0]]
+
| [[File:Findings3.png|center|600x500px]]
 +
<br><br>
 +
<div align="center"><font size="1">Source: https://weatherspark.com/y/114655/Average-Weather-in-Singapore-Year-Round</font></div>
 +
| The visualisation allows the user to see how the rainfall varies between the 25th to 75th and 10th to 90th percentile bands, over the period of one year, showing variation within the months and not just the aggregate of the month's’ readings. By doing so, the viewers are able to differentiate the likelihood of a rainfall and its measurement throughout the year.
  
−
<div align="center">Source: https://www.moh.gov.sg/content/dam/moh_web/Publications/Reports/2014/HLMP/MOH_Healthy%20Living%20Master%20Plan_Inside%20Page_8d.pdf</div>
 
−
| This figure has shown the obesity rate among children and how these habits that was inculcated since young may lead to a lifestyle in their later stage of life. The graph has also included the recommended and actual calories intake by adult on a daily basis. With the alarming rate of obesity among children and adult, the proportion of obese residents in Singapore will reach 15% by 2024, if no action or measures is taken or enforced.
 
 
|}
 
|}
  
−
===<div style="background-color:maroon"><font color="white"> Technical Challenges </font></div>===
+
===<div style="background: #1E90FF; padding-top: 20px; padding-bottom: 20px; line-height: 0.3em; text-indent: 15px; font-size:18px; font-family:Trebuchet MS; letter-spacing: 1px;"><font color= #fff>Technical Challenges</font></div>===
 
{| class="wikitable"
 
{| class="wikitable"
 +
|-
 +
|'''Key Technical Challenges'''
 +
|'''Solutions'''
 
|-
 
|-
 
|Least familiarity with D3.js, javascript and jQuery
 
|Least familiarity with D3.js, javascript and jQuery
−
|Attend workshop conducted during recess week
+
|Attend workshop conducted during recess week<br>
−
Self-learning through online platform (e.g. codeAcademy)
+
Self-learning through online platform (e.g. codeAcademy)<br><br>
 
Peer-learning
 
Peer-learning
 
|-
 
|-
Line 43: Line 107:
 
|Research data through other platforms such as SMU Libraries and companies’ official webpage  
 
|Research data through other platforms such as SMU Libraries and companies’ official webpage  
 
|}
 
|}
 +
 +
===<div style="background: #1E90FF; padding-top: 20px; padding-bottom: 20px; line-height: 0.3em; text-indent: 15px; font-size:18px; font-family:Trebuchet MS; letter-spacing: 1px;"><font color= #fff>Project Timeline</font></div>===
 +
 +
[[File:Drizzle_schedule.png|center|1000x900px]]
 +
 +
 +
===<div style="background: #1E90FF; padding-top: 20px; padding-bottom: 20px; line-height: 0.3em; text-indent: 15px; font-size:18px; font-family:Trebuchet MS; letter-spacing: 1px;"><font color= #fff>Sketch</font></div>===
 +
 +
{| class="wikitable"
 +
 +
|-
 +
| [[File:Homepage.jpg|center|600px]]
 +
| [[File:Droplet1.jpg|center|600px]]
 +
|-
 +
 +
| [[File:Droplet2.jpg|center|600px]]
 +
| [[File:Droplet3.jpg|center|600px]]
 +
|-
 +
 +
|}
 +
 +
===<div style="background: #1E90FF; padding-top: 20px; padding-bottom: 20px; line-height: 0.3em; text-indent: 15px; font-size:18px; font-family:Trebuchet MS; letter-spacing: 1px;"><font color= #fff> Technologies & Tools</font></div>===
 +
 +
 +
<ul>
 +
<li>Excel</li>
 +
<li>Python</li>
 +
<li>Tableau</li>
 +
<li>Javascript</li>
 +
<li>HTML5</li>
 +
<li>CSS</li>
 +
<li>jQuery</li>
 +
</ul>
 +
 +
 +
===<div style="background: #1E90FF; padding-top: 20px; padding-bottom: 20px; line-height: 0.3em; text-indent: 15px; font-size:18px; font-family:Trebuchet MS; letter-spacing: 1px;"><font color= #fff> References </font></div>===
 +
<ol>
 +
<li>http://www.weather.gov.sg/about-our-organisation/#vision</li>
 +
<li>http://www.weather.gov.sg/climate-historical-daily/</li>
 +
<li>http://www.weather.gov.sg/wp-content/uploads/2017/02/Annual-Climatological-Report-2016.pdf</li>
 +
</ol>
  
  
−
===<div style="background-color:maroon"><font color="white">Project Timeline</font></div>===
+
===<div style="background: #1E90FF; padding-top: 20px; padding-bottom: 20px; line-height: 0.3em; text-indent: 15px; font-size:18px; font-family:Trebuchet MS; letter-spacing: 1px;"><font color= #fff> Comments  </font></div>===

Latest revision as of 03:13, 23 November 2017

Drizzle header.png


 
Drizzle home.png
  

Proposal

 

Poster

 

Application

 

Research Paper


Problem, Motivation and Objective

Meteorological Service Singapore (MSS) collects abundant data on the weather in Singapore. There are 63 Automated Weather Stations (AWS) in Singapore, that collect daily rainfall, temperature and wind speed. This data is readily available, yearly since 1980. However, this useful data is not being properly presented, in a way that is the weather trends and patterns can be easily inferred.


Organisations in Singapore utilise past data from MSS to devise plans for future projects. Although the information is readily available from MSS, there is a strain on resources to extract, clean and analyse the data for specific organisations. Some organisations may be equipped with enough resources to carry out data analysis efficiently and effectively; while some may settle for the simplest analysis. With this application, we will provide a common data visualisation for the various organisations to utilize. As such, they will be able to infer relevant information from our application, without having to employ extra resources to do the same.


We want to build an application that visualizes the rainfall, temperature and wind speed patterns in Singapore. The visualisation should display the data over time (daily, monthly, yearly), and over location (based on the location of the AWS). By doing so, we believe that various organisations will benefit, based on the patterns observed.

Data Collection and Preparation

1) Historical daily records of rainfall, temperature and wind speed from the 63 AWSs, from Jan 1980 to Sept 2017.

Data source: http://www.weather.gov.sg/climate-historical-daily


Description: Daily rainfall total, highest 30-min rainfall, highest 60-min rainfall, highest 120-min rainfall, mean temperature, maximum temperature, mean wind speed and maximum wind speed by date for each AWS over the time period of January 1980 to September 2017.


Data Preparation:
Option 1: Use an original code developed by our team, to crawl the data from the MSS website, and clean it into individual CSV files for each year.
Option 2: Download the individual CSV, by location, month and year for the relevant locations (19 AWS), months and years (September 2007 to September 2017). Combine these :data into a individual CSV files for each year.


2) Location of the 63 AWSs (Automatic Weather Stations)

Data Source: http://www.weather.gov.sg/wp-content/uploads/2017/02/Annual-Climatological-Report-2016.pdf
Page 4 & 5, Table 4, Locations of AWSs


Description: Data table including AWS ID, AWS Name, Latitude, Longitude and Elevation above mean sea-level.


Data Preparation: Extract the data relevant to the 63 specified AWSs, and save it as a CSV file.

Background Survey and Related Works

Survey Explanation
Findings1.png



 This visualisation shows the distribution of precipitation (i.e. rainfall) across the United States. The intensity of color on the map indicates the severity of rainfall at that location, with a darker color reflecting higher rainfall.
Findings2.png



 This visualisation allows the user to choose 2 or more locations from the map, upon which the rainfall at these locations over the years is displayed as separate graphs for each location. As these graphs are placed side by side and follow similar axes, it is easy to compare the trends in rainfall between the locations selected. This is an easy and interactive way to allow the users to compare the data trends for the specific locations that are of interest to them.
Findings3.png



 The visualisation allows the user to see how the rainfall varies between the 25th to 75th and 10th to 90th percentile bands, over the period of one year, showing variation within the months and not just the aggregate of the month's’ readings. By doing so, the viewers are able to differentiate the likelihood of a rainfall and its measurement throughout the year.

Technical Challenges

Key Technical Challenges Solutions
Least familiarity with D3.js, javascript and jQuery Attend workshop conducted during recess week

Self-learning through online platform (e.g. codeAcademy)

Peer-learning

Data Preparation Decide as a team on what data to keep and eliminate
Availability of data sets Research data through other platforms such as SMU Libraries and companies’ official webpage

Project Timeline

Drizzle schedule.png


Sketch

Homepage.jpg
Droplet1.jpg
Droplet2.jpg
Droplet3.jpg

Technologies & Tools

  • Excel
  • Python
  • Tableau
  • Javascript
  • HTML5
  • CSS
  • jQuery


References

  1. http://www.weather.gov.sg/about-our-organisation/#vision
  2. http://www.weather.gov.sg/climate-historical-daily/
  3. http://www.weather.gov.sg/wp-content/uploads/2017/02/Annual-Climatological-Report-2016.pdf


Comments

Retrieved from ‘https://wiki.smu.edu.sg/1718t1is428g1/index.php?title=1718t1is428T4&oldid=4787’