1718t1is428T4

From Visual Analytics for Business Intelligence
Revision as of 16:49, 18 November 2017 by Rujia.foo.2015 (talk | contribs)
Jump to navigation Jump to search
Drizzle header.png


 
Drizzle home.png
 

Proposal

 

Poster

 

Application

 

Research Paper


Problem, Motivation and Objective

Meteorological Service Singapore (MSS) collects abundant data on the weather in Singapore. There are 63 Automated Weather Stations (AWS) in Singapore, that collect daily rainfall, temperature and wind speed. This data is readily available, yearly since 1980. However, this useful data is not being properly presented, in a way that is the weather trends and patterns can be easily inferred.


Organisations in Singapore utilise past data from MSS to devise plans for future projects. Although the information is readily available from MSS, there is a strain on resources to extract, clean and analyse the data for specific organisations. Some organisations may be equipped with enough resources to carry out data analysis efficiently and effectively; while some may settle for the simplest analysis. With this application, we will provide a common data visualisation for the various organisations to utilize. As such, they will be able to infer relevant information from our application, without having to employ extra resources to do the same.


We want to build an application that visualizes the rainfall, temperature and wind speed patterns in Singapore. The visualisation should display the data over time (daily, monthly, yearly), and over location (based on the location of the AWS). By doing so, we believe that various organisations will benefit, based on the patterns observed.

Data Collection and Preparation

1) Historical daily records of rainfall, temperature and wind speed from the 63 AWSs, from Jan 1980 to Sept 2017.

Data source: http://www.weather.gov.sg/climate-historical-daily


Description: Daily rainfall total, highest 30-min rainfall, highest 60-min rainfall, highest 120-min rainfall, mean temperature, maximum temperature, mean wind speed and maximum wind speed by date for each AWS over the time period of January 1980 to September 2017.


Data Preparation:
Option 1: Use an original code developed by our team, to crawl the data from the MSS website, and clean it into individual CSV files for each year.
Option 2: Download the individual CSV, by location, month and year for the relevant locations (19 AWS), months and years (September 2007 to September 2017). Combine these :data into a individual CSV files for each year.


2) Location of the 63 AWSs (Automatic Weather Stations)

Data Source: http://www.weather.gov.sg/wp-content/uploads/2017/02/Annual-Climatological-Report-2016.pdf
Page 4 & 5, Table 4, Locations of AWSs


Description: Data table including AWS ID, AWS Name, Latitude, Longitude and Elevation above mean sea-level.


Data Preparation: Extract the data relevant to the 63 specified AWSs, and save it as a CSV file.

Background Survey and Related Works

Survey Explanation
Findings1.png



This visualisation shows the distribution of precipitation (i.e. rainfall) across the United States. The intensity of color on the map indicates the severity of rainfall at that location, with a darker color reflecting higher rainfall.
Findings2.png



This visualisation allows the user to choose 2 or more locations from the map, upon which the rainfall at these locations over the years is displayed as separate graphs for each location. As these graphs are placed side by side and follow similar axes, it is easy to compare the trends in rainfall between the locations selected. This is an easy and interactive way to allow the users to compare the data trends for the specific locations that are of interest to them.
Findings3.png



The visualisation allows the user to see how the rainfall varies between the 25th to 75th and 10th to 90th percentile bands, over the period of one year, showing variation within the months and not just the aggregate of the month's’ readings. By doing so, the viewers are able to differentiate the likelihood of a rainfall and its measurement throughout the year.

Technical Challenges

Key Technical Challenges Solutions
Least familiarity with D3.js, javascript and jQuery Attend workshop conducted during recess week

Self-learning through online platform (e.g. codeAcademy)

Peer-learning

Data Preparation Decide as a team on what data to keep and eliminate
Availability of data sets Research data through other platforms such as SMU Libraries and companies’ official webpage

Project Timeline

Drizzle schedule.png


Sketch

Homepage.jpg
Droplet1.jpg
Droplet2.jpg
Droplet3.jpg

Technologies & Tools

  • Excel
  • D3.js
  • Tableau
  • Javascript
  • jQuery


References

  1. https://www.ava.gov.sg/
  2. https://www.hpb.gov.sg/
  3. https://www.moh.gov.sg/content/moh_web/home.html


Comments