Difference between revisions of "ChargeMetrics Proposal"

From Visual Analytics for Business Intelligence
Jump to navigation Jump to search
Line 48: Line 48:
  
 
<!-- END  Related Works  -->
 
<!-- END  Related Works  -->
 +
 +
<p>In our analysis, we will only be using data within the year of 1990 - 2017. The rationale for the range of data selected is as follows:</p>
 +
 +
<p>The dataset for analysis will be retrieved from multiple databases, as elaborated below:</p>
 +
{| class="wikitable" style="background-color:#FFFFFF;" width="100%"
 +
|-
 +
! style="font-weight: bold;background: #56C0BE;color:#fbfcfd;width: 30%;" | Dataset/Source
 +
! style="font-weight: bold;background: #56C0BE;color:#fbfcfd;width: 30%" | Data Attributes
 +
! style="font-weight: bold;background: #56C0BE;color:#fbfcfd;" | Rationale Of Usage
 +
|-
 +
| <center>Resales flat prices from Mar 2012 onwards<br/>
 +
(https://data.gov.sg/dataset/resale-flat-prices?resource_id=83b2fc37-ce8c-4df4-968b-370fd818138b ) </center>
 +
<center>Resales flat prices from 2002 - Feb 2012 <br/>
 +
(https://data.gov.sg/dataset/resale-flat-prices?resource_id=8c00bf08-9124-479e-aeca-7cc411d884c4 ) </center>
 +
<center>Resales flat prices from 1990 - 1999<br/>
 +
(https://data.gov.sg/dataset/resale-flat-prices?resource_id=adbbddd3-30e2-445f-a123-29bee150a6fe ) </center>
 +
||
 +
* Month
 +
* Town
 +
* Flat Type
 +
* Block
 +
* Street Name
 +
* Storey Range
 +
* Floor Area (Sqm)
 +
* Flat Model
 +
* Lease Commence Date
 +
* Resale Price (S$)
 +
||
 +
<center>This dataset will be used as a main source of information in our analysis to understand the number of HDB around Singapore from 1990 to 1999, 2002 to Feb 2012 and Mar 2012 onwards respectively.</center>
 +
|-
 +
| <center>Bus Stop Names and Locations<br/>
 +
(https://www.mytransport.sg/content/mytransport/home/dataMall.html#)</center>
 +
[[File:Bus data.png|center|500px]]
 +
||
 +
* Bus Stop Number
 +
* Bus Stop Roof Number
 +
* Bus Stop Name
 +
* X
 +
* Y
 +
* Latitude
 +
* Longitude
 +
||
 +
<center>This dataset aims to complement the main dataset by providing detailed information about the latitude and longitude of the bus stops located around HDB. We use a javascript geocoding script to convert all the X and Y coordinates to EPSG:4326 latitude and longitude coordinates.</center>
 +
|-
 +
| <center>Mrt Stations Names and Locations <br/>
 +
(https://www.mytransport.sg/content/mytransport/home/dataMall.html#)</center>
 +
[[File:MRT data.png|center|500px]]
 +
||
 +
* MRT Station Number
 +
* MRT Station Name
 +
* X
 +
* Y
 +
* Latitude
 +
* Longitude
 +
||
 +
<center>This dataset aims to complement the main dataset by providing detailed information about the latitude and longitude of the MRT stations located around HDB. We use a javascript geocoding script to convert all the X and Y coordinates to EPSG:4326 latitude and longitude coordinates</center>
 +
|-
 +
| <center>Master Plan Subzone Boundary Names and GeoPolygon <br/>
 +
(https://data.gov.sg/dataset/master-plan-2014-subzone-boundary-no-sea)</center>
 +
[[File:Subzone1.png|center|500px]]<br/>
 +
[[File:Subzone2.png|center|500px]]
 +
||
 +
* Polygon
 +
* Name
 +
* Subzone Number
 +
* Subzone Code
 +
* Region Name
 +
* Area Code
 +
* Area Indicator
 +
||
 +
<center>This dataset aims to complement the main dataset by providing detailed information about all the subzone in Singapore. We use a javascript library toGeoJson.js to help us convert .KML file to .GeoJson file</center>
 +
|}
 +
 +
 +
<br/><div style="background: #347473; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px;letter-spacing:-0.08em;font-size:20px"><font color=#fbfcfd face="Century Gothic">BACKGROUND SURVEY OF RELATED WORKS</font></div>
 +
There are many charts and visualisations available which illustrates the various trends of house prices and index. We have selected a few of these to study and learn before we begin developing our own visualizations.
 +
{| class="wikitable" style="background-color:#FFFFFF;" width="100%"
 +
|-
 +
! style="font-weight: bold;background: #56C0BE;color:#fbfcfd;width: 50%;" | Related Works
 +
! style="font-weight: bold;background: #56C0BE;color:#fbfcfd;" | What We Can Learn
 +
|-
 +
|
 +
<p><center>'''An Analysis of the trend and correlation between resale prices and flat production''' </center></p>
 +
[[File:1718T1G1 BackgroundSurvey1.png|400px|center]]
 +
<p><center>'''Source''': http://www.teoalida.com/singapore/hdbprices/</center></p>
 +
||
 +
* The use of 2 different chart types with a secondary axis is effective in illustrating the correlation between resale prices and flat production.
 +
* The colours used are striking and contrast well with each other.
 +
* There are dips  in both variables which are not explained in the infographic itself (E.g. 1997 Asian crisis, 2003 SARs outbreak). This events could be incorporated into the charts to make it more informative.
 +
* However, major events are not shown in the chart itself. This makes it difficult for the audience to understand the various changes throughout the years. It would be much clearer if events were annotated directly on the charts.
 +
|-
 +
| <p><center> '''An interactive heatmap of Singapore’s house prices in various districts''' </center></p>
 +
[[File:1718T1G1 BackgroundSurvey2.png|400px|center]]
 +
<p><center> '''Source''': https://www.srx.com.sg/heat-map </center> </p>
 +
||
 +
* This heatmap uses colours appropriately so that the house prices of each district can be identified intuitively (Red means expensive, blue means cheap, orange means mid-range)
 +
* The use of filters allows user to find out more about the price distribution of each house type easily.
 +
* When user mouseover a district on the heatmap, the corresponding district on the legend is highlighted. This improves usability as users do not have to match district numbers manually.
 +
* Even though the colours are intuitive, it could still be confusing as audience might still have to constantly refer back to the colour scale to interpret the colours. Colour intensity of a single colour could be used instead of to illustrate the difference in prices.
 +
|-
 +
| <p><center> '''An interactive visualization of house prices along MRT stations''' </center></p>
 +
[[File:1718T1G1 BackgroundSurvey3.png|400px|center]]
 +
<p><center> '''Source''': https://www.srx.com.sg/mrt-home-prices/property-listings-near-east-west-line </center></p>
 +
||
 +
* This visualization makes use of unique ways to illustrate the relation between nearby facilities and house prices. Thus in a glance, a person can tell where are the expensive areas based on the MRT stations.
 +
* The separating of the various MRT lines using filters at the top prevent too much information from being shown in one page
 +
* However, this chart could be too high level and general. Illustrating this on the Singapore map would be more useful instead, where each house's proximity to the MRT station and their respective resale price is shown. Also, in order to drill down, you would have to navigate to another page and then search for a specific house based on a table view which does not help one visualize where the resale flat is actually located at.
 +
|-
 +
| <p><center> '''Four Ways to Slice Obama’s 2013 Budget Proposal''' </center></p>
 +
[[File:4waystosliceobamaproposal.png|400px|center]]
 +
<p><center> '''Source''': http://www.nytimes.com/interactive/2012/02/13/us/politics/2013-budget-proposal-graphic.html </center></p>
 +
||
 +
* This visualization makes use of unique ways to illustrate Obama's Budget Proposal
 +
* The various circles denote the various types of proposed budget items and the circles are sized based on the proposed budget amount.
 +
* Users can toggle the links to slice and dice the initial visualization into different views so that a user can get different insights from the same initial visualization.
 +
* This chart is very interesting and it is something that we wanted to use to present the changes in resale prices based on different flat types. If we have the time, we could do different filters as well but for now, we will try doing it for flat-type.
 +
|-
 +
| <p><center> '''OneMap Visualization of resale flat prices''' </center></p>
 +
[[File:Onemap screenshot.png|400px|center]]
 +
<p><center> '''Source''': https://www.onemap.sg/main/v2/propertyquery </center></p>
 +
||
 +
* This is a screenshot of an implementation of a interactive map by OneMap which allows users to search for resale flats on the map and view information related to the selected flat easily.
 +
* We found this very good as it was very informative if you only wanted to look at one flat.
 +
* However, the map looks very ugly and out-dated in terms of style and coloring and this map does not allow one to easily do comparisons between flats.
 +
|}
 +
  
 
<!-- START PROTOTYPE -->
 
<!-- START PROTOTYPE -->

Revision as of 17:26, 14 October 2018

IS428_ChargeMetrics_Project
HOME  

PROPOSAL

  PROJECT POSTER  

PROJECT APPLICATION

  RESEARCH PAPER


Motivation

Objectives

Data

Related Works

In our analysis, we will only be using data within the year of 1990 - 2017. The rationale for the range of data selected is as follows:

The dataset for analysis will be retrieved from multiple databases, as elaborated below:

Dataset/Source Data Attributes Rationale Of Usage
Resales flat prices from Mar 2012 onwards
(https://data.gov.sg/dataset/resale-flat-prices?resource_id=83b2fc37-ce8c-4df4-968b-370fd818138b )
Resales flat prices from 2002 - Feb 2012
(https://data.gov.sg/dataset/resale-flat-prices?resource_id=8c00bf08-9124-479e-aeca-7cc411d884c4 )
Resales flat prices from 1990 - 1999
(https://data.gov.sg/dataset/resale-flat-prices?resource_id=adbbddd3-30e2-445f-a123-29bee150a6fe )
  • Month
  • Town
  • Flat Type
  • Block
  • Street Name
  • Storey Range
  • Floor Area (Sqm)
  • Flat Model
  • Lease Commence Date
  • Resale Price (S$)
This dataset will be used as a main source of information in our analysis to understand the number of HDB around Singapore from 1990 to 1999, 2002 to Feb 2012 and Mar 2012 onwards respectively.
Bus Stop Names and Locations
(https://www.mytransport.sg/content/mytransport/home/dataMall.html#)
  • Bus Stop Number
  • Bus Stop Roof Number
  • Bus Stop Name
  • X
  • Y
  • Latitude
  • Longitude
This dataset aims to complement the main dataset by providing detailed information about the latitude and longitude of the bus stops located around HDB. We use a javascript geocoding script to convert all the X and Y coordinates to EPSG:4326 latitude and longitude coordinates.
Mrt Stations Names and Locations
(https://www.mytransport.sg/content/mytransport/home/dataMall.html#)
  • MRT Station Number
  • MRT Station Name
  • X
  • Y
  • Latitude
  • Longitude
This dataset aims to complement the main dataset by providing detailed information about the latitude and longitude of the MRT stations located around HDB. We use a javascript geocoding script to convert all the X and Y coordinates to EPSG:4326 latitude and longitude coordinates
Master Plan Subzone Boundary Names and GeoPolygon
(https://data.gov.sg/dataset/master-plan-2014-subzone-boundary-no-sea)

  • Polygon
  • Name
  • Subzone Number
  • Subzone Code
  • Region Name
  • Area Code
  • Area Indicator
This dataset aims to complement the main dataset by providing detailed information about all the subzone in Singapore. We use a javascript library toGeoJson.js to help us convert .KML file to .GeoJson file



BACKGROUND SURVEY OF RELATED WORKS

There are many charts and visualisations available which illustrates the various trends of house prices and index. We have selected a few of these to study and learn before we begin developing our own visualizations.

Related Works What We Can Learn

An Analysis of the trend and correlation between resale prices and flat production

Source: http://www.teoalida.com/singapore/hdbprices/

  • The use of 2 different chart types with a secondary axis is effective in illustrating the correlation between resale prices and flat production.
  • The colours used are striking and contrast well with each other.
  • There are dips in both variables which are not explained in the infographic itself (E.g. 1997 Asian crisis, 2003 SARs outbreak). This events could be incorporated into the charts to make it more informative.
  • However, major events are not shown in the chart itself. This makes it difficult for the audience to understand the various changes throughout the years. It would be much clearer if events were annotated directly on the charts.

An interactive heatmap of Singapore’s house prices in various districts

Source: https://www.srx.com.sg/heat-map

  • This heatmap uses colours appropriately so that the house prices of each district can be identified intuitively (Red means expensive, blue means cheap, orange means mid-range)
  • The use of filters allows user to find out more about the price distribution of each house type easily.
  • When user mouseover a district on the heatmap, the corresponding district on the legend is highlighted. This improves usability as users do not have to match district numbers manually.
  • Even though the colours are intuitive, it could still be confusing as audience might still have to constantly refer back to the colour scale to interpret the colours. Colour intensity of a single colour could be used instead of to illustrate the difference in prices.

An interactive visualization of house prices along MRT stations

Source: https://www.srx.com.sg/mrt-home-prices/property-listings-near-east-west-line

  • This visualization makes use of unique ways to illustrate the relation between nearby facilities and house prices. Thus in a glance, a person can tell where are the expensive areas based on the MRT stations.
  • The separating of the various MRT lines using filters at the top prevent too much information from being shown in one page
  • However, this chart could be too high level and general. Illustrating this on the Singapore map would be more useful instead, where each house's proximity to the MRT station and their respective resale price is shown. Also, in order to drill down, you would have to navigate to another page and then search for a specific house based on a table view which does not help one visualize where the resale flat is actually located at.

Four Ways to Slice Obama’s 2013 Budget Proposal

Source: http://www.nytimes.com/interactive/2012/02/13/us/politics/2013-budget-proposal-graphic.html

  • This visualization makes use of unique ways to illustrate Obama's Budget Proposal
  • The various circles denote the various types of proposed budget items and the circles are sized based on the proposed budget amount.
  • Users can toggle the links to slice and dice the initial visualization into different views so that a user can get different insights from the same initial visualization.
  • This chart is very interesting and it is something that we wanted to use to present the changes in resale prices based on different flat types. If we have the time, we could do different filters as well but for now, we will try doing it for flat-type.

OneMap Visualization of resale flat prices

Source: https://www.onemap.sg/main/v2/propertyquery

  • This is a screenshot of an implementation of a interactive map by OneMap which allows users to search for resale flats on the map and view information related to the selected flat easily.
  • We found this very good as it was very informative if you only wanted to look at one flat.
  • However, the map looks very ugly and out-dated in terms of style and coloring and this map does not allow one to easily do comparisons between flats.


Prototype

Challenges

Project Schedules

References

References

[1] Energy Market Authority (https://www.ema.gov.sg/singapore_energy_statistics.aspx)
[2] Data Gov Database (https://data.gov.sg)
[3] D3.js (Documentation https://d3js.org/)
[4] Observalehq (https://beta.observablehq.com/)
[5] One Map (https://www.onemap.sg/main/v2/)
[6] Energy Consumption Predition Example (http://cs109-energy.github.io/building-energy-consumption-prediction.html)


Feedback

Please leave your comments, suggestions or anything interesting :)