Difference between revisions of "Charge Metrics Proposal"

From Visual Analytics for Business Intelligence
Jump to navigation Jump to search
 
(87 intermediate revisions by 2 users not shown)
Line 2: Line 2:
 
<!--Header-->
 
<!--Header-->
 
{|style="background-color:#000000; color:#ffcc33; padding: 10 0 10 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0"  |
 
{|style="background-color:#000000; color:#ffcc33; padding: 10 0 10 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0"  |
| style="padding:0em; font-size:100%; background-color:#000000; border-bottom:5px solid #ffcc33; text-align:center; color:#ffcc33" width="10%" | [[Charge Metrics|
+
| style="padding:0em; font-size:100%; background-color:#ffcc33; border-bottom:5px solid #ffcc33; text-align:center; color:#000000" width="10%" | [[Charge_Metrics_Proposal|
<font color="#ffcc33" size=2><b>HOME</b></font>]]
 
 
 
| style="background:none; border-bottom:5px solid #ffcc33;" width="1%" | &nbsp;
 
| style="padding:0em; font-size:100%; background-color:#ffcc33;  border-bottom:5px solid #ffcc33; text-align:center; color:#ffcc33" width="12%" |  [[Charge_Metrics_Proposal |
 
 
<font color="#000000" size=2><b>PROPOSAL</b></font>]]
 
<font color="#000000" size=2><b>PROPOSAL</b></font>]]
  
Line 21: Line 17:
 
| style="padding:0em; font-size:100%; background-color:#000000;  border-bottom:5px solid #ffcc33; text-align:center; color:#000000" width="10%" | [[Charge_Metrics_Research_Paper|
 
| style="padding:0em; font-size:100%; background-color:#000000;  border-bottom:5px solid #ffcc33; text-align:center; color:#000000" width="10%" | [[Charge_Metrics_Research_Paper|
 
<font color="#ffcc33" size=2><b>RESEARCH PAPER</b></font>]]
 
<font color="#ffcc33" size=2><b>RESEARCH PAPER</b></font>]]
 +
 +
| style="background:none; border-bottom:5px solid #ffcc33;" width="1%" | &nbsp;
 +
| style="padding:0em; font-size:100%; background-color:#000000;  border-bottom:5px solid #ffcc33; text-align:center; color:#000000" width="10%" | [[Project_Groups|
 +
<font color="#ffcc33" size=2><b>OTHER GROUPS</b></font>]]
 
|}  
 
|}  
 
<br>
 
<br>
Line 30: Line 30:
 
<!-- END MOTIVATION -->
 
<!-- END MOTIVATION -->
  
Household electricity consumption in Singapore has increased by about 17% over the past decade, according to a report by the National Environment Agency in May 2018. On aggregate levels, Singapore households consumed 7,295 GWh (gigawatt hours) in 2017, which roughly translates to an average expenditure of $1,000 a year on electricity per household. <br>  
+
Household electricity consumption in Singapore has increased by about 17% over the past decade, according to a report by the National Environment Agency in May 2018. On aggregate levels, Singapore households consumed 7,295 GWh (gigawatt hours) in 2017, which roughly translates to an average expenditure of $1,000 a year on electricity per household. [1] <br>  
  
Electricity consumption is a national issue, especially given that Singapore has finite energy sources. It is therefore important to encourage households to consume electricity in more sustainable ways. <br>
+
Electricity consumption is a national issue, especially given that about 95% of Singapore's electricity supply is imported. [2] It is therefore important to encourage households to consume electricity in more sustainable ways. <br>
  
Traditionally, the lack of transparency surrounding electricity use has been acknowledged as a possible challenge in raising awareness on electricity consumption. Improving visualisation of household electricity consumption can help people in Singapore gain better clarity of their consumption habits and expenditure, and thus more incentive to reduce electricity usage. <br>
+
Traditionally, the lack of transparency surrounding electricity use has been acknowledged as a possible challenge in raising awareness on electricity consumption. [3] Improving visualisation of household electricity consumption can help people in Singapore gain better clarity of their consumption habits and expenditure, and thus more incentive to reduce electricity usage. [3] <br>
  
 
Our project visualises the distribution of household electricity consumption across planning regions in Singapore, accounting for type of residential homes, income and demographic profiles. We aim to better communicate electricity consumption in everyday life to people in Singapore, and ultimately engage them to reduce electricity consumption.
 
Our project visualises the distribution of household electricity consumption across planning regions in Singapore, accounting for type of residential homes, income and demographic profiles. We aim to better communicate electricity consumption in everyday life to people in Singapore, and ultimately engage them to reduce electricity consumption.
Line 42: Line 42:
 
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px"><span style="font-size:100%; font-family:sans-serif;">Objectives </div>==
 
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px"><span style="font-size:100%; font-family:sans-serif;">Objectives </div>==
  
 +
This project aims to create an interactive data visualisation tool to achieve the following objectives: <br \>
 +
# Provide a clear geographical visualisation for household electricity consumption across planning areas <br \>
 +
# Provide an overview of the relationship between resident population and electricity consumption for the various housing types across time <br \>
 +
# Allow users to explore household electricity consumption in Singapore by comparing across planning regions <br \>
 +
# Ensure a smooth interactivity for a better user experience <br \>
 
<!-- END OBJECTIVES -->
 
<!-- END OBJECTIVES -->
  
Line 51: Line 56:
 
|-
 
|-
 
! style="font-weight: bold;background: #000000;color:#ffcc33;width: 30%;" | Datasets
 
! style="font-weight: bold;background: #000000;color:#ffcc33;width: 30%;" | Datasets
! style="font-weight: bold;background: #000000;color:#ffcc33;width: 30%" | Data Attributes
+
! style="font-weight: bold;background: #000000;color:#ffcc33;width: 15%" | Data Attributes
! style="font-weight: bold;background: #000000;color:#ffcc33;" | Rationale Of Usage
+
! style="font-weight: bold;background: #000000;color:#ffcc33;" | Rationale of Usage
 
|-
 
|-
| <center>EMA Household Energy Consumption<br/></center>
+
| <center>'''EMA Household Energy Consumption'''<br/></center>
 
[[File:Datasource1.png|center|500px]]
 
[[File:Datasource1.png|center|500px]]
  <center>Source: https://www.ema.gov.sg/Statistics.aspx </center>
+
  <center>'''Source''': https://www.ema.gov.sg/statistic.aspx?sta_sid=20140617E32XNb1d0Iqa </center>
 
||  
 
||  
* Postal Code (2013-2016)
+
* Postal Code  
* Room Type
+
* Type of Dwelling
* Month
+
* Month, 2013-2016
 
* Electricity Consumption  
 
* Electricity Consumption  
 
||  
 
||  
<center>There are 2 group of dataset. 1. Household Energy consumption</center>
+
This dataset contains granular data on average household monthly electricity consumption by postal code for each type of housing between 2013 to 2016.
 +
|-
 +
| <center>'''Average Monthly Household Electricity Consumption by Dwelling Type, 2005-2017'''<br/>
 +
[[File:Avg by dwelling type, 2005 to 2017.png|500px|center]]
 +
'''Source''': https://www.ema.gov.sg/statistic.aspx?sta_sid=20140617E32XNb1d0Iqa </center>
 +
||
 +
* Type of Dwelling
 +
* Average Monthly Electricity Consumption (in kWh)
 +
* Date (mmm-yyyy)
 +
||
 +
This dataset will be used to visualise the overall historical trend of monthly average household electricity consumption in Singapore from 2005 to 2017.
 
|-
 
|-
| <center>Bus Stop Names and Locations<br/>
+
| <center>'''Singapore Residents by Planning Area and Type of Dwelling, 2000 - 2017'''<br/>
(https://www.mytransport.sg/content/mytransport/home/dataMall.html#)</center>
+
[[File:Datasource2.png|center|500px]]
[[File:Bus data.png|center|500px]]
+
'''Source''': https://www.singstat.gov.sg/find-data/search-by-theme/population/geographic-distribution/latest-data</center>
 
||  
 
||  
* Bus Stop Number
+
* Planning Area
* Bus Stop Roof Number
+
* Type of Dwelling
* Bus Stop Name
+
* Resident Population
* X
+
* Year
* Y
 
* Latitude
 
* Longitude
 
 
||  
 
||  
<center>This dataset aims to complement the main dataset by providing detailed information about the latitude and longitude of the bus stops located around HDB. We use a javascript geocoding script to convert all the X and Y coordinates to EPSG:4326 latitude and longitude coordinates.</center>
+
This dataset is used to complement the main dataset by providing detailed information about the number of Singapore residents in each planning area, according to dwelling type.
 +
 
 +
 
 
|-
 
|-
| <center>Mrt Stations Names and Locations <br/>
+
| <center>'''HDB Property Information'''<br/>
(https://www.mytransport.sg/content/mytransport/home/dataMall.html#)</center>
+
[[File:Datasource3.png|center|500px]]
[[File:MRT data.png|center|500px]]
+
'''Source''': https://data.gov.sg/dataset/hdb-property-information</center>
 
||  
 
||  
* MRT Station Number
+
* Block Number
* MRT Station Name
+
* Street
* X
+
* Residential
* Y
+
* Total Dwelling Units
* Latitude
+
* Number of 1-room Sold
* Longitude
+
* Number of 2-rooms Sold
 +
* Number of 3-rooms Sold
 +
* Number of 4-rooms Sold
 +
* Number of 5-rooms Sold
 +
* Number of 5-rooms Sold
 +
* Number of Executive Condominiums Sold
 
||  
 
||  
<center>This dataset aims to complement the main dataset by providing detailed information about the latitude and longitude of the MRT stations located around HDB. We use a javascript geocoding script to convert all the X and Y coordinates to EPSG:4326 latitude and longitude coordinates</center>
+
This dataset provides a comprehensive record of Singapore HDB Property Information, and enables us to scale the average electricity consumption by the number of units for the given dwelling type for the block.
 
|-
 
|-
| <center>Master Plan Subzone Boundary Names and GeoPolygon <br/>
+
| <center>'''Private Apartment Information'''<br/>
(https://data.gov.sg/dataset/master-plan-2014-subzone-boundary-no-sea)</center>
+
[[File:Datasource5.png|center|500px]]
[[File:Subzone1.png|center|500px]]<br/>
+
'''Source''': Real Estate Information System</center>
[[File:Subzone2.png|center|500px]]
 
 
||  
 
||  
* Polygon
+
* Block Number
* Name
+
* Street
* Subzone Number
+
* Residential
* Subzone Code
+
* No of Units
* Region Name
+
* Property Type
* Area Code
+
* Postal District
* Area Indicator
+
* Postal Sector
 +
* Postal Code
 +
* Planning Region
 +
* Planning Area
 +
 
 
||  
 
||  
<center>This dataset aims to complement the main dataset by providing detailed information about all the subzone in Singapore. We use a javascript library toGeoJson.js to help us convert .KML file to .GeoJson file</center>
+
This dataset will be a complementary dataset for private housing types by providing information on the number of units.
 +
|-
 +
| <center>'''List of Postal Districts'''<br/>
 +
[[File:Datasource4.png|center|500px]]
 +
'''Source''': https://www.ura.gov.sg/realEstateIIWeb/resources/misc/list_of_postal_districts.htm</center>
 +
||
 +
* Postal District
 +
* Postal Sector
 +
* General Location
 +
 
 +
||
 +
This dataset is used to map the postal sector, also the first two digits of the postal code, to the corresponding postal district.
 
|}
 
|}
  
Line 115: Line 148:
  
 
<!-- END  Related Works  -->
 
<!-- END  Related Works  -->
<p>The following related work </p>
+
<p></p>
  
  
Line 125: Line 158:
 
|  
 
|  
 
<p><center>'''Dashboard Visualisation of Average Monthly Household Energy Consumption Per Year in Singapore''' </center></p>
 
<p><center>'''Dashboard Visualisation of Average Monthly Household Energy Consumption Per Year in Singapore''' </center></p>
[[File:ChargeMetrics Related1.png.png|400px|center]]
+
[[File:ChargeMetrics Related1.png|400px|center]]
 
<p><center>'''Source''': https://analyticsandintelligentsystems.wordpress.com/2017/04/28/dashboard-visualisation-of-average-monthly-household-energy-consumption-per-year-in-singapore/</center></p>
 
<p><center>'''Source''': https://analyticsandintelligentsystems.wordpress.com/2017/04/28/dashboard-visualisation-of-average-monthly-household-energy-consumption-per-year-in-singapore/</center></p>
 
  ||  
 
  ||  
*  
+
* Interactive dashboard allows the user to view the top ranking planning regions in terms of energy consumption, as well as choose the number of top ranking planning regions they are interested in.
 +
*  The use of a filter dashboard action also allows the user to view information only for selected planning regions.
 
|-
 
|-
| <p><center> '''An interactive heatmap of Singapore’s house prices in various districts''' </center></p>
+
| <p><center> '''Prediction of Buildings Energy Consumption''' </center></p>
[[File:1718T1G1 BackgroundSurvey2.png|400px|center]]
+
[[File:ChargeMetrics Related2.png|400px|center]]
<p><center> '''Source''': https://www.srx.com.sg/heat-map </center> </p>
+
<p><center> '''Source''': http://cs109-energy.github.io/building-energy-consumption-prediction.html </center> </p>
 
||
 
||
* This heatmap uses colours appropriately so that the house prices of each district can be identified intuitively (Red means expensive, blue means cheap, orange means mid-range)
+
* Calendar view map allows the user to view the daily pattern of energy consumption, and detect any hourly patterns easily, if present.
* The use of filters allows user to find out more about the price distribution of each house type easily.
+
* Provide multiple possible machine learning models for the prediction on energy consumption.
* When user mouseover a district on the heatmap, the corresponding district on the legend is highlighted. This improves usability as users do not have to match district numbers manually.  
+
* Direct illustration of graphs and models on python Jupyter notebook for effective reproducible communication.
* Even though the colours are intuitive, it could still be confusing as audience might still have to constantly refer back to the colour scale to interpret the colours. Colour intensity of a single colour could be used instead of to illustrate the difference in prices.  
+
 
 
|-
 
|-
| <p><center> '''An interactive visualization of house prices along MRT stations''' </center></p>
+
| <p><center> '''Visualising Energy Consumption in Philadelphia''' </center></p>
[[File:1718T1G1 BackgroundSurvey3.png|400px|center]]
+
[[File:ChargeMetrics Related3.png|400px|center]]
<p><center> '''Source''': https://www.srx.com.sg/mrt-home-prices/property-listings-near-east-west-line </center></p>
+
<p><center> '''Source''': http://www.kennethelder.com/visualizing-energy-consumption-in-philadelphia/ </center></p>
 
||  
 
||  
* This visualization makes use of unique ways to illustrate the relation between nearby facilities and house prices. Thus in a glance, a person can tell where are the expensive areas based on the MRT stations.
+
* Allows the user to hide or view the scatter plot without leaving the landing page or changing the map view.
* The separating of the various MRT lines using filters at the top prevent too much information from being shown in one page
+
* Measures for heat map and scatter plot can also be customised by the user.
* However, this chart could be too high level and general. Illustrating this on the Singapore map would be more useful instead, where each house's proximity to the MRT station and their respective resale price is shown. Also, in order to drill down, you would have to navigate to another page and then search for a specific house based on a table view which does not help one visualize where the resale flat is actually located at.
+
* Project incorporated an added dimension to their scatter plot by sizing the points by the energy rating. This is useful for adding another dimension on top of the two variables typically represented on a scatter plot.
 +
 
 
|-
 
|-
| <p><center> '''Four Ways to Slice Obama’s 2013 Budget Proposal''' </center></p>
+
| <p><center> '''Visualising U.S. Energy Consumption in One Chart''' </center></p>
[[File:4waystosliceobamaproposal.png|400px|center]]
+
[[File:ChargeMetrics Related4.png|400px|center]]
<p><center> '''Source''': http://www.nytimes.com/interactive/2012/02/13/us/politics/2013-budget-proposal-graphic.html </center></p>
+
<p><center> '''Source''': http://www.visualcapitalist.com/visualizing-u-s-energy-consumption-one-chart/ </center></p>
 
||  
 
||  
* This visualization makes use of unique ways to illustrate Obama's Budget Proposal
+
* Clear overview of how different energy sources are used and classified
* The various circles denote the various types of proposed budget items and the circles are sized based on the proposed budget amount.
+
* Good usage of colours to clearly illustrate individual flow of the energy source
* Users can toggle the links to slice and dice the initial visualization into different views so that a user can get different insights from the same initial visualization.
+
 
* This chart is very interesting and it is something that we wanted to use to present the changes in resale prices based on different flat types. If we have the time, we could do different filters as well but for now, we will try doing it for flat-type.
 
|-
 
| <p><center> '''OneMap Visualization of resale flat prices''' </center></p>
 
[[File:Onemap screenshot.png|400px|center]]
 
<p><center> '''Source''': https://www.onemap.sg/main/v2/propertyquery </center></p>
 
||
 
* This is a screenshot of an implementation of a interactive map by OneMap which allows users to search for resale flats on the map and view information related to the selected flat easily.
 
* We found this very good as it was very informative if you only wanted to look at one flat.
 
* However, the map looks very ugly and out-dated in terms of style and coloring and this map does not allow one to easily do comparisons between flats.
 
 
|}
 
|}
  
Line 169: Line 195:
  
 
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px; font-family:sans-serif;">Prototype</div>==
 
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px; font-family:sans-serif;">Prototype</div>==
 
+
===Iteration 1===
 
===Landing Page===
 
===Landing Page===
 
<center> [[File: Chargemetrics Prototype.jpg|800px|Prototype 1]] </center> <br />
 
<center> [[File: Chargemetrics Prototype.jpg|800px|Prototype 1]] </center> <br />
 
[1]Logo <br />
 
[1]Logo <br />
[2]Bivariate Chloropleth Map<br />
+
[2]Bivariate Choropleth Map<br />
 
[3]Filter <br />
 
[3]Filter <br />
 
[4]Button to Historical Trend Page<br />
 
[4]Button to Historical Trend Page<br />
Line 182: Line 208:
 
[1]Area Chart for Total Electricity Consumption<br />
 
[1]Area Chart for Total Electricity Consumption<br />
 
[2]Area Chart for Number of Singapore Resident<br />
 
[2]Area Chart for Number of Singapore Resident<br />
 +
[3]Connected Scatter Plot <br />
 
[4]Rate of Change of Number of Singapore Resident and Total Electricity Consumption<br />
 
[4]Rate of Change of Number of Singapore Resident and Total Electricity Consumption<br />
[3]Connected Scatter Plot <br />
+
 
  
  
  
 
<!-- END  PROTOTYPE  -->
 
<!-- END  PROTOTYPE  -->
 +
 +
<!-- START Application Architecture -->
 +
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px;font-family:sans-serif;">Application Architecture</div>==
 +
 +
[[File:aass.jpg|500px|center|ChargeMetrics_Timeline]]
 +
 +
<!-- END Application Architecture -->
  
 
<!-- START Project Schedules -->
 
<!-- START Project Schedules -->
Line 194: Line 228:
  
  
[[File:Project_Schedule.png|1200px|center|ChargeMetrics_Project_Schedule]]
+
[[File:ChargeMetrics_Timeline2.jpg|1000px|center|ChargeMetrics_Timeline]]
 
Project Schedule on Google Sheet:https://docs.google.com/spreadsheets/d/1IlT3Na8Ujlv9izY-0PWvCWEWzfqOmzq3jGHIbWCDiwk/edit?usp=sharing  
 
Project Schedule on Google Sheet:https://docs.google.com/spreadsheets/d/1IlT3Na8Ujlv9izY-0PWvCWEWzfqOmzq3jGHIbWCDiwk/edit?usp=sharing  
  
[[File:ChargeMetrics_Timeline.jpg|1200px|center|ChargeMetrics_Timeline]]
 
  
  
Line 213: Line 246:
 
|-
 
|-
 
|  
 
|  
<p>Unfamiliar with D3.js </p>
+
<p>Unfamiliarity with D3.js </p>
 
  ||  
 
  ||  
* Independent learning through online learning resources  
+
* Independent learning through online learning resources
* Validating learning outcome through review and coding practices  
+
* Validating learning outcome through review and coding practices
 
|-
 
|-
| <p>Data Merge, Cleaning and Transformation</p>
+
| <p>Data merge, cleaning and transformation</p>
 
||
 
||
* Subzone energy usage data:  
+
* Planning area electricity consumption data: Since the data provided by Energy Market Authority is an average of type of dwelling for each block, we will scale the average electricity consumption by the number of units for the given dwelling type for the block, then sum all the blocks in the relevant planning area to get the aggregate monthly consumption per planning area.
* Missing NA records: government have purposedly removed some data points to enforce the data privacy. We will be examine the effect of remove the NA and decide the appropriate action to take.  
+
* Missing NA records: Due to privacy concerns, Energy Market Authority does not disclose some data points. We will examine the effect of removing the NA records to decide the appropriate action to take.
 
|-
 
|-
 
| <p>Choice of web hosting provider</p>
 
| <p>Choice of web hosting provider</p>
 
||  
 
||  
 
* A quick production pipeline required due to the time limit
 
* A quick production pipeline required due to the time limit
* Examine the requirement of the data visualisation: dynamic or statics
+
* Examine the requirements of the data visualisation: dynamic or static
* Current solution is to use Github Page as a hosting provider there is no dynamic data retrieval required  
+
* Current solution is to use Github Page as a hosting provider as there is no dynamic data retrieval required
 
|-
 
|-
| <p>Unfamilar with implementation efforts required for customized D3.js interactivity</p>
+
| <p>Unfamiliar with implementation efforts required for customised D3.js interactivity</p>
 
||  
 
||  
* The week will be spending 2 weeks to familiarize with D3.js structure & syntax
+
* We will be spending 2 weeks to familiarise ourselves with D3.js structure and syntax
* Follwing 2 weeks will be trying out the customized D3.js interactivity
+
* The following 2 weeks will involve us trying out the customised D3.js interactivity
 
* The project scope and plan will be re-examined based on the project objective, complexity and time available
 
* The project scope and plan will be re-examined based on the project objective, complexity and time available
 
 
|}
 
|}
  
Line 243: Line 275:
  
  
[1] Energy Market Authority (https://www.ema.gov.sg/singapore_energy_statistics.aspx) <br />
+
[1] The Straits Times (https://www.straitstimes.com/singapore/singapores-household-electricity-consumption-up-17-per-cent-over-past-decade) <br />
[2] Data Gov Database (https://data.gov.sg) <br />
+
[2] Energy Market Authority (https://www.ema.gov.sg/electricity_market_overview.aspx) <br />
[3] D3.js (Documentation https://d3js.org/) <br />
+
[3] National Center for Biotechnology Information (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4746293/) <br />
[4] Observalehq (https://beta.observablehq.com/) <br />
+
[4] Energy Market Authority (https://www.ema.gov.sg/singapore_energy_statistics.aspx) <br />
[5] One Map (https://www.onemap.sg/main/v2/) <br />
+
[5] Data.gov Database (https://data.gov.sg) <br />
[6] Energy Consumption Predition Example (http://cs109-energy.github.io/building-energy-consumption-prediction.html) <br />
+
[6] D3.js (Documentation https://d3js.org/) <br />
 +
[7] Observale (https://beta.observablehq.com/) <br />
 +
[8] OneMap (https://www.onemap.sg/main/v2/) <br />
 +
[9] Prediction of Buildings Energy Consumption (http://cs109-energy.github.io/building-energy-consumption-prediction.html) <br />
  
 
<!-- END  References    -->
 
<!-- END  References    -->
Line 254: Line 289:
 
<!-- START Feedback -->
 
<!-- START Feedback -->
  
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px; Font-family: sans serif;"> Feedback </div>==
+
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px; font-family:sans-serif;">Feedback </div>==
 
Please feel free leave your comments, suggestions or anything interesting :)
 
Please feel free leave your comments, suggestions or anything interesting :)
  
 
<!-- END  Feedback    -->
 
<!-- END  Feedback    -->

Latest revision as of 19:29, 25 November 2018

IS428_ChargeMetrics_Project

PROPOSAL

  PROJECT POSTER  

PROJECT APPLICATION

  RESEARCH PAPER   OTHER GROUPS


Motivation

Household electricity consumption in Singapore has increased by about 17% over the past decade, according to a report by the National Environment Agency in May 2018. On aggregate levels, Singapore households consumed 7,295 GWh (gigawatt hours) in 2017, which roughly translates to an average expenditure of $1,000 a year on electricity per household. [1]

Electricity consumption is a national issue, especially given that about 95% of Singapore's electricity supply is imported. [2] It is therefore important to encourage households to consume electricity in more sustainable ways.

Traditionally, the lack of transparency surrounding electricity use has been acknowledged as a possible challenge in raising awareness on electricity consumption. [3] Improving visualisation of household electricity consumption can help people in Singapore gain better clarity of their consumption habits and expenditure, and thus more incentive to reduce electricity usage. [3]

Our project visualises the distribution of household electricity consumption across planning regions in Singapore, accounting for type of residential homes, income and demographic profiles. We aim to better communicate electricity consumption in everyday life to people in Singapore, and ultimately engage them to reduce electricity consumption.


Objectives

This project aims to create an interactive data visualisation tool to achieve the following objectives:

  1. Provide a clear geographical visualisation for household electricity consumption across planning areas
  2. Provide an overview of the relationship between resident population and electricity consumption for the various housing types across time
  3. Allow users to explore household electricity consumption in Singapore by comparing across planning regions
  4. Ensure a smooth interactivity for a better user experience


Data

Datasets Data Attributes Rationale of Usage
EMA Household Energy Consumption
Datasource1.png
Source: https://www.ema.gov.sg/statistic.aspx?sta_sid=20140617E32XNb1d0Iqa
  • Postal Code
  • Type of Dwelling
  • Month, 2013-2016
  • Electricity Consumption

This dataset contains granular data on average household monthly electricity consumption by postal code for each type of housing between 2013 to 2016.

Average Monthly Household Electricity Consumption by Dwelling Type, 2005-2017
Avg by dwelling type, 2005 to 2017.png
Source: https://www.ema.gov.sg/statistic.aspx?sta_sid=20140617E32XNb1d0Iqa
  • Type of Dwelling
  • Average Monthly Electricity Consumption (in kWh)
  • Date (mmm-yyyy)

This dataset will be used to visualise the overall historical trend of monthly average household electricity consumption in Singapore from 2005 to 2017.

Singapore Residents by Planning Area and Type of Dwelling, 2000 - 2017
Datasource2.png
Source: https://www.singstat.gov.sg/find-data/search-by-theme/population/geographic-distribution/latest-data
  • Planning Area
  • Type of Dwelling
  • Resident Population
  • Year

This dataset is used to complement the main dataset by providing detailed information about the number of Singapore residents in each planning area, according to dwelling type.


HDB Property Information
Datasource3.png
Source: https://data.gov.sg/dataset/hdb-property-information
  • Block Number
  • Street
  • Residential
  • Total Dwelling Units
  • Number of 1-room Sold
  • Number of 2-rooms Sold
  • Number of 3-rooms Sold
  • Number of 4-rooms Sold
  • Number of 5-rooms Sold
  • Number of 5-rooms Sold
  • Number of Executive Condominiums Sold

This dataset provides a comprehensive record of Singapore HDB Property Information, and enables us to scale the average electricity consumption by the number of units for the given dwelling type for the block.

Private Apartment Information
Datasource5.png
Source: Real Estate Information System
  • Block Number
  • Street
  • Residential
  • No of Units
  • Property Type
  • Postal District
  • Postal Sector
  • Postal Code
  • Planning Region
  • Planning Area

This dataset will be a complementary dataset for private housing types by providing information on the number of units.

List of Postal Districts
Datasource4.png
Source: https://www.ura.gov.sg/realEstateIIWeb/resources/misc/list_of_postal_districts.htm
  • Postal District
  • Postal Sector
  • General Location

This dataset is used to map the postal sector, also the first two digits of the postal code, to the corresponding postal district.


Related Works


Related Works What We Can Learn

Dashboard Visualisation of Average Monthly Household Energy Consumption Per Year in Singapore

ChargeMetrics Related1.png

Source: https://analyticsandintelligentsystems.wordpress.com/2017/04/28/dashboard-visualisation-of-average-monthly-household-energy-consumption-per-year-in-singapore/

  • Interactive dashboard allows the user to view the top ranking planning regions in terms of energy consumption, as well as choose the number of top ranking planning regions they are interested in.
  • The use of a filter dashboard action also allows the user to view information only for selected planning regions.

Prediction of Buildings Energy Consumption

ChargeMetrics Related2.png

Source: http://cs109-energy.github.io/building-energy-consumption-prediction.html

  • Calendar view map allows the user to view the daily pattern of energy consumption, and detect any hourly patterns easily, if present.
  • Provide multiple possible machine learning models for the prediction on energy consumption.
  • Direct illustration of graphs and models on python Jupyter notebook for effective reproducible communication.

Visualising Energy Consumption in Philadelphia

ChargeMetrics Related3.png

Source: http://www.kennethelder.com/visualizing-energy-consumption-in-philadelphia/

  • Allows the user to hide or view the scatter plot without leaving the landing page or changing the map view.
  • Measures for heat map and scatter plot can also be customised by the user.
  • Project incorporated an added dimension to their scatter plot by sizing the points by the energy rating. This is useful for adding another dimension on top of the two variables typically represented on a scatter plot.

Visualising U.S. Energy Consumption in One Chart

ChargeMetrics Related4.png

Source: http://www.visualcapitalist.com/visualizing-u-s-energy-consumption-one-chart/

  • Clear overview of how different energy sources are used and classified
  • Good usage of colours to clearly illustrate individual flow of the energy source


Prototype

Iteration 1

Landing Page

Prototype 1


[1]Logo
[2]Bivariate Choropleth Map
[3]Filter
[4]Button to Historical Trend Page
[5]Slope Graph

Historical Trend Page

Prototype 1


[1]Area Chart for Total Electricity Consumption
[2]Area Chart for Number of Singapore Resident
[3]Connected Scatter Plot
[4]Rate of Change of Number of Singapore Resident and Total Electricity Consumption



Application Architecture

ChargeMetrics_Timeline


Project Schedules

ChargeMetrics_Timeline

Project Schedule on Google Sheet:https://docs.google.com/spreadsheets/d/1IlT3Na8Ujlv9izY-0PWvCWEWzfqOmzq3jGHIbWCDiwk/edit?usp=sharing



Challenges

Challenges Possible Solutions

Unfamiliarity with D3.js

  • Independent learning through online learning resources
  • Validating learning outcome through review and coding practices

Data merge, cleaning and transformation

  • Planning area electricity consumption data: Since the data provided by Energy Market Authority is an average of type of dwelling for each block, we will scale the average electricity consumption by the number of units for the given dwelling type for the block, then sum all the blocks in the relevant planning area to get the aggregate monthly consumption per planning area.
  • Missing NA records: Due to privacy concerns, Energy Market Authority does not disclose some data points. We will examine the effect of removing the NA records to decide the appropriate action to take.

Choice of web hosting provider

  • A quick production pipeline required due to the time limit
  • Examine the requirements of the data visualisation: dynamic or static
  • Current solution is to use Github Page as a hosting provider as there is no dynamic data retrieval required

Unfamiliar with implementation efforts required for customised D3.js interactivity

  • We will be spending 2 weeks to familiarise ourselves with D3.js structure and syntax
  • The following 2 weeks will involve us trying out the customised D3.js interactivity
  • The project scope and plan will be re-examined based on the project objective, complexity and time available


References

[1] The Straits Times (https://www.straitstimes.com/singapore/singapores-household-electricity-consumption-up-17-per-cent-over-past-decade)
[2] Energy Market Authority (https://www.ema.gov.sg/electricity_market_overview.aspx)
[3] National Center for Biotechnology Information (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4746293/)
[4] Energy Market Authority (https://www.ema.gov.sg/singapore_energy_statistics.aspx)
[5] Data.gov Database (https://data.gov.sg)
[6] D3.js (Documentation https://d3js.org/)
[7] Observale (https://beta.observablehq.com/)
[8] OneMap (https://www.onemap.sg/main/v2/)
[9] Prediction of Buildings Energy Consumption (http://cs109-energy.github.io/building-energy-consumption-prediction.html)


Feedback

Please feel free leave your comments, suggestions or anything interesting :)