Difference between revisions of "Charge Metrics Proposal"

From Visual Analytics for Business Intelligence
Jump to navigation Jump to search
 
(111 intermediate revisions by 2 users not shown)
Line 2: Line 2:
 
<!--Header-->
 
<!--Header-->
 
{|style="background-color:#000000; color:#ffcc33; padding: 10 0 10 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0"  |
 
{|style="background-color:#000000; color:#ffcc33; padding: 10 0 10 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0"  |
| style="padding:0em; font-size:100%; background-color:#000000; border-bottom:5px solid #ffcc33; text-align:center; color:#ffcc33" width="10%" | [[Charge Metrics|
+
| style="padding:0em; font-size:100%; background-color:#ffcc33; border-bottom:5px solid #ffcc33; text-align:center; color:#000000" width="10%" | [[Charge_Metrics_Proposal|
<font color="#ffcc33" size=2><b>HOME</b></font>]]
 
 
 
| style="background:none; border-bottom:5px solid #ffcc33;" width="1%" | &nbsp;
 
| style="padding:0em; font-size:100%; background-color:#ffcc33;  border-bottom:5px solid #ffcc33; text-align:center; color:#ffcc33" width="12%" |  [[Charge_Metrics_Proposal |
 
 
<font color="#000000" size=2><b>PROPOSAL</b></font>]]
 
<font color="#000000" size=2><b>PROPOSAL</b></font>]]
  
Line 21: Line 17:
 
| style="padding:0em; font-size:100%; background-color:#000000;  border-bottom:5px solid #ffcc33; text-align:center; color:#000000" width="10%" | [[Charge_Metrics_Research_Paper|
 
| style="padding:0em; font-size:100%; background-color:#000000;  border-bottom:5px solid #ffcc33; text-align:center; color:#000000" width="10%" | [[Charge_Metrics_Research_Paper|
 
<font color="#ffcc33" size=2><b>RESEARCH PAPER</b></font>]]
 
<font color="#ffcc33" size=2><b>RESEARCH PAPER</b></font>]]
 +
 +
| style="background:none; border-bottom:5px solid #ffcc33;" width="1%" | &nbsp;
 +
| style="padding:0em; font-size:100%; background-color:#000000;  border-bottom:5px solid #ffcc33; text-align:center; color:#000000" width="10%" | [[Project_Groups|
 +
<font color="#ffcc33" size=2><b>OTHER GROUPS</b></font>]]
 
|}  
 
|}  
 
<br>
 
<br>
Line 26: Line 26:
 
<!-- START MOTIVATION -->
 
<!-- START MOTIVATION -->
  
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px"><span style="font-size:100%; font-family:sans-serif;">MOTIVATION</div>==
+
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px"><span style="font-size:100%; font-family:sans-serif;">Motivation</div>==
  
 
<!-- END MOTIVATION -->
 
<!-- END MOTIVATION -->
 +
 +
Household electricity consumption in Singapore has increased by about 17% over the past decade, according to a report by the National Environment Agency in May 2018. On aggregate levels, Singapore households consumed 7,295 GWh (gigawatt hours) in 2017, which roughly translates to an average expenditure of $1,000 a year on electricity per household. [1] <br>
 +
 +
Electricity consumption is a national issue, especially given that about 95% of Singapore's electricity supply is imported. [2] It is therefore important to encourage households to consume electricity in more sustainable ways. <br>
 +
 +
Traditionally, the lack of transparency surrounding electricity use has been acknowledged as a possible challenge in raising awareness on electricity consumption. [3] Improving visualisation of household electricity consumption can help people in Singapore gain better clarity of their consumption habits and expenditure, and thus more incentive to reduce electricity usage. [3] <br>
 +
 +
Our project visualises the distribution of household electricity consumption across planning regions in Singapore, accounting for type of residential homes, income and demographic profiles. We aim to better communicate electricity consumption in everyday life to people in Singapore, and ultimately engage them to reduce electricity consumption.
  
 
<!-- START OBJECTIVES -->
 
<!-- START OBJECTIVES -->
  
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px"><span style="font-size:100%; font-family:sans-serif;">OBJECTIVES</div>==
+
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px"><span style="font-size:100%; font-family:sans-serif;">Objectives </div>==
  
 +
This project aims to create an interactive data visualisation tool to achieve the following objectives: <br \>
 +
# Provide a clear geographical visualisation for household electricity consumption across planning areas <br \>
 +
# Provide an overview of the relationship between resident population and electricity consumption for the various housing types across time <br \>
 +
# Allow users to explore household electricity consumption in Singapore by comparing across planning regions <br \>
 +
# Ensure a smooth interactivity for a better user experience <br \>
 
<!-- END OBJECTIVES -->
 
<!-- END OBJECTIVES -->
  
Line 39: Line 52:
 
<!-- START DATA -->
 
<!-- START DATA -->
  
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px; font-family:sans-serif">DATA</div>==
+
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px; font-family:sans-serif">Data</div>==
 
{| class="wikitable" style="background-color:#FFFFFF;" width="100%"
 
{| class="wikitable" style="background-color:#FFFFFF;" width="100%"
 
|-
 
|-
! style="font-weight: bold;background: #000000;color:#ffcc33;width: 30%;" | Dataset/Source
+
! style="font-weight: bold;background: #000000;color:#ffcc33;width: 30%;" | Datasets
! style="font-weight: bold;background: #000000;color:#ffcc33;width: 30%" | Data Attributes
+
! style="font-weight: bold;background: #000000;color:#ffcc33;width: 15%" | Data Attributes
! style="font-weight: bold;background: #000000;color:#ffcc33;" | Rationale Of Usage
+
! style="font-weight: bold;background: #000000;color:#ffcc33;" | Rationale of Usage
 +
|-
 +
| <center>'''EMA Household Energy Consumption'''<br/></center>
 +
[[File:Datasource1.png|center|500px]]
 +
<center>'''Source''': https://www.ema.gov.sg/statistic.aspx?sta_sid=20140617E32XNb1d0Iqa </center>
 +
||
 +
* Postal Code
 +
* Type of Dwelling
 +
* Month, 2013-2016
 +
* Electricity Consumption
 +
||
 +
This dataset contains granular data on average household monthly electricity consumption by postal code for each type of housing between 2013 to 2016.
 
|-
 
|-
| <center>Resales flat prices from Mar 2012 onwards<br/>
+
| <center>'''Average Monthly Household Electricity Consumption by Dwelling Type, 2005-2017'''<br/>
(https://data.gov.sg/dataset/resale-flat-prices?resource_id=83b2fc37-ce8c-4df4-968b-370fd818138b ) </center>
+
[[File:Avg by dwelling type, 2005 to 2017.png|500px|center]]
<center>Resales flat prices from 2002 - Feb 2012 <br/>
+
'''Source''': https://www.ema.gov.sg/statistic.aspx?sta_sid=20140617E32XNb1d0Iqa </center>
(https://data.gov.sg/dataset/resale-flat-prices?resource_id=8c00bf08-9124-479e-aeca-7cc411d884c4 ) </center>
 
<center>Resales flat prices from 1990 - 1999<br/>
 
(https://data.gov.sg/dataset/resale-flat-prices?resource_id=adbbddd3-30e2-445f-a123-29bee150a6fe ) </center>
 
 
||  
 
||  
* Data Type 1
+
* Type of Dwelling
* Data Type 1
+
* Average Monthly Electricity Consumption (in kWh)
 +
* Date (mmm-yyyy)
 
||  
 
||  
<center>This dataset will be used as a main source of information in our analysis to understand the number of HDB around Singapore from 1990 to 1999, 2002 to Feb 2012 and Mar 2012 onwards respectively.</center>
+
This dataset will be used to visualise the overall historical trend of monthly average household electricity consumption in Singapore from 2005 to 2017.  
 
|-
 
|-
| <center>Bus Stop Names and Locations<br/>
+
| <center>'''Singapore Residents by Planning Area and Type of Dwelling, 2000 - 2017'''<br/>
(https://www.mytransport.sg/content/mytransport/home/dataMall.html#)</center>
+
[[File:Datasource2.png|center|500px]]
[[File:Bus data.png|center|500px]]
+
'''Source''': https://www.singstat.gov.sg/find-data/search-by-theme/population/geographic-distribution/latest-data</center>
 
||  
 
||  
* Bus Stop Number
+
* Planning Area
* Bus Stop Roof Number
+
* Type of Dwelling
* Bus Stop Name
+
* Resident Population
* X
+
* Year
* Y
 
* Latitude
 
* Longitude
 
 
||  
 
||  
<center>This dataset aims to complement the main dataset by providing detailed information about the latitude and longitude of the bus stops located around HDB. We use a javascript geocoding script to convert all the X and Y coordinates to EPSG:4326 latitude and longitude coordinates.</center>
+
This dataset is used to complement the main dataset by providing detailed information about the number of Singapore residents in each planning area, according to dwelling type.
 +
 
 +
 
 
|-
 
|-
| <center>Mrt Stations Names and Locations <br/>
+
| <center>'''HDB Property Information'''<br/>
(https://www.mytransport.sg/content/mytransport/home/dataMall.html#)</center>
+
[[File:Datasource3.png|center|500px]]
[[File:MRT data.png|center|500px]]
+
'''Source''': https://data.gov.sg/dataset/hdb-property-information</center>
 
||  
 
||  
* MRT Station Number
+
* Block Number
* MRT Station Name
+
* Street
* X
+
* Residential
* Y
+
* Total Dwelling Units
* Latitude
+
* Number of 1-room Sold
* Longitude
+
* Number of 2-rooms Sold
 +
* Number of 3-rooms Sold
 +
* Number of 4-rooms Sold
 +
* Number of 5-rooms Sold
 +
* Number of 5-rooms Sold
 +
* Number of Executive Condominiums Sold
 
||  
 
||  
<center>This dataset aims to complement the main dataset by providing detailed information about the latitude and longitude of the MRT stations located around HDB. We use a javascript geocoding script to convert all the X and Y coordinates to EPSG:4326 latitude and longitude coordinates</center>
+
This dataset provides a comprehensive record of Singapore HDB Property Information, and enables us to scale the average electricity consumption by the number of units for the given dwelling type for the block.
 
|-
 
|-
| <center>Master Plan Subzone Boundary Names and GeoPolygon <br/>
+
| <center>'''Private Apartment Information'''<br/>
(https://data.gov.sg/dataset/master-plan-2014-subzone-boundary-no-sea)</center>
+
[[File:Datasource5.png|center|500px]]
[[File:Subzone1.png|center|500px]]<br/>
+
'''Source''': Real Estate Information System</center>
[[File:Subzone2.png|center|500px]]
 
 
||  
 
||  
* Polygon
+
* Block Number
* Name
+
* Street
* Subzone Number
+
* Residential
* Subzone Code
+
* No of Units
* Region Name
+
* Property Type
* Area Code
+
* Postal District
* Area Indicator
+
* Postal Sector
 +
* Postal Code
 +
* Planning Region
 +
* Planning Area
 +
 
 +
||
 +
This dataset will be a complementary dataset for private housing types by providing information on the number of units.
 +
|-
 +
| <center>'''List of Postal Districts'''<br/>
 +
[[File:Datasource4.png|center|500px]]
 +
'''Source''': https://www.ura.gov.sg/realEstateIIWeb/resources/misc/list_of_postal_districts.htm</center>
 +
||
 +
* Postal District
 +
* Postal Sector
 +
* General Location
 +
 
 
||  
 
||  
<center>This dataset aims to complement the main dataset by providing detailed information about all the subzone in Singapore. We use a javascript library toGeoJson.js to help us convert .KML file to .GeoJson file</center>
+
This dataset is used to map the postal sector, also the first two digits of the postal code, to the corresponding postal district.
 
|}
 
|}
  
Line 105: Line 145:
 
<!-- START Related Works -->
 
<!-- START Related Works -->
  
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px; font-family:sans-serif;">RELATED WORKS</div>==
+
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px; font-family:sans-serif;">Related Works</div>==
  
 
<!-- END  Related Works  -->
 
<!-- END  Related Works  -->
<p>The following related work </p>
+
<p></p>
 +
 
  
There are many charts and visualisations available which illustrates the various trends of house prices and index. We have selected a few of these to study and learn before we begin developing our own visualizations.
 
 
{| class="wikitable" style="background-color:#FFFFFF;" width="100%"
 
{| class="wikitable" style="background-color:#FFFFFF;" width="100%"
 
|-
 
|-
Line 117: Line 157:
 
|-
 
|-
 
|  
 
|  
<p><center>'''An Analysis of the trend and correlation between resale prices and flat production''' </center></p>
+
<p><center>'''Dashboard Visualisation of Average Monthly Household Energy Consumption Per Year in Singapore''' </center></p>
[[File:1718T1G1 BackgroundSurvey1.png|400px|center]]
+
[[File:ChargeMetrics Related1.png|400px|center]]
<p><center>'''Source''': http://www.teoalida.com/singapore/hdbprices/</center></p>
+
<p><center>'''Source''': https://analyticsandintelligentsystems.wordpress.com/2017/04/28/dashboard-visualisation-of-average-monthly-household-energy-consumption-per-year-in-singapore/</center></p>
 
  ||  
 
  ||  
* The use of 2 different chart types with a secondary axis is effective in illustrating the correlation between resale prices and flat production.
+
* Interactive dashboard allows the user to view the top ranking planning regions in terms of energy consumption, as well as choose the number of top ranking planning regions they are interested in.
* The colours used are striking and contrast well with each other.
+
The use of a filter dashboard action also allows the user to view information only for selected planning regions.
* There are dips in both variables which are not explained in the infographic itself (E.g. 1997 Asian crisis, 2003 SARs outbreak). This events could be incorporated into the charts to make it more informative.
 
* However, major events are not shown in the chart itself. This makes it difficult for the audience to understand the various changes throughout the years. It would be much clearer if events were annotated directly on the charts.  
 
 
|-
 
|-
| <p><center> '''An interactive heatmap of Singapore’s house prices in various districts''' </center></p>
+
| <p><center> '''Prediction of Buildings Energy Consumption''' </center></p>
[[File:1718T1G1 BackgroundSurvey2.png|400px|center]]
+
[[File:ChargeMetrics Related2.png|400px|center]]
<p><center> '''Source''': https://www.srx.com.sg/heat-map </center> </p>
+
<p><center> '''Source''': http://cs109-energy.github.io/building-energy-consumption-prediction.html </center> </p>
 
||
 
||
* This heatmap uses colours appropriately so that the house prices of each district can be identified intuitively (Red means expensive, blue means cheap, orange means mid-range)
+
* Calendar view map allows the user to view the daily pattern of energy consumption, and detect any hourly patterns easily, if present.
* The use of filters allows user to find out more about the price distribution of each house type easily.
+
* Provide multiple possible machine learning models for the prediction on energy consumption.
* When user mouseover a district on the heatmap, the corresponding district on the legend is highlighted. This improves usability as users do not have to match district numbers manually.  
+
* Direct illustration of graphs and models on python Jupyter notebook for effective reproducible communication.
* Even though the colours are intuitive, it could still be confusing as audience might still have to constantly refer back to the colour scale to interpret the colours. Colour intensity of a single colour could be used instead of to illustrate the difference in prices.  
+
 
 
|-
 
|-
| <p><center> '''An interactive visualization of house prices along MRT stations''' </center></p>
+
| <p><center> '''Visualising Energy Consumption in Philadelphia''' </center></p>
[[File:1718T1G1 BackgroundSurvey3.png|400px|center]]
+
[[File:ChargeMetrics Related3.png|400px|center]]
<p><center> '''Source''': https://www.srx.com.sg/mrt-home-prices/property-listings-near-east-west-line </center></p>
+
<p><center> '''Source''': http://www.kennethelder.com/visualizing-energy-consumption-in-philadelphia/ </center></p>
 
||  
 
||  
* This visualization makes use of unique ways to illustrate the relation between nearby facilities and house prices. Thus in a glance, a person can tell where are the expensive areas based on the MRT stations.
+
* Allows the user to hide or view the scatter plot without leaving the landing page or changing the map view.
* The separating of the various MRT lines using filters at the top prevent too much information from being shown in one page
+
* Measures for heat map and scatter plot can also be customised by the user.
* However, this chart could be too high level and general. Illustrating this on the Singapore map would be more useful instead, where each house's proximity to the MRT station and their respective resale price is shown. Also, in order to drill down, you would have to navigate to another page and then search for a specific house based on a table view which does not help one visualize where the resale flat is actually located at.
+
* Project incorporated an added dimension to their scatter plot by sizing the points by the energy rating. This is useful for adding another dimension on top of the two variables typically represented on a scatter plot.
 +
 
 
|-
 
|-
| <p><center> '''Four Ways to Slice Obama’s 2013 Budget Proposal''' </center></p>
+
| <p><center> '''Visualising U.S. Energy Consumption in One Chart''' </center></p>
[[File:4waystosliceobamaproposal.png|400px|center]]
+
[[File:ChargeMetrics Related4.png|400px|center]]
<p><center> '''Source''': http://www.nytimes.com/interactive/2012/02/13/us/politics/2013-budget-proposal-graphic.html </center></p>
+
<p><center> '''Source''': http://www.visualcapitalist.com/visualizing-u-s-energy-consumption-one-chart/ </center></p>
 
||  
 
||  
* This visualization makes use of unique ways to illustrate Obama's Budget Proposal
+
* Clear overview of how different energy sources are used and classified
* The various circles denote the various types of proposed budget items and the circles are sized based on the proposed budget amount.
+
* Good usage of colours to clearly illustrate individual flow of the energy source
* Users can toggle the links to slice and dice the initial visualization into different views so that a user can get different insights from the same initial visualization.
+
 
* This chart is very interesting and it is something that we wanted to use to present the changes in resale prices based on different flat types. If we have the time, we could do different filters as well but for now, we will try doing it for flat-type.
 
|-
 
| <p><center> '''OneMap Visualization of resale flat prices''' </center></p>
 
[[File:Onemap screenshot.png|400px|center]]
 
<p><center> '''Source''': https://www.onemap.sg/main/v2/propertyquery </center></p>
 
||
 
* This is a screenshot of an implementation of a interactive map by OneMap which allows users to search for resale flats on the map and view information related to the selected flat easily.
 
* We found this very good as it was very informative if you only wanted to look at one flat.
 
* However, the map looks very ugly and out-dated in terms of style and coloring and this map does not allow one to easily do comparisons between flats.
 
 
|}
 
|}
  
Line 164: Line 194:
 
<!-- START PROTOTYPE -->
 
<!-- START PROTOTYPE -->
  
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px; font-family:sans-serif;">PROTOTYPE </div>==
+
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px; font-family:sans-serif;">Prototype</div>==
 +
===Iteration 1===
 +
===Landing Page===
 +
<center> [[File: Chargemetrics Prototype.jpg|800px|Prototype 1]] </center> <br />
 +
[1]Logo <br />
 +
[2]Bivariate Choropleth Map<br />
 +
[3]Filter <br />
 +
[4]Button to Historical Trend Page<br />
 +
[5]Slope Graph<br />
 +
 
 +
===Historical Trend Page===
 +
<center> [[File: Chargemetrics Prototype2.jpg|800px|Prototype 1]] </center> <br />
 +
[1]Area Chart for Total Electricity Consumption<br />
 +
[2]Area Chart for Number of Singapore Resident<br />
 +
[3]Connected Scatter Plot <br />
 +
[4]Rate of Change of Number of Singapore Resident and Total Electricity Consumption<br />
 +
 
 +
 
 +
 
  
 
<!-- END  PROTOTYPE  -->
 
<!-- END  PROTOTYPE  -->
 +
 +
<!-- START Application Architecture -->
 +
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px;font-family:sans-serif;">Application Architecture</div>==
 +
 +
[[File:aass.jpg|500px|center|ChargeMetrics_Timeline]]
 +
 +
<!-- END Application Architecture -->
  
 
<!-- START Project Schedules -->
 
<!-- START Project Schedules -->
  
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px;font-family:sans-serif;">PROJECT SCHEDULES</div>==
+
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px;font-family:sans-serif;">Project Schedules</div>==
 +
 
 +
 
 +
[[File:ChargeMetrics_Timeline2.jpg|1000px|center|ChargeMetrics_Timeline]]
 +
Project Schedule on Google Sheet:https://docs.google.com/spreadsheets/d/1IlT3Na8Ujlv9izY-0PWvCWEWzfqOmzq3jGHIbWCDiwk/edit?usp=sharing
 +
 
 +
 
  
 
<!-- END  Project Schedules  -->
 
<!-- END  Project Schedules  -->
Line 176: Line 237:
 
<!-- START CHALLENGES -->
 
<!-- START CHALLENGES -->
  
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px;font-family:sans-serif;">CHALLENGES</div>==
+
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px;font-family:sans-serif;">Challenges</div>==
  
 
<!-- END  CHALLENGES  -->
 
<!-- END  CHALLENGES  -->
Line 185: Line 246:
 
|-
 
|-
 
|  
 
|  
<p>Unfamiliar with D3.js </p>
+
<p>Unfamiliarity with D3.js </p>
 
  ||  
 
  ||  
* Independent learning through online learning resources  
+
* Independent learning through online learning resources
* Validating learning outcome through review and coding practices  
+
* Validating learning outcome through review and coding practices
 
|-
 
|-
| <p>Data Merge, Cleaning and Transformation</p>
+
| <p>Data merge, cleaning and transformation</p>
 
||
 
||
* Subzone energy usage data:  
+
* Planning area electricity consumption data: Since the data provided by Energy Market Authority is an average of type of dwelling for each block, we will scale the average electricity consumption by the number of units for the given dwelling type for the block, then sum all the blocks in the relevant planning area to get the aggregate monthly consumption per planning area.
* Missing NA records: government have purposedly removed some data points to enforce the data privacy. We will be examine the effect of remove the NA and decide the appropriate action to take.  
+
* Missing NA records: Due to privacy concerns, Energy Market Authority does not disclose some data points. We will examine the effect of removing the NA records to decide the appropriate action to take.
 
|-
 
|-
 
| <p>Choice of web hosting provider</p>
 
| <p>Choice of web hosting provider</p>
 
||  
 
||  
 
* A quick production pipeline required due to the time limit
 
* A quick production pipeline required due to the time limit
* Examine the requirement of the data visualisation: dynamic or statics
+
* Examine the requirements of the data visualisation: dynamic or static
* Current solution is to use Github Page as a hosting provider there is no dynamic data retrieval required  
+
* Current solution is to use Github Page as a hosting provider as there is no dynamic data retrieval required
 
|-
 
|-
| <p>Unfamilar with implementation efforts required for customized D3.js interactivity</p>
+
| <p>Unfamiliar with implementation efforts required for customised D3.js interactivity</p>
 
||  
 
||  
* The week will be spending 2 weeks to familiarize with D3.js structure & syntax
+
* We will be spending 2 weeks to familiarise ourselves with D3.js structure and syntax
* Follwing 2 weeks will be trying out the customized D3.js interactivity
+
* The following 2 weeks will involve us trying out the customised D3.js interactivity
 
* The project scope and plan will be re-examined based on the project objective, complexity and time available
 
* The project scope and plan will be re-examined based on the project objective, complexity and time available
 
 
|}
 
|}
  
 
<!-- START References -->
 
<!-- START References -->
  
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px; font-family:sans-serif;"> REFERENCES </div>==
+
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px; font-family:sans-serif;"> References </div>==
  
  
  
[1] Energy Market Authority (https://www.ema.gov.sg/singapore_energy_statistics.aspx) <br />
+
[1] The Straits Times (https://www.straitstimes.com/singapore/singapores-household-electricity-consumption-up-17-per-cent-over-past-decade) <br />
[2] Data Gov Database (https://data.gov.sg) <br />
+
[2] Energy Market Authority (https://www.ema.gov.sg/electricity_market_overview.aspx) <br />
[3] D3.js (Documentation https://d3js.org/) <br />
+
[3] National Center for Biotechnology Information (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4746293/) <br />
[4] Observalehq (https://beta.observablehq.com/) <br />
+
[4] Energy Market Authority (https://www.ema.gov.sg/singapore_energy_statistics.aspx) <br />
[5] One Map (https://www.onemap.sg/main/v2/) <br />
+
[5] Data.gov Database (https://data.gov.sg) <br />
[6] Energy Consumption Predition Example (http://cs109-energy.github.io/building-energy-consumption-prediction.html) <br />
+
[6] D3.js (Documentation https://d3js.org/) <br />
 +
[7] Observale (https://beta.observablehq.com/) <br />
 +
[8] OneMap (https://www.onemap.sg/main/v2/) <br />
 +
[9] Prediction of Buildings Energy Consumption (http://cs109-energy.github.io/building-energy-consumption-prediction.html) <br />
  
 
<!-- END  References    -->
 
<!-- END  References    -->
Line 226: Line 289:
 
<!-- START Feedback -->
 
<!-- START Feedback -->
  
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px; Font-family: sans serif;"> FEEDBACK </div>==
+
==<div style="margin-top: 6px;font-weight:bold;text-align: left;font-size:20px; border-bottom:5px solid #ffcc33;text-align:center; background-color: #000000; color: #ffcc33; padding: 2px; font-family:sans-serif;">Feedback </div>==
 
Please feel free leave your comments, suggestions or anything interesting :)
 
Please feel free leave your comments, suggestions or anything interesting :)
  
 
<!-- END  Feedback    -->
 
<!-- END  Feedback    -->

Latest revision as of 19:29, 25 November 2018

IS428_ChargeMetrics_Project

PROPOSAL

  PROJECT POSTER  

PROJECT APPLICATION

  RESEARCH PAPER   OTHER GROUPS


Motivation

Household electricity consumption in Singapore has increased by about 17% over the past decade, according to a report by the National Environment Agency in May 2018. On aggregate levels, Singapore households consumed 7,295 GWh (gigawatt hours) in 2017, which roughly translates to an average expenditure of $1,000 a year on electricity per household. [1]

Electricity consumption is a national issue, especially given that about 95% of Singapore's electricity supply is imported. [2] It is therefore important to encourage households to consume electricity in more sustainable ways.

Traditionally, the lack of transparency surrounding electricity use has been acknowledged as a possible challenge in raising awareness on electricity consumption. [3] Improving visualisation of household electricity consumption can help people in Singapore gain better clarity of their consumption habits and expenditure, and thus more incentive to reduce electricity usage. [3]

Our project visualises the distribution of household electricity consumption across planning regions in Singapore, accounting for type of residential homes, income and demographic profiles. We aim to better communicate electricity consumption in everyday life to people in Singapore, and ultimately engage them to reduce electricity consumption.


Objectives

This project aims to create an interactive data visualisation tool to achieve the following objectives:

  1. Provide a clear geographical visualisation for household electricity consumption across planning areas
  2. Provide an overview of the relationship between resident population and electricity consumption for the various housing types across time
  3. Allow users to explore household electricity consumption in Singapore by comparing across planning regions
  4. Ensure a smooth interactivity for a better user experience


Data

Datasets Data Attributes Rationale of Usage
EMA Household Energy Consumption
Datasource1.png
Source: https://www.ema.gov.sg/statistic.aspx?sta_sid=20140617E32XNb1d0Iqa
  • Postal Code
  • Type of Dwelling
  • Month, 2013-2016
  • Electricity Consumption

This dataset contains granular data on average household monthly electricity consumption by postal code for each type of housing between 2013 to 2016.

Average Monthly Household Electricity Consumption by Dwelling Type, 2005-2017
Avg by dwelling type, 2005 to 2017.png
Source: https://www.ema.gov.sg/statistic.aspx?sta_sid=20140617E32XNb1d0Iqa
  • Type of Dwelling
  • Average Monthly Electricity Consumption (in kWh)
  • Date (mmm-yyyy)

This dataset will be used to visualise the overall historical trend of monthly average household electricity consumption in Singapore from 2005 to 2017.

Singapore Residents by Planning Area and Type of Dwelling, 2000 - 2017
Datasource2.png
Source: https://www.singstat.gov.sg/find-data/search-by-theme/population/geographic-distribution/latest-data
  • Planning Area
  • Type of Dwelling
  • Resident Population
  • Year

This dataset is used to complement the main dataset by providing detailed information about the number of Singapore residents in each planning area, according to dwelling type.


HDB Property Information
Datasource3.png
Source: https://data.gov.sg/dataset/hdb-property-information
  • Block Number
  • Street
  • Residential
  • Total Dwelling Units
  • Number of 1-room Sold
  • Number of 2-rooms Sold
  • Number of 3-rooms Sold
  • Number of 4-rooms Sold
  • Number of 5-rooms Sold
  • Number of 5-rooms Sold
  • Number of Executive Condominiums Sold

This dataset provides a comprehensive record of Singapore HDB Property Information, and enables us to scale the average electricity consumption by the number of units for the given dwelling type for the block.

Private Apartment Information
Datasource5.png
Source: Real Estate Information System
  • Block Number
  • Street
  • Residential
  • No of Units
  • Property Type
  • Postal District
  • Postal Sector
  • Postal Code
  • Planning Region
  • Planning Area

This dataset will be a complementary dataset for private housing types by providing information on the number of units.

List of Postal Districts
Datasource4.png
Source: https://www.ura.gov.sg/realEstateIIWeb/resources/misc/list_of_postal_districts.htm
  • Postal District
  • Postal Sector
  • General Location

This dataset is used to map the postal sector, also the first two digits of the postal code, to the corresponding postal district.


Related Works


Related Works What We Can Learn

Dashboard Visualisation of Average Monthly Household Energy Consumption Per Year in Singapore

ChargeMetrics Related1.png

Source: https://analyticsandintelligentsystems.wordpress.com/2017/04/28/dashboard-visualisation-of-average-monthly-household-energy-consumption-per-year-in-singapore/

  • Interactive dashboard allows the user to view the top ranking planning regions in terms of energy consumption, as well as choose the number of top ranking planning regions they are interested in.
  • The use of a filter dashboard action also allows the user to view information only for selected planning regions.

Prediction of Buildings Energy Consumption

ChargeMetrics Related2.png

Source: http://cs109-energy.github.io/building-energy-consumption-prediction.html

  • Calendar view map allows the user to view the daily pattern of energy consumption, and detect any hourly patterns easily, if present.
  • Provide multiple possible machine learning models for the prediction on energy consumption.
  • Direct illustration of graphs and models on python Jupyter notebook for effective reproducible communication.

Visualising Energy Consumption in Philadelphia

ChargeMetrics Related3.png

Source: http://www.kennethelder.com/visualizing-energy-consumption-in-philadelphia/

  • Allows the user to hide or view the scatter plot without leaving the landing page or changing the map view.
  • Measures for heat map and scatter plot can also be customised by the user.
  • Project incorporated an added dimension to their scatter plot by sizing the points by the energy rating. This is useful for adding another dimension on top of the two variables typically represented on a scatter plot.

Visualising U.S. Energy Consumption in One Chart

ChargeMetrics Related4.png

Source: http://www.visualcapitalist.com/visualizing-u-s-energy-consumption-one-chart/

  • Clear overview of how different energy sources are used and classified
  • Good usage of colours to clearly illustrate individual flow of the energy source


Prototype

Iteration 1

Landing Page

Prototype 1


[1]Logo
[2]Bivariate Choropleth Map
[3]Filter
[4]Button to Historical Trend Page
[5]Slope Graph

Historical Trend Page

Prototype 1


[1]Area Chart for Total Electricity Consumption
[2]Area Chart for Number of Singapore Resident
[3]Connected Scatter Plot
[4]Rate of Change of Number of Singapore Resident and Total Electricity Consumption



Application Architecture

ChargeMetrics_Timeline


Project Schedules

ChargeMetrics_Timeline

Project Schedule on Google Sheet:https://docs.google.com/spreadsheets/d/1IlT3Na8Ujlv9izY-0PWvCWEWzfqOmzq3jGHIbWCDiwk/edit?usp=sharing



Challenges

Challenges Possible Solutions

Unfamiliarity with D3.js

  • Independent learning through online learning resources
  • Validating learning outcome through review and coding practices

Data merge, cleaning and transformation

  • Planning area electricity consumption data: Since the data provided by Energy Market Authority is an average of type of dwelling for each block, we will scale the average electricity consumption by the number of units for the given dwelling type for the block, then sum all the blocks in the relevant planning area to get the aggregate monthly consumption per planning area.
  • Missing NA records: Due to privacy concerns, Energy Market Authority does not disclose some data points. We will examine the effect of removing the NA records to decide the appropriate action to take.

Choice of web hosting provider

  • A quick production pipeline required due to the time limit
  • Examine the requirements of the data visualisation: dynamic or static
  • Current solution is to use Github Page as a hosting provider as there is no dynamic data retrieval required

Unfamiliar with implementation efforts required for customised D3.js interactivity

  • We will be spending 2 weeks to familiarise ourselves with D3.js structure and syntax
  • The following 2 weeks will involve us trying out the customised D3.js interactivity
  • The project scope and plan will be re-examined based on the project objective, complexity and time available


References

[1] The Straits Times (https://www.straitstimes.com/singapore/singapores-household-electricity-consumption-up-17-per-cent-over-past-decade)
[2] Energy Market Authority (https://www.ema.gov.sg/electricity_market_overview.aspx)
[3] National Center for Biotechnology Information (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4746293/)
[4] Energy Market Authority (https://www.ema.gov.sg/singapore_energy_statistics.aspx)
[5] Data.gov Database (https://data.gov.sg)
[6] D3.js (Documentation https://d3js.org/)
[7] Observale (https://beta.observablehq.com/)
[8] OneMap (https://www.onemap.sg/main/v2/)
[9] Prediction of Buildings Energy Consumption (http://cs109-energy.github.io/building-energy-consumption-prediction.html)


Feedback

Please feel free leave your comments, suggestions or anything interesting :)