Difference between revisions of "1718t1is428T15"

From Visual Analytics for Business Intelligence
Jump to navigation Jump to search
Line 34: Line 34:
 
==<div style="margin-top: 10px;font-family: Helvetica; text-align: left;font-size:20px; border: 5px solid #00000000; border-radius:5px; text-align:center; background-color: #708090; color: white; padding: 2px"><span style="font-size:24px;">D</span>ataset</div>==
 
==<div style="margin-top: 10px;font-family: Helvetica; text-align: left;font-size:20px; border: 5px solid #00000000; border-radius:5px; text-align:center; background-color: #708090; color: white; padding: 2px"><span style="font-size:24px;">D</span>ataset</div>==
  
=== Data Source ===
+
The analysis will be based on EMA dataset:
The analysis will be based on EMA dataset<ref>https://www.ema.gov.sg/Statistics.aspx</ref>:
 
 
* Public housing's average monthly household electricity consumption (kwh) (2013 - 2015)
 
* Public housing's average monthly household electricity consumption (kwh) (2013 - 2015)
 
* Private apartment's average monthly household electricity consumption (kwh) (2013 - 2015)
 
* Private apartment's average monthly household electricity consumption (kwh) (2013 - 2015)
  
=== Data Attributes ===
 
Public Housing
 
* Postal code
 
* 1-room
 
* 2-room
 
* 3-room
 
* 4-room
 
* 5-room/executive
 
 
Private Apartment
 
* Postal code
 
* Jan
 
* Feb
 
* Mar
 
* Apr
 
* May
 
* Jun
 
* Jul
 
* Aug
 
* Sep
 
* Oct
 
* Nov
 
* Dec
 
  
 
<!-- END DATASET-->
 
<!-- END DATASET-->
Line 68: Line 44:
  
 
==<div style="margin-top: 10px;font-family: Helvetica; text-align: left;font-size:20px; border: 5px solid #00000000; border-radius:5px; text-align:center; background-color: #708090; color: white; padding: 2px"><span style="font-size:24px;">R</span>elated <span style="font-size:24px">W</span>orks</div>==
 
==<div style="margin-top: 10px;font-family: Helvetica; text-align: left;font-size:20px; border: 5px solid #00000000; border-radius:5px; text-align:center; background-color: #708090; color: white; padding: 2px"><span style="font-size:24px;">R</span>elated <span style="font-size:24px">W</span>orks</div>==
 
Much of the relevant prior work on residential energy consumption levels in Singapore revolve around the motivations and barriers towards energy efficiency.
 
 
In 2013, the  Ministry of the Environment and Water Resources (MEWR) interviewed 2,500 residents on their extent of energy efficiency practice at home, level of awareness of energy efficiency, and barriers towards being energy efficient. It found that 41.3% of the respondents are more encouraged to conserve electricity if the government were to provide monetary incentives or voucher rewards/rebates, and 36.5% are motivated by advertisements on various media platforms. The findings also concluded that residents generally perceived the high cost of energy-efficient appliances and inconvenience of energy-saving practices as barriers to energy efficiency in households.<ref>https://www.mewr.gov.sg/docs/default-source/default-document-library/grab-our-research/mewr_ee_report.pdf</ref>
 
 
Another research by Energy Efficient Singapore (E2 Singapore) indicated that when residents in other countries are allowed to compare their utility bills against that of their neighbours, they can potentially achieve 4 to 12% energy savings. This is because it leverages on the power of social norms to provide direct feedback to the residents – residents are likely to bring their behavior closer to the norm when they are informed of what the norm is.<ref>http://www.e2singapore.gov.sg/DATA/0/docs/NewsFiles/Find%20out%20how%20much%20your%20neighbours%20spend%20on%20energy_v2.pdf</ref>
 
 
A third by Xu and Ang from NUS analyzes the root cause of high energy consumption using the index decomposition analysis (IDA). The IDA model studies changes in energy consumption over time and is often used in major energy consuming sectors such as the transport industry. To fit the model for use on the residential sector, Xu and Ang applied a hybrid IDA model that divides the residential sector into various subsectors, each with a different key factor driving energy consumption. For instance, energy consumption in a subsector may be driven by floor area (for air cooling and heating). The paper found that environment control and household appliances are the main factors for energy consumption by households, and each of these is greatly affected by population growth and decreases in residents per household.<ref>http://www.e2singapore.gov.sg/DATA/0/docs/1-s2.0-S0306261913006193-main.pdf</ref>
 
 
By using our proposed work jointly with the first two papers, users can visually identify clusters with high energy usage where efficient energy consumption measures can be implemented. With the last paper, we can trace the root cause for high energy usage.
 
  
 
<!-- END RELATED WORKS -->
 
<!-- END RELATED WORKS -->
Line 84: Line 50:
  
 
==<div style="margin-top: 10px;font-family: Helvetica; text-align: left;font-size:20px; border: 5px solid #00000000; border-radius:5px; text-align:center; background-color: #708090; color: white; padding: 2px"><span style="font-size:24px;">I</span>nspirations</div>==
 
==<div style="margin-top: 10px;font-family: Helvetica; text-align: left;font-size:20px; border: 5px solid #00000000; border-radius:5px; text-align:center; background-color: #708090; color: white; padding: 2px"><span style="font-size:24px;">I</span>nspirations</div>==
 +
[[File:Otf choro.PNG |1000px|center]]<br />
 +
The number of public and private address points in Singapore is exceptionally large at about twenty thousands records. While this may pale in comparison to data sets that amount to tens of millions of records in size, the real challenge lies in plotting these points over a geographical region as small as Singapore. The limitation in land space coupled with the immense number of data points would result in many overlapping and cluttering of address points, making data aggregation and visualizing energy consumption extremely difficult and ineffective.
 +
 +
Our team has already experimented aggregating energy consumption levels onto a choropleth map segmented by planning areas. This approach is effective in providing an overview of energy consumption levels across planning areas in Singapore, further assisting analysis in local indications of spatial correlation in terms of energy usage clustering. However, this approach is inept at investigating clustering at finer levels of spatial granularity, focusing on smaller areas is impossible as data is aggregated at the level of planning areas.
 
[[File:Hexbin inspiration.PNG ||center]]<br />
 
[[File:Hexbin inspiration.PNG ||center]]<br />
 +
With this in mind, On The Fly is experimenting with an alternative technique of hexagonal binning for visualizing energy usage density of public and private housings. By aggregating the number of address points into hexagons and computing the average energy consumption of address points in these hexagons, we aim to visualize energy consumption levels of address points aggregated across smaller areas in hex bins to generate a more detailed view of energy usages across geographical land space.
  
EMA publishes energy statistics on an annual basis to provide readers with a comprehensive understanding of the Singapore energy landscape through a detailed coverage of various energy-related topics. As project Enerlyst focuses on analysing households' energy consumption, only private and public households data will be used. This study will be based on EMA dataset from 2013 to 2015.  2013 data will be prepared manually whereas 2014 and 2015 data will be uploaded to the application and process on the fly.
 
 
 
<!-- END INSPIRATIONS-->
 
<!-- END INSPIRATIONS-->
  
Line 99: Line 68:
  
 
==<div style="margin-top: 10px;font-family: Helvetica; text-align: left;font-size:20px; border: 5px solid #00000000; border-radius:5px; text-align:center; background-color: #708090; color: white; padding: 2px"><span style="font-size:24px;">T</span>echnical <span style="font-size:24px">C</span>hallenges</div>==
 
==<div style="margin-top: 10px;font-family: Helvetica; text-align: left;font-size:20px; border: 5px solid #00000000; border-radius:5px; text-align:center; background-color: #708090; color: white; padding: 2px"><span style="font-size:24px;">T</span>echnical <span style="font-size:24px">C</span>hallenges</div>==
 
{| class="wikitable" style="background-color:#FFFFFF;" width="100%"
 
|-
 
! style="font-weight: bold;background: #808080;color:#fbfcfd;width: 50%;" | Key Technical Challenges
 
! style="font-weight: bold;background: #808080;color:#fbfcfd;" | How We Propose To Resolve
 
|-
 
| <center> Unfamiliarity with d3.js libraries </center> ||
 
* Independent Learning
 
* Consult Instructor Prakash
 
* Peer Learning
 
|-
 
| <center> Data Cleaning & Transformation </center> ||
 
* Work together to clean, transform and analyze the data
 
|-
 
| <center> Unfamiliarity in Implementing Interactivity and Animation Tools/Techniques in Visualization App </center> ||
 
* Develop a Storyboard/Design Flow
 
* Assign members to specialize on Interactivity/Animation Techniques
 
|}
 
  
 
<!-- END TECHNICAL CHALLENGES-->
 
<!-- END TECHNICAL CHALLENGES-->
Line 124: Line 75:
 
==<div style="margin-top: 10px;font-family: Helvetica; text-align: left;font-size:20px; border: 5px solid #00000000; border-radius:5px; text-align:center; background-color: #708090; color: white; padding: 2px"><span style="font-size:24px;">T</span>imeline</div>==
 
==<div style="margin-top: 10px;font-family: Helvetica; text-align: left;font-size:20px; border: 5px solid #00000000; border-radius:5px; text-align:center; background-color: #708090; color: white; padding: 2px"><span style="font-size:24px;">T</span>imeline</div>==
 
<div align="center">
 
<div align="center">
 
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
! style="font-weight: bold;background: #808080;color:#fbfcfd;" | Week No(s). !! style="font-weight: bold;background: #808080;color:#fbfcfd;" | Task !! style="font-weight: bold;background: #808080;color:#fbfcfd;" |Status
+
! Week No(s). !! Task !! Status
 +
|-
 +
| 3 || Form team || Completed
 +
|-
 +
| 4-5 || Discuss and choose a project topic || Completed
 +
|-
 +
| 6-9 || Research chosen project topic and data collection || Completed
 
|-
 
|-
| <center>7</center> || Prepares Project Proposal || Completed
+
| 10-11 || Create project repository and web application planning ||Completed
 
|-
 
|-
| <center>8</center> || Attend D3.js workshop, research on technologies/tools and project wiki || Completed
+
| 12 || Create project wiki || Completed
 
|-
 
|-
| <center>9</center> || Clean data, start visualisation || Incomplete
+
| 11-15 || Develop application || Completed
 
|-
 
|-
| <center>10-11</center> || Continue with visualisation || Incomplete
+
| 14-15 || Research report || Completed
 
|-
 
|-
| <center>12</center> || Prepare poster, final report and wiki page || Incomplete
+
| 16 || Finalize application || Completed
 
|-
 
|-
| <center>13</center> || Poster submission and final deliverables || Incomplete
+
| 16 || Finalize Poster and Research Paper || Completed
 +
|-
 +
| 16 || Prepare for Townhall Presentation || Completed
 +
|-
 +
| 16 || Townhall Poster Presentation || Completed
 +
|-
 +
| 16 || Final Project Submission ||  Completed
 
|}
 
|}
 
</div>
 
</div>
Line 147: Line 109:
  
 
==<div style="margin-top: 10px;font-family: Helvetica; text-align: left;font-size:20px; border: 5px solid #00000000; border-radius:5px; text-align:center; background-color: #708090; color: white; padding: 2px"><span style="font-size:24px;">T</span>echnologies/<span style="font-size:24px">T</span>ools</div>==
 
==<div style="margin-top: 10px;font-family: Helvetica; text-align: left;font-size:20px; border: 5px solid #00000000; border-radius:5px; text-align:center; background-color: #708090; color: white; padding: 2px"><span style="font-size:24px;">T</span>echnologies/<span style="font-size:24px">T</span>ools</div>==
 
The following are technologies and tools which we used:
 
* Microsoft Excel (data cleaning)
 
* D3.js (visualisation)
 
* Leaflet (overlaying of map)
 
* Github (version control)
 
  
 
<!-- END TECHNOLOGIES-->
 
<!-- END TECHNOLOGIES-->

Revision as of 21:55, 12 October 2017

OnTheFlyLogo.png


PROJECT PROPOSAL

PROJECT POSTER

PROJECT APPLICATION

RESEARCH PAPER


Project Motivation

Experts have warned that power demand is set to double by 2030 globally despite authoritative control. High power consumption can already be observed locally. According Energy Market Authority (EMA), Singapore has faced increasing power consumption from 1965 to 2013 [1].

1718t1is428T15-Motivation.png

As Singapore is land-scarce and does not have significant renewable energy options such as hydro-power, wave, or sufficient land for mass solar energy production, energy has been a top concern in the urban nation[2]. It is thus important to promote energy saving concepts to the public as well as deploying energy saving solution island wide. However, the usual analysis tools are not enough to provide a different perspective to facilitate the deployment of the solution. Information about the energy consumption levels of residents in Singapore are often not conveyed adequately enough in data visualisation. While EMA and Singstat provide annual data and reports on energy usage in Singapore, a powerful visualisation technique should be used to gain insights effectively.


Project Objective

Our team aims to create a visualisation that leverages on energy datasets provided by EMA to perform spatial analysis to identify energy usage clusters with hexagonal binning.


Dataset

The analysis will be based on EMA dataset:

  • Public housing's average monthly household electricity consumption (kwh) (2013 - 2015)
  • Private apartment's average monthly household electricity consumption (kwh) (2013 - 2015)



Related Works

Inspirations

Otf choro.PNG


The number of public and private address points in Singapore is exceptionally large at about twenty thousands records. While this may pale in comparison to data sets that amount to tens of millions of records in size, the real challenge lies in plotting these points over a geographical region as small as Singapore. The limitation in land space coupled with the immense number of data points would result in many overlapping and cluttering of address points, making data aggregation and visualizing energy consumption extremely difficult and ineffective.

Our team has already experimented aggregating energy consumption levels onto a choropleth map segmented by planning areas. This approach is effective in providing an overview of energy consumption levels across planning areas in Singapore, further assisting analysis in local indications of spatial correlation in terms of energy usage clustering. However, this approach is inept at investigating clustering at finer levels of spatial granularity, focusing on smaller areas is impossible as data is aggregated at the level of planning areas.

Hexbin inspiration.PNG


With this in mind, On The Fly is experimenting with an alternative technique of hexagonal binning for visualizing energy usage density of public and private housings. By aggregating the number of address points into hexagons and computing the average energy consumption of address points in these hexagons, we aim to visualize energy consumption levels of address points aggregated across smaller areas in hex bins to generate a more detailed view of energy usages across geographical land space.


Proposed Storyboard

Technical Challenges

Timeline

Week No(s). Task Status
3 Form team Completed
4-5 Discuss and choose a project topic Completed
6-9 Research chosen project topic and data collection Completed
10-11 Create project repository and web application planning Completed
12 Create project wiki Completed
11-15 Develop application Completed
14-15 Research report Completed
16 Finalize application Completed
16 Finalize Poster and Research Paper Completed
16 Prepare for Townhall Presentation Completed
16 Townhall Poster Presentation Completed
16 Final Project Submission Completed


Technologies/Tools

Reference


Comments