Difference between revisions of "Kabak: Research Paper Data Preparation"

From Visual Analytics for Business Intelligence
Jump to navigation Jump to search
Line 89: Line 89:
 
|-
 
|-
 
|  
 
|  
<p>Average Monthly Household Electricity Consumption <br> by Postal Code (Public Housing) & Dwelling Type, 1H & 2H 2015</p>
+
*Stack data to consolidate data table in to 2 columns (Postal Code, Housing Type)  
<p>'''Link (1H)''': https://www.ema.gov.sg/cmsmedia/Publications_and_Statistics/Statistics/23RSU.xls </p>
+
*Remove rows with missing data
<p>'''Link (2H)''': https://www.ema.gov.sg/cmsmedia/Publications_and_Statistics/Statistics/25RSU.xls </p>
 
 
  ||  
 
  ||  
* Average monthly household electricity consumption (kwh)
+
*Stack and Eliminate rows with missing data
**By month
+
[[File: publichousingdc1.jpg|400px|center]]
**By postal code
+
[[File: publichousingdc2.jpg|400px|center]]
**By public housing type
+
[[File: publichousingdc3.jpg|400px|center]]
* Total Average household electricity consumption (kwh)
 
**By postal code
 
**By public housing type
 
 
|-
 
|-
 
|
 
|

Revision as of 11:27, 22 November 2016


OVERVIEW

DATA PREPARATION

ANALYSIS

PROJECT MANAGEMENT


Initial Dataset

DATASET DESCRIPTION DATA USED

Average Monthly Household Electricity Consumption
by Postal Code (Public Housing) & Dwelling Type, 1H & 2H 2015

Link (1H): https://www.ema.gov.sg/cmsmedia/Publications_and_Statistics/Statistics/23RSU.xls

Link (2H): https://www.ema.gov.sg/cmsmedia/Publications_and_Statistics/Statistics/25RSU.xls

  • Average monthly household electricity consumption (kwh)
    • By month
    • By postal code
    • By public housing type
  • Total Average household electricity consumption (kwh)
    • By postal code
    • By public housing type
  • 9379 rows of raw data X 12 sheets = 112,548 rows of raw data

Average Monthly Household Electricity Consumption by Postal Code (Private Apartments), 2015

Link: https://www.ema.gov.sg/cmsmedia/Publications_and_Statistics/Statistics/2RSU.xls

  • Average monthly household electricity consumption (kwh)
    • By month
    • By postal code
  • Total Average household electricity consumption (kwh)
    • By postal code
  • 9911 rows of raw data

Basic Demographics Characteristics (2015)

Link: http://www.singstat.gov.sg/docs/default-source/default-document-library/publications/publications_and_papers/GHS/ghs2015/excel/t7-9.xls

  • Resident Population by Planning Area/Subzone
    • By age group
    • By sex
    • By ethnicity
    • By type of dwelling
  • T7 Age group
    • 378 rows of raw data
  • T8 Ethnicity
    • 378 rows of raw data


Data Cleaning

METHOD DESCRIPTION
  • Stack data to consolidate data table in to 2 columns (Postal Code, Housing Type)
  • Remove rows with missing data
  • Stack and Eliminate rows with missing data
Publichousingdc1.jpg
Publichousingdc2.jpg
Publichousingdc3.jpg

Average Monthly Household Electricity Consumption by Postal Code (Private Apartments), 2015

Link: https://www.ema.gov.sg/cmsmedia/Publications_and_Statistics/Statistics/2RSU.xls

  • Average monthly household electricity consumption (kwh)
    • By month
    • By postal code
  • Total Average household electricity consumption (kwh)
    • By postal code

Basic Demographics Characteristics (2015)

Link: http://www.singstat.gov.sg/docs/default-source/default-document-library/publications/publications_and_papers/GHS/ghs2015/excel/t7-9.xls

  • Resident Population by Planning Area/Subzone
    • By age group
    • By sex
    • By ethnicity
    • By type of dwelling