Difference between revisions of "Group02 proposal"

From Visual Analytics for Business Intelligence
Jump to navigation Jump to search
(Created page with " {|style="background-color:#f67c6c; color:#fff; padding: 10 0 10 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" | | style="padding:0.2em; font-size:1...")
 
 
(112 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 +
[[File:Rain & Shine(new).png|center|300px]]
  
{|style="background-color:#f67c6c; color:#fff; padding: 10 0 10 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" | | style="padding:0.2em; font-size:100%; background-color:#f67c6c; text-align:center; color:#fff" width="10%" | [[Policy_Sharpener_Team |Team]] | style="background:none;" width="1%" |  | style="padding:0.2em; font-size:100%; background-color:#ffd4cc; border-bottom:0px solid #3D9DD7; text-align:center; color:#100c08" width="10%" | [[Policy_Sharpener|Proposal]] | style="background:none;" width="1%" |  | style="padding:0.2em; font-size:100%; background-color:#f67c6c; border-bottom:0px solid #3D9DD7; text-align:center; color:#fff" width="10%" | [[Policy_Sharpener_Poster|Poster]] | style="background:none;" width="1%" |  | style="padding:0.2em; font-size:100%; background-color:#f67c6c; border-bottom:0px solid #3D9DD7; text-align:center; color:#fff" width="10%" | [[Policy_Sharpener_Application|Application]] | style="background:none;" width="1%" |  | style="padding:0.2em; font-size:100%; background-color:#f67c6c; border-bottom:0px solid #3D9DD7; text-align:center; color:#fff" width="10%" | [[Policy_Sharpener_Research Paper|Research Paper]] |}
+
<!--Header-->
 +
<div style="width:100%; text-align:center;">
 +
{|style="background-color:#143c67; color:#4d79ff; padding: 10 0 10 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" |
 +
| style="padding:0.2em; font-size:100%; background-color:#143c67; text-align:center; color:#F5F5F5" width="10%" |  
 +
;
 +
[[Group02 team|<font color="#F5F5F5" size=3 face="Helvetica">Team</font>]]
  
[[Project Groups|<--- Go Back to Project Groups]]
+
| style="background:none;" width="1%" | &nbsp;
 +
| style="padding:0.2em; font-size:100%; background-color:#143c67;  border-bottom:0px solid #3D9DD7; text-align:center; color:#F5F5F5" width="10%" |
 +
;
 +
[[Group02 proposal v2| <font color="#FFFFFF">Proposal</font>]]
  
==
+
| style="background:none;" width="1%" | &nbsp;
PROBLEM & MOTIVATION
+
| style="padding:0.2em; font-size:100%; background-color:#143c67;  border-bottom:0px solid #3D9DD7; text-align:center; color:#F5F5F5" width="10%" |
==
+
;
TO DO: Explain problem and motivation
+
[[Group02 poster| <font color="#FFFFFF">Poster</font>]]
==
+
 
PROJECT OBJECTIVES
+
| style="background:none;" width="1%" | &nbsp;
==
+
| style="padding:0.2em; font-size:100%; background-color:#143c67;  border-bottom:0px solid #3D9DD7; text-align:center; color:#F5F5F5" width="10%" |
TO DO: Explain project Objectives
+
;
==
+
[[Group02 application| <font color="#FFFFFF">Application</font>]]
SELECTED DATABASE
+
 
==
+
| style="background:none;" width="1%" | &nbsp;
 +
| style="padding:0.2em; font-size:100%; background-color:#143c67;  border-bottom:0px solid #3D9DD7; text-align:center; color:#F5F5F5" width="10%" |
 +
;
 +
[[Group02 research paper| <font color="#FFFFFF">Research Paper</font>]]
 +
|}
 +
 
 +
</div>
 +
<!--/Header-->
 +
<div>
 +
{|style="background-color:#143c67; color:#143c67; padding: 10 0 10 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0"  |
 +
| style="padding:0.2em; font-size:100%; background-color:#ff6b89; text-align:center; color:#F5F5F5" width="10%" |
 +
;
 +
[[Group02 proposal v2|Version2]]|[[Group02 proposal|Version1]]
 +
|}
 +
</div>
 +
<br /><br />
 +
==<div style="background:#143c67; padding: 15px; font-weight: bold; line-height: 0.3em; letter-spacing:0.5em;font-size:20px"><font color=#fbfcfd face="Century Gothic"><center>PROBLEM & MOTIVATION</center></font></div>==
 +
 
 +
'''<u>Problem</u>''' <br>
 +
When it comes to purchasing or renting a property, there are many factors that go into a buyer’s consideration before he makes the final decision. The primary concern for buyers is the pricing of the property [https://www.ura.gov.sg/Corporate/Property/Residential/Buying-Property]. However, our group identified that there are also secondary concerns such as the weather and the amenities available that do influence the buyer’s final decision to purchase the property. There are limited tools available to help property buyers to identify areas that suit their needs/preferences best. The current available tools are only optimal to suit one category of concern, but fails when we try to use more categories to make our visualization. <br><br>
 +
For example, different people have different preferences for the weather. Some may prefer sunny weather while others prefer it to rain all the time. Currently, there are tools to find weather information, and property prices information, but not both at the same time.<br><br>
 +
 
 +
'''<u>Motivation</u>''' <br>
 +
Through our visualization, the group hopes to assist users to be able to easily visualize a home of his dreams in different aspects beyond mere prices. Our visualization will incorporate data from property prices, weather and amenities to identify the accessibility of the area and help our users to justify the real value of the property. With our visualization dashboard, users will be able to identify properties that they truly desire.
 +
 
 +
==<div style="background:#143c67; padding: 15px; font-weight: bold; line-height: 0.3em; letter-spacing:0.5em;font-size:20px"><font color=#fbfcfd face="Century Gothic"><center>OBJECTIVES</center></font></div>==
 +
 
 +
We aim to provide an interactive visualization dashboard to assist <b>pGeneral Public, people living in Singapore</b> with understanding the weather of our country with visualization information such as:
 +
 
 +
:# Insights on the Rainfall Precipitation of the whole of Singapore and each postal area for the past 20 years.
 +
:# Insights on the Temperature of the whole of Singapore and each postal area for the past 20 years.
 +
:# Insights on the relationship of the Rainfall Precipitation and Temperature in the different months/seasons yearly.
 +
 
 +
<b><u>Target Group</u></b>:
 +
* <b> General Public, people living in Singapore
 +
 
 +
==<div style="background:#143c67; padding: 15px; font-weight: bold; line-height: 0.3em; letter-spacing:0.5em;font-size:20px"><font color=#fbfcfd face="Century Gothic"><center>DATASET</center></font></div>==
 +
<center>
 
The Data Sets we will be using for our analysis and for our application is listed below:
 
The Data Sets we will be using for our analysis and for our application is listed below:
{| class="wikitable" style="background-color:#FFFFFF;" width="90%" |- ! style="font-weight: bold;background: #141414;color:#fbfcfd;width: 30%;" | Dataset/Source ! style="font-weight: bold;background: #141414;color:#fbfcfd;width: 20%" | Data Attributes ! style="font-weight: bold;background: #141414;color:#fbfcfd;width: 50%;" | Rationale Of Usage |- |
+
{| class="wikitable" width="100%"
(Data Source) (Data time of coverage)
+
|-
 +
! style="font-weight: bold;background: #899db3;color:#fbfcfd;width: 30%;" |Data/Source
 +
! style="font-weight: bold;background: #899db3;color:#fbfcfd;width: 30%;" |Variables/Description
 +
! style="font-weight: bold;background: #899db3;color:#fbfcfd;width: 40%;" |Rationale Of Usage
 +
|-
 +
|
 +
<center>
 +
<b>Temperature and Rainfall Data</b><br/>
 +
(Jan 2012 - Dec 2019)<br/><br/>
 +
 
 +
(http://www.weather.gov.sg/climate-historical-daily/)
 +
</center>
 +
||
 +
* Stations
 +
* Date
 +
* Daily Rainfall
 +
* Highest  30-min/60-min/120-min Rainfall (mm)
 +
* Mean/Minimum/Maximum Temperature (°C)
 +
* Mean/Max Wind Speed (km/h)
 +
||
 +
<center>
 +
This dataset covers a good time series of Singapore's weather from 2012 to 2019 across different weather categories. Our team wish to spot the trend or pattern of Singapore's climate in every town if possible.
 +
</center>
 +
|-
 +
|
 +
<center>
 +
<b>Amenities Location Data</b></br><br/>
 +
(https://api.data.gov.sg/v1/environment/rainfall)
 +
(https://api.data.gov.sg/v1/environment/air-temperature)
 +
</center>
 +
||
 +
* Station ID
 +
* Station Name
 +
* Latitude
 +
* Longitude
 +
||
 +
<center>
 +
The data set will be used to anchor the amenities available for the selected property in a specified range
 +
</center>
 +
 
 +
|-
 +
|}
 +
</center>
 +
 
 +
==<div style="background:#143c67; padding: 15px; font-weight: bold; line-height: 0.3em; letter-spacing:0.5em;font-size:20px"><font color=#fbfcfd face="Century Gothic"><center>BACKGROUND SURVEY OF RELATED WORK</center></font></div>==
  
(Link to data source)
+
Below are a few visualizations and charts we considered making for our projects.
|| * '''Attribute''': : Examples * '''Attribute''': : Examples ||
+
{| class="wikitable" style="margin-left: auto; margin-right: auto; width: 90%;
The dataset will be used to understand the Indonesian Export and import figure from 1996 - 2019, July across multiple categories. At the end, we wish to spot the trend or pattern of Indonesia trading and economy situation.
+
|-
|- |
+
! style="background: #899db3;color:#fbfcfd;|Visual Considerations !!style="background: #899db3;color:#fbfcfd;| Insights / Comments
(Data Source) (Data time of coverage)
+
|-
 +
| <center><br/>  '''Title: Qualitative Thematic Map  '''
 +
[[File:ThematicMap.png|300px|frameless|center]]
 +
<b>Source: https://mapdesign.icaci.org/2014/12/mapcarte-353365-life-in-los-angeles-by-eugene-turner-1977/</b>
 +
</center>
 +
||  
  
(Link to data source)
+
One of the items that we looked at is this qualitative thematic map that was covered in class.  
|| * '''Attribute''': : Examples * '''Attribute''': : Examples ||
 
The dataset will be used to understand the Indonesian Export and import figure from 1996 - 2019, July across multiple categories. At the end, we wish to spot the trend or pattern of Indonesia trading and economy situation.
 
|- |
 
(Data Source) (Data time of coverage)
 
  
(Link to data source)
+
From our initial brainstorming of ideas, we intend to look at various factors that a buyer will look at, giving the buyer a high-level overview of the different areas and whether it fits the criteria that he chooses. How we will adapt ideas from this graph is for us to allow the users to make a few selections of multiple factors. Then based on which criteria the different properties in the different subzones can meet, we can choose different shapes, colours to represent the zone.
|| * '''Attribute''': : Examples * '''Attribute''': : Examples ||
+
 
The dataset will be used to understand the Indonesian Export and import figure from 1996 - 2019, July across multiple categories. At the end, we wish to spot the trend or pattern of Indonesia trading and economy situation.
+
 
 +
|-
 +
| <center><br/> '''Title: Whisker plot of temperature'''
 +
[[File:Temperature whisker.png|300px|frameless|center]]
 +
<b>Source: https://www.ck12.org/statistics/box-and-whisker-plots/rwa/The-Ways-of-Weather/</b>
 +
</center>
 +
||  
 +
We can see the temperature for the selected area over a year. The whisker plots can show the upper and lower boundaries of temperature, and we can observe that the temperature gradually rises to a peak from Jan to Aug, before decreasing until December.
 +
 
 +
We hope to apply this chart to display the rainfall for a selected area over a year. This allows buyers to be able to better understand the rainfall pattern in the area so that he can better understand if the area suits his preferences.
 +
 
 +
|-
 +
| <center><br/>  '''Title: Heatmap of rainfall'''  
 +
[[File:Heatmap of rainfall.png|300px|frameless|center]]
 +
<b>Source: https://www.shanelynn.ie/analysis-of-weather-data-using-pandas-python-and-seaborn/</b>
 +
</center>
 +
||
 +
This is a heatmap of daily rainfall. Darker colours of red represent heavier rainfall.
 +
 
 +
Another way to have a visualization to understand the patterns of rainfall. Through this, we can quickly see how many days in a year where there is rain for a selected subzone. Assuming that a potential buyer is interested in a property that sees more sunlight, he will be more interested in a subzone where the graph looks brighter. On the other hand, if the buyer is interested in a property that is always rainy, he would be interested in an area where the graph looks darker.
 +
 
 +
|-
 +
| <center><br/>  '''Title: Spatial Interpolation'''  
 +
[[File:Property heatmap.png|300px|frameless|center]]
 +
<b>Source: https://www.srx.com.sg/heat-map/</b>
 +
</center>
 +
||  
 +
This graph shows the property prices in Singapore for different property types. The user can choose to select different property types, and the graph will update to show only the selected property type. A variety of colours are chosen here to display different levels of prices.
 +
 
 +
Based on our problem, there are 2 key aspects that we are looking at: Prices and Weather. One way this kind of visualization could be utilized by our group is for us to use this to display prices or Weather in Singapore across all subzones. By charting either prices or the various weather types over a map of Singapore, the user will be able to quickly gain an understanding of how the different criteria that he can choose will be like across Singapore.
 +
 
 +
 
 +
 
 +
 
 +
|}
 +
 
 +
==<div style="background:#143c67; padding: 15px; font-weight: bold; line-height: 0.3em; letter-spacing:0.5em;font-size:20px"><font color=#fbfcfd face="Century Gothic"><center>KEY TECHNICAL CHALLENGES & MITIGATION</center></font></div>==
 +
 
 +
{| class="wikitable" width="100%"
 +
|-
 +
! style="font-weight: bold;background: #899db3;color:#fbfcfd;width: 5%;" |No.
 +
! style="font-weight: bold;background: #899db3;color:#fbfcfd;width: 15%;" |Challenge
 +
! style="font-weight: bold;background: #899db3;color:#fbfcfd;width: 40%;" |Description
 +
! style="font-weight: bold;background: #899db3;color:#fbfcfd;width: 40%;" |Mitigation Plan
 +
|-
 +
|<center>1. </center>
 +
||Software Challenge
 +
||Unfamiliarity of visualisation tools such as R, R Shiny, Tableau.
 +
||
 +
* Github Learning
 +
* Stackoverflow research
 +
* Self-directed and peer learning
 +
* Watch video tutorials from YouTube
 +
* Hands-on practice using the different training platforms such as Data Camps
 +
|-
 +
|<center>2. </center>
 +
||Programming Challenge
 +
||Inexperince with data cleaning and transformation using R
 +
||
 +
* Trial and error
 +
* Read online articles and forums for guidance
 +
* Watch video tutorials on how to fully utilise packages such as lapply, tidyr and dplyr
 +
|-
 +
|<center>3. </center>
 +
||Workload Constraint
 +
||Time and Workload Constrains
 +
||
 +
* Design reasonable project timeline based on everyone's ability and capacity.
 +
* Set milestones and adjust the timeline accordingly based on the team's progress.
 +
|-
 +
|<center>4. </center>
 +
|| Dataset Complexity
 +
||
 +
Our have different data from multiple sources in multiple different formats, hence we foresee a huge challenge in standardizing the data
 +
* Note: Our current dataset is looking at 49 areas over the spread of 8 years of data, for every year there are 12 months of data. This gives a total of 4,704 CSV files to consolidate and clean for weather data alone.
 +
||
 +
* Make use of data preparation tools such as tableau prep
 +
* Make use of our database management skills to normalize all data tables into third normal form
 +
|-
 
|}
 
|}
  
 +
==<div style="background:#143c67; padding: 15px; font-weight: bold; line-height: 0.3em; letter-spacing:0.5em;font-size:20px"><font color=#fbfcfd face="Century Gothic"><center>STORYBOARD</center></font></div>==
 +
 +
{| class="wikitable" style="margin-left: auto; margin-right: auto; width: 90%;
 +
|-
 +
! style="background: #899db3;color:#fbfcfd;| Dashboards !!style="background: #899db3;color:#fbfcfd;| Description
 +
|-
 +
| <center><br/>  ''' Dashboard 1: Qualitative Thematic Map of Singapore property'''
 +
[[File:VA1.jpg|400px|frameless|center]]
 +
</center>
 +
||
  
==
+
Our group plans to do an interactive Qualitative Thematic Map which reflects different faces based on the year, price, weather, amenities filters adjusted by the users. This chart will show the data at a high level for users to identify which area meets their needs in a glance. Users can also view the map based on the postal area or zone.  
BACKGROUND SURVEY
 
==
 
We did basic background research on some existing visualizations or dashboards we could drive inspirations from or make it better. Below are a few visuals we found:
 
{| class="wikitable" style="background-color:#FFFFFF;" width="90%" |- ! style="font-weight: bold;background: #141414;color:#fbfcfd;width: 45%;" | Reference of Other Interactive Visualization ! style="font-weight: bold;background: #141414;color:#fbfcfd;width: 55%" | Learning Point |- |
 
'''Title''': (Type Title Here) [[File:Policy_Sharpener_Background1.png|300px|frameless|center]]
 
'''Source''': (Source Link Here)
 
|| '''Positive Points:''' # (Type point here) '''Negative Points:''' # (Type point here) |- |
 
'''Title''': (Type Title Here) [[File:Policy_Sharpener_Background1.png|300px|frameless|center]]
 
'''Source''': (Source Link Here)
 
|| '''Positive Points:''' # (Type point here) '''Negative Points:''' # (Type point here) |- |
 
'''Title''': (Type Title Here) [[File:Policy_Sharpener_Background1.png|300px|frameless|center]]
 
'''Source''': (Source Link Here)
 
|| '''Positive Points:''' # (Type point here) '''Negative Points:''' # (Type point here) |}
 
  
 +
Filters used includes:
 +
* Sliders
 +
:# Year
 +
:# Transacted Price
 +
:# Amenities
 +
* Single Dropdown List
 +
:# Weather
 +
:# Map level of detail
 +
* Multiple Drowndown List
 +
:# Property Type
  
==
+
 
EVALUATION AND SELECTION OF VISUALISATIONS
+
Based on User’s adjustment for the filters, the map would reflect the user <u>3 different data types</u>:
==
+
* <b>Weather</b>
Below are a few visualizations and charts we considered making for our projects.
+
: When the postal area/zone’s selected weather is above the median of Singapore’s data over the selected year, the chart will reflect a circle face shape. However, if the postal area/zone’s selected weather falls in the median or is lower than the median of Singapore’s data over the selected year, the chart will reflect a circle face shape with devil horns.
{| class="wikitable" style="background-color:#FFFFFF;" width="90%" |- ! style="font-weight: bold;background: #141414;color:#fbfcfd;width: 45%;" | Visual Considerations ! style="font-weight: bold;background: #141414;color:#fbfcfd;width: 55%" | Insights / Comments |- |
+
* <b>Pricing</b>
'''Title''': (Title of chart) [[File:Policy_Sharpener_ConsiderationVisual1.png|250px|frameless|center]] '''Source''': (Link to chart)
+
: When the postal area/zones have houses with pricing over the selected year that meets the requirements of the user based on his/her filter, the chart will reflect a smiling face. However, if the postal area/zones have houses with pricing over the selected year that is lower than the requirements of the user based on his/her filter, the chart will reflect a blank face. Lastly, if the postal area/zones have houses with pricing over the selected year that is more than the requirements of the user based on his/her filter, the chart will reflect a sad face.
|| '''(Brief one liner on what the chart shows)''' *'''Pros:''' ** (Type point here) *'''Cons:''' ** (Type point here) |- |
+
* <b>Amenities</b>
'''Title''': (Title of chart) [[File:Policy_Sharpener_ConsiderationVisual1.png|250px|frameless|center]] '''Source''': (Link to chart)
+
: When the postal area/zone’s number of amenities in the selected year meets the requirements of the user based on the filter, the chart will reflect the faces to be shown in green colour. However, if the postal area/zone’s number of amenities does not meet the requirements of the user, the chart will reflect the faces in blue colour.
|| '''(Brief one liner on what the chart shows)''' *'''Pros:''' ** (Type point here) *'''Cons:''' ** (Type point here) |- |
+
 
'''Title''': (Title of chart) [[File:Policy_Sharpener_ConsiderationVisual1.png|250px|frameless|center]] '''Source''': (Link to chart)
+
 
|| '''(Brief one liner on what the chart shows)''' *'''Pros:''' ** (Type point here) *'''Cons:''' ** (Type point here) |- |
+
With this visualisation, users will be able to identify and shortlist the area(s) that meets their requirements the best.
'''Title''': (Title of chart) [[File:Policy_Sharpener_ConsiderationVisual1.png|250px|frameless|center]] '''Source''': (Link to chart)
+
 
|| '''(Brief one liner on what the chart shows)''' *'''Pros:''' ** (Type point here) *'''Cons:''' ** (Type point here) |}
+
|-
 +
| <center><br/>  ''' Dashboard 2: Property prices in Postal Areas{Based on Users selected areas in storyboard 1} '''  
 +
</center>
 +
[[File:VA2.jpg|400px|frameless|center]]
 +
||  
 +
 
 +
The purpose of this chart is to show a detailed breakdown of the properties that meet the requirements of the Users based on his/her filters and User's shortlisted area(s) in the chart from Dashboard 1.
 +
 
 +
 
 +
This chart shows all the properties and their prices for all the properties that meet the requirements of the Users based on the filter’s range and the shortlisted area(s).
 +
 
 +
 
 +
Filters used includes:
 +
*Sliders
 +
:# Year
 +
:# Transaction Price
 +
:# Amenities
 +
* Single Dropdown List
 +
:# Property Type
 +
:# Sorted By
 +
 
 +
 
 +
The chart will be able to help users better understand the property prices based on his/her shortlisted area(s) and make a decision on which area’s property to purchase.
 +
 
 +
 
 +
: <b>X-Axis:</b> Transacted Properties’ Name<br/>
 +
: <b>Y-Axis:</b> Transacted Pricing
 +
 
 +
 
 +
This chart will be shown together with the chart on Dashboard 3 to help the buyer make the best-informed decisions.
 +
 
 +
|-
 +
| <center><br/>  ''' Dashboard 3: Distribution of Rain Precipitation Amount/ Temperature/ Wind Speed in Postal Areas{Based on Users selected areas in Dashboard 1} '''  
 +
</center>
 +
[[File:VA3.jpg|400px|frameless|center]]
 +
||
 +
 +
The purpose of this chart is to show a detailed breakdown of the weather (which includes Rain Precipitation Amount/ Temperature/ Wind Speed) for User’s shortlisted area(s) from the chart in Dashboard 1.
 +
 
 +
 
 +
Filters used includes:
 +
* Sliders
 +
:# Year
 +
:# Month
 +
* Single Dropdown List
 +
:# Level of Detail
 +
 
 +
 
 +
The user can adjust the filters to identify any patterns or trends of the weather based on the short-listed areas in Singapore. This chart can help the user better identify which area best suits the user based on his preferences and needs.
 +
 
 +
 
 +
: <b>X-Axis:</b> Level of Detail(Sub-zone/ Postal Area/ Zone)<br/>
 +
: <b>Y-Axis:</b> Rain Precipitation Amount/ Temperature/ Wind Speed
 +
 
 +
 
 +
This chart will be shown together with the chart on Dashboard 2 to help the buyer make the best-informed decisions.
 +
 
 +
|-
 +
| <center><br/>  ''' Dashboard 4: Comparing Rainfall {selected weather} and the median pricing of All Properties{selected property type} '''  
 +
</center>
 +
[[File:VA4.jpg|400px|frameless|center]]
 +
||  
 +
 
 +
The chart in this storyboard reflects a combination of two thematic maps, a bar chart map as well as a spatial interpolation map. Similar to the chart in Dashboard 1, this chart will show data at a high level for users to identify which area meets their needs in a glance. However, this chart is more-straightforward as the results shown in this chart is more clear cut and less informative.
 +
 
 +
 
 +
In this chart, the user will be able to compare:
 +
* The weather of the user’s choice in each zone/postal area.
 +
* Median pricing of their selected property type in each zone/postal area.
 +
 
 +
 
 +
Filters used includes:
 +
* Sliders
 +
:# Year
 +
* Single Dropdown List
 +
:# Level of Detail
 +
:# Weather
 +
:# Property Type
  
  
==
+
With the visualization, users will be able to compare all the areas in Singapore to make an informed decision. By doing so, the chart can help the user in shortlisting the area that they wish to zoom into in another view of light as compared to the chart in Dashboard 1 where detailed comparison of the whole Singapore is limited.
BRAINSTORMING SESSIONS
 
==
 
(TO DO: Insert Brainstorming charts & Explain) [[File:Policy_Sharpener_Brainstorming.png|500px|frameless|center]]
 
(Type in methodology of brainstorming sessions and explain how each chart was derived and the potential use)
 
==
 
PROPOSED STORYBOARD
 
==
 
Below is the proposed story board for our project:
 
{| class="wikitable" style="background-color:#FFFFFF;" width="90%" |- ! style="font-weight: bold;background: #141414;color:#fbfcfd;width: 45%;" | Storyboard ! style="font-weight: bold;background: #141414;color:#fbfcfd;width: 55%" | Insights / Comments |- |
 
'''Title''': DASHBOARD X - (Type in Dashboard Title) [[File:Policy_Sharpener_ProposedStoryboard1.png|400px|frameless|center]]
 
|| * Point for insights and comments * Point for insights and comments * Point for insights and comments |- |
 
'''Title''': DASHBOARD X - (Type in Dashboard Title) [[File:Policy_Sharpener_ProposedStoryboard1.png|400px|frameless|center]]
 
|| * Point for insights and comments * Point for insights and comments * Point for insights and comments |- |
 
'''Title''': DASHBOARD X - (Type in Dashboard Title) [[File:Policy_Sharpener_ProposedStoryboard1.png|400px|frameless|center]]
 
|| * Point for insights and comments * Point for insights and comments * Point for insights and comments |- |
 
'''Title''': DASHBOARD X - (Type in Dashboard Title) [[File:Policy_Sharpener_ProposedStoryboard1.png|400px|frameless|center]]
 
|| * Point for insights and comments * Point for insights and comments * Point for insights and comments |}
 
  
==
+
|}
TECHNOLOGY USED
 
==
 
The technologies we will be using for this Project are as below: (TO DO: Show png of the tech used) [[File:Policy_Sharpener_Technologies_V2.png|650px|frameless|center]]
 
==
 
CHALLENGES, RISK ASSESMENT AND MITIGATION
 
==
 
{| class="wikitable" style="background-color:#FFFFFF;" width="90%" |- ! style="font-weight: bold;background: #141414;color:#fbfcfd;width: 45%;" | Challenges ! style="font-weight: bold;background: #141414;color:#fbfcfd;width: 55%" | Mitigation Plan |- | * Unfamiliarity of visualisation tools such as R, R Shiny, Tableau. || * Hands on practice using the different training platforms such as Data Camps * Watch video tutorials from YouTube * Peer Learning |- | * Unfamiliarity of data cleaning and transformation using Tableau Prep || * Attend workshop on data cleaning methods * Watch video tutorials on how to fully utilise Tableau Prep * Trial and test on the different cleaned data sets while maintaining the raw data |- | * Limited knowledge and the jargon used in Indonesia’s trading industry || * Research and learn the situation of Indonesia’ export and import in the last ten years * Read articles or news to find out the recent trends and global updates on trade |}
 
  
==
+
==<div style="background:#143c67; padding: 15px; font-weight: bold; line-height: 0.3em; letter-spacing:0.5em;font-size:20px"><font color=#fbfcfd face="Century Gothic"><center>MILESTONES</center></font></div>==
PROPOSED TIMELINE
+
[[File:Photo 2020-03-01 16-22-33.jpg|1000px|frameless|center]]
==
 
(TODO: Insert High level timeline & Gantt Chart) [[File:Policy_Sharpener_TimelineProposal.png|1000px|frameless|center]]
 
  
==
+
==<div style="background:#143c67; padding: 15px; font-weight: bold; line-height: 0.3em; letter-spacing:0.5em;font-size:20px"><font color=#fbfcfd face="Century Gothic"><center>COMMENTS</center></font></div>==
COMMENTS AND FEEDBACK
+
<center>
==
+
{| class="wikitable" width="100%"
Feel free to leave us some comments so that we can improve!
+
|-
{| class="wikitable" width="100%" |- ! style="font-weight: bold;background: #141414;color:#fbfcfd;width: 5%;" |No. ! style="font-weight: bold;background: #141414;color:#fbfcfd;width: 25%;" |Name ! style="font-weight: bold;background: #141414;color:#fbfcfd;width: 20%;" |Date ! style="font-weight: bold;background: #141414;color:#fbfcfd;width: 50%;" |Comments |- | 1. | Insert your name here | Insert date here | Insert comment here |- | 2. | Insert your name here | Insert date here | Insert comment here |- | 3. | Insert your name here | Insert date here | Insert comment here |}
+
! style="font-weight: bold;background: #899db3;color:#fbfcfd;width: 5%;" |No.
 +
! style="font-weight: bold;background: #899db3;color:#fbfcfd;width: 15%;" |Name
 +
! style="font-weight: bold;background: #899db3;color:#fbfcfd;width: 10%;" |Date
 +
! style="font-weight: bold;background: #899db3;color:#fbfcfd;width: 70%;" |Comments
 +
|-
 +
| 1.
 +
| (Name)
 +
| (Date)
 +
| (Comment)
 +
|-
 +
| 2.
 +
| (Name)
 +
| (Date)
 +
| (Comment)
 +
|-
 +
| 3.
 +
| (Name)
 +
| (Date)
 +
| (Comment)
 +
|}
 +
</center>

Latest revision as of 15:32, 11 April 2020

Rain & Shine(new).png

Team

 

Proposal

 

Poster

 

Application

 

Research Paper

Version2|Version1



PROBLEM & MOTIVATION

Problem
When it comes to purchasing or renting a property, there are many factors that go into a buyer’s consideration before he makes the final decision. The primary concern for buyers is the pricing of the property [1]. However, our group identified that there are also secondary concerns such as the weather and the amenities available that do influence the buyer’s final decision to purchase the property. There are limited tools available to help property buyers to identify areas that suit their needs/preferences best. The current available tools are only optimal to suit one category of concern, but fails when we try to use more categories to make our visualization.

For example, different people have different preferences for the weather. Some may prefer sunny weather while others prefer it to rain all the time. Currently, there are tools to find weather information, and property prices information, but not both at the same time.

Motivation
Through our visualization, the group hopes to assist users to be able to easily visualize a home of his dreams in different aspects beyond mere prices. Our visualization will incorporate data from property prices, weather and amenities to identify the accessibility of the area and help our users to justify the real value of the property. With our visualization dashboard, users will be able to identify properties that they truly desire.

OBJECTIVES

We aim to provide an interactive visualization dashboard to assist pGeneral Public, people living in Singapore with understanding the weather of our country with visualization information such as:

  1. Insights on the Rainfall Precipitation of the whole of Singapore and each postal area for the past 20 years.
  2. Insights on the Temperature of the whole of Singapore and each postal area for the past 20 years.
  3. Insights on the relationship of the Rainfall Precipitation and Temperature in the different months/seasons yearly.

Target Group:

  • General Public, people living in Singapore

DATASET

The Data Sets we will be using for our analysis and for our application is listed below:

Data/Source Variables/Description Rationale Of Usage

Temperature and Rainfall Data
(Jan 2012 - Dec 2019)

(http://www.weather.gov.sg/climate-historical-daily/)

  • Stations
  • Date
  • Daily Rainfall
  • Highest 30-min/60-min/120-min Rainfall (mm)
  • Mean/Minimum/Maximum Temperature (°C)
  • Mean/Max Wind Speed (km/h)

This dataset covers a good time series of Singapore's weather from 2012 to 2019 across different weather categories. Our team wish to spot the trend or pattern of Singapore's climate in every town if possible.

Amenities Location Data

(https://api.data.gov.sg/v1/environment/rainfall) (https://api.data.gov.sg/v1/environment/air-temperature)

  • Station ID
  • Station Name
  • Latitude
  • Longitude

The data set will be used to anchor the amenities available for the selected property in a specified range

BACKGROUND SURVEY OF RELATED WORK

Below are a few visualizations and charts we considered making for our projects.

Visual Considerations Insights / Comments

Title: Qualitative Thematic Map
ThematicMap.png

Source: https://mapdesign.icaci.org/2014/12/mapcarte-353365-life-in-los-angeles-by-eugene-turner-1977/

One of the items that we looked at is this qualitative thematic map that was covered in class.

From our initial brainstorming of ideas, we intend to look at various factors that a buyer will look at, giving the buyer a high-level overview of the different areas and whether it fits the criteria that he chooses. How we will adapt ideas from this graph is for us to allow the users to make a few selections of multiple factors. Then based on which criteria the different properties in the different subzones can meet, we can choose different shapes, colours to represent the zone.



Title: Whisker plot of temperature
Temperature whisker.png

Source: https://www.ck12.org/statistics/box-and-whisker-plots/rwa/The-Ways-of-Weather/

We can see the temperature for the selected area over a year. The whisker plots can show the upper and lower boundaries of temperature, and we can observe that the temperature gradually rises to a peak from Jan to Aug, before decreasing until December.

We hope to apply this chart to display the rainfall for a selected area over a year. This allows buyers to be able to better understand the rainfall pattern in the area so that he can better understand if the area suits his preferences.


Title: Heatmap of rainfall
Heatmap of rainfall.png

Source: https://www.shanelynn.ie/analysis-of-weather-data-using-pandas-python-and-seaborn/

This is a heatmap of daily rainfall. Darker colours of red represent heavier rainfall.

Another way to have a visualization to understand the patterns of rainfall. Through this, we can quickly see how many days in a year where there is rain for a selected subzone. Assuming that a potential buyer is interested in a property that sees more sunlight, he will be more interested in a subzone where the graph looks brighter. On the other hand, if the buyer is interested in a property that is always rainy, he would be interested in an area where the graph looks darker.


Title: Spatial Interpolation
Property heatmap.png

Source: https://www.srx.com.sg/heat-map/

This graph shows the property prices in Singapore for different property types. The user can choose to select different property types, and the graph will update to show only the selected property type. A variety of colours are chosen here to display different levels of prices.

Based on our problem, there are 2 key aspects that we are looking at: Prices and Weather. One way this kind of visualization could be utilized by our group is for us to use this to display prices or Weather in Singapore across all subzones. By charting either prices or the various weather types over a map of Singapore, the user will be able to quickly gain an understanding of how the different criteria that he can choose will be like across Singapore.



KEY TECHNICAL CHALLENGES & MITIGATION

No. Challenge Description Mitigation Plan
1.
Software Challenge Unfamiliarity of visualisation tools such as R, R Shiny, Tableau.
  • Github Learning
  • Stackoverflow research
  • Self-directed and peer learning
  • Watch video tutorials from YouTube
  • Hands-on practice using the different training platforms such as Data Camps
2.
Programming Challenge Inexperince with data cleaning and transformation using R
  • Trial and error
  • Read online articles and forums for guidance
  • Watch video tutorials on how to fully utilise packages such as lapply, tidyr and dplyr
3.
Workload Constraint Time and Workload Constrains
  • Design reasonable project timeline based on everyone's ability and capacity.
  • Set milestones and adjust the timeline accordingly based on the team's progress.
4.
Dataset Complexity

Our have different data from multiple sources in multiple different formats, hence we foresee a huge challenge in standardizing the data

  • Note: Our current dataset is looking at 49 areas over the spread of 8 years of data, for every year there are 12 months of data. This gives a total of 4,704 CSV files to consolidate and clean for weather data alone.
  • Make use of data preparation tools such as tableau prep
  • Make use of our database management skills to normalize all data tables into third normal form

STORYBOARD

Dashboards Description

Dashboard 1: Qualitative Thematic Map of Singapore property
VA1.jpg

Our group plans to do an interactive Qualitative Thematic Map which reflects different faces based on the year, price, weather, amenities filters adjusted by the users. This chart will show the data at a high level for users to identify which area meets their needs in a glance. Users can also view the map based on the postal area or zone.

Filters used includes:

  • Sliders
  1. Year
  2. Transacted Price
  3. Amenities
  • Single Dropdown List
  1. Weather
  2. Map level of detail
  • Multiple Drowndown List
  1. Property Type


Based on User’s adjustment for the filters, the map would reflect the user 3 different data types:

  • Weather
When the postal area/zone’s selected weather is above the median of Singapore’s data over the selected year, the chart will reflect a circle face shape. However, if the postal area/zone’s selected weather falls in the median or is lower than the median of Singapore’s data over the selected year, the chart will reflect a circle face shape with devil horns.
  • Pricing
When the postal area/zones have houses with pricing over the selected year that meets the requirements of the user based on his/her filter, the chart will reflect a smiling face. However, if the postal area/zones have houses with pricing over the selected year that is lower than the requirements of the user based on his/her filter, the chart will reflect a blank face. Lastly, if the postal area/zones have houses with pricing over the selected year that is more than the requirements of the user based on his/her filter, the chart will reflect a sad face.
  • Amenities
When the postal area/zone’s number of amenities in the selected year meets the requirements of the user based on the filter, the chart will reflect the faces to be shown in green colour. However, if the postal area/zone’s number of amenities does not meet the requirements of the user, the chart will reflect the faces in blue colour.


With this visualisation, users will be able to identify and shortlist the area(s) that meets their requirements the best.


Dashboard 2: Property prices in Postal Areas{Based on Users selected areas in storyboard 1}
VA2.jpg

The purpose of this chart is to show a detailed breakdown of the properties that meet the requirements of the Users based on his/her filters and User's shortlisted area(s) in the chart from Dashboard 1.


This chart shows all the properties and their prices for all the properties that meet the requirements of the Users based on the filter’s range and the shortlisted area(s).


Filters used includes:

  • Sliders
  1. Year
  2. Transaction Price
  3. Amenities
  • Single Dropdown List
  1. Property Type
  2. Sorted By


The chart will be able to help users better understand the property prices based on his/her shortlisted area(s) and make a decision on which area’s property to purchase.


X-Axis: Transacted Properties’ Name
Y-Axis: Transacted Pricing


This chart will be shown together with the chart on Dashboard 3 to help the buyer make the best-informed decisions.


Dashboard 3: Distribution of Rain Precipitation Amount/ Temperature/ Wind Speed in Postal Areas{Based on Users selected areas in Dashboard 1}
VA3.jpg

The purpose of this chart is to show a detailed breakdown of the weather (which includes Rain Precipitation Amount/ Temperature/ Wind Speed) for User’s shortlisted area(s) from the chart in Dashboard 1.


Filters used includes:

  • Sliders
  1. Year
  2. Month
  • Single Dropdown List
  1. Level of Detail


The user can adjust the filters to identify any patterns or trends of the weather based on the short-listed areas in Singapore. This chart can help the user better identify which area best suits the user based on his preferences and needs.


X-Axis: Level of Detail(Sub-zone/ Postal Area/ Zone)
Y-Axis: Rain Precipitation Amount/ Temperature/ Wind Speed


This chart will be shown together with the chart on Dashboard 2 to help the buyer make the best-informed decisions.


Dashboard 4: Comparing Rainfall {selected weather} and the median pricing of All Properties{selected property type}
VA4.jpg

The chart in this storyboard reflects a combination of two thematic maps, a bar chart map as well as a spatial interpolation map. Similar to the chart in Dashboard 1, this chart will show data at a high level for users to identify which area meets their needs in a glance. However, this chart is more-straightforward as the results shown in this chart is more clear cut and less informative.


In this chart, the user will be able to compare:

  • The weather of the user’s choice in each zone/postal area.
  • Median pricing of their selected property type in each zone/postal area.


Filters used includes:

  • Sliders
  1. Year
  • Single Dropdown List
  1. Level of Detail
  2. Weather
  3. Property Type


With the visualization, users will be able to compare all the areas in Singapore to make an informed decision. By doing so, the chart can help the user in shortlisting the area that they wish to zoom into in another view of light as compared to the chart in Dashboard 1 where detailed comparison of the whole Singapore is limited.

MILESTONES

Photo 2020-03-01 16-22-33.jpg

COMMENTS

No. Name Date Comments
1. (Name) (Date) (Comment)
2. (Name) (Date) (Comment)
3. (Name) (Date) (Comment)