Difference between revisions of "1718t1is428T8"

From Visual Analytics for Business Intelligence
Jump to navigation Jump to search
 
(27 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
[[File:DOTA.png|center]]
 
[[File:DOTA.png|center]]
 
  
 
{| style="background-color:#32cd32; color:white padding: 5px 0 0 0;" width="100%" height=50px cellspacing="0" cellpadding="0" valign="top" border="0" |
 
{| style="background-color:#32cd32; color:white padding: 5px 0 0 0;" width="100%" height=50px cellspacing="0" cellpadding="0" valign="top" border="0" |
Line 8: Line 7:
 
| style="vertical-align:top;width:16%;" | <div style="padding: 3px; font-weight: bold; text-align:center; line-height: wrap_content; font-size:16px; border-bottom:1px solid #32cd32; border-top:1px solid #32cd32; font-family: helvetica"> [[1718t1is428T8 | <b>Proposal</b>]]
 
| style="vertical-align:top;width:16%;" | <div style="padding: 3px; font-weight: bold; text-align:center; line-height: wrap_content; font-size:16px; border-bottom:1px solid #32cd32; border-top:1px solid #32cd32; font-family: helvetica"> [[1718t1is428T8 | <b>Proposal</b>]]
  
| style="vertical-align:top;width:16%;" | <div style="padding: 3px; font-weight: 100; text-align:center; line-height: wrap_content; font-size:16px; border-bottom:1px solid #32cd32; border-top:1px solid #32cd32; font-family: helvetica"> [[1718t1is428T8: Poster | <b>Poster</b>]]
+
| style="vertical-align:top;width:16%;" | <div style="padding: 3px; font-weight: 100; text-align:center; line-height: wrap_content; font-size:16px; border-bottom:1px solid #32cd32; border-top:1px solid #32cd32; font-family: helvetica"> [[1718t1is428T8 Poster | <b>Poster</b>]]
  
| style="vertical-align:top;width:16%;" | <div style="padding: 3px; font-weight: 100; text-align:center; line-height: wrap_content; font-size:16px; border-bottom:1px solid #32cd32; border-top:1px solid #32cd32; font-family: helvetica"> [[1718t1is428T8: Application | <b>Application</b>]]
+
| style="vertical-align:top;width:16%;" | <div style="padding: 3px; font-weight: 100; text-align:center; line-height: wrap_content; font-size:16px; border-bottom:1px solid #32cd32; border-top:1px solid #32cd32; font-family: helvetica"> [[1718t1is428T8 Application |   <b>Application</b>]]
  
| style="vertical-align:top;width:16%;" | <div style="padding: 3px; font-weight: 100; text-align:center; line-height: wrap_content; font-size:16px; border-bottom:1px solid #32cd32; border-top:1px solid #32cd32; font-family: helvetica"> [[1718t1is428T8: Research Paper | <b>Research Paper</b>]]
+
| style="vertical-align:top;width:16%;" | <div style="padding: 3px; font-weight: 100; text-align:center; line-height: wrap_content; font-size:16px; border-bottom:1px solid #32cd32; border-top:1px solid #32cd32; font-family: helvetica"> [[1718t1is428T8 Research Paper | <b>Research Paper</b>]]
 
|}
 
|}
  
Line 20: Line 19:
 
[[File:Singaporecbd.jpg|center|350px]]
 
[[File:Singaporecbd.jpg|center|350px]]
 
<br/><br/>
 
<br/><br/>
The international exports and imports of services has played an increasingly important role in Singapore over the last decade, with 70% of the nation’s GDP comprising of service industries such as finance, insurance and wholesale retail trade, up from 64% 10 years ago. This is contrasted to the decline of the share of manufacturing in the economy, down from 26% to 19% in the same period.
+
Singapore’s location at the tip of the Malay Peninsula has long made it a vital hub for the trade of goods through the Straits of Malacca. As a city-state with scarce natural resources, international trade forms the lifeblood of this bustling country, while at the same time, forming its greatest vulnerability. This establishes the importance of understanding trade patterns, influenced by multiple macroeconomic factors, to safeguard the stability and future of the nation.
 
<br/><br/>
 
<br/><br/>
As government bodies such as the Ministry of Trade and Industry (MTI) and Innovation and Enterprise (IE) Singapore focus more on these industries in their development plans, there comes the need to continuously view  the trends and components of our services exports. This will allow us to understand the growth trends of this critical aspect of Singapore’s economy, its individual components and the countries that contribute to it and finally to monitor the effects of existing initiatives from various government agencies. Through
+
Various government bodies such as the [https://www.google.com.sg/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&ved=0ahUKEwj1lKWp7aTXAhWBOo8KHfhBAVMQFggkMAA&url=https%3A%2F%2Fwww.iesingapore.gov.sg%2F-%2Fmedia%2FIE-Singapore%2FFiles%2FPublications%2FSingapore-Trade-Statistics%2FQuarterly-Trade-Statistics%2F2017%2FTrade-Report-2Q-2017.ashx&usg=AOvVaw3DeVXjqQFF7ykCECV4cDpa Ministry of Trade and Industry] (MTI) and Innovation and Enterprise (IE) Singapore pay close attention to these figures, continuously monitoring the trade numbers, its individual components and the countries that contribute to it. While the [http://www.straitstimes.com/business/economy/mixed-fortunes-for-singapore-firms-in-china Straits Times] regularly refers to trade figures when reporting trade-related news. As such, there is a need for a visualisation tool to quickly, clearly and concisely display this information for the relevant agencies to analyse and for the public to consume.  
  
 
</p>
 
</p>
Line 30: Line 29:
  
 
<p align="justify">
 
<p align="justify">
After reviewing the existing reports prepared by MTI and similar graphs reported by the Straits Times, we identified the following areas in which we plan our visualization to value-add to:
+
 
 +
After reviewing the existing reports prepared by [https://www.google.com.sg/url?sa=t&rct=j&q=&esrc=s&source=web&cd=3&ved=0ahUKEwjfgJ7xianXAhXBRo8KHbmCA7cQFggxMAI&url=https%3A%2F%2Fwww.mti.gov.sg%2FResearchRoom%2FSiteAssets%2FPages%2FEconomic-Survey-of-Singapore-2015%2FFullReport_AES2015.pdf&usg=AOvVaw3jR6IlTrnQsDEhWEqBvpHn MTI] and similar graphs reported by the Straits Times, we identified the following objectives for our visualisation:
 +
<br/><br/>
 +
'''The Objectives'''
 +
<br/><br/>
 +
1) Visualisation of the trends in imports and exports over time, by country
 +
<br/><br/>
 +
[[File:TradeReportQ217.PNG|750px]]
 +
<br/><br/>
 +
2) Visualisation of the % Share of trade from each country
 +
<br/><br/>
 +
[[File:STexports.PNG|600px]]
 +
<br/><br/>
 +
We also identified the following areas in which our visualisation can value-add to:
 +
<br/><br/>
 +
'''Problems Solved'''
 
<br/><br/>
 
<br/><br/>
 
1) Interactivity and Customisability  - By allowing the reader to interact with the graph to filter periods to view as well as the level of detail. This will facilitate user-led investigation and exploration of the data without any data processing tools.
 
1) Interactivity and Customisability  - By allowing the reader to interact with the graph to filter periods to view as well as the level of detail. This will facilitate user-led investigation and exploration of the data without any data processing tools.
Line 36: Line 50:
 
2) Professional and ready to use format – This will save stakeholders such as MTI and SPH time in the preparation of graphs, especially when graph formatting is necessary before release to the public.
 
2) Professional and ready to use format – This will save stakeholders such as MTI and SPH time in the preparation of graphs, especially when graph formatting is necessary before release to the public.
 
<br/><br/>
 
<br/><br/>
[[File:Exhibit_5_Growth_of_services_exports_va.png]]
+
3) Clarity - By utilising the data visualisation concepts and charts we've learned, we aim to display the data in clearer, more easily consumed formats
 +
 
 +
 
 
<br/><br/>
 
<br/><br/>
 
This will provide a one stop visualization for stakeholders in the services industry in Singapore, to quickly consume the aspects of this data that is relevant to them, in an aesthetically pleasing and intuitive manner.
 
This will provide a one stop visualization for stakeholders in the services industry in Singapore, to quickly consume the aspects of this data that is relevant to them, in an aesthetically pleasing and intuitive manner.
Line 44: Line 60:
 
<div style="background: #32cd32; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px;letter-spacing:-0.08em;font-size:20px"><font color=white face="Century Gothic">Data Source</font></div>
 
<div style="background: #32cd32; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px;letter-spacing:-0.08em;font-size:20px"><font color=white face="Century Gothic">Data Source</font></div>
  
We are using the following two datasets from the Singapore Department of Statistics:
+
We are using the following two datasets from IE Singapore:
<br/><br/> [http://www.tablebuilder.singstat.gov.sg/publicfacing/createDataTable.action?refId=6810 Exports Of Services By Major Trading Partner And Services Category, Annual Dataset]
+
<br/><br/> [http://www.tablebuilder.singstat.gov.sg/publicfacing/createDataTable.action?refId=4713 Merchandise Imports By Region/Country, Monthly]
 
<br/><br/>
 
<br/><br/>
[http://www.tablebuilder.singstat.gov.sg/publicfacing/createDataTable.action?refId=6816 Imports Of Services By Major Trading Partner And Services Category, Annual Dataset]
+
[http://www.tablebuilder.singstat.gov.sg/publicfacing/createDataTable.action?refId=4715 Merchandise Exports By Region/Country, Monthly]
  
The dataset consists of the following columns:
+
Both data sources (import and export) consists information about the monthly trade volume from January 1976 to September 2017 between Singapore and 114 other countries/areas, where the data included existing countries and also dissolved countries that do not exists today.
 
   
 
   
  
Line 55: Line 71:
 
To meet the required objectives of customisability and interactivity, we drew our inspiration from [http://www.nytimes.com/interactive/2013/03/29/sports/baseball/Strikeouts-Are-Still-Soaring.html?ref=baseball Mike Bostock's Visualisation on Baseball Strikeouts]. We would like to reproduce his method of incorporating the many components of a time series visualisation into one graph, hidden in the background of the overall trend, as well as the ability to select a component to view when needed.
 
To meet the required objectives of customisability and interactivity, we drew our inspiration from [http://www.nytimes.com/interactive/2013/03/29/sports/baseball/Strikeouts-Are-Still-Soaring.html?ref=baseball Mike Bostock's Visualisation on Baseball Strikeouts]. We would like to reproduce his method of incorporating the many components of a time series visualisation into one graph, hidden in the background of the overall trend, as well as the ability to select a component to view when needed.
 
<br/><br/>
 
<br/><br/>
[[File:Strikeouts_on_the_Rise.png]]
+
[[File:Strikeouts_on_the_Rise.PNG]]
 
<br/><br/>
 
<br/><br/>
Trend Over Time
+
'''Trend Over Time'''
 
<br/><br/>
 
<br/><br/>
 
Our plan is to produce a similar visualisation, with countries instead of baseball players and exports or imports of services instead of strikeouts. This will allow us to view the long-term trend of this dataset while viewing the individual country data in the background, as well as allowing selection and highlighting of individual countries upon request.  
 
Our plan is to produce a similar visualisation, with countries instead of baseball players and exports or imports of services instead of strikeouts. This will allow us to view the long-term trend of this dataset while viewing the individual country data in the background, as well as allowing selection and highlighting of individual countries upon request.  
 
<br/><br/>
 
<br/><br/>
  
For additional customisability, we will include filters to toggle between viewing the absolute Exports in services, the percentage change over the years and selection of imports or exports. On top of that, to facilitate country selection, we will have a bar graph on the right denoting the measure selected, such as exports, by each individual country. This bar graph will be linked to the time series chart, allowing us to quickly view and select, for example, the largest country that imports Singapore's services and quickly highlight it on the main chart.
+
For additional customisability, we will include filters to toggle between viewing the absolute merchandise trade, the percentage change over the years and selection of imports or exports. On top of that, to facilitate country selection, we will have a bar graph on the right denoting the measure selected, such as exports, by each individual country. This bar graph will be linked to the time series chart, allowing us to quickly view and select, for example, the largest importer from Singapore and quickly highlight it on the main chart to view its trend relative to the other countries.
 +
<br/><br/>
 +
'''Components Analysis'''
 +
<br/><br/>
 +
[[File:Chord.PNG|500px]]
 
<br/><br/>
 
<br/><br/>
Components Analysis
+
In addition to analysing the trade trends over time, another area of interest is in the amount of trade we do with each individual country. In a particular year, who was our largest trade partner as well as how much of the trade was imports versus exports. To visualise, we chose the [http://www.delimited.io/blog/2014/11/18/interactive-chord-diagrams-in-d3 Chord Diagram] implementation of the same problem as it is an intuitive but clear way of visualising trade flow and its components.
 
<br/><br/>
 
<br/><br/>
In addition to analysing the trends of each country over time, another area of interest is in the components mix of our services imports and exports. In a particular year, how much each service industry contributed to the overall imports/exports, and also which countries were responsible for this. To visualise this multi-level data, we chose the [http://www.delimited.io/blog/2014/11/18/interactive-chord-diagrams-in-d3 Chord Diagram] for its ability to visualise multiple quantitative relatonships in an intuitive manner.
+
The chord chart will order the countries in descending amount of imports and exports done with that country, allowing us to quickly view which countries most of our exports go to, as well as whether our imports with them are equally large, essentially displaying the trade balance as well.  
  
 
<br/>
 
<br/>
Line 92: Line 112:
 
<p>The timeline for this project until its completion is as follows:</p>
 
<p>The timeline for this project until its completion is as follows:</p>
  
[[File:T8_Timeline.png|center]]
+
[[File:T8_Timeline.png]]
  
 
<br/>
 
<br/>

Latest revision as of 17:54, 23 November 2017

DOTA.png


Introduction

Singaporecbd.jpg



Singapore’s location at the tip of the Malay Peninsula has long made it a vital hub for the trade of goods through the Straits of Malacca. As a city-state with scarce natural resources, international trade forms the lifeblood of this bustling country, while at the same time, forming its greatest vulnerability. This establishes the importance of understanding trade patterns, influenced by multiple macroeconomic factors, to safeguard the stability and future of the nation.

Various government bodies such as the Ministry of Trade and Industry (MTI) and Innovation and Enterprise (IE) Singapore pay close attention to these figures, continuously monitoring the trade numbers, its individual components and the countries that contribute to it. While the Straits Times regularly refers to trade figures when reporting trade-related news. As such, there is a need for a visualisation tool to quickly, clearly and concisely display this information for the relevant agencies to analyse and for the public to consume.


Problem and Motivation

After reviewing the existing reports prepared by MTI and similar graphs reported by the Straits Times, we identified the following objectives for our visualisation:

The Objectives

1) Visualisation of the trends in imports and exports over time, by country

TradeReportQ217.PNG

2) Visualisation of the % Share of trade from each country

STexports.PNG

We also identified the following areas in which our visualisation can value-add to:

Problems Solved

1) Interactivity and Customisability - By allowing the reader to interact with the graph to filter periods to view as well as the level of detail. This will facilitate user-led investigation and exploration of the data without any data processing tools.

2) Professional and ready to use format – This will save stakeholders such as MTI and SPH time in the preparation of graphs, especially when graph formatting is necessary before release to the public.

3) Clarity - By utilising the data visualisation concepts and charts we've learned, we aim to display the data in clearer, more easily consumed formats

This will provide a one stop visualization for stakeholders in the services industry in Singapore, to quickly consume the aspects of this data that is relevant to them, in an aesthetically pleasing and intuitive manner.


Data Source

We are using the following two datasets from IE Singapore:

Merchandise Imports By Region/Country, Monthly

Merchandise Exports By Region/Country, Monthly

Both data sources (import and export) consists information about the monthly trade volume from January 1976 to September 2017 between Singapore and 114 other countries/areas, where the data included existing countries and also dissolved countries that do not exists today.


Visualisation Plan

To meet the required objectives of customisability and interactivity, we drew our inspiration from Mike Bostock's Visualisation on Baseball Strikeouts. We would like to reproduce his method of incorporating the many components of a time series visualisation into one graph, hidden in the background of the overall trend, as well as the ability to select a component to view when needed.

Strikeouts on the Rise.PNG

Trend Over Time

Our plan is to produce a similar visualisation, with countries instead of baseball players and exports or imports of services instead of strikeouts. This will allow us to view the long-term trend of this dataset while viewing the individual country data in the background, as well as allowing selection and highlighting of individual countries upon request.

For additional customisability, we will include filters to toggle between viewing the absolute merchandise trade, the percentage change over the years and selection of imports or exports. On top of that, to facilitate country selection, we will have a bar graph on the right denoting the measure selected, such as exports, by each individual country. This bar graph will be linked to the time series chart, allowing us to quickly view and select, for example, the largest importer from Singapore and quickly highlight it on the main chart to view its trend relative to the other countries.

Components Analysis

Chord.PNG

In addition to analysing the trade trends over time, another area of interest is in the amount of trade we do with each individual country. In a particular year, who was our largest trade partner as well as how much of the trade was imports versus exports. To visualise, we chose the Chord Diagram implementation of the same problem as it is an intuitive but clear way of visualising trade flow and its components.

The chord chart will order the countries in descending amount of imports and exports done with that country, allowing us to quickly view which countries most of our exports go to, as well as whether our imports with them are equally large, essentially displaying the trade balance as well.


Key Technical Challenges

The following are some of the key technical challenges that we may face throughout the course of the project:

Key Technical Challenges Plans to resolve these issues
Data Cleaning & Transformation
  • Understanding the data
  • Cleaning and Transforming the data together
Unfamiliarity in Javascript, especially D3 Libraries
  • Attending D3 Programming Workshop
  • Research on different types of charts
  • Independent Learning on D3 Libraries
  • Asking questions on sites like StackOverflow to seek help


Project Timeline

The timeline for this project until its completion is as follows:

T8 Timeline.png


Tools & Technologies

The tools and technologies we will be using for this project:

  • Data Cleaning
    • Excel
    • JMP
    • R
  • Data Visualization
    • D3.js


Comments

Please give us feedbacks! Thank you!