Difference between revisions of "TEN Project Proposal"

From Visual Analytics for Business Intelligence
Jump to navigation Jump to search
Line 14: Line 14:
 
The application aims to provide users with the following capabilities:<br><br>
 
The application aims to provide users with the following capabilities:<br><br>
 
<b>1. To be able to allow users to select their own data for analysis</b><br>
 
<b>1. To be able to allow users to select their own data for analysis</b><br>
This will be achieved by dynamically generating the filters based on the columns in the dataset. Taking the Singapore Tourism data as an example, users will be able to filter by Country and Date.<br>
+
This will be achieved by dynamically generating the filters based on the columns in the dataset. Taking the Singapore Tourism data as an example, users will be able to filter by Country and Date.<br><br>
  
 
<b>2. To allow users to provide inputs for exploring and understanding their data through the visualisations</b><br>
 
<b>2. To allow users to provide inputs for exploring and understanding their data through the visualisations</b><br>
During the data discovery and exploration of the time series data, the exploration will be made as realistic as possible. For example, correlogram includes specifying of lags/periods, hence we will give the user the autonomy to explore the data by specifying their own input value.<br>
+
During the data discovery and exploration of the time series data, the exploration will be made as realistic as possible. For example, correlogram includes specifying of lags/periods, hence we will give the user the autonomy to explore the data by specifying their own input value.<br><br>
  
 
<b>3. To allow users to generate forecasts quickly and easily</b><br>
 
<b>3. To allow users to generate forecasts quickly and easily</b><br>
This will be achieved by providing selections and inputs for the users to generate forecasts of different methods.<br>
+
This will be achieved by providing selections and inputs for the users to generate forecasts of different methods.<br><br>
  
 
<b>4. To allow users to compare the performance of the generated forecasting results</b><br>
 
<b>4. To allow users to compare the performance of the generated forecasting results</b><br>
Line 28: Line 28:
  
 
<div style="background: #dce6f9; line-height: 0.3em; font-family:Century Gothic;  border-left: #003464 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#000000"><strong>Related Works</strong></font></div></div>
 
<div style="background: #dce6f9; line-height: 0.3em; font-family:Century Gothic;  border-left: #003464 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#000000"><strong>Related Works</strong></font></div></div>
The team has looked into some visualisations that was created on the Singapore’s tourism sectors, which gave us ideas on the factors or areas that the team can also looked into. The visualisations also provided us with an understanding of the tourism industry over the years and the different visualisation techniques.<br>
+
To better understand forecasting models and time series, our team has looked into the forecasting functions in JMP Pro and related applications that were built with R. This is to understand the visulisations that we should use and terms and models used in forecasting.<br><br>
 +
<b>JMP Pro</b><br>
 +
Looking at how forecasting is done in JMP:<br>
 +
- Forecasting in JMP includes the following default visualisations: Time series, Autocorrelation and Partial Autocorrelation<br>
 +
- Users can specify lags for autocorrelation<br>
 +
- Using the ARIMA forecasting, the user can specify 3 parameters and generate different combinations<br>
 +
- Remove linear trend with decomposition and differencing<br><br>
  
===Knoema===
+
<b>Time Series Forcasting Tutorial App</b><br>
Knoema provides access to a large number of databases and visualisations tools for those databases to the public. From the [https://knoema.com/uhukord/tourism-country-profile?Region=Singapore/ visualisation] of Singapore’s tourism from Knoema, the team has identified some factors which can be looked into such as the Government’s spending on tourism. However the team finds that the visualisations could be done better if it can present how the various factors are correlated, as currently the various factors are independent. Hence, the team will be taking this into consideration when designing our visualisations. <br>
+
The app developer has shown various forecasting models and is also developed with ShinyR. For
  
===Public Tableau===
+
<div style="background: #dce6f9; line-height: 0.3em; font-family:Century Gothic;  border-left: #003464 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#000000"><strong>References</strong></font></div></div>
The Tableau [http://public.tableau.com/views/UnravelingtheSingaporeTourismIndustrywithVisualAnalytics/UnravelingtheSingaporeTourismIndustrywithVisualAnalytics?:embed=y&:showVizHome=no&:display_count=y&:display_static_image=y&:bootstrapWhenNotified=true/ visualisation]
+
<b>Related Works</b><br>
looks at the Singapore’s tourism industry from various aspects up to year 2013. Unlike the visualisations from Knoema, the Tableua visualisation further looks into the happenings in Singapore such as the opening of RWS which is closely related to the tourism industry and also the revenue and occupancy of the hotel industry which could be affected by the number of tourists. It also supported the observed trends with reasons which explains the drop or increase in tourist arrivals, which provided us with an overview of the tourism industry between 2009 to 2013. With this, our team has also identified areas which we can look into such as the hotel industry which is closely related to tourism.<br>
+
1. Exploring Time series and Forecasting: [https://jasonliushiny.shinyapps.io/Forcast/ Time Series Forcasting Tutorial App]
 
 
===ISSS608 Group 9===
 
While researching, the team realised that Group 9 [https://wiki.smu.edu.sg/1516t1isss608g1/ISSS608_2015_16T1_Group9_Application] of 2015/16 T1 of ISSS608 has also worked on Singapore’s tourism industry for their project. Thus, the team has looked into the visualisation techniques that was used and the factors and areas that they have considered for their project. The ISSS608 team has visualised the visitors’ data using a sunburst diagram which allows for further drilling down by continent, by country and by mode of transport which we find that it is an interesting way of visualising the data. Furthermore, the references provided has also provided us with more sources for data.
 
 
<br><br>
 
<br><br>
  
<div style="background: #dce6f9; line-height: 0.3em; font-family:Century Gothic;  border-left: #003464 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#000000"><strong>References</strong></font></div></div>
+
<b>Data sources</b><br>
===Related Works===
 
1. Visualisation on Singapore’s Tourism Industry by [https://knoema.com/uhukord/tourism-country-profile?Region=Singapore/ Knoema]<br>
 
2. Visualisation on Singapore’s Tourism Industry by [http://public.tableau.com/views/UnravelingtheSingaporeTourismIndustrywithVisualAnalytics/UnravelingtheSingaporeTourismIndustrywithVisualAnalytics?:embed=y&:showVizHome=no&:display_count=y&:display_static_image=y&:bootstrapWhenNotified=true/ Public Tableau]<br>
 
3. Visualisation on Singapore’s Tourism Industry by Group 9 of 2015/16 T1 ISSS608 Visual Analytics and Applications [https://wiki.smu.edu.sg/1516t1isss608g1/ISSS608_2015_16T1_Group9] <br>
 
 
 
===Data sources===
 
 
1. CEIC: [https://www.ceicdata.com/en/ Data on Visitor arrivals, Revenue and Expenditure]<br>
 
1. CEIC: [https://www.ceicdata.com/en/ Data on Visitor arrivals, Revenue and Expenditure]<br>
 
2. Singapore Tourism Board (STB): Data on [https://www.stb.gov.sg/statistics-and-market-insights/Pages/statistics-Hotel-Statistics.aspx/ Hotel statistics] and [https://www.stb.gov.sg/statistics-and-market-insights/Pages/statistics-Quarterly-Tourism-Performance-Report.aspx/ Tourism sector performance] <br><br>
 
2. Singapore Tourism Board (STB): Data on [https://www.stb.gov.sg/statistics-and-market-insights/Pages/statistics-Hotel-Statistics.aspx/ Hotel statistics] and [https://www.stb.gov.sg/statistics-and-market-insights/Pages/statistics-Quarterly-Tourism-Performance-Report.aspx/ Tourism sector performance] <br><br>
  
 
<div style="background: #dce6f9; line-height: 0.3em; font-family:Century Gothic;  border-left: #003464 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#000000"><strong>Key Challenges</strong></font></div></div>
 
<div style="background: #dce6f9; line-height: 0.3em; font-family:Century Gothic;  border-left: #003464 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#000000"><strong>Key Challenges</strong></font></div></div>
===ShinyR===
+
<b>ShinyR</b><br>
In order to leverage on the various forecasting models that is available in R and its libraries, our group will be be using ShinyR to develop our web application. ShinyR also provides the platform to create a dashboard.However, our team forsee the learning of R to be a major challenge as none of us has build a web application with ShinyR, and based on intital research, the R syntax is also quite different.
+
In order to leverage on the various forecasting models that is available in R and its libraries, our group will be be using ShinyR to develop our web application. ShinyR also provides the platform to create a dashboard.However, our team forsee the learning of R to be a major challenge as none of us has build a web application with ShinyR, and based on intital research, the R syntax is also quite different.<br><br>
  
===Forecasting Model & Visualisations===
+
<b>Forecasting Model & Visualisations</b><br>
 
As our group is working on providing a platform for forecasting, we needed to understand the various methods that are available and the visualisations that will be useful for the users to identify the hidden patterns in their data.
 
As our group is working on providing a platform for forecasting, we needed to understand the various methods that are available and the visualisations that will be useful for the users to identify the hidden patterns in their data.
  
Line 65: Line 62:
 
<div style="background: #dce6f9; line-height: 0.3em; font-family:Century Gothic;  border-left: #003464 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#000000"><strong>Future Work</strong></font></div></div>
 
<div style="background: #dce6f9; line-height: 0.3em; font-family:Century Gothic;  border-left: #003464 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#000000"><strong>Future Work</strong></font></div></div>
 
<b> 1. Comparing multiple forecasting methods & finding the best</b><br>
 
<b> 1. Comparing multiple forecasting methods & finding the best</b><br>
Our application will only be showing the results of forecasting for users to evaluate the accuracy of each. However, it will be better if the application could compare and recommend the best, such that users with no prior knowledge of forecasting can easily understand the results.<br>
+
Our application will only be showing the results of forecasting for users to evaluate the accuracy of each. However, it will be better if the application could compare and recommend the best, such that users with no prior knowledge of forecasting can easily understand the results.<br><br>
  
 
<b> 2. Forecasting of stream data</b><br>
 
<b> 2. Forecasting of stream data</b><br>
 
+
Our application can work towards forcasting live data source. This would eliminated the need for users to upload their own data manually.<br><br>
  
 
<b> 3. Allowing wider range of data formats</b><br>
 
<b> 3. Allowing wider range of data formats</b><br>
Line 88: Line 85:
 
<br>
 
<br>
 
<div style="background: #dce6f9; line-height: 0.3em; font-family:Century Gothic;  border-left: #003464 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#000000"><strong>Comments</strong></font></div></div>
 
<div style="background: #dce6f9; line-height: 0.3em; font-family:Century Gothic;  border-left: #003464 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#000000"><strong>Comments</strong></font></div></div>
 +
<br><br>

Revision as of 03:22, 28 November 2016

Back to Project Group

PROJECT DETAILS PROJECT POSTER PROJECT APPLICATION REPORT


Problem & Motivation

Forecasting time series data requires technical knowledge and specialised software, making it difficult to do for most people. Even for those with the required resources, completing the entire forecasting process requires many complicated steps to be done manually, making it a tedious process. This problem is exacerbated when forecasting for different datasets is required and the entire process is repeated multiple times. Therefore we would like to create a web application for business and government agencies to be able to assist these organisations in predicting the future performance of their operations by simplify the process.


Approach

The application aims to provide users with the following capabilities:

1. To be able to allow users to select their own data for analysis
This will be achieved by dynamically generating the filters based on the columns in the dataset. Taking the Singapore Tourism data as an example, users will be able to filter by Country and Date.

2. To allow users to provide inputs for exploring and understanding their data through the visualisations
During the data discovery and exploration of the time series data, the exploration will be made as realistic as possible. For example, correlogram includes specifying of lags/periods, hence we will give the user the autonomy to explore the data by specifying their own input value.

3. To allow users to generate forecasts quickly and easily
This will be achieved by providing selections and inputs for the users to generate forecasts of different methods.

4. To allow users to compare the performance of the generated forecasting results
This will be achieved by providing various forecasting methods and the results of each forecasting methods such that users can estimate the accuracy of the models.


Related Works

To better understand forecasting models and time series, our team has looked into the forecasting functions in JMP Pro and related applications that were built with R. This is to understand the visulisations that we should use and terms and models used in forecasting.

JMP Pro
Looking at how forecasting is done in JMP:
- Forecasting in JMP includes the following default visualisations: Time series, Autocorrelation and Partial Autocorrelation
- Users can specify lags for autocorrelation
- Using the ARIMA forecasting, the user can specify 3 parameters and generate different combinations
- Remove linear trend with decomposition and differencing

Time Series Forcasting Tutorial App
The app developer has shown various forecasting models and is also developed with ShinyR. For

References

Related Works
1. Exploring Time series and Forecasting: Time Series Forcasting Tutorial App

Data sources
1. CEIC: Data on Visitor arrivals, Revenue and Expenditure
2. Singapore Tourism Board (STB): Data on Hotel statistics and Tourism sector performance

Key Challenges

ShinyR
In order to leverage on the various forecasting models that is available in R and its libraries, our group will be be using ShinyR to develop our web application. ShinyR also provides the platform to create a dashboard.However, our team forsee the learning of R to be a major challenge as none of us has build a web application with ShinyR, and based on intital research, the R syntax is also quite different.

Forecasting Model & Visualisations
As our group is working on providing a platform for forecasting, we needed to understand the various methods that are available and the visualisations that will be useful for the users to identify the hidden patterns in their data.


Milestones

TEN-Milestones.png


Future Work

1. Comparing multiple forecasting methods & finding the best
Our application will only be showing the results of forecasting for users to evaluate the accuracy of each. However, it will be better if the application could compare and recommend the best, such that users with no prior knowledge of forecasting can easily understand the results.

2. Forecasting of stream data
Our application can work towards forcasting live data source. This would eliminated the need for users to upload their own data manually.

3. Allowing wider range of data formats
Our application will only allow the reading of csv data file. With a wider range of formats, it will be more flexible for the user.


Thought Process

First Tab: Dynamic Filters Filters should be dynamically generated from the data source as user inputs/filters.

First Tab: Time series & Correlogram
To allow users to do the exploration first before moving to the next tab which is applying forecasting models. The visualisations will include time series graph to look at the trend for the past periods and correlogram to understand the correlation between the lags/periods. We want to allow users to explore the data by smoothing the linear trend with decomposition and differencing with different differences. As for the correlogram, it should allow users to specify the number of lags/periods that they would like to see.


Second Tab: Forecasting Models & Results
After the data exploration in the first tab, users are now ready to perform forecasting with the models provided. Similarly, we want to give users the autonomy to select different models and inputs. We would also provide the results for users to evaluate the accurracy of the model.


Comments