Difference between revisions of "ANLY482 AY2016-17 T2 Group12 : Project Overview / Methodology"

From Analytics Practicum
Jump to navigation Jump to search
Line 34: Line 34:
 
==<div style="background: #34454c; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px; font-size: 16px"><font color=#FFFFFF>Methodology</font></div>==
 
==<div style="background: #34454c; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px; font-size: 16px"><font color=#FFFFFF>Methodology</font></div>==
  
*Data Collection
+
{| class="wikitable"
The dataset is from KST Bikers feedback system which is collected from a variety of sources such as email, SMS and feedback form. We will also be using external data such as weather and public holiday data. Having such data allows us to examine external factors which could impact the generation of feedbacks.
+
|-
 +
! S/N !! Title of Article !! Summary of Key Findings
 +
|-
 +
| 1 || [http://www.operationalsynergy.co.uk/why-analysing-feedback-is-essential/%20 Top tips on how to analyse feedback]||
 +
Having a comprehension of how to use present and future state process mapping and the advantages of using data boxes, plus a visual workflow diagram are going to be essential in the most of the cases and will increase value to your data analysis. This provides a clear visual help in seeing where the bottlenecks are in your processing and areas where you have to made the improvements. <br>
  
*Data Exploration
+
Other methods include cause and effect diagrams, like the fishbone technique with the 5 whys, which enable you to identify your root causes and will introduce you to your path of resolving your key critical areas. <br>
Spot missing values, identify outliers and select necessary variables such as categories and subcategories for analysis. We will also figure out the number of feedbacks in each subcategories. This will allow us to figure out which are the top few most important problems that Singaporeans faced.
 
  
*Data Cleaning
+
Data analysis in the form of a chart will bring up some important areas for discussion, revisit and future strategy. <br>
Outliers and missing values cause data inaccuracy. Hence we will remove missing values and outliers. However, if there are too many outliers, they will be treated as a separate group for analysis.
 
  
*Data Normalization and Transformation
+
|-
As the variables in the dataset have different forms of measurements, normalization is conducted to provide equal weightage to each variable. Z-score normalization will be used. If the distribution of the variables is found to be skewed, natural log will be conducted to each involved variable to make the model more normally distributed.
+
| 2|| [http://www.itl.nist.gov/div898/handbook/eda/section1/eda11.htm%20  What is EDA?]|| Exploratory data analysis (EDA) is not just a collection of techniques. It is a philosophy as to how we breakdown a data set; what to look out for; how we look; and how to interpret. Most EDA techniques are graphical with little quantitative techniques. There is heavy reliance on graphics as the main role of EDA is to open-mindedly explore.
 +
|-
 +
| 3|| [https://hbr.org/2016/12/why-youre-not-getting-value-from-your-data-science%20 Why You’re Not Getting Value from Your Data Science]|| Business users keep coming up with problems and data analysts cannot keep up as they take much time build sophisticated data models. The most common problem is that data scientists often do not build their work around the final objective which is to derive business value. The following are the best practices:
 +
*Stick with simple models
 +
*Explore more business problems: Instead of exploring one business problem with a sophisticated business models. Build a simple model for each problem and assess the value proposition
 +
*Learn from a sample of data – not all the data
 +
*Focus on automation: Use algorithms and develop software systems to automate data processing techniques
  
*Dashboards
+
|-
Two visual dashboards will be created for KST Bikers to visualize the analysis. The dashboards will provide a summary of the trends in the feedback data and the different external factors which generate these feedbacks.
+
}

Revision as of 19:54, 15 January 2017

Home

About Us

Project Overview

Findings

Project Management

Documentation

Description Methodology


Data

The dataset provided by KST Bikers is a Feedback System which consists of feedback lodged by:

  • SMS
  • Email
  • Feedback Form

Tools Used

  • Microsoft Excel 2016
  • JMP Pro 13
  • Tableau 10.0

Methodology

}
S/N Title of Article Summary of Key Findings
1 Top tips on how to analyse feedback

Having a comprehension of how to use present and future state process mapping and the advantages of using data boxes, plus a visual workflow diagram are going to be essential in the most of the cases and will increase value to your data analysis. This provides a clear visual help in seeing where the bottlenecks are in your processing and areas where you have to made the improvements.

Other methods include cause and effect diagrams, like the fishbone technique with the 5 whys, which enable you to identify your root causes and will introduce you to your path of resolving your key critical areas.

Data analysis in the form of a chart will bring up some important areas for discussion, revisit and future strategy.

2 What is EDA? Exploratory data analysis (EDA) is not just a collection of techniques. It is a philosophy as to how we breakdown a data set; what to look out for; how we look; and how to interpret. Most EDA techniques are graphical with little quantitative techniques. There is heavy reliance on graphics as the main role of EDA is to open-mindedly explore.
3 Why You’re Not Getting Value from Your Data Science Business users keep coming up with problems and data analysts cannot keep up as they take much time build sophisticated data models. The most common problem is that data scientists often do not build their work around the final objective which is to derive business value. The following are the best practices:
  • Stick with simple models
  • Explore more business problems: Instead of exploring one business problem with a sophisticated business models. Build a simple model for each problem and assess the value proposition
  • Learn from a sample of data – not all the data
  • Focus on automation: Use algorithms and develop software systems to automate data processing techniques