IS480 Team wiki: 2018T1 analyteaka projectscope

From IS480
Revision as of 17:17, 13 August 2018 by Solomon.teo.2016 (talk | contribs)
Jump to navigation Jump to search
Analyteaka Header.png






Analyteaka Scope.png
Analyteaka customer profiling.png
Customer categorization Based on the historical sales data provided by Scanteak, we are going to work out the customers’ race (from name), gender (from name), age (from NRIC), income level (based on their housing district), and if they are return customers (based on the past transaction records).
Customer profiling Moving forward from customer categorization, which isolates various identifiable traits (age, race, gender etc.), we are going to generate several profiles/personas based on a combination of identifiable traits.

Examples of descriptive analytics would include:

  • Age/race/gender/housing district composition of customers
  • Customer return rate
  • Sales and quantity sold for each identifiable trait or profile
  • Main payment method

Examples of business questions that will be answered:

  • What is the average amount spent by customers between the age 40-45?
  • Are they mostly new customers or return customers?
  • What is the main target profile (40-year-old Chinese male)?
Analyteaka store profiling.png
Part 1 This module is responsible for providing descriptive analytics for different products and their respective categories. It will provide the foundation for predictive analytics (e.g. recommended product and quantity allocation for each store).

Examples of descriptive analytics would include:

  • Sales figure and quantity sold for each product and category
  • Sales composition of each product and category
  • Grouping of products which are commonly purchased together

Examples of business questions that will be answered:

  • What is the best performing product/category for this outlet?
  • How many products do customers usually buy in a single purchase?
  • What other products do customers usually buy when they purchase a coffee table?
  • What is the best performing store/location?
  • What is the best performing month/day/period?
  • Which is the race/age/gender demographic for each store?
  • What kind of item sells better as combination?
Part 2 This module is responsible for providing predictive analytics for different stores and their respective locations based on part 1.

Examples of descriptive analytics would include:

  • Number of customers for each store
  • Number of sales and sales figure for different months/days/periods
  • Customer (age, race, gender, etc.) composition of each store

Examples of business questions that will be answered:

  • What is the best performing item category next quarter?
  • Which store sells the most item next quarter?
  • What kind of product can we push as an add-on/bundle per season?
Analyteaka Bootstrap.png

A new sales system, meant to replace Scanteak’s legacy system, is currently being developed by Scanteak’s in-house developers. As the new sales system is still in the midst of completion, the bootstrap module will allow the user to upload the customer data exported from the new sales system. Once the new sales system has been completed, the manual bootstrapping of CSV files will be phased out and the bootstrap module will be modified to interact with the new sales system directly through API calls.

Furthermore, the new system will allow for higher level of data quality, providing better predictive analytics result.

Steps for bootstrapping

1. Data cleaning by removing the duplicate row (double entry, invalid rows)
2. Infer columns required

  • Gender and ethnicity based on first name and last name
  • Residential district/housing type/ house value based on postal code
  • Age and citizenship based on NRIC.

3. Convert into datastore request objects
4. Uploading data to datastore

Analyteaka data visualisation.png

This module will make use of Bootstrap, flask and Dash by Plothy to generate charts based on data output generated by customer and store profiling module.

Analyteaka analytics reporting.png

This module provide weekly and monthly report based on data provided by the store and customer profiling module and provide recommendations based on the data. It will make use of data visualization module to generate reports for end users based on their roles (sales executives, senior management, etc.).

Data Analytics is the process of examining data sets in order to draw conclusions about the information they contain, increasingly with the aid of specialized systems and software.

Typical mechanisms: Database (only Data)

Typical timeframe: Offline

The outcome of analytics is informed business decisions to verify or disprove scientific models, theories and hypotheses. The typical goals is to improve efficiency, optimize processes, increase revenues etc.

The hardest part of analytics project is asking the question. As Robert Half once mentioned, "Asking the right questions takes as much skill as giving the right answers." - Robert Half

Descriptive analytics Insight into the past:
  • Uses data aggregation and data mining to provide insight into the past and answer: “What has happened?”.
  • It is typically used to summarise raw data and make it interpretable by humans.

Data operations:

  • Report card of data, used for spotting potential issues when you need to understand at an aggregate level what is going on
  • When you want to summarize and describe different aspects of your business.
Predictive analytics Understanding the future:
  • Uses statistical models and forecasts techniques to understand the future and answer: “What could happen?”
  • Provides estimates about the likelihood of a future outcome
  • Foundation of predictive analytics is based on probabilities
Prescriptive analytics Advise on possible outcomes:
  • Uses optimization and simulation algorithms to advice on possible outcomes and answer: “What should we do?”
  • Attempts to quantify the effect of future decisions in order to advise on possible outcomes before the decisions are actually made
  • Uses a combination of techniques and tools such as business rules, algorithms, machine learning and computational modelling procedures
  • Anytime you need to provide users with advice on what action to take.

Based on the above details our modules are split into the respective section


  • Customer Profile module
  • Store Profile
  • Staff profile


  • Machine Learning


  • Data visualisation module
  • Analytics and reporting module

Analyteaka machine learning.png

This module will contain the machine learning system. As we are using Python as our main programming language, we will be utilizing libraries such as – SciPy, NumPy, matplotlib, pandas, Scikit-learn to help us complete this module. Using the training dataset (6 months’ worth of offline retail data) we have prepared, we will train the system to provide predictive analytics for both customers and stores.

The entire process can be automated, whereby the system will retrieve raw sales data from the in-house sales system, process the raw sales data in the machine learning module before handing it over to the analytics & reporting module.

Examples of predictive analytics:

  • Recommended products for different customer profiles
  • Recommended price range for different customer profiles
  • Recommended products to be displayed for different stores
  • Best selling type of item and item category for different stores

Examples of business questions that will be answered:

  • What kind of furniture (based on price range) should you recommend to a certain customer profile (e.g. 30-year-old Chinese male at the Suntec Branch)
  • What kind of customers (e.g. Chinese) are you expecting at a certain branch (e.g. Suntec) and what kind of furniture (e.g. Oriental-style) should you display?
Analyteaka Footer Transparent.png