Difference between revisions of "Smartie Mall"

From Visual Analytics and Applications
Jump to navigation Jump to search
 
(29 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
<div style="background:#565656; border:#565656; padding-left:15px; text-align:center;">  
 
<div style="background:#565656; border:#565656; padding-left:15px; text-align:center;">  
<font size = 5; color="#FFFFFF"><span style="font-family:Century Gothic;">ISSS608 Visual Analytics and Applications Project</span></font>  
+
<font size = 5; color="#FFFFFF"><span style="font-family:Century Gothic;">Turning Concrete Malls into Smart Malls (S-MALL): <br></span></font>
<p><font size = 4; color="#FFFFFF"><span style="font-family:Century Gothic;">Team S-MALL</span></font></p>
+
<font size = 3; color="#FFFFFF"><span style="font-family:Century Gothic;">A web-based analytics application for visualizing and mapping in-mall customer journeys and shopping behaviours</span></font>
 +
<p><font size = 3; color="#FFFFFF"><span style="font-family:Century Gothic;">Team S-MALL: Chen Yun-Chen | Chiam Zhan Peng | Zheng Bijun</span></font></p>
 
</div>
 
</div>
<div style="width: 100%; display: table;">
+
{|style="background-color:#565656;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0"  |
  <div style="width: 600px; display: table-cell; background: #ffffff;"><font size=5; color="#000000"><span style="font-family:Calibri;">Milestone</span></font></div>
+
| style="font-family:Century Gothic; font-size:100%; solid #000000; background:#002060; text-align:center;" width="20%" | 
<div style="width: 400px; display: table-cell;"> [[File:T3 banner.png|right|1000x400 px]] </div>
+
;
</div>  
+
[[S-MALL_Overview| <font color="#FFFFF">Overview</font>]]
 +
   
 +
| style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#565656; text-align:center;" width="20%" | 
 +
;
 +
[[S-MALL_Proposal| <font color="#FFFFFF">Proposal</font>]]
 +
 +
| style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#565656; text-align:center;" width="20%" | 
 +
;
 +
[[S-MALL_Application| <font color="#FFFFFF">Application</font>]]
 +
 +
| style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#565656; text-align:center;" width="20%" | 
 +
;
 +
[[S-MALL_Poster| <font color="#FFFFFF">Poster</font>]]
 +
 +
| style="font-family:Century Gothic; font-size:100%; solid #1B338F; background:#565656; text-align:center;" width="20%" | 
 +
;  
 +
[[S-MALL_Reports| <font color="#FFFFFF">Reports</font>]]
 +
 +
|  &nbsp;
 +
|}
 +
 
 +
 
 +
== ABSTRACT ==
 +
 
 +
<p align="justify"><font size = 2><span style="font-family:Century Gothic;">With growing popularity of e-commerce and online shopping, traditional brick & mortar retail malls are facing stiff challenge and need to reinvent itself and compete with these new “online” channels. As part of the Smart-Nation drive and transformation, retail malls can leverage on this digital transformation journey to find its own unique value preposition with its physical and “offline” presence. With new technologies and connected era like IoT, shoppers are leaving their digital footprints and trackable just like on-line customers.</span></font></p>
 +
 
 +
<p align="justify"><font size = 2><span style="font-family:Century Gothic;">Retail malls have data such as presence and movement via Wi-Fi access point with customers’ mobile devices, traditional transaction data gathered from daily operations and customers profile data obtained from loyalty programs. The opportunity is to discover patterns and relationship within the data and offer deeper insights, formulate marketing strategies for retail stores and better experience for their customers. This project aims to design and develop a web-based application that provides such analytical visualization. It is developed using open-source R Shiny framework and several R packages such as ggplot2, chorddiag, hexbin, sunburstR, highcharter, arules, visNetwork.</span></font></p>
 +
 
 +
<p align="justify"><font size = 2><span style="font-family:Century Gothic;">The motivation and objectives will be discussed followed by detailed discussion of the principles, approach and data visualization techniques that are used. Using actual data from a well-known shopping mall, we will demonstrate the functionality of the application in visualizing and discovering the patterns such as peak hour, busy area, movement and customers behavior associated with their profile and transactions. Finally, we will conclude by providing some insights and potential recommendations for their mall operations and strategy.</span></font></p>
 +
 
  
<div style="text-align:left; padding-top:25px; font-family:Calibri;">
 
 
<font size = 5>Motivation</font>  
 
<font size = 5>Motivation</font>  
 
<br>Brick and Mortar retail malls are facing stiff challenge from online e-commerce shopping and mobile smartphone penetration. How can physical malls continue to survive under such conditions? Also, how can shopping malls transform as part of the Smart Nation initiative in Singapore? Using real data of a mega-mall, this project aims to leverage multiple data sources from typical retail operation, and develop a visual application to assist company reveal customer behavior, uncover patterns that may present opportunities for the mall as well as tenants to better optimise operations, layout, events, maximize sales as well improve the customers' experience.  
 
<br>Brick and Mortar retail malls are facing stiff challenge from online e-commerce shopping and mobile smartphone penetration. How can physical malls continue to survive under such conditions? Also, how can shopping malls transform as part of the Smart Nation initiative in Singapore? Using real data of a mega-mall, this project aims to leverage multiple data sources from typical retail operation, and develop a visual application to assist company reveal customer behavior, uncover patterns that may present opportunities for the mall as well as tenants to better optimise operations, layout, events, maximize sales as well improve the customers' experience.  
</div>
 
  
<div style="text-align:left; padding-top:25px; font-family:Calibri;">  
+
 
 +
<div style="text-align:left; padding-top:5px; font-family:Calibri;">  
 
<font size = 5>Data Description</font>  
 
<font size = 5>Data Description</font>  
 
[[File:T3 Datades.PNG|center|800x300 px]]
 
[[File:T3 Datades.PNG|center|800x300 px]]
Line 22: Line 51:
 
</div>
 
</div>
  
<div style="text-align:left; padding-top:25px; font-family:Calibri;">  
+
<div style="text-align:left; padding-top:5px; font-family:Calibri;">  
 
<font size = 5>Expected Outcome</font>  
 
<font size = 5>Expected Outcome</font>  
 
  <li>Data Integration: Combine the three dataset to derive patterns, associations and actionable insights</li>
 
  <li>Data Integration: Combine the three dataset to derive patterns, associations and actionable insights</li>
  <li>Interactive Visualization: 1. Overview of customers movements patterns by weeks, days, hours 2. Inter-floor movement 3. Customers' profile and transaction patterns </li>
+
  <li>Interactive Visualization:  
  <li></li>
+
<ol>
  <li></li>
+
<li>Overview of customers movements patterns by weeks, days, hours</li>
 +
<li>Inter-floor movement</li>
 +
<li>Customers' profile and transactions integration </li>
 +
  </ol>
 +
  <li>Use Cases: Zone Traffic Statistics, Zone Traffic Flow, Staff Planning, Marketing/Event Campaign</li>
 
</div>  
 
</div>  
  
<div style="text-align:left; padding-top:25px; font-family:Calibri;">  
+
<div style="text-align:left; padding-top:5px; font-family:Calibri;">  
 
<font size = 5>Visualization Tool & Packages</font>  
 
<font size = 5>Visualization Tool & Packages</font>  
 
  <li>R: Hexagonal binning using ggplot2 and Kernel Decimal Estimate using stat_Density2d</li>
 
  <li>R: Hexagonal binning using ggplot2 and Kernel Decimal Estimate using stat_Density2d</li>
Line 36: Line 69:
 
  <li>R: Shinyapp, shinydashboard, flexdashboard</li>
 
  <li>R: Shinyapp, shinydashboard, flexdashboard</li>
 
</div>
 
</div>
 +
 +
== Web-Based Visualization Application==
 +
Part1:
 +
{| class="wikitable"
 +
|-
 +
! scope="col" style="width: 20%;"| Visualization
 +
! scope="col" style="width: 30%;"| Methodology & Technique
 +
! scope="col" style="width: 30%;"| Usage
 +
|-
 +
! scope="row"| insert image of line chart
 +
|
 +
<ul>
 +
<li>Chart type: Line chart & trellis plot</li>
 +
<li>R Package: ggplot2, plotly</li>
 +
<li>Interactivity: Use selectInput to control plot and segment by different timelevels, eg. Date, day of week, and hour</li>
 +
</ul>
 +
|
 +
<ul>
 +
<li>Line chart without trellis (segment=None) can be used to analyze the daily/weekly/hourly pattern of footfalls.</li>
 +
<li>Trellis plot can be used to detect the cycling pattern over time.</li>
 +
</ul>
 +
|-
 +
! scope="row"| insert image of chord diagram
 +
|
 +
<ul>
 +
<li>Chart type: Chord diagram</li>
 +
<li>R Package: chorddiag</li>
 +
<li>Interactivity: Set specific datetime using selectIput and sliderInput to view the traffic transfer across floors.<br>
 +
Hover to each floor to see the destination of its outflow traffics.</li>
 +
</ul>
 +
|
 +
<ul>
 +
<li>Analyze traffic flow across floor for specific datetime selection</li>
 +
</ul>
 +
|-
 +
! scope="row"| insert image of hexbin map
 +
|
 +
<ul>
 +
<li>Chart type: Hexagonal binning map</li>
 +
<li>R Package: hexbin, ggplot, plotly</li>
 +
<li>Key parameter setting: number of bins is set to 50</li>
 +
<li>Interactivity: Set specific datetime using selectIput and sliderInput to view the traffic density on each floor.<br>
 +
Click on specific hexbin to investigate members identity.</li>
 +
</ul>
 +
|
 +
<ul>
 +
<li>Analyze traffic density of floors for specific datetime selection</li>
 +
<li>Drill down to shoppers’ identity based on interested density area</li>
 +
</ul>
 +
|-
 +
|}
 +
 +
Part2:
 +
{| class="wikitable"
 +
|-
 +
! scope="col" style="width: 20%;"| Visualization
 +
! scope="col" style="width: 30%;"| Methodology & Technique
 +
! scope="col" style="width: 30%;"| Usage
 +
|-
 +
! scope="row"| insert image of sunburst
 +
|
 +
<ul>
 +
<li>Chart type: Sunburst diagram</li>
 +
<li>R Package: sunburstR</li>
 +
<li>Interactivity: Set radio button to view the journey of different member segments.<br>
 +
Set minimum dwell time using sliderInput to exclude passing-by floors.<br>
 +
Hover to see the path and relevant statistics.</li>
 +
</ul>
 +
|
 +
<ul>
 +
<li>Investigate popular shopping path of members based on floors.</li>
 +
</ul>
 +
|-
 +
! scope="row"| insert image of treemap
 +
|
 +
<ul>
 +
<li>Chart type: Treemap</li>
 +
<li>R Package: treemap, highCharter </li>
 +
<li>Interactivity: Set radio button to view the journey of different member segments.<br>
 +
Click on floor level to drill down to store level.<br></li>
 +
</ul>
 +
|
 +
<ul>
 +
<li>Analyze members’ average dwell time on each floor and store.</li>
 +
</ul>
 +
|-
 +
! scope="row"| insert image of boxploter
 +
|
 +
<ul>
 +
<li>Chart type: Boxplot</li>
 +
<li>R Package: plotly</li>
 +
<li>Key parameter setting: number of bins is set to 50</li>
 +
<li>Interactivity: Click on the treemap to get the relevant boxplot for selected floor.</li>
 +
</ul>
 +
|
 +
<ul>
 +
<li>Analyze dwell time distribution of each store based on floor selection on treemap.</li>
 +
</ul>
 +
|-
 +
! scope="row"| insert image of bar chart
 +
|
 +
<ul>
 +
<li>Chart type: Bar chart</li>
 +
<li>R Package: plotly</li>
 +
<li>Interactivity: Select on the boxplot distribution to view the demographic of interested members.<br>
 +
Set the ‘profile count by’ parameter to decide the y-axis of bar plots.</li>
 +
</ul>
 +
|
 +
<ul>
 +
<li>Analyze members’ profile based on selection of their dwell time distribution. For example, we may analyze the high time spender of a specific store to see if they are of similar demographic.</li>
 +
</ul>
 +
|}
 +
 +
Part3:
 +
{| class="wikitable"
 +
|-
 +
! scope="col" style="width: 20%;"| Visualization
 +
! scope="col" style="width: 30%;"| Methodology & Technique
 +
! scope="col" style="width: 30%;"| Usage
 +
|-
 +
! scope="row"| insert image of bar
 +
|
 +
<ul>
 +
<li>Chart type: Bar chart</li>
 +
<li>R Package: ggplot, plotly</li>
 +
<li>Interactivity: Set date range using radio button to see the plot of different months.</li>
 +
</ul>
 +
|
 +
<ul>
 +
<li>Investigate popular shopping path of members based on floors.</li>
 +
</ul>
 +
|-
 +
! scope="row"| insert image of quadrant
 +
|
 +
<ul>
 +
<li>Chart type: Scatter plot</li>
 +
<li>R Package: arules, ggplot, plotly</li>
 +
<li>Interactivity: Set date range using radio button to generate association rules based on different month’s transactions.<br>
 +
Set parameters (support/confidence/min items) to generate valid associations rules and render plot. <br>
 +
Hover over the bar to fade out non-relevant rules in the quadrant.<br>
 +
Hover over the network to fade out non-relevant rules in the quadrant.</li>
 +
</ul>
 +
|
 +
<ul>
 +
<li>Analyze the competitive position of different rules based on set parameters.</li>
 +
</ul>
 +
|-
 +
! scope="row"| insert image of network
 +
|
 +
<ul>
 +
<li>Chart type: Network</li>
 +
<li>R Package: visNetwork</li>
 +
<li>Interactivity: Set date range using radio button to plot rules of different months.</li>
 +
</ul>
 +
|
 +
<ul>
 +
<li>Visualize the associations among departments.</li>
 +
</ul>
 +
|}

Latest revision as of 10:37, 4 August 2017

Turning Concrete Malls into Smart Malls (S-MALL):
A web-based analytics application for visualizing and mapping in-mall customer journeys and shopping behaviours

Team S-MALL: Chen Yun-Chen | Chiam Zhan Peng | Zheng Bijun

Overview

Proposal

Application

Poster

Reports

 


ABSTRACT

With growing popularity of e-commerce and online shopping, traditional brick & mortar retail malls are facing stiff challenge and need to reinvent itself and compete with these new “online” channels. As part of the Smart-Nation drive and transformation, retail malls can leverage on this digital transformation journey to find its own unique value preposition with its physical and “offline” presence. With new technologies and connected era like IoT, shoppers are leaving their digital footprints and trackable just like on-line customers.

Retail malls have data such as presence and movement via Wi-Fi access point with customers’ mobile devices, traditional transaction data gathered from daily operations and customers profile data obtained from loyalty programs. The opportunity is to discover patterns and relationship within the data and offer deeper insights, formulate marketing strategies for retail stores and better experience for their customers. This project aims to design and develop a web-based application that provides such analytical visualization. It is developed using open-source R Shiny framework and several R packages such as ggplot2, chorddiag, hexbin, sunburstR, highcharter, arules, visNetwork.

The motivation and objectives will be discussed followed by detailed discussion of the principles, approach and data visualization techniques that are used. Using actual data from a well-known shopping mall, we will demonstrate the functionality of the application in visualizing and discovering the patterns such as peak hour, busy area, movement and customers behavior associated with their profile and transactions. Finally, we will conclude by providing some insights and potential recommendations for their mall operations and strategy.


Motivation
Brick and Mortar retail malls are facing stiff challenge from online e-commerce shopping and mobile smartphone penetration. How can physical malls continue to survive under such conditions? Also, how can shopping malls transform as part of the Smart Nation initiative in Singapore? Using real data of a mega-mall, this project aims to leverage multiple data sources from typical retail operation, and develop a visual application to assist company reveal customer behavior, uncover patterns that may present opportunities for the mall as well as tenants to better optimise operations, layout, events, maximize sales as well improve the customers' experience.


Data Description

T3 Datades.PNG
  • Profile Data: contains demographic information of the shopping mall members
  • Transaction Data: contains two months transnational records from January to February 2017
  • Wi-Fi Sensor Data: contains two months Wi-Fi sensor records captured in the mall, which can be used to analyze the movement of customers
  • Maps: shopping mall layouts
  • Expected Outcome

  • Data Integration: Combine the three dataset to derive patterns, associations and actionable insights
  • Interactive Visualization:
    1. Overview of customers movements patterns by weeks, days, hours
    2. Inter-floor movement
    3. Customers' profile and transactions integration
  • Use Cases: Zone Traffic Statistics, Zone Traffic Flow, Staff Planning, Marketing/Event Campaign
  • Visualization Tool & Packages

  • R: Hexagonal binning using ggplot2 and Kernel Decimal Estimate using stat_Density2d
  • R: Chord diagram using chorddiag
  • R: Shinyapp, shinydashboard, flexdashboard
  • Web-Based Visualization Application

    Part1:

    Visualization Methodology & Technique Usage
    insert image of line chart
    • Chart type: Line chart & trellis plot
    • R Package: ggplot2, plotly
    • Interactivity: Use selectInput to control plot and segment by different timelevels, eg. Date, day of week, and hour
    • Line chart without trellis (segment=None) can be used to analyze the daily/weekly/hourly pattern of footfalls.
    • Trellis plot can be used to detect the cycling pattern over time.
    insert image of chord diagram
    • Chart type: Chord diagram
    • R Package: chorddiag
    • Interactivity: Set specific datetime using selectIput and sliderInput to view the traffic transfer across floors.
      Hover to each floor to see the destination of its outflow traffics.
    • Analyze traffic flow across floor for specific datetime selection
    insert image of hexbin map
    • Chart type: Hexagonal binning map
    • R Package: hexbin, ggplot, plotly
    • Key parameter setting: number of bins is set to 50
    • Interactivity: Set specific datetime using selectIput and sliderInput to view the traffic density on each floor.
      Click on specific hexbin to investigate members identity.
    • Analyze traffic density of floors for specific datetime selection
    • Drill down to shoppers’ identity based on interested density area

    Part2:

    Visualization Methodology & Technique Usage
    insert image of sunburst
    • Chart type: Sunburst diagram
    • R Package: sunburstR
    • Interactivity: Set radio button to view the journey of different member segments.
      Set minimum dwell time using sliderInput to exclude passing-by floors.
      Hover to see the path and relevant statistics.
    • Investigate popular shopping path of members based on floors.
    insert image of treemap
    • Chart type: Treemap
    • R Package: treemap, highCharter
    • Interactivity: Set radio button to view the journey of different member segments.
      Click on floor level to drill down to store level.
    • Analyze members’ average dwell time on each floor and store.
    insert image of boxploter
    • Chart type: Boxplot
    • R Package: plotly
    • Key parameter setting: number of bins is set to 50
    • Interactivity: Click on the treemap to get the relevant boxplot for selected floor.
    • Analyze dwell time distribution of each store based on floor selection on treemap.
    insert image of bar chart
    • Chart type: Bar chart
    • R Package: plotly
    • Interactivity: Select on the boxplot distribution to view the demographic of interested members.
      Set the ‘profile count by’ parameter to decide the y-axis of bar plots.
    • Analyze members’ profile based on selection of their dwell time distribution. For example, we may analyze the high time spender of a specific store to see if they are of similar demographic.

    Part3:

    Visualization Methodology & Technique Usage
    insert image of bar
    • Chart type: Bar chart
    • R Package: ggplot, plotly
    • Interactivity: Set date range using radio button to see the plot of different months.
    • Investigate popular shopping path of members based on floors.
    insert image of quadrant
    • Chart type: Scatter plot
    • R Package: arules, ggplot, plotly
    • Interactivity: Set date range using radio button to generate association rules based on different month’s transactions.
      Set parameters (support/confidence/min items) to generate valid associations rules and render plot.
      Hover over the bar to fade out non-relevant rules in the quadrant.
      Hover over the network to fade out non-relevant rules in the quadrant.
    • Analyze the competitive position of different rules based on set parameters.
    insert image of network
    • Chart type: Network
    • R Package: visNetwork
    • Interactivity: Set date range using radio button to plot rules of different months.
    • Visualize the associations among departments.