Difference between revisions of "Analysis of User and Merchant Dropoff for Sugar App - Project Overview"

From Analytics Practicum
Jump to navigation Jump to search
Line 38: Line 38:
 
In this day and age of rapid modernization, local businesses have had a very hard time competing with large franchise chains such as Walmart, 7-11, Giant etc. Customers of local businesses also demand that local businesses deliver a high quality product (38%), yet offer the lowest price possible (38%) (The Consumer Barometer Survey, 2015). The lack of economies of scale, as well as the high infrastructure and marketing costs have led to the closure of many local businesses.
 
In this day and age of rapid modernization, local businesses have had a very hard time competing with large franchise chains such as Walmart, 7-11, Giant etc. Customers of local businesses also demand that local businesses deliver a high quality product (38%), yet offer the lowest price possible (38%) (The Consumer Barometer Survey, 2015). The lack of economies of scale, as well as the high infrastructure and marketing costs have led to the closure of many local businesses.
 
   
 
   
However, we are currently living in a digital age where rapid technological advancements has continuously shaped and changed our attitudes and behaviour towards different aspects of our lifestyles. With this move towards a more digitized society, conventional shopping, that traditionally takes place in brick-and-mortar shops, is now gravitating towards online platforms for ease of convenience as well as the low cost of setup and outreach. As of 2016, Singapore has the highest smartphone penetration rate in the world at 88%, ahead of other countries such as Hong Kong, Australia and the U.S.(The Connected Consumer Survey, 2015) This will in turn result in many Singaporean local businesses considering digitization in order to attract more customers.
 
 
 
As such, there have been a rise of various local discount websites such as Groupon, Deal.com.sg, Lazada and Qoo10, which offer high quality products at low prices; and are frequented by many Singaporeans (42%) (The Consumer Barometer Survey, 2015). The growing trend suggests that there may be room for more growth in this area, which is where Sugar steps in.
 
As such, there have been a rise of various local discount websites such as Groupon, Deal.com.sg, Lazada and Qoo10, which offer high quality products at low prices; and are frequented by many Singaporeans (42%) (The Consumer Barometer Survey, 2015). The growing trend suggests that there may be room for more growth in this area, which is where Sugar steps in.
  
Line 82: Line 80:
  
 
==<div style="background: #95A5A6; line-height: 0.3em; font-family:helvetica;  border-left: #6C7A89 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#F2F1EF"><strong>Project Objectives</strong></font></div></div>==
 
==<div style="background: #95A5A6; line-height: 0.3em; font-family:helvetica;  border-left: #6C7A89 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#F2F1EF"><strong>Project Objectives</strong></font></div></div>==
Therefore, the objective of the project is to understand user and merchant behavior via survival analysis, subsequently deriving recommendations for Sugar to increase its KPIs - voucher redemption rate, user retention rate and merchant retention rate.
+
'''Merchants'''
 +
*Identifying star merchants (performing better than expected) and laggard merchants (performing worse than expected)
 +
**Based on Revenue and Redemption Rate
 +
*Identifying time-series patterns (e.g. day of week and hour) and grouping merchants with similar redemption behavior together
 +
 
 +
'''Items'''
 +
*Identifying star items (performing better than expected) and laggard items (performing worse than expected)
 +
**Based on Impressions, Clicks and Price
 +
*Identifying time-series patterns (e.g. day of week and hour) and grouping items with similar redemption behavior together - drill down to product level
 +
 
 +
'''Users'''
 +
*Identifying star users (performing better than expected) and normal users using LRFM
 +
*#Length
 +
*#Recency
 +
*#Frequency
 +
*#Monetary
 +
*Cluster users based on that
 +
*Apply survival analysis from installation to purchase (e.g. which type of users are more likely to purchase only x times before falling off the app?)
 +
 
 +
'''Geospatial'''
 +
*Determining the relationship between user location and merchant location (i.e. do users really go to places near them or are they more willing to travel to visit certain merchants?)
 +
*Identifying popular areas and unpopular areas (i.e. the proportion of merchants in an area should be proportion to the number of orders it receive)
 +
*Recommending potential locations for new merchants
  
 
==<div style="background: #95A5A6; line-height: 0.3em; font-family:helvetica;  border-left: #6C7A89 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#F2F1EF"><strong>Scope of Project</strong></font></div></div>==
 
==<div style="background: #95A5A6; line-height: 0.3em; font-family:helvetica;  border-left: #6C7A89 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#F2F1EF"><strong>Scope of Project</strong></font></div></div>==
Line 94: Line 114:
 
*Extrapolation of survival curve for forecast  
 
*Extrapolation of survival curve for forecast  
 
*Derive recommendations and solutions for Sugar
 
*Derive recommendations and solutions for Sugar
 
==<div style="background: #95A5A6; line-height: 0.3em; font-family:helvetica;  border-left: #6C7A89 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#F2F1EF"><strong>Review of Existing Work</strong></font></div></div>==
 
Survival analysis is a statistical technique that analyses the duration to an event. The event can be death, divorce, churn or purchase. It overcomes the limitation of logistic regression because the probabilities may change over time. Furthermore, it can handle censoring, which refers to the incomplete information about participants if they continue beyond the range of the study or drop out from the study.
 
 
In business and marketing, survival analysis has been used in many studies including telecommunications, insurance companies and financial services. In telecommunications, Zhang and Chen (2007) applied clustering and survival analysis for each cluster as a way to segment customers into groups. Portela and Menezes (2009) applied survival analysis on the Portugal Telecommunications industry and found that factors affecting churn are related to the amount of purchase with the company. Usage, subscription conditions and satisfaction do not seem to affect churn. Lu (2003) calculated customer lifetime values for a telecommunications company using survival curves.
 
 
For the financial services industry, Van den Poel and Lariviere (2003) used survival analysis to create proportional hazard models to predict customer attrition and found that customer alone may not be able to predict attrition and a better model considers the combination of customer and product (Van den Poel & Lariviere, 2004).
 
 
However, few studies have tried to apply survival analysis into e-commerce and mobile applications. Moreover, most studies study only a single affected party (one sided markets), whereas Sugar operates in a two sided market, with two stakeholders, users and merchants, which have a mutual effect on each other. Our study will attempt to apply these well-established techniques and modify them to suit our needs.
 
  
 
==<div style="background: #95A5A6; line-height: 0.3em; font-family:helvetica;  border-left: #6C7A89 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#F2F1EF"><strong>Project Deliverables</strong></font></div></div>==
 
==<div style="background: #95A5A6; line-height: 0.3em; font-family:helvetica;  border-left: #6C7A89 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#F2F1EF"><strong>Project Deliverables</strong></font></div></div>==

Revision as of 17:02, 28 February 2016

Home

 

Project Overview

 

Findings

 

Project Documentation

 

Project Management

Background Data Source Methodology

Introduction and Project Background

In this day and age of rapid modernization, local businesses have had a very hard time competing with large franchise chains such as Walmart, 7-11, Giant etc. Customers of local businesses also demand that local businesses deliver a high quality product (38%), yet offer the lowest price possible (38%) (The Consumer Barometer Survey, 2015). The lack of economies of scale, as well as the high infrastructure and marketing costs have led to the closure of many local businesses.

As such, there have been a rise of various local discount websites such as Groupon, Deal.com.sg, Lazada and Qoo10, which offer high quality products at low prices; and are frequented by many Singaporeans (42%) (The Consumer Barometer Survey, 2015). The growing trend suggests that there may be room for more growth in this area, which is where Sugar steps in.

Introduction of Sugar

Sugar is an interactive city guide that seeks to encourage a culture of exploration in Singapore and helping local small businesses get discovered.

Currently, Sugar operates in 3 countries – Hong Kong, Jakarta and Singapore. It originated from Shanghai where it has experienced tremendous success of over 250,000 users a day and hence, the founders has decided to expand its operations to Singapore in early 2014.

Sugar has discovered that product quality and price is essential in a user making a purchase decision. Thus, as a city guide with its location-based features, it hopes to revolutionise the online shopping industry, by providing high quality products, at the lowest price, at the most convenient locations for the user.

There are two main stakeholders: Merchants and Users as Sugar exists as a platform in a two-sided market. Like many other two-sided markets, it connects users and merchants and earn a premium for connecting these two groups by charging the transactions made between the two groups.

Sugar’s merchants are mainly small local businesses in Singapore. It has a large variety, including cafes, small restaurants, bars, hair salons, gyms, gift shops. The benefits for merchants is advertising to users that are in close proximity to them. As mentioned before, convenience is an important factor for a purchase decision and thus, Sugar is leveraging on this aspect.

Users derive benefits from the discounted deals on the app. For example, Sugar can offer a deal which offers a 50% discount on truffle fries at a restaurant near potential users. Since price is highlighted as an extremely important factor in a purchase decision, this can entice existing users and new users to check out deals on Sugar app. The location-based feature also provides them with ample opportunities to explore hidden gems and new establishments in their vicinity.

Differentiation from Other Apps

What differentiates Sugar from the rest of the apps are 2 features: Location-Based Recommendations and Skimming Mechanism.

Location-Based Recommendations

Sugar offers location-based advertising for local businesses while simultaneously offering attractive deals to users. As a heuristic, the app uses location information provided by the user to recommend deals. Location can be set by the user or by the in-built GPS system.

Skimming Mechanism

Another important feature of the app is the Skimming Mechanism. It allows each user to reduce the price of an item by 20 cents, hence “skimming the price”. This gives the app word-of-mouth potential as users are motivated to reduce the price further by persuading their friends to skim the price of an item. For example, if a person can get 4 other friends, the 5 of them can reduce the price of an item by $1 for everyone.

Business Problems and Motivations

As Sugar is a relatively young startup in Singapore, it has not yet attained a critical mass of user and merchant numbers. As such, user growth and user experience is vitally important. To reach this critical mass, Sugar needs to minimise user and merchant attrition, and retain vital segments of both groups in order to preserve the network effect of Sugar’s platform. This is done by enhancing the app experience for both users and merchants.

Unredeemed Vouchers

One issue Sugar faces is the issue of unredeemed vouchers. When a user applies for a voucher, there is a 7-day redemption period before it expires. Many users allow the vouchers expire. Maximising the voucher redemption rate will benefit both merchants and users, by ensuring that a faster turnaround time for products that users want, and higher profits for the merchant. This will enhance the user experience for both groups.

User Retention

To build a successful application, Sugar needs to grow as fast as possible while retaining existing users. Many users have become dormant or stop buying after the first purchase. Analysis can be applied to find out why they have turned dormant/ stopped buying and identify solutions that may be able to attract them.

Merchant Retention

Not all merchants are the same. There is a large variation between the popularity of individual merchants. Some merchants experience uptake daily whereas some have little to none at all. As a result, many of the latter may choose to drop out after a period of time. Since Sugar is in a two-sided market, a high attrition rate of merchants may result in users also ceasing usage. As Sugar has limited resources to reach out and engage merchants, high value targets can be identified to optimise the effort in reaching out to retain merchants. Further analysis can be finding out the main factors for merchant attrition.

Project Objectives

Merchants

  • Identifying star merchants (performing better than expected) and laggard merchants (performing worse than expected)
    • Based on Revenue and Redemption Rate
  • Identifying time-series patterns (e.g. day of week and hour) and grouping merchants with similar redemption behavior together

Items

  • Identifying star items (performing better than expected) and laggard items (performing worse than expected)
    • Based on Impressions, Clicks and Price
  • Identifying time-series patterns (e.g. day of week and hour) and grouping items with similar redemption behavior together - drill down to product level

Users

  • Identifying star users (performing better than expected) and normal users using LRFM
    1. Length
    2. Recency
    3. Frequency
    4. Monetary
  • Cluster users based on that
  • Apply survival analysis from installation to purchase (e.g. which type of users are more likely to purchase only x times before falling off the app?)

Geospatial

  • Determining the relationship between user location and merchant location (i.e. do users really go to places near them or are they more willing to travel to visit certain merchants?)
  • Identifying popular areas and unpopular areas (i.e. the proportion of merchants in an area should be proportion to the number of orders it receive)
  • Recommending potential locations for new merchants

Scope of Project

The scope of our project includes the following:

  • Data collection - Collating datasets from Sugar’s SQL database, Flurry and Localytics analytics dashboard
  • Data preparation - Setting and censoring the data. We will also be filtering users and merchants based on location, where we will only focus only on the Singapore region.
  • Analysis of voucher redemption rates using survival analysis
  • Analysis of survival curves for merchant and users
  • Refinement - Get client feedback and refine the model
  • Extrapolation of survival curve for forecast
  • Derive recommendations and solutions for Sugar

Project Deliverables

  • Project Proposal
  • Mid-term Presentation
  • Mid-term Report
  • Final Presentation
  • Final Report
  • Project Poster

References

Deciding Factor in Selecting a Local Business. (n.d.). Retrieved January 10, 2016, from https://www.consumerbarometer.com/en/insights/?countryCode=SG

Larivière, B., & Van den Poel, D. (2004). Investigating the role of product features in preventing customer churn, by using survival analysis and choice modeling: The case of financial services. Expert Systems with Applications,27(2), 277-285.

Lu, J., & Park, O. (2003). Modeling customer lifetime value using survival analysis—an application in the telecommunications industry. Data Mining Techniques, 120-128.

Portela, S., & Menezes, R. Modeling Customer Churn: An Application of Duration Models.

The Connected Consumer Survey 2014/2015. (2015). Retrieved January 10, 2016, from https://www.consumerbarometer.com/en/graph-builder/question=M1&filter=country:united_states,china,hong_kong_sar,korea,malaysia,singapore,australia

The Consumer Barometer Survey 2014/2015 (2015). Retrieved January 10, 2016, from https://www.consumerbarometer.com/en/insights/?countryCode=SG

Van den Poel, D., & Lariviere, B. (2003). Customer attrition analysis for financial services using proportional hazard models. European Journal of Operational Research, 157(1), 196-217.

Zhang, G., & Chen, Y. (2007). An Integrated Data Mining and Survival Analysis Model for Customer Segmentation. In Integration and Innovation Orient to E-Society Volume 1 (pp. 88-95). Springer US.