Difference between revisions of "Group08 Proposal"
Line 49: | Line 49: | ||
|} | |} | ||
− | [[Image:g8_Metadata.png|thumb|alt=Alt text|Full | + | [[Image:g8_Metadata.png|thumb|alt=Alt text|Full data variables description can be found here|none]] |
<h1><span lang=EN-GB>Visualization and Analysis</span></h1> | <h1><span lang=EN-GB>Visualization and Analysis</span></h1> | ||
Line 57: | Line 57: | ||
In this module, we aim to provide an interactive data explorer to visualize the data and in different ways. We will employ different visualization techniques, eg. treemaps, heatmaps, corrplots, time-series line graphs, to demonstrate the interaction and relationships between different combination of cash flow behaviour user profile and financial data. App users will have the freedom to select the variables of their interest to dynamically generate the corresponding visualization. | In this module, we aim to provide an interactive data explorer to visualize the data and in different ways. We will employ different visualization techniques, eg. treemaps, heatmaps, corrplots, time-series line graphs, to demonstrate the interaction and relationships between different combination of cash flow behaviour user profile and financial data. App users will have the freedom to select the variables of their interest to dynamically generate the corresponding visualization. | ||
+ | === Survival Analysis and Visualization === | ||
+ | In contrast to predicting the future cash flow, we will perform survival analysis on the user cash flow data. This will give us an understanding of how soon Yu’e Bao users will withdraw they deposits upon increase their balances. The survival analysis will also be performed for individual categories of user profiles. This will allow us to compare the survival of Yu’e Bao users’ deposits between different classes, for example, between male and female users, or between Taurus and Aries. With this, we can become MythBusters to see the myth, that Taurus are better savers than Aries, is indeed true. | ||
− | |||
Performing Survival analysis.... | Performing Survival analysis.... |
Revision as of 21:44, 21 November 2018
|
|
|
|
Contents
40 Thieves Members
¥ Wong Yam Yip
¥ Wu Jinglong
¥ Song Chenxi
Abstract
Yu’e Bao (余额宝) is an investment product offered by Alipay (支付宝), a mobile and online payment platform established by China’s multinational conglomerate Alibaba Group. In June 2013, Alibaba Group launched Yu’e Bao, in collaboration with Tianhong Asset Management Co., Ltd., to form the first internet fund in China. Since then, Yu’e Bao has become the nation’s largest money market fund and, by Feb 2018, has US$251 billion under its management. In Chinese, Yu’e Bao represents “Leftover Treasure”. Alipay users can deposit their extra cash, for example, leftover from online shopping, into this investment product. The money will be invested via a money market fund with no minimum amount or exit charges, with interest paid on a daily basis. While major banks offer 0.35% annual interest on deposits, Yu’e Bao may offers user 6% interest with the convenience and freedom to deposit and withdraw anytime via Alipay mobile app. Thus, Yu’e Bao became extremely popular in China.
Using various data visualization methodologies, coupled with analysis of survival and time-series, this project aims to build an interactive tool on R Shiny framework, to unearth the underlying treasures of associations between Yu’e Bao’s user profile, behaviour, time and other financial factors.
Dataset
Source: Alibaba Cloud TIANCHI Competition: The Purchase and Redemption Forecasts - Challenge the Baseline. The dataset from this competition comprises of Yu'e Bao user’s profiles, transaction behaviour, and financial interest rates over time, in 4 CSV tables:
Table Name | Description |
---|---|
user_balance_table.csv | 2,840,421 observations of the cash flow time-series data from 28,041 Yu’e Bao users for 14 months from 1st Jul 2013 to 31st Aug 2014. Cash flow data includes 18 variables of account balances, different types of deposits, withdrawals, interest earned and categories of purchase if funds are used to make online purchases. |
user_profile_table.csv | 28,041 rows of user profile data that describes the user’s gender, zodiac sign, and registered city, based on each user ID, in 4 columns. |
mfd_day_share_interest.csv | 427 observed dates from 1st Jul 2013 to 31st Aug 2014 and the corresponding Yu’e Bao’s daily and 7 daily interest rates. |
mfd_bank_shibor.csv | 294 observed dates from 1st Jul 2013 to 31st Aug 2014 and the corresponding 8 types of Shibor interest rates, from overnight interest rates to yearly interest rates. Although the time frame is the same as above, the number of observations is less here because there are no Shibor interest rates data for weekends and public holidays. |
Visualization and Analysis
The goal of the TIANCHI competition is to train a model to predict future cash flow of Yu’e Bao users to aid Ant Financial Services Group, Alibaba Group’s affiliate company operating Alipay, in its business of processing the cash inflow and outflow of its users. To provide an alternative view and insights to this data, our group has chosen to implement the below modules in the Shiny app:
Data Exploration and Visualization
In this module, we aim to provide an interactive data explorer to visualize the data and in different ways. We will employ different visualization techniques, eg. treemaps, heatmaps, corrplots, time-series line graphs, to demonstrate the interaction and relationships between different combination of cash flow behaviour user profile and financial data. App users will have the freedom to select the variables of their interest to dynamically generate the corresponding visualization.
Survival Analysis and Visualization
In contrast to predicting the future cash flow, we will perform survival analysis on the user cash flow data. This will give us an understanding of how soon Yu’e Bao users will withdraw they deposits upon increase their balances. The survival analysis will also be performed for individual categories of user profiles. This will allow us to compare the survival of Yu’e Bao users’ deposits between different classes, for example, between male and female users, or between Taurus and Aries. With this, we can become MythBusters to see the myth, that Taurus are better savers than Aries, is indeed true.
Performing Survival analysis....
Objective 3: Time-Series Clustering and Visualization
dtwclust time series cluster....
Challenges
Libraries
The below R libraries will be considered for the project
- shiny
- shinydashboard
- shinyWidgets
- dashboardthemes
- tidyverse
- lubridate
- ggplot2
- plotly
- lattice
- xts
- treemap
- d3treeR
- survival
- ggfortify
- survminer
- dplyr
- TSclust
- dtwclust
- cluster