Difference between revisions of "AY1516 T2 Team Hew - Prediction"

From Analytics Practicum
Jump to navigation Jump to search
Line 89: Line 89:
 
|-
 
|-
 
|  
 
|  
[[File:Passenger initial.png|center|550px]]  
+
[[File:Passenger initial.png|center|500px]]  
|| [[File:Passenger_after_log.png|center|550px]]  
+
|| [[File:Passenger_after_log.png|center|500px]]  
 
|}
 
|}
 
We can see that the Mean of 15.0673 is now approximately equal to the Median of 15.0318, indicating a Normal distribution.
 
We can see that the Mean of 15.0673 is now approximately equal to the Median of 15.0318, indicating a Normal distribution.
 
<br /><br />
 
<br /><br />
 +
 
===Multiple Linear Regression===
 
===Multiple Linear Regression===
 
We then set out to predict the Log(Claim amount) of the Passenger Car segment, using independent variables like Jap_Ind, Vehicle Age, Business_Ind, Driver Age, At_Fault, Corppers
 
We then set out to predict the Log(Claim amount) of the Passenger Car segment, using independent variables like Jap_Ind, Vehicle Age, Business_Ind, Driver Age, At_Fault, Corppers

Revision as of 11:35, 17 April 2016

Exploratory Analysis Prediction


Claim Amount Distribution Fitting

Analyze Distribution

Vaughn[1] and a number of actuaries have mentioned that Claim amounts have to factor in inflation for greater accuracy. However, as the highest inflation rate attained by Indonesia for the time period of study is about 7%, this is rather negligible. Using JMP Pro 12, we first excluded rows where Claim amount = 0 and derived the distribution statistics of:

N Min Max Median Mean Standard Deviation
49,066 2,570 3,295,056,701 4,297,418 21,090,896 90,927,485
Overall Claim amount distribution


From figure above, we can see that there are many instances of small claim amounts, with few instances of extreme values, and the distribution shape is right skewed. Similar distribution shapes for Claim amounts have also been derived from insurance companies based in other regions, as seen in figure below taken from Eling's Research[2].

Eling's Research



Fit Distribution

We then attempt to fit several distributions on the Claim amounts column, using JMP Pro’s Fit Distribution function. The most suitable distribution selected will be the one which minimizes the -2Log(Likelihood), taken to be a measure of variation or uncertainty in the sample.

Fit Distribution Results



We can see that -2Log(Likelihood) is minimized with the LogNormal distribution. According to JMP Pro documentation, maximum likelihood estimation is used in determining the parameters for the LogNormal distribution. Naturally, we can see why the LogNormal distribution derives the lowest -2Log(Likelihood) as the problem of maximizing the likelihood function is reformulated to become a minimization of the negative of the natural logarithm of the likelihood function.

We did another Goodness-of-Fit test using Kolmogrov’s D test with the null hypothesis as “H0: The data is from the LogNormal Distribution”, thus obtaining a D-statistic of 0.048569 and a p-value of 0.01. As p-values are the probability of getting an even more extreme statistic given the true value being tested is at the hypothesized value (usually at zero), a small p-value means that the statistic is unlikely to be that extreme by coincidence. In this case, the p-value of 0.01 is fairly small, indicating significance that the fitted distribution is LogNormal.

Using JMP Pro’s Diagnostic Plot function, we can visually affirm the goodness-of-fit, as seen in the figure below. The actual Claim amount is plotted against its corresponding estimated LogNormal probability on the Y-axis. We can see that most of the data points fall on the Line of Fit (red line) for Claim amounts within the mid-range, thus depicting a good fit.

Diagnostic Plot



Several other papers have adopted to fit Claim amounts with the LogNormal distribution because of its right-skewed shape[3], and this is in line with our findings. We therefore fit a LogNormal distribution to the Claim amounts, which allows us to use it for prediction or modelling purposes.

Segmentation

We hypothesized that there would be differences in claim amounts for different vehicle types, due to the varying costs of each vehicle, so we proceeded to segment the dataset by the Vehicle Type (Passenger Car, Bus, Truck, Motorcycle) and plot the Claim amount distributions for each segment:

Claim amounts for Bus & Motorcycle


Claim amounts for Passenger Car & Truck


We can see that the distribution shape for Motorcycles is different as compared to the other Vehicle Types, as about 90% of the claims were theft-related. The other Vehicle Types have a similar right-skewed distribution which we can fit a LogNormal distribution, albeit with different parameter values due to the differences in Claim amounts. Claim amount is generally higher for larger Vehicle Types.


Multiple Linear Regression

Applying Log Transformation

We first attempted a prediction of Claim amounts on the Passenger Car Segment of the dataset. A natural logarithm transformation was applied to normalize the Claim amounts as shown below:

Initial Distribution After Applying Log Transformation
Passenger initial.png
Passenger after log.png

We can see that the Mean of 15.0673 is now approximately equal to the Median of 15.0318, indicating a Normal distribution.

Multiple Linear Regression

We then set out to predict the Log(Claim amount) of the Passenger Car segment, using independent variables like Jap_Ind, Vehicle Age, Business_Ind, Driver Age, At_Fault, Corppers

Research & Methodology

Coming Soon

References

  1. Vaughn, Trent R. (1996), Simulation Models for Self-Insurance
  2. Eling, M. (2011), Fitting Insurance Claims to Skewed Distributions, Working Papers on Risk Management and Insurance, No. 98, November 2011
  3. Adeleke, Ismail A., Ibiwoye, A. (2011), Modelling claim sizes in Personal Line non-life insurance, International Business & Economics Research Journal - February 2011, Vol. 10, No. 2, pp. 21-38