View source for ANLY482 AY2017-18T2 Group31 Project Data

__NOEDITSECTION__
<div align="center">
[[File:bannernew.png|500px]]
<!--Header Start-->
{|style="background-color:#FFA500; color: #F5F5F5; padding: 10 0 10 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" |
| style="padding:0.3em; font-size:100%; background-color:#FF8C00; text-align:center; color: #F5F5F5" width="10%" |
[[ANLY482 AY2017-18 T2 Group 31| 
<font color="#F5F5F5" size=2><b>HOME</b></font>]]

| style="background:none;" width="1%" | &nbsp;
| style="padding:0.3em; font-size:100%; background-color:#FF8C00; text-align:center; color:#F5F5F5" width="10%" | 
[[ANLY482_AY2017-18_T2_Group_31 About Us|
<font color="#F5F5F5" size=2><b>ABOUT US</b></font>]]

| style="background:none;" width="1%" | &nbsp;
| style="padding:0.3em; font-size:100%; background-color:#FF8C00; text-align:center; color:#F5F5F5" width="10%" | 
[[ANLY482_AY2017-18_T2_Group_31 Project Overview|
<font color="#F5F5F5" size=2><b>PROJECT OVERVIEW</b></font>]]

| style="background:none;" width="1%" | &nbsp;
| style="padding:0.3em; font-size:100%; background-color:#ececec; text-align:center; color:#F5F5F5" width="10%" | 
[[ANLY482_AY2017-18_T2_Group_31 Project Analysis|
<font color="#000000" size=2><b>PROJECT ANALYSIS</b></font>]]

| style="background:none;" width="1%" | &nbsp;
| style="padding:0.3em; font-size:100%; background-color:#FF8C00; text-align:center; color:#F5F5F5" width="10%" | 
[[ANLY482 AY2017-18 T2 Group 31 Project Management|
<font color="#F5F5F5" size=2><b>PROJECT MANAGEMENT</b></font>]]

| style="background:none;" width="1%" | &nbsp;
| style="padding:0.3em; font-size:100%; background-color:#FF8C00; text-align:center; color:#F5F5F5" width="10%" | 
[[ANLY482_AY2017-18_Term_2|
<font color="#F5F5F5" size=2><b>ANLY482 HOMEPAGE</b></font>]]
|} 
<!--Header End-->

<!------- Secondary Navigation Bar---->
<center>
{| style="background-color:#ffffff ; margin: 3px 10px 3px 10px;" width="80%"|
| style="font-family:Century Gothic, Open Sans, Arial, sans-serif; font-size:15px; text-align: center; border:solid 2px #FF8C00; border-radius: 10px; background-color: #fff" width="250px" |  
[[ANLY482_AY2017-18T2_Group31_Project_Data|<font color="#3c3c3c"><strong>Data</strong></font>]]
| style="font-family:Century Gothic, Open Sans, Arial, sans-serif; font-size:15px; text-align: center; border:solid 1px #FF8C00; border-radius: 10px; background-color: #fff" width="250px" |  
[[ANLY482_AY2017-18_T2_Group_31 Project Analysis|<font color="#3c3c3c"><strong>Exploratory Data Analysis</strong></font>]]
| style="font-family:Century Gothic, Open Sans, Arial, sans-serif; font-size:15px; text-align: center; border:solid 1px #FF8C00; border-radius: 10px; background-color: #fff" width="250px" |  
[[ANLY482_AY2017-18_T2_Group_31 Model Building|<font color="#3c3c3c"><strong>Model Building</strong></font>]]
| style="font-family:Century Gothic, Open Sans, Arial, sans-serif; font-size:15px; text-align: center; border:solid 1px #FF8C00; border-radius: 10px; background-color: #fff" width="250px" |  
[[ANLY482_AY2017-18_T2_Group_31 Main Findings and Analysis|<font color="#3c3c3c"><strong>Main Findings and Analysis</strong></font>]]
| style="font-family:Century Gothic, Open Sans, Arial, sans-serif; font-size:15px; text-align: center; border:solid 1px #FF8C00; border-radius: 10px; background-color: #fff" width="250px" |  
[[ANLY482_AY2017-18T2_Group31_Project_Recommendation|<font color="#3c3c3c"><strong>Recommendation</strong></font>]]
|}
</center>
<!------- End of Secondary Navigation Bar---->

==<div style="background: #FF8C00; line-height: 0.3em; font-family:helvetica;  border-left: #FFA500 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#F2F1EF"><strong>Data Quality Analysis</strong></font></div></div>==
<div style="margin:20px; padding: 10px; background: #ffffff; text-align:left; font-size: 95%;-webkit-border-radius: 15px;-webkit-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96); -moz-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);">
<p></p>
Data quality analysis highlights the following issues present in the dataset provided: <br><br>

<b>Inconsistent Reporting</b><br>
In the data, we observed that the data were not consistent when they are reported. We have observed some records that are repeated, which have same location, same reported time and same date. The only difference is CODE column. Another reporting behavior was identified. In this case, a record represents more than one bikes found in the location. Inconsistent reporting can be a limitation in the analysis as certain individual records might potentially carry more weight due to the presence of more bikes found, but overlooked because they only exist in one record. In our analysis, all records are treated evenly. <br><br>

<b>Ambiguous and Meaningless data </b><br>
Among the records of data provided, there was a significant number of data that did not value add to our analysis at this stage. Such cases of ambiguous data found accounts for 5.3% of total data. 
As more data are collected in the future, such data will not be meaningful to oBike to conduct further analysis, and also it will not aid the removal and clearance of indiscriminately parked bikes. <br><br>

<b>Too little data</b><br>
In total, we only have 3014 rows of data over a period of less than 3 months. The date also only ranges from 18 November 2017 to 2 January 2018, where we only have December 2017 with a whole month worth of data. This prevents us on comparing data between months. In addition, the analysis might be skewed as it contributed more from data points for December.<br><br>

<b>Short forms</b> <br>
Certain addresses are given in short forms and this made it hard for us to interpret the address of the reports and hard to be read by GeoCode. Although this is not a big issue, it creates confusions for us who are not familiar with these short forms. <br><br>

<b>Lack of unique identifier</b><br><br>

<b>Unsuitable Time Format </b><br>
oBike records time in the format hhmm using a general numeric data type. Also, bikes that were relocated after the day of report (for eg relocated on 25 Nov 17 although reported on 24 Nov 17), oBike uses the general format of hhmm(dd/mm). These two factors makes it hard for us to make better use of the data.<br><br>
</div>

==<div style="background: #FF8C00; line-height: 0.3em; font-family:helvetica;  border-left: #FFA500 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#F2F1EF"><strong>Data Preparation</strong></font></div></div>==
<div style="margin:20px; padding: 10px; background: #ffffff; text-align:left; font-size: 95%;-webkit-border-radius: 15px;-webkit-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96); -moz-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);">
<p></p>
The following data preparation efforts were done: <br><br>
<b>Location - Added Category, Street, Other details</b><br>
We categorised the data into different groups based on their location. The categories are of below:<br>
HDB, BUS STOP, MRT STATION, LANDED, PARKS & RESERVOIR, CONDO, COMMERCIAL, MALL, HOSPITAL, SCHOOL, COMMUNITY CENTRE<br>
There are also features to give information for street name and descriptions of the location. STREET and OTHER DETAILS were created, where we sieve out information from raw location given, and state them accordingly in the new features.<br><br>

<b>Location - Excel GeoCode</b><br>
We make use of World Geodetic System (WGS84), a reference coordinate system that is used by the Global Positioning System (GPS) to obtain the latitude and longitude coordinates, using Excel VBA and Google Maps Geocoding API to convert the street address into latitude and longitude which can be positioned onto a map.<br><br>

<b>Day of the week</b><br>
Used JMP to create a new column which will generate number from 1 - 7 each representing a day of the week. The values were then recoded to words to make it easier to understand. 1 being Sunday, and 7 being Saturday. <br><br>

<b>Reporting Time Period</b><br>
Used a nested IF formula in JMP Pro, we created a new column to aggregate the timing into 4 groups as follows: <br>
Time between 6AM - 12PM is regarded as Morning. <br>
12PM to 3PM is Noon. <br>
3PM to 7PM is Evening. <br>
7PM to 6AM is Night. <br>

==<div align="center"><div style="background: #FF8C00; line-height: 0.3em; font-family:helvetica;  border-left: #FFA500 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#F2F1EF"><strong>Data Quality Recommendation</strong></font></div></div>==
<div style="margin:20px; padding: 10px; background: #ffffff; text-align:left; font-size: 95%;-webkit-border-radius: 15px;-webkit-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96); -moz-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);">
<p></p>
<div align="center">
[[File:Screen Shot 2018-02-28 at 8.43.57 PM.png|500px]] [[File:Screen Shot 2018-02-28 at 8.42.41 PM.png|500px]]
[[File:Screen Shot 2018-02-28 at 8.43.45 PM.png|500px]]
</div>