Difference between revisions of "Uncovering Market-Insights for Charles & Keith: Data Preparation"
| Line 32: | Line 32: | ||
<div style="border-style: solid solid none; border-color: #35383c; border-width: 1px 1px; padding: 5px; font-size: 120%; font-weight: bold; background-color: #{{LibreOfficeColor2}}; color: #{{LibreOfficeColor3}}; border-radius: 3px 3px 0 0;">Recoding of Columns</div> | <div style="border-style: solid solid none; border-color: #35383c; border-width: 1px 1px; padding: 5px; font-size: 120%; font-weight: bold; background-color: #{{LibreOfficeColor2}}; color: #{{LibreOfficeColor3}}; border-radius: 3px 3px 0 0;">Recoding of Columns</div> | ||
<div style="border: 1px solid #35383c; padding: 15px 15px 20px; border-radius: 0 0 3px 3px;"> | <div style="border: 1px solid #35383c; padding: 15px 15px 20px; border-radius: 0 0 3px 3px;"> | ||
| + | <b>Invalid Transactions</b> | ||
| + | [[File:InvalidTransaction.png|none| ]] | ||
| + | For attribute “SaleQty”, it contains negative value from 0 to -25. Upon confirming with our sponsors, these sales quantity are actually recorded wrongly and sale have taken place. Hence, our group removed all the sales quantity that are less than 1. | ||
| + | |||
| + | |||
<b>Country</b> | <b>Country</b> | ||
| Line 79: | Line 84: | ||
<div style="border: 1px solid #35383c; padding: 15px 15px 20px; border-radius: 0 0 3px 3px;"> | <div style="border: 1px solid #35383c; padding: 15px 15px 20px; border-radius: 0 0 3px 3px;"> | ||
[[File:Final.png|none| ]] | [[File:Final.png|none| ]] | ||
| − | + | By the end of our data preparation, the dataset contains 4,238,373 rows of data. The dataset also has 19 columns instead of the original 15 columns. | |
| + | |||
</div> | </div> | ||
Revision as of 12:57, 28 February 2016
| HOME | OVERVIEW | DATA PREPARATION | ANALYSIS | PROJECT MANAGEMENT | DOCUMENTATION |
Our data set has 15 columns and 4,374,674 rows of data
Invalid Transactions
For attribute “SaleQty”, it contains negative value from 0 to -25. Upon confirming with our sponsors, these sales quantity are actually recorded wrongly and sale have taken place. Hence, our group removed all the sales quantity that are less than 1.
Country
Since the dataset is the record from China, our group has decided to remove the attribute “Country”.
TransactionId
For attribute “TransactionId”, since it is a identifier, our group changed the data type from Numeric to Character.
Date
To prepare the data correctly, the Date attribute has to be changed. Using JMP Pro, we changed the setting of Date, Data Type from “Character” to “Numeric”. We also set the date format to “m/d/y”.
Materials
In the figure below, even though Ankle Boot and ANKLEBOOT are the same name, they are classified differently. This also applies to Ballerina and BALLERINA. Hence, our group has recoded attribute “Material” into a separate column named “Material 2” to ensure that materials of the same name are being grouped together
Subclass
Besides Materials, similar recoding work was also done to attribute “Subclass”, “Class” and “Size”. For “Subclass”, the PF in PF COVERED, PF OPEN TOE and PF PEEP TOE are all referring to PLATFORM.
Hence, We replaced all PF to PLATFORM.
Class
For attribute “CLASS”, upon further investigation, our group realise that PASSPORT HOLDER and PP HOLDER are the same thing. The same could be said about SHOULDER and SHOULDER BAG as well as SLING and SLING BAG.
Hence, We recoded this names, to ensure that our analysis will be accurate in the future.
Size
For attribute “SIZE”, all the numerical values belong to Shoe sizes, while the rest refers to accessory sizes such as Necklace, Bags and Wallets etc. To prevent any confusion, our group recoded the size from “340” to “34” for all shoes sizes.
TransactionStoreID
To ensure that our market basket analysis to be accurate for the next phase of our practicum, our group has created a new variable name that is unique. The attribute “TransactionId” is not a unique identifier for each row of data because different StorName of different Region could have used the same TransactionID. Hence, our group has concatenated the StoreName and TransactionId to create a unique identifier.
By the end of our data preparation, the dataset contains 4,238,373 rows of data. The dataset also has 19 columns instead of the original 15 columns.
