Difference between revisions of "ISSS608 2017-18 T3 Assign LUO Haoran Data Preparation"

From Visual Analytics and Applications
Jump to navigation Jump to search
Line 30: Line 30:
 
==<div style="background: #ffffff; padding: 17px; line-height: 0.1em;  text-indent: 10px; font-size:17px; font-family: Helvetica;  border-left:8px solid #0091b3"><font color= #000000><strong>Data Aggregation</strong></font></div>==
 
==<div style="background: #ffffff; padding: 17px; line-height: 0.1em;  text-indent: 10px; font-size:17px; font-family: Helvetica;  border-left:8px solid #0091b3"><font color= #000000><strong>Data Aggregation</strong></font></div>==
 
<div style="margin:0px; padding: 10px; background: #f2f4f4; font-family: Open Sans, Arial, sans-serif; border-radius: 7px; text-align:left">
 
<div style="margin:0px; padding: 10px; background: #f2f4f4; font-family: Open Sans, Arial, sans-serif; border-radius: 7px; text-align:left">
<center>
+
<b>1. Add Column Name</b><br>
{| style="background-color:#ffffff ; margin: 3px 10px 3px 10px; font-size:15px" width="85%"
+
[[File:1. add column name.jpg|750px]]
|- style="background:#f2f4f4; font-size:17px"
+
*Applied the same command to 9 event data tables to add column names.
 
 
|-
 
| style="font-family:Open Sans, Arial, sans-serif; font-size:16px; text-align: center; padding:5px; border-bottom:solid #0091b3" | <font color="#3c3c3c"><strong>Method </strong>(Python) </font>
 
| style="font-family:Open Sans, Arial, sans-serif; font-size:16px; text-align: center; padding:5px; border-bottom:solid #0091b3" | <font color="#3c3c3c"><strong>Result</strong></font>
 
 
 
|-
 
| style="font-family:Open Sans, Arial, sans-serif; text-align: center; padding:3px 10px; border-bottom:solid 1px #d8d8d8" | <strong>
 
Add Column Name[[column name]]</strong>
 
| style="font-family:Open Sans, Arial, sans-serif; text-align: left; padding:3px 10px; border-bottom:solid 1px #d8d8d8" |
 
*Added column name for each of 9 data table.
 
 
*Corresponding Column Name: Source, Etype, Target, TimeStamp
 
*Corresponding Column Name: Source, Etype, Target, TimeStamp
 +
<br>
  
 
+
<b>2. Convert TimeInterval to TimeStamp</b><br>
|-
+
[[File:2. convert to time date.jpg|750px]]
| style="font-family:Open Sans, Arial, sans-serif; text-align: center; padding:3px 10px; border-bottom:solid 1px #d8d8d8" | <strong>Convert TimeInterval to TimeStamp <br />[[File:Forensic NinjaChord Diagram.PNG|300px]]</strong>
+
*Changed TimeInterval in original data tables into TimeStamp in format of dd/mm/yyyy hh:mm:ss.
| style="font-family:Open Sans, Arial, sans-serif; text-align: left; padding:3px 10px; border-bottom:solid 1px #d8d8d8" |
 
*Change TimeInterval in raw data into TimeStamp in format of dd/mm/yyyy hh:mm:ss.
 
 
*Initial time is 11/05/2015 14:00:00.
 
*Initial time is 11/05/2015 14:00:00.
 +
<br>
  
|-
+
<b>3. Save New Data Tables</b><br>
| style="font-family:Open Sans, Arial, sans-serif; text-align: center; padding:3px 10px; border-bottom:solid 1px #d8d8d8" | <strong>Save New Data Tables <br />[[File:Forensic Ninja Concept Map.png|300px]] </strong>
+
[[File:3. save new data table.jpg|750px]]
| style="font-family:Open Sans, Arial, sans-serif; text-align: left; padding:3px 10px; border-bottom:solid 1px #d8d8d8" |
+
*Saved new data tables with TimeStamp to the path.
*Save new data tables with TimeStamp into the path.
+
<br>
 
 
</center>
 
 
</div>
 
</div>

Revision as of 22:24, 7 July 2018

MC3 2018.jpg

VAST Challenge 2018 MC3:
Catch the Unsub – Who hurts Eurasian Pipit?

Overview

Data Preparation

Methodology

Insights


Raw Data Overview


Data Aggregation

1. Add Column Name
1. add column name.jpg

  • Applied the same command to 9 event data tables to add column names.
  • Corresponding Column Name: Source, Etype, Target, TimeStamp


2. Convert TimeInterval to TimeStamp
2. convert to time date.jpg

  • Changed TimeInterval in original data tables into TimeStamp in format of dd/mm/yyyy hh:mm:ss.
  • Initial time is 11/05/2015 14:00:00.


3. Save New Data Tables
3. save new data table.jpg

  • Saved new data tables with TimeStamp to the path.