APA Project Overview

From Analytics Practicum
Revision as of 15:29, 23 February 2017 by Akshitad.2013 (talk | contribs) (data update)
Jump to navigation Jump to search

APA logo.png

HOME

 

PROJECT OVERVIEW

 

PROJECT FINDINGS

 

PROJECT MANAGEMENT

 

DOCUMENTATION

 

FEATURE ENGINEERING

 

METHODOLOGY

 
Motivation And Project Overview

People Analytics has been rated as the second-biggest overall capability gap in organizations by the Deloitte university press in 20151. Through people analytics, companies are able to find better hires, improve retention, and find more suitable leaders. This has a direct impact on direction of the organization and hence its growth. Our team has a great opportunity to delve into Social Network Analysis, a fast-growing research field in Analytics through this project.
In this project, our focus is to develop various metrics that would quantify the collaboration between employees, identify the most influential employees and give managers a high-level view of these statistics to maintain a collaborative and efficient workplace. Currently at the company, these metrics are computed based on various sets of data that are primarily collected via pulse surveys. The survey data collection process is slow and makes it difficult for managers to view real-time insights. As an alternative, our team would be computing these metrics based on only email communication data. Since the data is always present in the IT system, an automated data pipeline can be created to compute the metrics and view them on a custom dashboard. We would also be involved in feature engineering to create an unbiased email network before the calculation of metrics.
A primary metric that our team would explore and test for value is a hybrid centrality to calculate an influential score. We are exploring a new equation that combines various

Objective

  1. Perform Feature Engineering to create a new ‘Trust Score’ algorithm. A trust score is an aggregate weightage shows the strength of communication tie between two employees in a social network.
  2. Develop a dashboard that displays various metrics that would quantify the collaboration between employees, identify the most influential employees and give managers a high-level view of these statistics to maintain a collaborative and efficient workplace.
  3. Research and validate the potential of a Hybrid Centrality (potentially a combination of betweeness and degree) calculated from email communication data as a measure of influence score.

Data

Before Cleaning
Our data consists of 14 columns as described below:

Column Explanations
Date Timestamp of the email
Remote IP If the email exchange is external then this column shows the external person's email
Remote The TrustSphere employee who is receiving or sending the email
Remote Domain Always TrustSphere
Local Email address of the person sending the email
Local Domain Domain of the person who is sending the email
Originator Inbound, outbound or internal (if you’re receiving the email, sending it or if the email is between 2 TrustSphere employees)
Direction Always TrustSphere in this case
Domain Group Email Header (Subject Line)
Subject Type of message: email/im (instant messaging)/voice/sms
Inbound Count Number of emails received
Outbound Count Number of emails sent
Size Size of the message (number of characters)
Msgid Encoded Message ID
Data Statistics
Number of rows 121,154
Date Range 11/26/2016 8:00 am to 02/01/2017 00:00 am


METHODOLOGY

We plan to take a social network analysis (SNA) approach to analyze the data since the goal is to analyze different attributes (preference to work in silos, importance, popularity) of the actors (employees) and the relationship between them (collaboration via email). This view of the data makes it an ideal social networks data when each email address would represent a node and every email would be the relationship between both the nodes.

SN diagram.png



There are various measures of SNA proposed over the years that help determine the role and importance of a node in the network. The following are a few examples:

• Degree centrality
• Closeness centrality
• Betweenness centrality
• Eigenvector centrality

Our first step would be to explore the network using these centralities, identifying hubs, brokers and groups as well as delving into other SNA concepts discussed by various academic researchers. We would be using softwares such as Gephi, and modelling packages from R such as weighted network packages for these analysis.

Our goal is to come up with our own hybrid centrality score along with a range of other metrics that would quantify an overall importance of each node in the network. Using the insights from step one, we will be creating multiple surveys (source of additional data) for the employees at TrustSphere to find influences (for the hybrid centrality). During the process, we will be referencing to the work of Karen Stephenson and Rob Cross, both of whom specialize in the field of organizational social networks.

In the end, along with the hybrid centrality score algorithm, we will be delivering a comprehensive dynamic dashboard visualizing the most relevant measures that we identify during our project.

SCOPE OF WORK

1. Create a hybrid centrality score as an overall comprehensive measure of the network
2. Identify Silos
3. Assess Collaboration
  a. Within departments
  b. Within different geographical regions
  c. Within projects
4. Assess Influence, Network Strength and Email collaboration
5. Develop a dynamic dashboard to visualize relevant measures
6. The Scope is fluid and will become more specific as the project progresses