Difference between revisions of "APA Project Overview"

From Analytics Practicum
Jump to navigation Jump to search
 
(10 intermediate revisions by 2 users not shown)
Line 5: Line 5:
 
<font face="Century Gothic">
 
<font face="Century Gothic">
 
{| style="background-color:#FFFFFF; color:#66ffcc padding: 5px 0 0 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" |
 
{| style="background-color:#FFFFFF; color:#66ffcc padding: 5px 0 0 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" |
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; border-left:2px solid #66ffcc; background:#FFFFFF; text-align:center;" width="8%" |  
+
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; border-left:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="8%" |  
[https://wiki.smu.edu.sg/ANLY482/ANLY482_AY2016-17_T2_Group17 <font face ="Century Gothic" color="#66ffcc"><strong>HOME</strong></font>]
+
[https://wiki.smu.edu.sg/ANLY482/ANLY482_AY2016-17_T2_Group17 <font face ="Century Gothic" color="#000000"><strong>HOME</strong></font>]
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="15%" |   
+
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#ffffff; text-align:center;" width="15%" |   
[[APA_Project Overview|<font face ="Century Gothic" color="#000000"><strong> PROJECT OVERVIEW</strong></font>]]
+
[[APA_Project Overview|<font face ="Century Gothic" color="#66ffcc"><strong> PROJECT OVERVIEW</strong></font>]]
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="12%" |
 
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="12%" |
Line 15: Line 15:
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="18%" |
 
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="18%" |
[[APA_Project_Management|<font  face ="Century Gothic" color="#000000"><strong>PROJECT MANAGEMENT </strong></font>]]
+
[[APA_Feature Engineering|<font  face ="Century Gothic" color="#000000"><strong> FEATURE ENGINEERING</strong></font>]]
 +
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 +
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:4px solid #66ffcc; border-top:4px solid #66ffcc; background:#66ffcc; text-align:center;" width="18%" |
 +
[[APA_Project_Management|<font  face ="Century Gothic" color="#000000"><strong>CLASSIFICATION MODELLING </strong></font>]]
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="12%" |
 
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="12%" |
 
[[APA_Documentation|<font  face ="Century Gothic" color="#000000"><strong> DOCUMENTATION</strong></font>]]
 
[[APA_Documentation|<font  face ="Century Gothic" color="#000000"><strong> DOCUMENTATION</strong></font>]]
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="17%" |
+
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #45c198; border-top:2px solid #45c198; background:#66ffcc; text-align:center;" width="17%" |
[[APA_Feature Engineering|<font  face ="Century Gothic" color="#000000"><strong> FEATURE ENGINEERING</strong></font>]]
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:4px solid #45c198; border-top:4px solid #45c198; background:#66ffcc; text-align:center;" width="18%" |
 
 
[[ANLY482_AY2016-17_Term_2|<font  face ="Century Gothic" color="#000000"><strong>OTHER PROJECTS</strong></font>]]
 
[[ANLY482_AY2016-17_Term_2|<font  face ="Century Gothic" color="#000000"><strong>OTHER PROJECTS</strong></font>]]
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="font-family:Helvetica; font-size:120%; border-bottom:4px solid #45c198; border-top:4px solid #45c198; background:#66ffcc; text-align:center;" width="20%" |
 
| style="font-family:Helvetica; font-size:120%; border-bottom:4px solid #45c198; border-top:4px solid #45c198; background:#66ffcc; text-align:center;" width="20%" |
 
|}
 
|}
 +
 
{|style="width:100%;vertical-align:top;margin-top:20px;"
 
{|style="width:100%;vertical-align:top;margin-top:20px;"
 
|-
 
|-
 
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Motivation And Project Overview</font></div><br/>
 
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Motivation And Project Overview</font></div><br/>
 
<p>
 
<p>
People Analytics has been rated as the second-biggest overall capability gap in organizations by the Deloitte university press in 20151. Through people analytics, companies are able to find better hires, improve retention, and find more suitable leaders. This has a direct impact on direction of the organization and hence its growth. Our team has a great opportunity to delve into Social Network Analysis, a fast-growing research field in Analytics through this project.
+
Human Resource Analytics is the idea of using data in the organizational context to understand different factors about employees such as their degree of collaboration and influence. Known researcher Rob Cross has also said “Organizational Network Analysis provides a powerful means of making invisible patterns of information flow and collaboration, visible.” These factors are generally computed based on various sets of data that are primarily collected via pulse surveys. The data collection process is slow because pulse surveys must be distributed at regular intervals to receive updated insights. However, this is not a viable option as it is not only a repetitive process but also makes it difficult for managers to view real-time insights.  
<br>
 
In this project, our focus is to develop various metrics that would quantify the collaboration between employees, identify the most influential employees and give managers a high-level view of these statistics to maintain a collaborative and efficient workplace. Currently at the company, these metrics are computed based on various sets of data that are primarily collected via pulse surveys. The survey data collection process is slow and makes it difficult for managers to view real-time insights. As an alternative, our team would be computing these metrics based on only email communication data. Since the data is always present in the IT system, an automated data pipeline can be created to compute the metrics and view them on a custom dashboard. We would also be involved in feature engineering to create an unbiased email network before the calculation of metrics.
 
 
<br>
 
<br>
A primary metric that our team would explore and test for value is a hybrid centrality to calculate an influential score. We are exploring a new equation that combines various
+
This study explores and investigates whether subject lines and frequency of emails exchanged between employees can be used as a representative resource for analyzing organizational networks, specifically, the work network. We define work network as the network of employees with whom one interacts with on a daily basis for work purposes.
 
</p>
 
</p>
  
Line 43: Line 42:
 
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Objective</font></div><br/>
 
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Objective</font></div><br/>
 
<p>
 
<p>
<ol>
+
The objective of this study is to understand if subject lines and frequency of emails exchanged between employees is a representative resource for analyzing organizational networks, specifically, work network.
<li>Perform Feature Engineering to create a new ‘Trust Score’ algorithm. A trust score is an aggregate weightage shows the strength of communication tie between two employees in a social network.</li>
+
At the company, these factors are computed based on various sets of data that are primarily collected via pulse surveys. The survey data collection process is slow and makes it difficult for managers to view real-time insights. As an alternative, our team wants to check if email interactions can be used to compute these factors based on only email communication data. Through feature engineering, an unbiased email network is created which is compared against the work network derived from a survey.
<li>Develop a dashboard that displays various metrics that would quantify the collaboration between employees, identify the most influential employees and give managers a high-level view of these statistics to maintain a collaborative and efficient workplace.</li>
 
<li>Research and validate the potential of a Hybrid Centrality (potentially a combination of betweeness and degree) calculated from email communication data as a measure of influence score.</li></ol>
 
 
</p>
 
</p>
  
Line 114: Line 111:
 
{|style="width:100%;vertical-align:top;margin-top:20px;"
 
{|style="width:100%;vertical-align:top;margin-top:20px;"
 
|-
 
|-
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>METHODOLOGY</font></div><br/>
+
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Literature Review</font></div><br/>
 +
<p>
 +
Rob Cross and Karen Stephenson have studied organizational networks for a long time, and their findings and theories are essential to the objective of this study. Their discoveries are important to evaluate the patterns and outcomes found from this study of organizational email data networks.
 +
<br><br>
 +
Rob Cross has done extensive work on organizational network analysis looking for methods to improve collaboration between company units and find ways to break silos. Cross (2004) states – “Organizational Network Analysis (ONA) can provide an x-ray into the inner workings of an organization – a powerful means of making invisible patterns of information flow and collaboration in strategically important groups visible.”
 +
<br><br>
 +
According to Cross’s (2000) research, the level of collaboration can impact employee stress, the distribution of collaborative work within teams and more. He found that employees who are willing to help beyond their scope, gradually develop a resourceful reputation, and hence are included into projects of higher impact. However, Cross said, such employees eventually become bottlenecks as other employees become over-reliant and have no substantial progress without the facilitation of that one employee, or because that employee is overloaded with work and is unable to deliver equivalently.
 +
<br><br>
 +
Karen Stephenson, also known as “The Organization Woman”, recognized six main types of knowledge network in an organization –
 +
<ul><li>Daily network: whom we see day-to-day</li>
 +
<li>Wider social network: whom we actively stay in touch with</li>
 +
<li>Innovation network: with whom we test out new ideas</li>
 +
<li>Expert network: to whom we go for expertise and knowledge</li>
 +
<li>Strategic network: to whom we go for guidance and advice</li>
 +
<li>Learning network: who help us move from what we know to new knowledge and expertise </li></ul>
 +
<br>
 +
Her famous book - Quantum Theory of Trust (2006) – shows that manipulating networks of trust can control the flow of information in an organization due to the link between networks of trust and tacit knowledge. Her research aimed at observing communication patterns, identifying bottlenecks and silos and understanding team dysfunctions.
 +
<br>
 +
<br>
 +
This study involves term analysis of employee email subject lines, which can be considered as short documents of text. A relevant paper by Mika Timonen (2013) on term weighting in short documents contains a variety of methods to determine the importance of terms and extracting keywords from a document. The most appropriate and relevant method to use for our study for term weighting is inverse document frequency (IDF).
 +
</p>
 +
 
 +
{|style="width:100%;vertical-align:top;margin-top:20px;"
 +
|-
 +
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Methodology</font></div><br/>
 +
 
 
<p>
 
<p>
 
<center>
 
<center>
[[File:Method1.JPG|800px]]
+
Click on [[APA_Final_Progress|<font face ="Century Gothic" color="#00C5CD"><strong><i>METHODOLOGY</i></strong></font>]] for more details.<br><br>
 +
[[File:MethodNew.jpg|800px]]
 
</center>
 
</center>
 
</p>
 
</p>
 +
 +
{|style="width:100%;vertical-align:top;margin-top:20px;"
 +
|-
 +
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Conclusion</font></div><br/>
 +
 +
Email data is not a strong representative for Work Network when divided into multiple relationship strength segments. However, it is a good representation of Work Network when divided into only two relationship strength segments.
 +
By just using email data to predict work relation strengths, companies can save large amounts of time, manpower and money spent on survey analysis to retrieve similar data. Further, it is possible to update the analysis is real time by changing the dates of the email data.
 +
<br>
 +
 +
{|style="width:100%;vertical-align:top;margin-top:20px;"
 +
|-
 +
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Limitation</font></div><br/>
 +
 +
The whole analysis has been done on email subject lines and distribution of the emails. However, the highest quality of information is present in the body of the emails. We didn’t have access to the email bodies which is the biggest limitation of the study. Future work should focus on deeper text mining on the email body to quantify a more accurate representation of work related emails. This could play a huge factor in differentiating work relationships between any two employees.

Latest revision as of 23:27, 23 April 2017

APA logo.png

HOME

 

PROJECT OVERVIEW

 

METHODOLOGY

 

FEATURE ENGINEERING

 

CLASSIFICATION MODELLING

 

DOCUMENTATION

 

OTHER PROJECTS

 
Motivation And Project Overview

Human Resource Analytics is the idea of using data in the organizational context to understand different factors about employees such as their degree of collaboration and influence. Known researcher Rob Cross has also said “Organizational Network Analysis provides a powerful means of making invisible patterns of information flow and collaboration, visible.” These factors are generally computed based on various sets of data that are primarily collected via pulse surveys. The data collection process is slow because pulse surveys must be distributed at regular intervals to receive updated insights. However, this is not a viable option as it is not only a repetitive process but also makes it difficult for managers to view real-time insights.
This study explores and investigates whether subject lines and frequency of emails exchanged between employees can be used as a representative resource for analyzing organizational networks, specifically, the work network. We define work network as the network of employees with whom one interacts with on a daily basis for work purposes.

Objective

The objective of this study is to understand if subject lines and frequency of emails exchanged between employees is a representative resource for analyzing organizational networks, specifically, work network. At the company, these factors are computed based on various sets of data that are primarily collected via pulse surveys. The survey data collection process is slow and makes it difficult for managers to view real-time insights. As an alternative, our team wants to check if email interactions can be used to compute these factors based on only email communication data. Through feature engineering, an unbiased email network is created which is compared against the work network derived from a survey.

Data

We are provided with an excel sheet containing a huge set of email exchange log via the TrustSphere domain. The data consists of 14 columns as described below:

Column Explanations
Date Timestamp of the email
Remote IP If the email exchange is external then this column shows the external person's email
Remote The TrustSphere employee who is receiving or sending the email
Remote Domain Always TrustSphere
Local Email address of the person sending the email
Local Domain Domain of the person who is sending the email
Originator Inbound, outbound or internal (if you’re receiving the email, sending it or if the email is between 2 TrustSphere employees)
Direction Always TrustSphere in this case
Domain Group Email Header (Subject Line)
Subject Type of message: email/im (instant messaging)/voice/sms
Inbound Count Number of emails received
Outbound Count Number of emails sent
Size Size of the message (number of characters)
Msgid Encoded Message ID
Data Statistics
Number of rows 121,154
Date Range 11/26/2016 8:00 am to 02/01/2017 00:00 am


Literature Review

Rob Cross and Karen Stephenson have studied organizational networks for a long time, and their findings and theories are essential to the objective of this study. Their discoveries are important to evaluate the patterns and outcomes found from this study of organizational email data networks.

Rob Cross has done extensive work on organizational network analysis looking for methods to improve collaboration between company units and find ways to break silos. Cross (2004) states – “Organizational Network Analysis (ONA) can provide an x-ray into the inner workings of an organization – a powerful means of making invisible patterns of information flow and collaboration in strategically important groups visible.”

According to Cross’s (2000) research, the level of collaboration can impact employee stress, the distribution of collaborative work within teams and more. He found that employees who are willing to help beyond their scope, gradually develop a resourceful reputation, and hence are included into projects of higher impact. However, Cross said, such employees eventually become bottlenecks as other employees become over-reliant and have no substantial progress without the facilitation of that one employee, or because that employee is overloaded with work and is unable to deliver equivalently.

Karen Stephenson, also known as “The Organization Woman”, recognized six main types of knowledge network in an organization –

  • Daily network: whom we see day-to-day
  • Wider social network: whom we actively stay in touch with
  • Innovation network: with whom we test out new ideas
  • Expert network: to whom we go for expertise and knowledge
  • Strategic network: to whom we go for guidance and advice
  • Learning network: who help us move from what we know to new knowledge and expertise


Her famous book - Quantum Theory of Trust (2006) – shows that manipulating networks of trust can control the flow of information in an organization due to the link between networks of trust and tacit knowledge. Her research aimed at observing communication patterns, identifying bottlenecks and silos and understanding team dysfunctions.

This study involves term analysis of employee email subject lines, which can be considered as short documents of text. A relevant paper by Mika Timonen (2013) on term weighting in short documents contains a variety of methods to determine the importance of terms and extracting keywords from a document. The most appropriate and relevant method to use for our study for term weighting is inverse document frequency (IDF).

Methodology

Click on METHODOLOGY for more details.

MethodNew.jpg

Conclusion

Email data is not a strong representative for Work Network when divided into multiple relationship strength segments. However, it is a good representation of Work Network when divided into only two relationship strength segments. By just using email data to predict work relation strengths, companies can save large amounts of time, manpower and money spent on survey analysis to retrieve similar data. Further, it is possible to update the analysis is real time by changing the dates of the email data.

Limitation

The whole analysis has been done on email subject lines and distribution of the emails. However, the highest quality of information is present in the body of the emails. We didn’t have access to the email bodies which is the biggest limitation of the study. Future work should focus on deeper text mining on the email body to quantify a more accurate representation of work related emails. This could play a huge factor in differentiating work relationships between any two employees.