Difference between revisions of "APA Project Overview"

From Analytics Practicum
Jump to navigation Jump to search
m
 
(25 intermediate revisions by 3 users not shown)
Line 5: Line 5:
 
<font face="Century Gothic">
 
<font face="Century Gothic">
 
{| style="background-color:#FFFFFF; color:#66ffcc padding: 5px 0 0 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" |
 
{| style="background-color:#FFFFFF; color:#66ffcc padding: 5px 0 0 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" |
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; border-left:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="20%" |  
+
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; border-left:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="8%" |  
 
[https://wiki.smu.edu.sg/ANLY482/ANLY482_AY2016-17_T2_Group17 <font face ="Century Gothic" color="#000000"><strong>HOME</strong></font>]
 
[https://wiki.smu.edu.sg/ANLY482/ANLY482_AY2016-17_T2_Group17 <font face ="Century Gothic" color="#000000"><strong>HOME</strong></font>]
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#FFFFFF; text-align:center;" width="20%" |   
+
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#ffffff; text-align:center;" width="15%" |   
 
[[APA_Project Overview|<font face ="Century Gothic" color="#66ffcc"><strong> PROJECT OVERVIEW</strong></font>]]
 
[[APA_Project Overview|<font face ="Century Gothic" color="#66ffcc"><strong> PROJECT OVERVIEW</strong></font>]]
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="20%" |
+
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="12%" |
[[APA_Final_Progress|<font face ="Century Gothic" color="#000000"><strong> FINAL PROGRESS</strong></font>]]
+
[[APA_Final_Progress|<font face ="Century Gothic" color="#000000"><strong> METHODOLOGY</strong></font>]]
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="20%" |
+
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="18%" |
[[APA_Project_Management|<font  face ="Century Gothic" color="#000000"><strong>PROJECT MANAGEMENT </strong></font>]]
+
[[APA_Feature Engineering|<font  face ="Century Gothic" color="#000000"><strong> FEATURE ENGINEERING</strong></font>]]
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="20%" |
+
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:4px solid #66ffcc; border-top:4px solid #66ffcc; background:#66ffcc; text-align:center;" width="18%" |
 +
[[APA_Project_Management|<font  face ="Century Gothic" color="#000000"><strong>CLASSIFICATION MODELLING </strong></font>]]
 +
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 +
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="12%" |
 
[[APA_Documentation|<font  face ="Century Gothic" color="#000000"><strong> DOCUMENTATION</strong></font>]]
 
[[APA_Documentation|<font  face ="Century Gothic" color="#000000"><strong> DOCUMENTATION</strong></font>]]
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="20%" |
+
| style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #45c198; border-top:2px solid #45c198; background:#66ffcc; text-align:center;" width="17%" |
 +
[[ANLY482_AY2016-17_Term_2|<font  face ="Century Gothic" color="#000000"><strong>OTHER PROJECTS</strong></font>]]
 +
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | &nbsp;
 +
| style="font-family:Helvetica; font-size:120%; border-bottom:4px solid #45c198; border-top:4px solid #45c198; background:#66ffcc; text-align:center;" width="20%" |
 
|}
 
|}
  
 
{|style="width:100%;vertical-align:top;margin-top:20px;"
 
{|style="width:100%;vertical-align:top;margin-top:20px;"
 
|-
 
|-
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Motivation</font></div><br/>
+
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Motivation And Project Overview</font></div><br/>
 
<p>
 
<p>
The way the employees of a company collaborate within teams and even across regions is very important to the success of a company. Thus, the business leaders are interested in keeping a check on this area of the firm and ask various questions such as:<br><br>
+
Human Resource Analytics is the idea of using data in the organizational context to understand different factors about employees such as their degree of collaboration and influence. Known researcher Rob Cross has also said “Organizational Network Analysis provides a powerful means of making invisible patterns of information flow and collaboration, visible.” These factors are generally computed based on various sets of data that are primarily collected via pulse surveys. The data collection process is slow because pulse surveys must be distributed at regular intervals to receive updated insights. However, this is not a viable option as it is not only a repetitive process but also makes it difficult for managers to view real-time insights.
• Are different geographies working well?<br>
+
<br>
• Which employees work in silos?<br>
+
This study explores and investigates whether subject lines and frequency of emails exchanged between employees can be used as a representative resource for analyzing organizational networks, specifically, the work network. We define work network as the network of employees with whom one interacts with on a daily basis for work purposes.  
• How effective are the sales people at email correspondence?<br><br>
 
Answers for such questions usually rely more on qualitative observations as not many standard metrics can be directly used to track these details. Due to its general derivation, the results are often considered unreliable and hence non-actionable. The main motivation of our project is to assist TrustSphere to derive reliable and actionable insights regarding collaboration due to our data-driven approach.
 
 
</p>
 
</p>
  
Line 38: Line 42:
 
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Objective</font></div><br/>
 
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Objective</font></div><br/>
 
<p>
 
<p>
The primary objective of our project is to use social network analysis theories to create a hybrid centrality scoring method and a comprehensive dashboard based on email correspondence data that would provide TrustSphere with direct insights on various aspects of global collaboration effectiveness.
+
The objective of this study is to understand if subject lines and frequency of emails exchanged between employees is a representative resource for analyzing organizational networks, specifically, work network.
 +
At the company, these factors are computed based on various sets of data that are primarily collected via pulse surveys. The survey data collection process is slow and makes it difficult for managers to view real-time insights. As an alternative, our team wants to check if email interactions can be used to compute these factors based on only email communication data. Through feature engineering, an unbiased email network is created which is compared against the work network derived from a survey.
 
</p>
 
</p>
  
Line 45: Line 50:
 
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Data</font></div><br/>
 
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Data</font></div><br/>
 
<p>
 
<p>
We are provided with an excel sheet containing a huge set of email exchange log via the trustsphere domain. The data provided is clean.
+
We are provided with an excel sheet containing a huge set of email exchange log via the TrustSphere domain. The data consists of 14 columns as described below:
<br><br>
+
{| class="wikitable"
[[Image:Data sample.png|800px]]
+
|+Column Explanations
<br><br>
+
|-
 +
|Date
 +
|Timestamp of the email
 +
|-
 +
|Remote IP
 +
|If the email exchange is external then this column shows the external person's email
 +
|-
 +
|Remote
 +
|The TrustSphere employee who is receiving or sending the email
 +
|-
 +
|Remote Domain
 +
|Always TrustSphere
 +
|-
 +
|Local
 +
|Email address of the person sending the email
 +
|-
 +
|Local Domain
 +
|Domain of the person who is sending the email
 +
|-
 +
|Originator
 +
|Inbound, outbound or internal (if you’re receiving the email, sending it or if the email is between 2 TrustSphere employees)
 +
|-
 +
|Direction
 +
|Always TrustSphere in this case
 +
|-
 +
|Domain Group
 +
|Email Header (Subject Line)
 +
|-
 +
|Subject
 +
|Type of message: email/im (instant messaging)/voice/sms
 +
|-
 +
|Inbound Count
 +
|Number of emails received
 +
|-
 +
|Outbound Count
 +
|Number of emails sent
 +
|-
 +
|Size
 +
|Size of the message (number of characters)
 +
|-
 +
|Msgid
 +
|Encoded Message ID
 +
|}
  
The data consists of the following attributes: <br>
+
{| class="wikitable"
&emsp; 1. <b> Date</b>: date the email was sent/received <br>
+
|+Data Statistics
&emsp; 2. <b>Originator address</b>: email address of the sender <br>
+
|-
&emsp; 3. <b>Recipient address</b>: email address of the recipient <br>
+
|'''Number of rows'''
&emsp; 4. <b>Direction</b>: <br>
+
|121,154
&emsp; &emsp; a. ‘Inbound’ – email received by an employee of TrustSphere from an external sender <br>
+
|-
&emsp; &emsp; b. ‘Outbound’ – email sent by an employee of TrustSphere to external recipient <br>
+
|'''Date Range'''
&emsp; &emsp; c. ‘Internal’ – email exchanged within TrustSphere employees <br>
+
|11/26/2016 8:00 am to 02/01/2017 00:00 am
&emsp; 5. <b>Type</b>: <br>
+
|}
&emsp; &emsp; a. ‘em’ – message sent via email <br>
+
<br>
&emsp; &emsp; b. ‘im’ – message sent via instant messaging <br>
 
&emsp; 6. <b>Size</b>: number of characters in the message <br>
 
&emsp; 7. <b>Msg ID</b>: unique ID given to every emailing chain <br>
 
&emsp; 8. <b>Email Subject</b>: subject of the email <br>
 
 
</p>
 
</p>
  
 
{|style="width:100%;vertical-align:top;margin-top:20px;"
 
{|style="width:100%;vertical-align:top;margin-top:20px;"
 
|-
 
|-
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>METHODOLOGY</font></div><br/>
+
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Literature Review</font></div><br/>
 
<p>
 
<p>
 
+
Rob Cross and Karen Stephenson have studied organizational networks for a long time, and their findings and theories are essential to the objective of this study. Their discoveries are important to evaluate the patterns and outcomes found from this study of organizational email data networks.
We plan to take a social network analysis (SNA) approach to analyze the data since the goal is to analyze different attributes (preference to work in silos, importance, popularity) of the actors (employees) and the relationship between them (collaboration via email). This view of the data makes it an ideal social networks data when each email address would represent a node and every email would be the relationship between both the nodes.
+
<br><br>
 +
Rob Cross has done extensive work on organizational network analysis looking for methods to improve collaboration between company units and find ways to break silos. Cross (2004) states – “Organizational Network Analysis (ONA) can provide an x-ray into the inner workings of an organization – a powerful means of making invisible patterns of information flow and collaboration in strategically important groups visible.
 
<br><br>
 
<br><br>
<center>
+
According to Cross’s (2000) research, the level of collaboration can impact employee stress, the distribution of collaborative work within teams and more. He found that employees who are willing to help beyond their scope, gradually develop a resourceful reputation, and hence are included into projects of higher impact. However, Cross said, such employees eventually become bottlenecks as other employees become over-reliant and have no substantial progress without the facilitation of that one employee, or because that employee is overloaded with work and is unable to deliver equivalently.  
[[Image:SN diagram.png|300px]]
 
</center>
 
 
<br><br>
 
<br><br>
There are various measures of SNA proposed over the years that help determine the role and importance of a node in the network. The following are a few examples: <br><br>
+
Karen Stephenson, also known as “The Organization Woman”, recognized six main types of knowledge network in an organization –
• Degree centrality <br>
+
<ul><li>Daily network: whom we see day-to-day</li>
• Closeness centrality <br>
+
<li>Wider social network: whom we actively stay in touch with</li>
• Betweenness centrality <br>
+
<li>Innovation network: with whom we test out new ideas</li>
• Eigenvector centrality<br>
+
<li>Expert network: to whom we go for expertise and knowledge</li>
 +
<li>Strategic network: to whom we go for guidance and advice</li>
 +
<li>Learning network: who help us move from what we know to new knowledge and expertise </li></ul>
 
<br>
 
<br>
Our first step would be to explore the network using these centralities, identifying hubs, brokers and groups as well as delving into other SNA concepts discussed by various academic researchers. We would be using softwares such as UCINET and NETDRAW for these analysis.<br><br>
+
Her famous book - Quantum Theory of Trust (2006) – shows that manipulating networks of trust can control the flow of information in an organization due to the link between networks of trust and tacit knowledge. Her research aimed at observing communication patterns, identifying bottlenecks and silos and understanding team dysfunctions.  
Our goal is to come up with our own hybrid centrality score that would quantify an overall importance of each node in the network. Using the insights from step one, we will be creating multiple surveys (source of additional data) for the employees at TrustSphere to find influences (for the hybrid centrality). During the process, we will be referencing to the work of Karen Stephenson and Rob Cross, both of whom specialize in the field of organizational social networks.<br><br>
+
<br>
In the end, along with the hybrid centrality score algorithm, we will be delivering a comprehensive dynamic dashboard visualizing the most relevant measures that we identify during our project. <br>
+
<br>
 +
This study involves term analysis of employee email subject lines, which can be considered as short documents of text. A relevant paper by Mika Timonen (2013) on term weighting in short documents contains a variety of methods to determine the importance of terms and extracting keywords from a document. The most appropriate and relevant method to use for our study for term weighting is inverse document frequency (IDF).
 
</p>
 
</p>
  
 
{|style="width:100%;vertical-align:top;margin-top:20px;"
 
{|style="width:100%;vertical-align:top;margin-top:20px;"
 
|-
 
|-
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>SCOPE OF WORK</font></div><br/>
+
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Methodology</font></div><br/>
 +
 
 
<p>
 
<p>
1. Create a hybrid centrality score as an overall comprehensive measure of the network <br>
+
<center>
2. Identify Silos<br>
+
Click on [[APA_Final_Progress|<font face ="Century Gothic" color="#00C5CD"><strong><i>METHODOLOGY</i></strong></font>]] for more details.<br><br>
3. Assess Collaboration<br>
+
[[File:MethodNew.jpg|800px]]
&emsp; a. Within departments<br>
+
</center>
&emsp; b. Within different geographical regions<br>
 
&emsp; c. Within projects<br>
 
4. Develop a dynamic dashboard to visualize relevant measures<br>
 
5. The Scope is fluid and will become more specific as the project progresses <br>
 
 
</p>
 
</p>
 +
 +
{|style="width:100%;vertical-align:top;margin-top:20px;"
 +
|-
 +
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Conclusion</font></div><br/>
 +
 +
Email data is not a strong representative for Work Network when divided into multiple relationship strength segments. However, it is a good representation of Work Network when divided into only two relationship strength segments.
 +
By just using email data to predict work relation strengths, companies can save large amounts of time, manpower and money spent on survey analysis to retrieve similar data. Further, it is possible to update the analysis is real time by changing the dates of the email data.
 +
<br>
 +
 +
{|style="width:100%;vertical-align:top;margin-top:20px;"
 +
|-
 +
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Limitation</font></div><br/>
 +
 +
The whole analysis has been done on email subject lines and distribution of the emails. However, the highest quality of information is present in the body of the emails. We didn’t have access to the email bodies which is the biggest limitation of the study. Future work should focus on deeper text mining on the email body to quantify a more accurate representation of work related emails. This could play a huge factor in differentiating work relationships between any two employees.

Latest revision as of 23:27, 23 April 2017

APA logo.png

HOME

 

PROJECT OVERVIEW

 

METHODOLOGY

 

FEATURE ENGINEERING

 

CLASSIFICATION MODELLING

 

DOCUMENTATION

 

OTHER PROJECTS

 
Motivation And Project Overview

Human Resource Analytics is the idea of using data in the organizational context to understand different factors about employees such as their degree of collaboration and influence. Known researcher Rob Cross has also said “Organizational Network Analysis provides a powerful means of making invisible patterns of information flow and collaboration, visible.” These factors are generally computed based on various sets of data that are primarily collected via pulse surveys. The data collection process is slow because pulse surveys must be distributed at regular intervals to receive updated insights. However, this is not a viable option as it is not only a repetitive process but also makes it difficult for managers to view real-time insights.
This study explores and investigates whether subject lines and frequency of emails exchanged between employees can be used as a representative resource for analyzing organizational networks, specifically, the work network. We define work network as the network of employees with whom one interacts with on a daily basis for work purposes.

Objective

The objective of this study is to understand if subject lines and frequency of emails exchanged between employees is a representative resource for analyzing organizational networks, specifically, work network. At the company, these factors are computed based on various sets of data that are primarily collected via pulse surveys. The survey data collection process is slow and makes it difficult for managers to view real-time insights. As an alternative, our team wants to check if email interactions can be used to compute these factors based on only email communication data. Through feature engineering, an unbiased email network is created which is compared against the work network derived from a survey.

Data

We are provided with an excel sheet containing a huge set of email exchange log via the TrustSphere domain. The data consists of 14 columns as described below:

Column Explanations
Date Timestamp of the email
Remote IP If the email exchange is external then this column shows the external person's email
Remote The TrustSphere employee who is receiving or sending the email
Remote Domain Always TrustSphere
Local Email address of the person sending the email
Local Domain Domain of the person who is sending the email
Originator Inbound, outbound or internal (if you’re receiving the email, sending it or if the email is between 2 TrustSphere employees)
Direction Always TrustSphere in this case
Domain Group Email Header (Subject Line)
Subject Type of message: email/im (instant messaging)/voice/sms
Inbound Count Number of emails received
Outbound Count Number of emails sent
Size Size of the message (number of characters)
Msgid Encoded Message ID
Data Statistics
Number of rows 121,154
Date Range 11/26/2016 8:00 am to 02/01/2017 00:00 am


Literature Review

Rob Cross and Karen Stephenson have studied organizational networks for a long time, and their findings and theories are essential to the objective of this study. Their discoveries are important to evaluate the patterns and outcomes found from this study of organizational email data networks.

Rob Cross has done extensive work on organizational network analysis looking for methods to improve collaboration between company units and find ways to break silos. Cross (2004) states – “Organizational Network Analysis (ONA) can provide an x-ray into the inner workings of an organization – a powerful means of making invisible patterns of information flow and collaboration in strategically important groups visible.”

According to Cross’s (2000) research, the level of collaboration can impact employee stress, the distribution of collaborative work within teams and more. He found that employees who are willing to help beyond their scope, gradually develop a resourceful reputation, and hence are included into projects of higher impact. However, Cross said, such employees eventually become bottlenecks as other employees become over-reliant and have no substantial progress without the facilitation of that one employee, or because that employee is overloaded with work and is unable to deliver equivalently.

Karen Stephenson, also known as “The Organization Woman”, recognized six main types of knowledge network in an organization –

  • Daily network: whom we see day-to-day
  • Wider social network: whom we actively stay in touch with
  • Innovation network: with whom we test out new ideas
  • Expert network: to whom we go for expertise and knowledge
  • Strategic network: to whom we go for guidance and advice
  • Learning network: who help us move from what we know to new knowledge and expertise


Her famous book - Quantum Theory of Trust (2006) – shows that manipulating networks of trust can control the flow of information in an organization due to the link between networks of trust and tacit knowledge. Her research aimed at observing communication patterns, identifying bottlenecks and silos and understanding team dysfunctions.

This study involves term analysis of employee email subject lines, which can be considered as short documents of text. A relevant paper by Mika Timonen (2013) on term weighting in short documents contains a variety of methods to determine the importance of terms and extracting keywords from a document. The most appropriate and relevant method to use for our study for term weighting is inverse document frequency (IDF).

Methodology

Click on METHODOLOGY for more details.

MethodNew.jpg

Conclusion

Email data is not a strong representative for Work Network when divided into multiple relationship strength segments. However, it is a good representation of Work Network when divided into only two relationship strength segments. By just using email data to predict work relation strengths, companies can save large amounts of time, manpower and money spent on survey analysis to retrieve similar data. Further, it is possible to update the analysis is real time by changing the dates of the email data.

Limitation

The whole analysis has been done on email subject lines and distribution of the emails. However, the highest quality of information is present in the body of the emails. We didn’t have access to the email bodies which is the biggest limitation of the study. Future work should focus on deeper text mining on the email body to quantify a more accurate representation of work related emails. This could play a huge factor in differentiating work relationships between any two employees.