Difference between revisions of "APA Project Overview"
Aayushg.2013 (talk | contribs) |
|||
(24 intermediate revisions by 3 users not shown) | |||
Line 5: | Line 5: | ||
<font face="Century Gothic"> | <font face="Century Gothic"> | ||
{| style="background-color:#FFFFFF; color:#66ffcc padding: 5px 0 0 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" | | {| style="background-color:#FFFFFF; color:#66ffcc padding: 5px 0 0 0;" width="100%" cellspacing="0" cellpadding="0" valign="top" border="0" | | ||
− | | style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; border-left:2px solid #66ffcc; background:#66ffcc; text-align:center;" width=" | + | | style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; border-left:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="8%" | |
[https://wiki.smu.edu.sg/ANLY482/ANLY482_AY2016-17_T2_Group17 <font face ="Century Gothic" color="#000000"><strong>HOME</strong></font>] | [https://wiki.smu.edu.sg/ANLY482/ANLY482_AY2016-17_T2_Group17 <font face ="Century Gothic" color="#000000"><strong>HOME</strong></font>] | ||
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | | | style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | | ||
− | | style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:# | + | | style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#ffffff; text-align:center;" width="15%" | |
[[APA_Project Overview|<font face ="Century Gothic" color="#66ffcc"><strong> PROJECT OVERVIEW</strong></font>]] | [[APA_Project Overview|<font face ="Century Gothic" color="#66ffcc"><strong> PROJECT OVERVIEW</strong></font>]] | ||
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | | | style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | | ||
− | | style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width=" | + | | style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="12%" | |
− | [[APA_Final_Progress|<font face ="Century Gothic" color="#000000"><strong> | + | [[APA_Final_Progress|<font face ="Century Gothic" color="#000000"><strong> METHODOLOGY</strong></font>]] |
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | | | style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | | ||
− | | style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width=" | + | | style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="18%" | |
− | [[ | + | [[APA_Feature Engineering|<font face ="Century Gothic" color="#000000"><strong> FEATURE ENGINEERING</strong></font>]] |
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | | | style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | | ||
− | | style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width=" | + | | style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:4px solid #66ffcc; border-top:4px solid #66ffcc; background:#66ffcc; text-align:center;" width="18%" | |
+ | [[APA_Project_Management|<font face ="Century Gothic" color="#000000"><strong>CLASSIFICATION MODELLING </strong></font>]] | ||
+ | | style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | | ||
+ | | style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="12%" | | ||
[[APA_Documentation|<font face ="Century Gothic" color="#000000"><strong> DOCUMENTATION</strong></font>]] | [[APA_Documentation|<font face ="Century Gothic" color="#000000"><strong> DOCUMENTATION</strong></font>]] | ||
| style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | | | style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | | ||
− | | style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc; text-align:center;" width="20%" | | + | | style="padding:0.3em; font-family:Helvetica; font-size:120%; border-bottom:2px solid #45c198; border-top:2px solid #45c198; background:#66ffcc; text-align:center;" width="17%" | |
+ | [[ANLY482_AY2016-17_Term_2|<font face ="Century Gothic" color="#000000"><strong>OTHER PROJECTS</strong></font>]] | ||
+ | | style="border-bottom:2px solid #66ffcc; border-top:2px solid #66ffcc; background:#66ffcc;" width="1%" | | ||
+ | | style="font-family:Helvetica; font-size:120%; border-bottom:4px solid #45c198; border-top:4px solid #45c198; background:#66ffcc; text-align:center;" width="20%" | | ||
|} | |} | ||
{|style="width:100%;vertical-align:top;margin-top:20px;" | {|style="width:100%;vertical-align:top;margin-top:20px;" | ||
|- | |- | ||
− | |style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Motivation</font></div><br/> | + | |style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Motivation And Project Overview</font></div><br/> |
<p> | <p> | ||
− | + | Human Resource Analytics is the idea of using data in the organizational context to understand different factors about employees such as their degree of collaboration and influence. Known researcher Rob Cross has also said “Organizational Network Analysis provides a powerful means of making invisible patterns of information flow and collaboration, visible.” These factors are generally computed based on various sets of data that are primarily collected via pulse surveys. The data collection process is slow because pulse surveys must be distributed at regular intervals to receive updated insights. However, this is not a viable option as it is not only a repetitive process but also makes it difficult for managers to view real-time insights. | |
− | + | <br> | |
− | + | This study explores and investigates whether subject lines and frequency of emails exchanged between employees can be used as a representative resource for analyzing organizational networks, specifically, the work network. We define work network as the network of employees with whom one interacts with on a daily basis for work purposes. | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
</p> | </p> | ||
Line 52: | Line 42: | ||
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Objective</font></div><br/> | |style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Objective</font></div><br/> | ||
<p> | <p> | ||
− | The | + | The objective of this study is to understand if subject lines and frequency of emails exchanged between employees is a representative resource for analyzing organizational networks, specifically, work network. |
+ | At the company, these factors are computed based on various sets of data that are primarily collected via pulse surveys. The survey data collection process is slow and makes it difficult for managers to view real-time insights. As an alternative, our team wants to check if email interactions can be used to compute these factors based on only email communication data. Through feature engineering, an unbiased email network is created which is compared against the work network derived from a survey. | ||
</p> | </p> | ||
Line 59: | Line 50: | ||
|style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Data</font></div><br/> | |style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Data</font></div><br/> | ||
<p> | <p> | ||
− | We are provided with an excel sheet containing a huge set of email exchange log via the TrustSphere domain. The data | + | We are provided with an excel sheet containing a huge set of email exchange log via the TrustSphere domain. The data consists of 14 columns as described below: |
− | + | {| class="wikitable" | |
+ | |+Column Explanations | ||
+ | |- | ||
+ | |Date | ||
+ | |Timestamp of the email | ||
+ | |- | ||
+ | |Remote IP | ||
+ | |If the email exchange is external then this column shows the external person's email | ||
+ | |- | ||
+ | |Remote | ||
+ | |The TrustSphere employee who is receiving or sending the email | ||
+ | |- | ||
+ | |Remote Domain | ||
+ | |Always TrustSphere | ||
+ | |- | ||
+ | |Local | ||
+ | |Email address of the person sending the email | ||
+ | |- | ||
+ | |Local Domain | ||
+ | |Domain of the person who is sending the email | ||
+ | |- | ||
+ | |Originator | ||
+ | |Inbound, outbound or internal (if you’re receiving the email, sending it or if the email is between 2 TrustSphere employees) | ||
+ | |- | ||
+ | |Direction | ||
+ | |Always TrustSphere in this case | ||
+ | |- | ||
+ | |Domain Group | ||
+ | |Email Header (Subject Line) | ||
+ | |- | ||
+ | |Subject | ||
+ | |Type of message: email/im (instant messaging)/voice/sms | ||
+ | |- | ||
+ | |Inbound Count | ||
+ | |Number of emails received | ||
+ | |- | ||
+ | |Outbound Count | ||
+ | |Number of emails sent | ||
+ | |- | ||
+ | |Size | ||
+ | |Size of the message (number of characters) | ||
+ | |- | ||
+ | |Msgid | ||
+ | |Encoded Message ID | ||
+ | |} | ||
− | + | {| class="wikitable" | |
− | + | |+Data Statistics | |
− | + | |- | |
− | + | |'''Number of rows''' | |
− | + | |121,154 | |
− | + | |- | |
− | + | |'''Date Range''' | |
− | + | |11/26/2016 8:00 am to 02/01/2017 00:00 am | |
− | + | |} | |
− | + | <br> | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
</p> | </p> | ||
{|style="width:100%;vertical-align:top;margin-top:20px;" | {|style="width:100%;vertical-align:top;margin-top:20px;" | ||
|- | |- | ||
− | |style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff> | + | |style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Literature Review</font></div><br/> |
<p> | <p> | ||
− | + | Rob Cross and Karen Stephenson have studied organizational networks for a long time, and their findings and theories are essential to the objective of this study. Their discoveries are important to evaluate the patterns and outcomes found from this study of organizational email data networks. | |
− | + | <br><br> | |
+ | Rob Cross has done extensive work on organizational network analysis looking for methods to improve collaboration between company units and find ways to break silos. Cross (2004) states – “Organizational Network Analysis (ONA) can provide an x-ray into the inner workings of an organization – a powerful means of making invisible patterns of information flow and collaboration in strategically important groups visible.” | ||
<br><br> | <br><br> | ||
− | + | According to Cross’s (2000) research, the level of collaboration can impact employee stress, the distribution of collaborative work within teams and more. He found that employees who are willing to help beyond their scope, gradually develop a resourceful reputation, and hence are included into projects of higher impact. However, Cross said, such employees eventually become bottlenecks as other employees become over-reliant and have no substantial progress without the facilitation of that one employee, or because that employee is overloaded with work and is unable to deliver equivalently. | |
− | |||
− | |||
<br><br> | <br><br> | ||
− | + | Karen Stephenson, also known as “The Organization Woman”, recognized six main types of knowledge network in an organization – | |
− | + | <ul><li>Daily network: whom we see day-to-day</li> | |
− | + | <li>Wider social network: whom we actively stay in touch with</li> | |
− | + | <li>Innovation network: with whom we test out new ideas</li> | |
− | + | <li>Expert network: to whom we go for expertise and knowledge</li> | |
+ | <li>Strategic network: to whom we go for guidance and advice</li> | ||
+ | <li>Learning network: who help us move from what we know to new knowledge and expertise </li></ul> | ||
+ | <br> | ||
+ | Her famous book - Quantum Theory of Trust (2006) – shows that manipulating networks of trust can control the flow of information in an organization due to the link between networks of trust and tacit knowledge. Her research aimed at observing communication patterns, identifying bottlenecks and silos and understanding team dysfunctions. | ||
<br> | <br> | ||
− | + | <br> | |
− | + | This study involves term analysis of employee email subject lines, which can be considered as short documents of text. A relevant paper by Mika Timonen (2013) on term weighting in short documents contains a variety of methods to determine the importance of terms and extracting keywords from a document. The most appropriate and relevant method to use for our study for term weighting is inverse document frequency (IDF). | |
− | |||
</p> | </p> | ||
{|style="width:100%;vertical-align:top;margin-top:20px;" | {|style="width:100%;vertical-align:top;margin-top:20px;" | ||
|- | |- | ||
− | |style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff> | + | |style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Methodology</font></div><br/> |
+ | |||
<p> | <p> | ||
− | + | <center> | |
− | + | Click on [[APA_Final_Progress|<font face ="Century Gothic" color="#00C5CD"><strong><i>METHODOLOGY</i></strong></font>]] for more details.<br><br> | |
− | + | [[File:MethodNew.jpg|800px]] | |
− | + | </center> | |
− | |||
− | |||
− | |||
− | |||
− | |||
</p> | </p> | ||
+ | |||
+ | {|style="width:100%;vertical-align:top;margin-top:20px;" | ||
+ | |- | ||
+ | |style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Conclusion</font></div><br/> | ||
+ | |||
+ | Email data is not a strong representative for Work Network when divided into multiple relationship strength segments. However, it is a good representation of Work Network when divided into only two relationship strength segments. | ||
+ | By just using email data to predict work relation strengths, companies can save large amounts of time, manpower and money spent on survey analysis to retrieve similar data. Further, it is possible to update the analysis is real time by changing the dates of the email data. | ||
+ | <br> | ||
+ | |||
+ | {|style="width:100%;vertical-align:top;margin-top:20px;" | ||
+ | |- | ||
+ | |style="vertical-align:top;width:30%;" | <div style="background: #10d0e5; padding: 13px; font-weight: bold; text-align:center; line-height: wrap_content; text-indent: 20px;font-size:20px; font-family:helvetica"> <font color= #ffffff>Limitation</font></div><br/> | ||
+ | |||
+ | The whole analysis has been done on email subject lines and distribution of the emails. However, the highest quality of information is present in the body of the emails. We didn’t have access to the email bodies which is the biggest limitation of the study. Future work should focus on deeper text mining on the email body to quantify a more accurate representation of work related emails. This could play a huge factor in differentiating work relationships between any two employees. |
Latest revision as of 23:27, 23 April 2017
Motivation And Project Overview
Human Resource Analytics is the idea of using data in the organizational context to understand different factors about employees such as their degree of collaboration and influence. Known researcher Rob Cross has also said “Organizational Network Analysis provides a powerful means of making invisible patterns of information flow and collaboration, visible.” These factors are generally computed based on various sets of data that are primarily collected via pulse surveys. The data collection process is slow because pulse surveys must be distributed at regular intervals to receive updated insights. However, this is not a viable option as it is not only a repetitive process but also makes it difficult for managers to view real-time insights.
|