Difference between revisions of "ANLY482 AY2016-17 T2 Group 2 Project Overview"

From Analytics Practicum
Jump to navigation Jump to search
Line 44: Line 44:
  
 
<!--Content-->
 
<!--Content-->
==<div style="background: #6A8D9D; line-height: 0.3em; font-family:helvetica;  border-left: #466675 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#F2F1EF"><strong>Project Overview</strong></font></div></div>==
+
==<div style="background: #6A8D9D; line-height: 0.3em; font-family:helvetica;  border-left: #466675 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#F2F1EF"><strong>Project Background & Motivation</strong></font></div></div>==
 
<div style="margin:20px; padding: 10px; background: #ffffff; text-align:left; font-size: 95%;-webkit-border-radius: 15px;-webkit-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96); -moz-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);">
 
<div style="margin:20px; padding: 10px; background: #ffffff; text-align:left; font-size: 95%;-webkit-border-radius: 15px;-webkit-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96); -moz-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);">
Jobsbank.gov.sg is a website administered by Workforce Singapore (WSG) to facilitate online job matching between Singapore-registered companies and local individuals (Singapore Citizens and Singapore Permanent Resident). Companies are able to advertise their job vacancies on the website and individuals can use it for their employment needs.
+
Various agencies in the government are interested to identify skill mismatches and emerging skills for planning purposes and for programs such as SkillsFuture Singapore. The Ministry of Trade and Industry (MTI) and GovTech started this project to meet these impending needs.<br><br>
In the job postings, skills that the companies are searching for are intertwined in the title, description and requirements. GovTech wants to leverage on this data to uncover new skillsets and existing skill mismatches of the labor market. This project seeks to analyze labor market trends by building a text analytics model using Python Natural Language Toolkit (NLTK). The purpose of the classifier is to extract and filter out the required skills from the job descriptions. Using this classifier model, GovTech will then be able to analyze the trends in skillsets required for job postings that are not applied and skills that are increasingly popular.  
+
They understand that there are high-paying jobs that no one is applying and a possible reason for that is because Singaporeans do not have such skills. In addition, with the evolving technology, companies will require new types of skills from their employees. For example, ReactJS was an upcoming programming language that was not in the market until two years ago, and has been quickly popularized to be demanded by many companies nowadays. <br><br>
 +
Jobsbank.gov.sg is a website administered by Workforce Singapore (WSG) to facilitate online job matching between Singapore-registered companies and local individuals (Singapore Citizens and Singapore Permanent Residents). Companies are able to advertise their job vacancies on the website and individuals can use it for their employment needs.<br><br>
 +
In the job postings, skills that the companies are searching for are intertwined in the title, description and requirements. GovTech wants to leverage on this data to uncover emerging skillsets and existing skill mismatches of the labour market. This project will leverage on natural language processing (NLP) and machine learning techniques to build a classifier that can identify words that are representative of the skills required for a job in a job posting. This classifier can then be applied to summarize the skill outlook for the job market – e.g. popular skills required by the sector or industry.  
 +
Through this project, GovTech hopes to understand the skills that are sought upon for the agencies to come up with better policies and skills development programs to inculcate these skills amongst Singaporeans.  
 +
 
</div>
 
</div>
  
==<div style="background: #6A8D9D; line-height: 0.3em; font-family:helvetica;  border-left: #466675 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#F2F1EF"><strong>Project Motivation</strong></font></div></div>==
+
==<div style="background: #6A8D9D; line-height: 0.3em; font-family:helvetica;  border-left: #466675 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#F2F1EF"><strong>Project Objectives</strong></font></div></div>==
 
<div style="margin:20px; padding: 10px; background: #ffffff; text-align:left; font-size: 95%;-webkit-border-radius: 15px;-webkit-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96); -moz-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);">
 
<div style="margin:20px; padding: 10px; background: #ffffff; text-align:left; font-size: 95%;-webkit-border-radius: 15px;-webkit-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96); -moz-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);">
MTI is concerned with the skills required by Singapore-based employers. They understand that there are high-paying jobs that no one is applying. A possible reason for that is because Singaporeans do not have such skills. In enabling Singapore to be a world class economy, MTI wants to know the sort of skills needed by the industry that is lacking in Singaporeans and fill the skill set gaps as required.
+
<p>This project aims to build a text analytics model that extracts text from job postings in jobsbank.gov.sg to obtain a list of relevant skills.
Furthermore, with the evolving technology, companies will require new types of skills from their employees. For example, ReactJS is an upcoming programming language that was not in the market until two years ago, but it is highly demanded by companies nowadays.
+
Thus, our main objectives are to:
With this analysis, MTI hopes to come up with better policies and skills development training programs to build those skills in Singaporeans.
+
#Curate a set of labelled data from the job postings
 +
#Use this data to build a model that can identify and summarise skills
 +
</p>
 
</div>
 
</div>
  
Line 60: Line 66:
 
<div style="margin:20px; padding: 10px; background: #ffffff; text-align:left; font-size: 95%;-webkit-border-radius: 15px;-webkit-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96); -moz-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);">
 
<div style="margin:20px; padding: 10px; background: #ffffff; text-align:left; font-size: 95%;-webkit-border-radius: 15px;-webkit-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96); -moz-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);">
 
<p><b>GovTech</b></p>
 
<p><b>GovTech</b></p>
<p>The role of GovTech or Government Technology Agency of Singapore is to co-create a technology enabled future and at the same time building smart nation capabilities and expertise. GovTech aims to harness the best info communications technologies to make a difference to the everyday lives of people in Singapore. Furthermore, they seek to improve the lives of citizens, promote innovation collaborations among enterprises and have stronger communities through a more responsive public service. </p>
+
The role of GovTech or Government Technology Agency of Singapore is to co-create a technology enabled future and at the same time building smart nation capabilities and expertise. GovTech aims to harness the best info communications technologies to make a difference to the everyday lives of people in Singapore. In a move to centralize all public sectors technologies, GovTech is in-charge of IT developments from all government agencies.  
<p><b>Ministry of Trade and Industry (MTI)</b></p>
 
<p>Ministry of Trade and Industry (MTI) provides economic growth and creates good jobs for Singaporeans. MTI aims for Singapore to be a leading global city with dynamic economy, world-class enterprises and innovative and productive SMEs. Furthermore, they seek to offer a conducive environment for enterprises to tap its diverse opportunities. These enterprises will then provide good jobs that are attractive to talent at all level.</p>
 
</div>
 
 
 
==<div style="background: #6A8D9D; line-height: 0.3em; font-family:helvetica;  border-left: #466675 solid 15px;"><div style="border-left: #FFFFFF solid 5px; padding:15px;font-size:15px;"><font color= "#F2F1EF"><strong>Project Objectives</strong></font></div></div>==
 
<div style="margin:20px; padding: 10px; background: #ffffff; text-align:left; font-size: 95%;-webkit-border-radius: 15px;-webkit-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96); -moz-box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);box-shadow: 7px 4px 14px rgba(176, 155, 121, 0.96);">
 
<p>The aim of our project is to analyse labour market trends by uncovering the skills required in job postings.
 
Thus, our project objectives are as follows:
 
#To build a text analytics model that extracts text from job postings in jobsbank.gov.sg and filter out a list of skills.
 
#To analyze current and upcoming skill trends based on the filtered list of skills.
 
</p>
 
 
</div>
 
</div>

Revision as of 15:50, 29 December 2016


HOME

 

PROJECT OVERVIEW

 

FINDINGS

 

PROJECT DOCUMENTATION

 

PROJECT MANAGEMENT

Background Data Source Methodology

Project Background & Motivation

Various agencies in the government are interested to identify skill mismatches and emerging skills for planning purposes and for programs such as SkillsFuture Singapore. The Ministry of Trade and Industry (MTI) and GovTech started this project to meet these impending needs.

They understand that there are high-paying jobs that no one is applying and a possible reason for that is because Singaporeans do not have such skills. In addition, with the evolving technology, companies will require new types of skills from their employees. For example, ReactJS was an upcoming programming language that was not in the market until two years ago, and has been quickly popularized to be demanded by many companies nowadays.

Jobsbank.gov.sg is a website administered by Workforce Singapore (WSG) to facilitate online job matching between Singapore-registered companies and local individuals (Singapore Citizens and Singapore Permanent Residents). Companies are able to advertise their job vacancies on the website and individuals can use it for their employment needs.

In the job postings, skills that the companies are searching for are intertwined in the title, description and requirements. GovTech wants to leverage on this data to uncover emerging skillsets and existing skill mismatches of the labour market. This project will leverage on natural language processing (NLP) and machine learning techniques to build a classifier that can identify words that are representative of the skills required for a job in a job posting. This classifier can then be applied to summarize the skill outlook for the job market – e.g. popular skills required by the sector or industry. Through this project, GovTech hopes to understand the skills that are sought upon for the agencies to come up with better policies and skills development programs to inculcate these skills amongst Singaporeans.

Project Objectives

This project aims to build a text analytics model that extracts text from job postings in jobsbank.gov.sg to obtain a list of relevant skills. Thus, our main objectives are to:

  1. Curate a set of labelled data from the job postings
  2. Use this data to build a model that can identify and summarise skills

GovTech

The role of GovTech or Government Technology Agency of Singapore is to co-create a technology enabled future and at the same time building smart nation capabilities and expertise. GovTech aims to harness the best info communications technologies to make a difference to the everyday lives of people in Singapore. In a move to centralize all public sectors technologies, GovTech is in-charge of IT developments from all government agencies.