Difference between revisions of "GeViz"
Mechong.2015 (talk | contribs) |
Mechong.2015 (talk | contribs) |
||
Line 37: | Line 37: | ||
<br/> | <br/> | ||
In this project, we are creating a visualisation that is able to show the following: | In this project, we are creating a visualisation that is able to show the following: | ||
− | * | + | * Gain an overview of procurement spending made by each ministry and agency |
− | * | + | * Identify the relationships between ministries, agencies and suppliers |
− | * Identify the | + | * Identify what are the goods and services procured by ministries and agencies under each category |
<br/> | <br/> | ||
+ | |||
==<div style="background:#143c67; padding: 15px; font-weight: bold; line-height: 0.3em;letter-spacing:0.5em;font-size:20px"><font color=#fbfcfd face="Lato"><center>SELECTED DATASETS</center></font></div>== | ==<div style="background:#143c67; padding: 15px; font-weight: bold; line-height: 0.3em;letter-spacing:0.5em;font-size:20px"><font color=#fbfcfd face="Lato"><center>SELECTED DATASETS</center></font></div>== | ||
<b>The following datasets will be used for analysis , as elaborated below:</b> | <b>The following datasets will be used for analysis , as elaborated below:</b> |
Revision as of 22:52, 24 November 2018
Contents
PROBLEM & MOTIVATION
GeBIZ is a Singapore Government’s one-stop e-procurement portal which facilitates the entire procurement lifecycle and revenue tender activities between Singapore government and local and overseas supplies electronically since June 2000. The purpose of the portal is to be transparency, encourage fair and open competition and to generate demands / quotations. With this portal, more companies are tendering for projects hence increasing the competitiveness.
We aim to create a visualisation which benefits businesses in crafting bidding prices and increasing their chances in winning the government contracts and tender. In addition, we hope to give an overview and identify interesting patterns of government spending.
OBJECTIVES
In this project, we are creating a visualisation that is able to show the following:
- Gain an overview of procurement spending made by each ministry and agency
- Identify the relationships between ministries, agencies and suppliers
- Identify what are the goods and services procured by ministries and agencies under each category
SELECTED DATASETS
The following datasets will be used for analysis , as elaborated below:
Dataset/Source | Data Attributes | Rationale of Usage |
---|---|---|
Government Procurement Data (https://data.gov.sg/dataset/government-procurement) |
|
To gain information on government procurement such as tender description, amount and supplier information |
Ministry and Agencies List |
|
We will be looking through the Singapore Government Directory (https://www.gov.sg/sgdi/ministries) to categorise the agencies into their respective ministries. This will allow us to visualise the procurement spending on a ministry level. |
Text Classification using Support Vector Classifier (SVC)
One of the key challenges of working with the provided procurement dataset is the absence of categorization of each procurement transaction. Instead of labelling manually, we applied machine learning to classify the tender descriptions into different categories. We firstly scraped the procurement descriptions and categories from GeBiz website using Selenium and BeautifulSoup libraries in Python to be used as the training and validation dataset in our Support Vector Classifier model. We were able to achieve 90% for training accuracy before performing the categorization prediction.
Government Procurement Dataset after Text Classification
Dataset/Source | Data Attributes |
---|---|
Government Procurement Data |
|
BACKGROUND SURVEY
Some of these visualizations that we draw inspiration from, are as follows:
To be filled!
CONSIDERATION & VISUAL SELECTION
To be filled!
BRAINSTORMING SESSIONS
TECHNOLOGIES
Tools and technologies
Data Architecture
KEY CHALLENGES
The following are some of the key technical challenges that we may face throughout the course of the project:
Key Challenges | Mitigation Plan |
---|---|
Unfamiliarity with Javascript Rshiny libraries ) |
|
Unfamiliarity with R Libraries for Machine Learning and Selenium |
|
Data Cleaning and Transformation |
|
TIMELINE
To be filled!
COMMENTS
Feel free to leave us some comments so that we can improve! We dont bite :)
No. | Name | Date | Comments |
---|---|---|---|
1. | Insert your name here | Insert date here | Insert comment here |
2. | Insert your name here | Insert date here | Insert comment here |
3. | Insert your name here | Insert date here | Insert comment here |