Assign2
Assignment 1 | Assignment 2 | Assignment 3 | Assignment Dropbox |
Contents
Interactive Data Exploration and Analysis (IDEAL)
Overview
In this digital economy age, massive and complex data have been captured and stored in organization databases and/or data warehouses. By and large, these data contain a large amount of variables of a particular product or activity. Due to limitations in perceptual and screen space, graphical techniques available in traditional business intelligence systems tend to confine to univariate and bivariate data such as bar chart, pie chart and scatterplot. As a result, many important relationships that live in these data remain undiscovered. In this assignment, you are required to apply interactive data exploration and analysis techniques to discovery patterns from multivariate data. The goal of this assignment is not to develop a new visualization tool, but to apply the interactive data exploration and analysis techniques you have learned by using commercial-of-the-shelf and opensource software. It also aims to allow you to gain hands-on experiences on using the visualization tool and at the same time, to evaluate the pros and cons of the tool in real world applications.
Data Sets
We have provided the following data sets and would like to encourage you to use one of them in order to get started quickly and therefore have more time to explore the data and develop your analysis questions.
Population Census 2010
The Census of Population 2010 Statistical Release 3 – Geographic Distribution and Transport is the third and final statistical release of a series of statistical publications on detailed census results. This release provides the broad trends and changes relating to the geographic distribution and transport characteristics of the Singapore resident population from the Population Census 2010. The report includes detailed statistical tables to enable more comprehensive study by users as well as a glossary of census concepts and definitions.
Source: Department of Statistics, Singapore [1]
Acell Computer
Acell is a company that assembles and sells laptops. One of its primary retail outlets is PC Universe with whom it started to do business with in 2008. A large number of laptop configurations are assembled and sold, involving different screen sizes, hard disk sizes, memory sizes and so on. New, improved components are being introduced almost weekly, giving the chance to build new “better” configurations.
Data Visualisation System Design Process
Step 1: Identify a theme of interest
Each of the dataset provides a wide range of parameters that can be used for many different purposes. Hence, it is very important for you to identify a theme clearly before you start your investigation. For example, you might want to focus on issues related to business competitiveness.
Step 2: Define questions for investigation
After you have identified a theme, you should now formulate questions for investigation. For example: Is there a relationship between sales revenue and marketing expenditure? Are the growth of GPD per capita and the growth of productivity correlated? Are there different patterns of energy consumption in different regions of the world?
Step 3: Find appropriate data attributes
Extract and download the datasets in convenient formats such as Excel or a CSV file. The online database contains a lot of tabulated data. In some cases, you will need to convert the data to a format you can use. Format conversion is a big part of visualization research so it is worth learning techniques for doing such conversions.
You will need to iterate through these steps a few times. It may be challenging to find interesting questions and a dataset that has the information that you need to answer those questions.
Recommended Best Practice
After you have the initial question and the appropriate datasets, construct a visualization that provides an answer to your question. As you construct the visualization, you will find that your question evolves – very often, it will become more specific. Keep track of this evolution and the other questions that occur to you along the way. Once you have answered all the questions to your satisfaction, think of a way to present the data and the answers as clearly as possible. The presentation must be in the form of interactive visualization.
Before starting, write down the initial question clearly. And, as you go, maintain a wiki notebook of what you have to do to construct the visualizations and how the questions evolved. Include in the notebook where you get the data from, and documentation about the format of the dataset. Describe any transformations or rearrangements of the dataset that you need to perform; in particular, describe how you get the data into the format needed by the visualization system. Keep copies of any intermediate visualizations that have helped you refine your question. After you have constructed the final visualization for presenting your answer, write a caption and a paragraph describing the visualization, and how it answers the question you posed. Think of the figure, the caption and the text as materials you might include in a research paper.
You should maintain a session on the assignment wiki documents all the questions you asked and the steps you performed from start to the end .
Visualization Software
To perform the analysis, you are encouraged to explore the following visual analytics toolkit and API or their equivalent besides Tableau, JMP and Qlik Sense:
- Mondrian
- High-D
- GeoViz Toolkit
One of the goals of this assignment is for you to learn to use and evaluate the effectiveness of these visualization tools. Please do not hesitate to consult me if you encounter problems in using the tool.
Useful resources
Submission details
This is an individual assignment. You are required to work on the assignment and prepare submission individually. Your completed assignment is due on 9th October 2015, by 11.59pm mid-night.
You need to edit your assignment in the appropriate wiki page of the Assignment Dropbox. The title of the wiki page should be in the form of: IS428_2015-16_Term1_Assign2_FullName.
The assignment 2 wiki page should include the URL link to the web-based interactive data visualization system prepared.
Assignment 2 Q&A
Need more clarification, please go here