ANLY482 AY2016-17 T2 Group11: Project Findings

From Analytics Practicum
Revision as of 21:08, 23 April 2017 by Gareth.ng.2013 (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Return to ANLY482 AY2016-17 Home Page

T11 logo.png

T11 home.png T11 about us.png T11 overview.png T11 mgmt.png T11 findings 2.png T11 documentation.png

Interim Final

Interim Slides
Interim Report

Data Source

All the data was taken from the 2015 PISA Database which is available from the PISA website (http://www.oecd.org/pisa/data/2015database/). The 2015 dataset contains the full set of responses from individual students, school principals, teachers, and parents. For this project, the team will be using the questionnaire, codebook, and compendia data from the PISA website.

T11 interim data source.png

Proposed Phases

From the start of the project up to the interim presentation, phases 1 to 4 were done and the team's progress and findings are documented in the sections below.

T11 interim phases.png

Data Preparation

6 steps were done in preparing the data before the team could progress further in doing analysis of the data.

T11 interim prep 1.png
T11 interim prep 2.png

Preliminary Findings

Descriptive Analysis (Cognitive)

Booklet

From the booklets which the students answered, there were 3 subjects. These were: Reading, Math, and Science. The team discovered that different sets of booklets consist of different sets of questions from all or some of the 3 subjects and each booklet consists of different number of questions.

T11 interim booklet.png

Mean Score

There was a wide range of mean scores across all questions and a similar pattern could be observed for all 3 subjects.

T11 interim mean scores.png

Segmentation

The questions were split into 3 segments based on difficulty. The bulk of the questions were placed in the middle segment which mean score falls in the range of 0.4 to 0.7.

T11 interim segment.png

Descriptive Analysis (School)

Uniform Response

The team observed that there were questions where all schools answered with the same answer. An insight for this is that there is a potential loophole that schools may be biased or afraid to answer truthfully.

T11 interim uniform.png

Science

The team observed that there were questions which were science specific which could be used together with the mean scores of the science questions. Science related questions asked to schools were related with how prepared and equipped the schools were to improve the learning of students.

T11 interim science .png

Descriptive Analysis (Student)

Country of Birth

Most of the students who took the PISA test in Singapore were born in Singapore and both parents were also born in Singapore. There is a rather sizeable group of students who have parents born overseas.

T11 interim students.png

Overall Challenge

T11 interim challenge.png

Exploratory Analysis

Standardisation of Booklets

Challenge

  • Different booklets were used for the test
  • Each booklet consists of different sets of questions

Proposed Solution

  • Find out the mean percentage of Easy, Medium, Hard questions for Reading, Mathematics and Science
  • Use score percentage of students * mean percentage

Assumptions

  • Mean scores are used as a proxy to determine level of difficulty
  • Level of difficulty is perceived to be the same across all students

Overall Cognitive Analysis

The team did an overview of the performance of all the students based on the booklets.

T11 interim overall 1.png
T11 interim overall 2.png

School Performance Analysis

Class Size

  • Private schools performed better than public schools in all class sizes except for classes with less than 15 students
T11 interim class size.png

Spending

  • Schools which spent money on new equipment generally performed better than schools which did not.
T11 interim spending.png

Quality of Teaching

  • Schools which had inadequate or poorly qualified teaching staff performed poorer than the rest (34 public schools)
T11 interim quality.png

Autonomy

  • Fully autonomous schools have the highest average scores compared to less autonomous schools
  • The least autonomous schools have the lowest average score compared to the rest
T11 interim autonomy.png

Student Performance Analysis

Language

  • Similar trends observed for all languages
  • To get more specific insights, further breakdown of students’ score required
T11 interim language.png

Education of Parents

  • GENERAL UPWARD TREND: Higher the parent’s education level, the higher the scores
  • None of the students from private schools have parents with no education
T11 interim parents.png

Support from Parents

  • GENERAL UPWARD TREND: Higher the support from parents, higher the score
T11 interim support.png

Overall Insight

T11 interim overall.png


Further Analyses

Regression Analysis

  • Regression Analysis on factors affecting school’s performance
  • Regression Analysis on factors affecting student’s performance in school

Cluster Analysis

  • Cluster Analysis on schools based on their performance


Appendix

School Performance Analysis

T11 interim appendix 1.png
T11 interim appendix 2.png