Does early tracking affect learning inequalities? Revisiting difference-in-differences modeling strategies with international assessments
Abstract The development of international surveys on children’s learning like PISA, PIRLS and TIMSS—delivering comparable achievement measures across educational systems—has revealed large cross-country variability in average performance and in the degree of inequality across social groups. A key qu...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2020-11-01
|
| Series: | Large-scale Assessments in Education |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s40536-020-00094-x |
| _version_ | 1819159038863081472 |
|---|---|
| author | Dalit Contini Federica Cugnata |
| author_facet | Dalit Contini Federica Cugnata |
| author_sort | Dalit Contini |
| collection | DOAJ |
| description | Abstract The development of international surveys on children’s learning like PISA, PIRLS and TIMSS—delivering comparable achievement measures across educational systems—has revealed large cross-country variability in average performance and in the degree of inequality across social groups. A key question is whether and how institutional differences affect the level and distribution of educational outcomes. In this contribution, we discuss the difference-in-differences strategies employed in the existing literature to evaluate the effect of early tracking on learning inequalities exploiting international assessments administered at different age/grades. In their seminal paper, Hanushek and Woessmann (Econ J 116:C63–C76, 2006) analyze with two-step estimation the effect of early tracking on overall inequalities, measured by test scores’ variability indexes. Later work of other scholars in the economics and sociology of education focuses instead on inequalities among children of different family background, using individual-level models on pooled data from different countries and assessments. In this contribution, we show that individual pooled difference-in-differences models are quite restrictive and that in essence they estimate the effect of tracking by double differentiating the estimated cross-sectional family background regression coefficients between tracking regimes and learning assessments. Starting from a simple learning growth model, we show that if test scores at different surveys are not measured on the same scale, as occurs for international learning assessments, pooled individual models may deliver severely biased results. Instead, the scaling problem does not affect the two-step approach. For this reason, we suggest using two-step estimation also to analyze family-background achievement inequalities. Against this background, using PIRLS-2006 and PISA-2012 we conduct two-step analyses, finding new evidence that early tracking fosters both overall inequalities and family background differentials in reading literacy. |
| first_indexed | 2024-12-22T16:34:12Z |
| format | Article |
| id | doaj.art-39fc95fdb62342d5b7f6a886c5fe9b36 |
| institution | Directory Open Access Journal |
| issn | 2196-0739 |
| language | English |
| last_indexed | 2024-12-22T16:34:12Z |
| publishDate | 2020-11-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | Large-scale Assessments in Education |
| spelling | doaj.art-39fc95fdb62342d5b7f6a886c5fe9b362022-12-21T18:19:59ZengSpringerOpenLarge-scale Assessments in Education2196-07392020-11-018112710.1186/s40536-020-00094-xDoes early tracking affect learning inequalities? Revisiting difference-in-differences modeling strategies with international assessmentsDalit Contini0Federica Cugnata1Department of Economics and Statistics, University of TorinoVita-Salute San Raffaele UniversityAbstract The development of international surveys on children’s learning like PISA, PIRLS and TIMSS—delivering comparable achievement measures across educational systems—has revealed large cross-country variability in average performance and in the degree of inequality across social groups. A key question is whether and how institutional differences affect the level and distribution of educational outcomes. In this contribution, we discuss the difference-in-differences strategies employed in the existing literature to evaluate the effect of early tracking on learning inequalities exploiting international assessments administered at different age/grades. In their seminal paper, Hanushek and Woessmann (Econ J 116:C63–C76, 2006) analyze with two-step estimation the effect of early tracking on overall inequalities, measured by test scores’ variability indexes. Later work of other scholars in the economics and sociology of education focuses instead on inequalities among children of different family background, using individual-level models on pooled data from different countries and assessments. In this contribution, we show that individual pooled difference-in-differences models are quite restrictive and that in essence they estimate the effect of tracking by double differentiating the estimated cross-sectional family background regression coefficients between tracking regimes and learning assessments. Starting from a simple learning growth model, we show that if test scores at different surveys are not measured on the same scale, as occurs for international learning assessments, pooled individual models may deliver severely biased results. Instead, the scaling problem does not affect the two-step approach. For this reason, we suggest using two-step estimation also to analyze family-background achievement inequalities. Against this background, using PIRLS-2006 and PISA-2012 we conduct two-step analyses, finding new evidence that early tracking fosters both overall inequalities and family background differentials in reading literacy.http://link.springer.com/article/10.1186/s40536-020-00094-xInternational assessmentsTest scoresAchievement inequalitiesCross-country analysesEducational systemsEarly tracking |
| spellingShingle | Dalit Contini Federica Cugnata Does early tracking affect learning inequalities? Revisiting difference-in-differences modeling strategies with international assessments Large-scale Assessments in Education International assessments Test scores Achievement inequalities Cross-country analyses Educational systems Early tracking |
| title | Does early tracking affect learning inequalities? Revisiting difference-in-differences modeling strategies with international assessments |
| title_full | Does early tracking affect learning inequalities? Revisiting difference-in-differences modeling strategies with international assessments |
| title_fullStr | Does early tracking affect learning inequalities? Revisiting difference-in-differences modeling strategies with international assessments |
| title_full_unstemmed | Does early tracking affect learning inequalities? Revisiting difference-in-differences modeling strategies with international assessments |
| title_short | Does early tracking affect learning inequalities? Revisiting difference-in-differences modeling strategies with international assessments |
| title_sort | does early tracking affect learning inequalities revisiting difference in differences modeling strategies with international assessments |
| topic | International assessments Test scores Achievement inequalities Cross-country analyses Educational systems Early tracking |
| url | http://link.springer.com/article/10.1186/s40536-020-00094-x |
| work_keys_str_mv | AT dalitcontini doesearlytrackingaffectlearninginequalitiesrevisitingdifferenceindifferencesmodelingstrategieswithinternationalassessments AT federicacugnata doesearlytrackingaffectlearninginequalitiesrevisitingdifferenceindifferencesmodelingstrategieswithinternationalassessments |