Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence
Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors’ collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that n...
| Main Authors: | , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SAGE Publishing
2024-02-01
|
| Series: | AERA Open |
| Online Access: | https://doi.org/10.1177/23328584241231933 |
| _version_ | 1827337649812144128 |
|---|---|
| author | Christina Weiland Rebecca Unterman Susan Dynarski Rachel Abenavoli Howard Bloom Breno Braga Anne-Marie Faria Erica Greenberg Brian A. Jacob Jane Arnold Lincove Karen Manship Meghan McCormick Luke Miratrix Tomás E. Monarrez Pamela Morris-Perez Anna Shapiro Jon Valant Lindsay Weixler |
| author_facet | Christina Weiland Rebecca Unterman Susan Dynarski Rachel Abenavoli Howard Bloom Breno Braga Anne-Marie Faria Erica Greenberg Brian A. Jacob Jane Arnold Lincove Karen Manship Meghan McCormick Luke Miratrix Tomás E. Monarrez Pamela Morris-Perez Anna Shapiro Jon Valant Lindsay Weixler |
| author_sort | Christina Weiland |
| collection | DOAJ |
| description | Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors’ collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next context: (a) available baseline covariates that may not be very rich; (b) limited data on the counterfactual; (c) limited and inconsistent outcome data; (d) weakened internal validity due to attrition; (e) constrained external validity due to who competes for oversubscribed programs; and (f) difficulties answering site-level questions with child-level randomization. The authors offer potential solutions to these six challenges and concrete recommendations for the design of future lottery-based early education studies. |
| first_indexed | 2024-03-07T18:59:20Z |
| format | Article |
| id | doaj.art-4cee2c3a8c4e4860a0c59ccd2193b219 |
| institution | Directory Open Access Journal |
| issn | 2332-8584 |
| language | English |
| last_indexed | 2024-03-07T18:59:20Z |
| publishDate | 2024-02-01 |
| publisher | SAGE Publishing |
| record_format | Article |
| series | AERA Open |
| spelling | doaj.art-4cee2c3a8c4e4860a0c59ccd2193b2192024-03-01T19:03:38ZengSAGE PublishingAERA Open2332-85842024-02-011010.1177/23328584241231933Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of EvidenceChristina WeilandRebecca UntermanSusan DynarskiRachel AbenavoliHoward BloomBreno BragaAnne-Marie FariaErica GreenbergBrian A. JacobJane Arnold LincoveKaren ManshipMeghan McCormickLuke MiratrixTomás E. MonarrezPamela Morris-PerezAnna ShapiroJon ValantLindsay WeixlerLottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors’ collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next context: (a) available baseline covariates that may not be very rich; (b) limited data on the counterfactual; (c) limited and inconsistent outcome data; (d) weakened internal validity due to attrition; (e) constrained external validity due to who competes for oversubscribed programs; and (f) difficulties answering site-level questions with child-level randomization. The authors offer potential solutions to these six challenges and concrete recommendations for the design of future lottery-based early education studies.https://doi.org/10.1177/23328584241231933 |
| spellingShingle | Christina Weiland Rebecca Unterman Susan Dynarski Rachel Abenavoli Howard Bloom Breno Braga Anne-Marie Faria Erica Greenberg Brian A. Jacob Jane Arnold Lincove Karen Manship Meghan McCormick Luke Miratrix Tomás E. Monarrez Pamela Morris-Perez Anna Shapiro Jon Valant Lindsay Weixler Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence AERA Open |
| title | Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence |
| title_full | Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence |
| title_fullStr | Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence |
| title_full_unstemmed | Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence |
| title_short | Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence |
| title_sort | lottery based evaluations of early education programs opportunities and challenges for building the next generation of evidence |
| url | https://doi.org/10.1177/23328584241231933 |
| work_keys_str_mv | AT christinaweiland lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT rebeccaunterman lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT susandynarski lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT rachelabenavoli lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT howardbloom lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT brenobraga lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT annemariefaria lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT ericagreenberg lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT brianajacob lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT janearnoldlincove lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT karenmanship lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT meghanmccormick lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT lukemiratrix lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT tomasemonarrez lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT pamelamorrisperez lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT annashapiro lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT jonvalant lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence AT lindsayweixler lotterybasedevaluationsofearlyeducationprogramsopportunitiesandchallengesforbuildingthenextgenerationofevidence |