Measuring the predictability of life outcomes with a scientific mass collaboration

<jats:p>How predictable are life trajectories? We investigated this question with a scientific mass collaboration using the common task method; 160 teams built predictive models for six life outcomes using data from the Fragile Families and Child Wellbeing Study, a high-quality birth c...

Full description

Bibliographic Details
Main Authors: Salganik, MJ, Lundberg, I, Kindel, KT, Ahearn, CE, Al-Ghoneim, K, Almaatouq, A, Altschul, DM, Brand, JE, Carnegie, NB, Compton, RJ, Datta, D, Davidson, T, Filippova, A, Gilroy, C, Goode, BJ, Jahani, E, Kashyap, R, Kirchner, A, McKay, S, Morgan, AC, Pentland, A, Polimis, K, Raes, L, Rigobon, DE, Roberts, CV, Stanescu, DM, Suhara, Y, Usmani, A, Wang, EH, Adem, M, Alhajri, A, AlShebli, B, Amin, B, Amos, RB, Argyle, LP, Baer-Bositis, L, Büchi, M, Chung, B-R, Eggert, W, Faletto, G, Fan, Z, Freese, J, Gadgil, T, Gagné, J, Gao, Y, Halpern-Manners, A, Hashim, SP, Hausen, S, He, G, Higuera, K
Format: Journal article
Language:English
Published: National Academy of Sciences 2020
_version_ 1797110077119791104
author Salganik, MJ
Lundberg, I
Kindel, KT
Ahearn, CE
Al-Ghoneim, K
Almaatouq, A
Altschul, DM
Brand, JE
Carnegie, NB
Compton, RJ
Datta, D
Davidson, T
Filippova, A
Gilroy, C
Goode, BJ
Jahani, E
Kashyap, R
Kirchner, A
McKay, S
Morgan, AC
Pentland, A
Polimis, K
Raes, L
Rigobon, DE
Roberts, CV
Stanescu, DM
Suhara, Y
Usmani, A
Wang, EH
Adem, M
Alhajri, A
AlShebli, B
Amin, B
Amos, RB
Argyle, LP
Baer-Bositis, L
Büchi, M
Chung, B-R
Eggert, W
Faletto, G
Fan, Z
Freese, J
Gadgil, T
Gagné, J
Gao, Y
Halpern-Manners, A
Hashim, SP
Hausen, S
He, G
Higuera, K
author_facet Salganik, MJ
Lundberg, I
Kindel, KT
Ahearn, CE
Al-Ghoneim, K
Almaatouq, A
Altschul, DM
Brand, JE
Carnegie, NB
Compton, RJ
Datta, D
Davidson, T
Filippova, A
Gilroy, C
Goode, BJ
Jahani, E
Kashyap, R
Kirchner, A
McKay, S
Morgan, AC
Pentland, A
Polimis, K
Raes, L
Rigobon, DE
Roberts, CV
Stanescu, DM
Suhara, Y
Usmani, A
Wang, EH
Adem, M
Alhajri, A
AlShebli, B
Amin, B
Amos, RB
Argyle, LP
Baer-Bositis, L
Büchi, M
Chung, B-R
Eggert, W
Faletto, G
Fan, Z
Freese, J
Gadgil, T
Gagné, J
Gao, Y
Halpern-Manners, A
Hashim, SP
Hausen, S
He, G
Higuera, K
author_sort Salganik, MJ
collection OXFORD
description <jats:p>How predictable are life trajectories? We investigated this question with a scientific mass collaboration using the common task method; 160 teams built predictive models for six life outcomes using data from the Fragile Families and Child Wellbeing Study, a high-quality birth cohort study. Despite using a rich dataset and applying machine-learning methods optimized for prediction, the best predictions were not very accurate and were only slightly better than those from a simple benchmark model. Within each outcome, prediction error was strongly associated with the family being predicted and weakly associated with the technique used to generate the prediction. Overall, these results suggest practical limits to the predictability of life outcomes in some settings and illustrate the value of mass collaborations in the social sciences.</jats:p>
first_indexed 2024-03-07T07:50:07Z
format Journal article
id oxford-uuid:898539e8-61d8-4538-be68-bd0077e219e2
institution University of Oxford
language English
last_indexed 2024-03-07T07:50:07Z
publishDate 2020
publisher National Academy of Sciences
record_format dspace
spelling oxford-uuid:898539e8-61d8-4538-be68-bd0077e219e22023-07-07T15:46:42ZMeasuring the predictability of life outcomes with a scientific mass collaborationJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:898539e8-61d8-4538-be68-bd0077e219e2EnglishSymplectic ElementsNational Academy of Sciences2020Salganik, MJLundberg, IKindel, KTAhearn, CEAl-Ghoneim, KAlmaatouq, AAltschul, DMBrand, JECarnegie, NBCompton, RJDatta, DDavidson, TFilippova, AGilroy, CGoode, BJJahani, EKashyap, RKirchner, AMcKay, SMorgan, ACPentland, APolimis, KRaes, LRigobon, DERoberts, CVStanescu, DMSuhara, YUsmani, AWang, EHAdem, MAlhajri, AAlShebli, BAmin, BAmos, RBArgyle, LPBaer-Bositis, LBüchi, MChung, B-REggert, WFaletto, GFan, ZFreese, JGadgil, TGagné, JGao, YHalpern-Manners, AHashim, SPHausen, SHe, GHiguera, K<jats:p>How predictable are life trajectories? We investigated this question with a scientific mass collaboration using the common task method; 160 teams built predictive models for six life outcomes using data from the Fragile Families and Child Wellbeing Study, a high-quality birth cohort study. Despite using a rich dataset and applying machine-learning methods optimized for prediction, the best predictions were not very accurate and were only slightly better than those from a simple benchmark model. Within each outcome, prediction error was strongly associated with the family being predicted and weakly associated with the technique used to generate the prediction. Overall, these results suggest practical limits to the predictability of life outcomes in some settings and illustrate the value of mass collaborations in the social sciences.</jats:p>
spellingShingle Salganik, MJ
Lundberg, I
Kindel, KT
Ahearn, CE
Al-Ghoneim, K
Almaatouq, A
Altschul, DM
Brand, JE
Carnegie, NB
Compton, RJ
Datta, D
Davidson, T
Filippova, A
Gilroy, C
Goode, BJ
Jahani, E
Kashyap, R
Kirchner, A
McKay, S
Morgan, AC
Pentland, A
Polimis, K
Raes, L
Rigobon, DE
Roberts, CV
Stanescu, DM
Suhara, Y
Usmani, A
Wang, EH
Adem, M
Alhajri, A
AlShebli, B
Amin, B
Amos, RB
Argyle, LP
Baer-Bositis, L
Büchi, M
Chung, B-R
Eggert, W
Faletto, G
Fan, Z
Freese, J
Gadgil, T
Gagné, J
Gao, Y
Halpern-Manners, A
Hashim, SP
Hausen, S
He, G
Higuera, K
Measuring the predictability of life outcomes with a scientific mass collaboration
title Measuring the predictability of life outcomes with a scientific mass collaboration
title_full Measuring the predictability of life outcomes with a scientific mass collaboration
title_fullStr Measuring the predictability of life outcomes with a scientific mass collaboration
title_full_unstemmed Measuring the predictability of life outcomes with a scientific mass collaboration
title_short Measuring the predictability of life outcomes with a scientific mass collaboration
title_sort measuring the predictability of life outcomes with a scientific mass collaboration
work_keys_str_mv AT salganikmj measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT lundbergi measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT kindelkt measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT ahearnce measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT alghoneimk measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT almaatouqa measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT altschuldm measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT brandje measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT carnegienb measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT comptonrj measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT dattad measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT davidsont measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT filippovaa measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT gilroyc measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT goodebj measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT jahanie measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT kashyapr measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT kirchnera measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT mckays measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT morganac measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT pentlanda measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT polimisk measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT raesl measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT rigobonde measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT robertscv measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT stanescudm measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT suharay measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT usmania measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT wangeh measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT ademm measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT alhajria measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT alsheblib measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT aminb measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT amosrb measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT argylelp measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT baerbositisl measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT buchim measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT chungbr measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT eggertw measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT falettog measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT fanz measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT freesej measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT gadgilt measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT gagnej measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT gaoy measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT halpernmannersa measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT hashimsp measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT hausens measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT heg measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration
AT higuerak measuringthepredictabilityoflifeoutcomeswithascientificmasscollaboration