Measurement bias in caregiver‐report of early childhood behavior problems across demographic factors in an ECHO‐wide diverse sample
Abstract Background Research and clinical practice rely heavily on caregiver‐report measures, such as the Child Behavior Checklist 1.5–5 (CBCL/1.5‐5), to gather information about early childhood behavior problems and to screen for child psychopathology. While studies have shown that demographic vari...
| Main Authors: | , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2024-03-01
|
| Series: | JCPP Advances |
| Subjects: | |
| Online Access: | https://doi.org/10.1002/jcv2.12198 |
| _version_ | 1827319054412546048 |
|---|---|
| author | Shuting Zheng Maxwell Mansolf Monica McGrath Marie L. Churchill Traci A. Bekelman Patricia A. Brennan Amy E. Margolis Sara S. Nozadi Theresa M. Bastain Amy J. Elliott Kaja Z. LeWinn Julie A. Hofheimer Leslie D. Leve Brandon Rennie Emily Zimmerman Carmen A. Marable Cindy T. McEvoy Chang Liu Alexis Sullivan Tracey J. Woodruff Samiran Ghosh Bennett Leventhal Assiamira Ferrara Johnnye Lewis Somer Bishop Environmental influences on Child Health Outcomes |
| author_facet | Shuting Zheng Maxwell Mansolf Monica McGrath Marie L. Churchill Traci A. Bekelman Patricia A. Brennan Amy E. Margolis Sara S. Nozadi Theresa M. Bastain Amy J. Elliott Kaja Z. LeWinn Julie A. Hofheimer Leslie D. Leve Brandon Rennie Emily Zimmerman Carmen A. Marable Cindy T. McEvoy Chang Liu Alexis Sullivan Tracey J. Woodruff Samiran Ghosh Bennett Leventhal Assiamira Ferrara Johnnye Lewis Somer Bishop Environmental influences on Child Health Outcomes |
| author_sort | Shuting Zheng |
| collection | DOAJ |
| description | Abstract Background Research and clinical practice rely heavily on caregiver‐report measures, such as the Child Behavior Checklist 1.5–5 (CBCL/1.5‐5), to gather information about early childhood behavior problems and to screen for child psychopathology. While studies have shown that demographic variables influence caregiver ratings of behavior problems, the extent to which the CBCL/1.5‐5 functions equivalently at the item level across diverse samples is unknown. Methods Item‐level data of CBCL/1.5‐5 from a large sample of young children (N = 9087) were drawn from 26 cohorts in the Environmental influences on Child Health Outcomes program. Factor analyses and the alignment method were applied to examine measurement invariance (MI) and differential item functioning (DIF) across child (age, sex, bilingual status, and neurodevelopmental disorders), and caregiver (sex, education level, household income level, depression, and language version administered) characteristics. Child race was examined in sensitivity analyses. Results Items with the most impactful DIF across child and caregiver groupings were identified for Internalizing, Externalizing, and Total Problems. The robust item sets, excluding the high DIF items, showed good reliability and high correlation with the original Internalizing and Total Problems scales, with lower reliability for Externalizing. Language version of CBCL administration, education level and sex of the caregiver respondent showed the most significant impact on MI, followed by child age. Sensitivity analyses revealed that child race has a unique impact on DIF over and above socioeconomic status. Conclusions The CBCL/1.5‐5, a caregiver‐report measure of early childhood behavior problems, showed bias across demographic groups. Robust item sets with less DIF can measure Internalizing and Total Problems equally as well as the full item sets, with slightly lower reliability for Externalizing, and can be crosswalked to the metric of the full item set, enabling calculation of normed T scores based on more robust item sets. |
| first_indexed | 2024-04-25T00:13:16Z |
| format | Article |
| id | doaj.art-44dc1473a33d43fc8b31c5beb1de8c6c |
| institution | Directory Open Access Journal |
| issn | 2692-9384 |
| language | English |
| last_indexed | 2024-04-25T00:13:16Z |
| publishDate | 2024-03-01 |
| publisher | Wiley |
| record_format | Article |
| series | JCPP Advances |
| spelling | doaj.art-44dc1473a33d43fc8b31c5beb1de8c6c2024-03-13T07:16:45ZengWileyJCPP Advances2692-93842024-03-0141n/an/a10.1002/jcv2.12198Measurement bias in caregiver‐report of early childhood behavior problems across demographic factors in an ECHO‐wide diverse sampleShuting Zheng0Maxwell Mansolf1Monica McGrath2Marie L. Churchill3Traci A. Bekelman4Patricia A. Brennan5Amy E. Margolis6Sara S. Nozadi7Theresa M. Bastain8Amy J. Elliott9Kaja Z. LeWinn10Julie A. Hofheimer11Leslie D. Leve12Brandon Rennie13Emily Zimmerman14Carmen A. Marable15Cindy T. McEvoy16Chang Liu17Alexis Sullivan18Tracey J. Woodruff19Samiran Ghosh20Bennett Leventhal21Assiamira Ferrara22Johnnye Lewis23Somer Bishop24Environmental influences on Child Health OutcomesDepartment of Psychiatry and Behavioral Sciences University of California San Francisco CA USADepartment of Medical Social Sciences Feinberg School of Medicine Northwestern University Chicago IL USADepartment of Epidemiology Johns Hopkins Bloomberg School of Public Health Baltimore MD USADepartment of Epidemiology Johns Hopkins Bloomberg School of Public Health Baltimore MD USADepartment of Epidemiology Colorado School of Public Health Aurora CO USADepartment of Psychology Emory University Atlanta GA USADepartment of Psychiatry Columbia University Irving Medical Center New York State Psychiatric Institute New York NY USACommunity Environmental Health College of Pharmacy Health Sciences Center University of New Mexico Albuquerque NM USADepartment of Population and Public Health Sciences University of Southern California Los Angeles CA USAAvera Research Institute Sioux Falls SD USADepartment of Psychiatry and Behavioral Sciences University of California San Francisco CA USADepartment of Pediatrics Division of Neonatal‐Perinatal Medicine North Carolina at Chapel Hill Chapel Hill NC USAPrevention Science Institute University of Oregon Eugene OR USAHealth Sciences Center Department of Pediatrics Center for Development and Disability University of New Mexico Navajo Birth Cohort Study Albuquerque NM USACommunication Sciences & Disorders Northeastern University Boston MA USASchool of Medicine University of North Carolina at Chapel Hill Neuroscience Curriculum Chapel Hill NC USADepartment of Pediatrics Pape Pediatric Research Institute Oregon Health & Science University Portland OR USADepartment of Psychology Washington State University Pullman WA USACenter for Health and Community University of California San Francisco CA USADepartment of Psychiatry and Behavioral Sciences University of California San Francisco CA USADepartment of Biostatistics and Data Science & Coordinating Center for Clinical Trials (CCCT) University of Texas School of Public Health Houston TX USAUniversity of Chicago Navajo Birth Cohort Study University of New Mexico Albuquerque NM USADivision of Research Kaiser Permanente Northern California Oakland CA USANavajo Birth Cohort Study Community Environmental Health Program College of Pharmacy University of New Mexico Albuquerque NM USADepartment of Psychiatry and Behavioral Sciences Weill Institute for Neurosciences University of California San Francisco CA USAAbstract Background Research and clinical practice rely heavily on caregiver‐report measures, such as the Child Behavior Checklist 1.5–5 (CBCL/1.5‐5), to gather information about early childhood behavior problems and to screen for child psychopathology. While studies have shown that demographic variables influence caregiver ratings of behavior problems, the extent to which the CBCL/1.5‐5 functions equivalently at the item level across diverse samples is unknown. Methods Item‐level data of CBCL/1.5‐5 from a large sample of young children (N = 9087) were drawn from 26 cohorts in the Environmental influences on Child Health Outcomes program. Factor analyses and the alignment method were applied to examine measurement invariance (MI) and differential item functioning (DIF) across child (age, sex, bilingual status, and neurodevelopmental disorders), and caregiver (sex, education level, household income level, depression, and language version administered) characteristics. Child race was examined in sensitivity analyses. Results Items with the most impactful DIF across child and caregiver groupings were identified for Internalizing, Externalizing, and Total Problems. The robust item sets, excluding the high DIF items, showed good reliability and high correlation with the original Internalizing and Total Problems scales, with lower reliability for Externalizing. Language version of CBCL administration, education level and sex of the caregiver respondent showed the most significant impact on MI, followed by child age. Sensitivity analyses revealed that child race has a unique impact on DIF over and above socioeconomic status. Conclusions The CBCL/1.5‐5, a caregiver‐report measure of early childhood behavior problems, showed bias across demographic groups. Robust item sets with less DIF can measure Internalizing and Total Problems equally as well as the full item sets, with slightly lower reliability for Externalizing, and can be crosswalked to the metric of the full item set, enabling calculation of normed T scores based on more robust item sets.https://doi.org/10.1002/jcv2.12198behavior problemsbehavioral measurespre‐school childrenpsychometrics |
| spellingShingle | Shuting Zheng Maxwell Mansolf Monica McGrath Marie L. Churchill Traci A. Bekelman Patricia A. Brennan Amy E. Margolis Sara S. Nozadi Theresa M. Bastain Amy J. Elliott Kaja Z. LeWinn Julie A. Hofheimer Leslie D. Leve Brandon Rennie Emily Zimmerman Carmen A. Marable Cindy T. McEvoy Chang Liu Alexis Sullivan Tracey J. Woodruff Samiran Ghosh Bennett Leventhal Assiamira Ferrara Johnnye Lewis Somer Bishop Environmental influences on Child Health Outcomes Measurement bias in caregiver‐report of early childhood behavior problems across demographic factors in an ECHO‐wide diverse sample JCPP Advances behavior problems behavioral measures pre‐school children psychometrics |
| title | Measurement bias in caregiver‐report of early childhood behavior problems across demographic factors in an ECHO‐wide diverse sample |
| title_full | Measurement bias in caregiver‐report of early childhood behavior problems across demographic factors in an ECHO‐wide diverse sample |
| title_fullStr | Measurement bias in caregiver‐report of early childhood behavior problems across demographic factors in an ECHO‐wide diverse sample |
| title_full_unstemmed | Measurement bias in caregiver‐report of early childhood behavior problems across demographic factors in an ECHO‐wide diverse sample |
| title_short | Measurement bias in caregiver‐report of early childhood behavior problems across demographic factors in an ECHO‐wide diverse sample |
| title_sort | measurement bias in caregiver report of early childhood behavior problems across demographic factors in an echo wide diverse sample |
| topic | behavior problems behavioral measures pre‐school children psychometrics |
| url | https://doi.org/10.1002/jcv2.12198 |
| work_keys_str_mv | AT shutingzheng measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT maxwellmansolf measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT monicamcgrath measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT marielchurchill measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT traciabekelman measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT patriciaabrennan measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT amyemargolis measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT sarasnozadi measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT theresambastain measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT amyjelliott measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT kajazlewinn measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT julieahofheimer measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT lesliedleve measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT brandonrennie measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT emilyzimmerman measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT carmenamarable measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT cindytmcevoy measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT changliu measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT alexissullivan measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT traceyjwoodruff measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT samiranghosh measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT bennettleventhal measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT assiamiraferrara measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT johnnyelewis measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT somerbishop measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample AT environmentalinfluencesonchildhealthoutcomes measurementbiasincaregiverreportofearlychildhoodbehaviorproblemsacrossdemographicfactorsinanechowidediversesample |