Interformat Reliability of Web-Based Parent-Rated Questionnaires for Assessing Neurodevelopmental Disorders Among Preschoolers: Cross-sectional Community Study
BackgroundEarly detection and intervention for neurodevelopmental disorders are effective. Several types of paper questionnaires have been developed to assess these conditions in early childhood; however, the psychometric equivalence between the web-based and the paper versions of these questionnair...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2021-02-01
|
| Series: | JMIR Pediatrics and Parenting |
| Online Access: | https://pediatrics.jmir.org/2021/1/e20172 |
| _version_ | 1818774269661806592 |
|---|---|
| author | Tanaka, Masanori Saito, Manabu Takahashi, Michio Adachi, Masaki Nakamura, Kazuhiko |
| author_facet | Tanaka, Masanori Saito, Manabu Takahashi, Michio Adachi, Masaki Nakamura, Kazuhiko |
| author_sort | Tanaka, Masanori |
| collection | DOAJ |
| description | BackgroundEarly detection and intervention for neurodevelopmental disorders are effective. Several types of paper questionnaires have been developed to assess these conditions in early childhood; however, the psychometric equivalence between the web-based and the paper versions of these questionnaires is unknown.
ObjectiveThis study examined the interformat reliability of the web-based parent-rated version of the Autism Spectrum Screening Questionnaire (ASSQ), Attention-Deficit/Hyperactivity Disorder Rating Scale (ADHD-RS), Developmental Coordination Disorder Questionnaire 2007 (DCDQ), and Strengths and Difficulties Questionnaire (SDQ) among Japanese preschoolers in a community developmental health check-up setting.
MethodsA set of paper-based questionnaires were distributed for voluntary completion to parents of children aged 5 years. The package of the paper format questionnaires included the ASSQ, ADHD-RS, DCDQ, parent-reported SDQ (P-SDQ), and several additional demographic questions. Responses were received from 508 parents of children who agreed to participate in the study. After 3 months, 300 parents, who were among the initial responders, were randomly selected and asked to complete the web-based versions of these questionnaires. A total of 140 parents replied to the web-based format and were included as a final sample in this study.
ResultsWe obtained the McDonald ω coefficients for both the web-based and paper formats of the ASSQ (web-based: ω=.90; paper: ω=.86), ADHD-RS total and subscales (web-based: ω=.88-.94; paper: ω=.87-.93), DCDQ total and subscales (web-based: ω=.82-.94; paper: ω=.74-.92), and P-SDQ total and subscales (web-based: ω=.55-.81; paper: ω=.52-.80). The intraclass correlation coefficients between the web-based and paper formats were all significant at the 99.9% confidence level: ASSQ (r=0.66, P<.001); ADHD-RS total and subscales (r=0.66-0.74, P<.001); DCDQ total and subscales (r=0.66-0.71, P<.001); P-SDQ Total Difficulties and subscales (r=0.55-0.73, P<.001). There were no significant differences between the web-based and paper formats for total mean score of the ASSQ (P=.76), total (P=.12) and subscale (P=.11-.47) mean scores of DCDQ, and the P-SDQ Total Difficulties mean score (P=.20) and mean subscale scores (P=.28-.79). Although significant differences were found between the web-based and paper formats for mean ADHD-RS scores (total: t132=2.83, P=.005; Inattention subscale: t133=2.15, P=.03; Hyperactivity/Impulsivity subscale: t133=3.21, P=.002), the effect sizes were small (Cohen d=0.18-0.22).
ConclusionsThese results suggest that the web-based versions of the ASSQ, ADHD-RS, DCDQ, and P-SDQ were equivalent, with the same level of internal consistency and intrarater reliability as the paper versions, indicating the applicability of the web-based versions of these questionnaires for assessing neurodevelopmental disorders. |
| first_indexed | 2024-12-18T10:38:28Z |
| format | Article |
| id | doaj.art-e146212a409141feaadae240308a0b0f |
| institution | Directory Open Access Journal |
| issn | 2561-6722 |
| language | English |
| last_indexed | 2024-12-18T10:38:28Z |
| publishDate | 2021-02-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Pediatrics and Parenting |
| spelling | doaj.art-e146212a409141feaadae240308a0b0f2022-12-21T21:10:42ZengJMIR PublicationsJMIR Pediatrics and Parenting2561-67222021-02-0141e2017210.2196/20172Interformat Reliability of Web-Based Parent-Rated Questionnaires for Assessing Neurodevelopmental Disorders Among Preschoolers: Cross-sectional Community StudyTanaka, MasanoriSaito, ManabuTakahashi, MichioAdachi, MasakiNakamura, KazuhikoBackgroundEarly detection and intervention for neurodevelopmental disorders are effective. Several types of paper questionnaires have been developed to assess these conditions in early childhood; however, the psychometric equivalence between the web-based and the paper versions of these questionnaires is unknown. ObjectiveThis study examined the interformat reliability of the web-based parent-rated version of the Autism Spectrum Screening Questionnaire (ASSQ), Attention-Deficit/Hyperactivity Disorder Rating Scale (ADHD-RS), Developmental Coordination Disorder Questionnaire 2007 (DCDQ), and Strengths and Difficulties Questionnaire (SDQ) among Japanese preschoolers in a community developmental health check-up setting. MethodsA set of paper-based questionnaires were distributed for voluntary completion to parents of children aged 5 years. The package of the paper format questionnaires included the ASSQ, ADHD-RS, DCDQ, parent-reported SDQ (P-SDQ), and several additional demographic questions. Responses were received from 508 parents of children who agreed to participate in the study. After 3 months, 300 parents, who were among the initial responders, were randomly selected and asked to complete the web-based versions of these questionnaires. A total of 140 parents replied to the web-based format and were included as a final sample in this study. ResultsWe obtained the McDonald ω coefficients for both the web-based and paper formats of the ASSQ (web-based: ω=.90; paper: ω=.86), ADHD-RS total and subscales (web-based: ω=.88-.94; paper: ω=.87-.93), DCDQ total and subscales (web-based: ω=.82-.94; paper: ω=.74-.92), and P-SDQ total and subscales (web-based: ω=.55-.81; paper: ω=.52-.80). The intraclass correlation coefficients between the web-based and paper formats were all significant at the 99.9% confidence level: ASSQ (r=0.66, P<.001); ADHD-RS total and subscales (r=0.66-0.74, P<.001); DCDQ total and subscales (r=0.66-0.71, P<.001); P-SDQ Total Difficulties and subscales (r=0.55-0.73, P<.001). There were no significant differences between the web-based and paper formats for total mean score of the ASSQ (P=.76), total (P=.12) and subscale (P=.11-.47) mean scores of DCDQ, and the P-SDQ Total Difficulties mean score (P=.20) and mean subscale scores (P=.28-.79). Although significant differences were found between the web-based and paper formats for mean ADHD-RS scores (total: t132=2.83, P=.005; Inattention subscale: t133=2.15, P=.03; Hyperactivity/Impulsivity subscale: t133=3.21, P=.002), the effect sizes were small (Cohen d=0.18-0.22). ConclusionsThese results suggest that the web-based versions of the ASSQ, ADHD-RS, DCDQ, and P-SDQ were equivalent, with the same level of internal consistency and intrarater reliability as the paper versions, indicating the applicability of the web-based versions of these questionnaires for assessing neurodevelopmental disorders.https://pediatrics.jmir.org/2021/1/e20172 |
| spellingShingle | Tanaka, Masanori Saito, Manabu Takahashi, Michio Adachi, Masaki Nakamura, Kazuhiko Interformat Reliability of Web-Based Parent-Rated Questionnaires for Assessing Neurodevelopmental Disorders Among Preschoolers: Cross-sectional Community Study JMIR Pediatrics and Parenting |
| title | Interformat Reliability of Web-Based Parent-Rated Questionnaires for Assessing Neurodevelopmental Disorders Among Preschoolers: Cross-sectional Community Study |
| title_full | Interformat Reliability of Web-Based Parent-Rated Questionnaires for Assessing Neurodevelopmental Disorders Among Preschoolers: Cross-sectional Community Study |
| title_fullStr | Interformat Reliability of Web-Based Parent-Rated Questionnaires for Assessing Neurodevelopmental Disorders Among Preschoolers: Cross-sectional Community Study |
| title_full_unstemmed | Interformat Reliability of Web-Based Parent-Rated Questionnaires for Assessing Neurodevelopmental Disorders Among Preschoolers: Cross-sectional Community Study |
| title_short | Interformat Reliability of Web-Based Parent-Rated Questionnaires for Assessing Neurodevelopmental Disorders Among Preschoolers: Cross-sectional Community Study |
| title_sort | interformat reliability of web based parent rated questionnaires for assessing neurodevelopmental disorders among preschoolers cross sectional community study |
| url | https://pediatrics.jmir.org/2021/1/e20172 |
| work_keys_str_mv | AT tanakamasanori interformatreliabilityofwebbasedparentratedquestionnairesforassessingneurodevelopmentaldisordersamongpreschoolerscrosssectionalcommunitystudy AT saitomanabu interformatreliabilityofwebbasedparentratedquestionnairesforassessingneurodevelopmentaldisordersamongpreschoolerscrosssectionalcommunitystudy AT takahashimichio interformatreliabilityofwebbasedparentratedquestionnairesforassessingneurodevelopmentaldisordersamongpreschoolerscrosssectionalcommunitystudy AT adachimasaki interformatreliabilityofwebbasedparentratedquestionnairesforassessingneurodevelopmentaldisordersamongpreschoolerscrosssectionalcommunitystudy AT nakamurakazuhiko interformatreliabilityofwebbasedparentratedquestionnairesforassessingneurodevelopmentaldisordersamongpreschoolerscrosssectionalcommunitystudy |