Comparing the psychometric properties of two primary school Computational Thinking (CT) assessments for grades 3 and 4: The Beginners' CT test (BCTt) and the competent CT test (cCTt)
IntroductionWith the increasing amount of research around Computational Thinking (CT) and endeavors introducing CT into curricula worldwide, assessing CT at all levels of formal education is of utmost importance to ensure that CT-related learning objectives are met. This has contributed to a progres...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2022-12-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fpsyg.2022.1082659/full |
| _version_ | 1811203264340819968 |
|---|---|
| author | Laila El-Hamamsy Laila El-Hamamsy María Zapata-Cáceres Pedro Marcelino Barbara Bruno Jessica Dehler Zufferey Estefanía Martín-Barroso Marcos Román-González |
| author_facet | Laila El-Hamamsy Laila El-Hamamsy María Zapata-Cáceres Pedro Marcelino Barbara Bruno Jessica Dehler Zufferey Estefanía Martín-Barroso Marcos Román-González |
| author_sort | Laila El-Hamamsy |
| collection | DOAJ |
| description | IntroductionWith the increasing amount of research around Computational Thinking (CT) and endeavors introducing CT into curricula worldwide, assessing CT at all levels of formal education is of utmost importance to ensure that CT-related learning objectives are met. This has contributed to a progressive increase in the number of validated and reliable CT assessments for K-12, including primary school. Researchers and practitioners are thus required to choose among multiple instruments, often overlapping in their age validity.MethodsIn this study, we compare the psychometric properties of two of these instruments: the Beginners' CT test (BCTt), developed for grades 1–6, and the competent CT test (cCTt), validated for grades 3–4. Classical Test Theory and Item Response Theory (IRT) were employed on data acquired from 575 students in grades 3–4 to compare the properties of the two instruments and refine the limits of their validity.ResultsThe findings (i) establish the detailed psychometric properties of the BCTt in grades 3–4 for the first time, and (ii) through a comparison with students from the same country, indicate that the cCTt should be preferred for grades 3–4 as the cCTt is able to discriminate between students of low and medium ability. Conversely, while the BCTt, which is easier, shows a ceiling effect, it is better suited to discriminate between students in the low ability range. For these grades, the BCTt can thus be employed as a screening mechanism to identify low ability students.DiscussionIn addition to providing recomendations for use of these instruments, the findings highlight the importance of comparing the psychometric properties of existing assessments, so that researchers and practitioners, including teachers and policy makers involved in digital education curricular reforms, may take informed decisions when selecting assessments. |
| first_indexed | 2024-04-12T02:51:47Z |
| format | Article |
| id | doaj.art-4ed6b67ca4ab4b55a50f0fed45eb9e53 |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-04-12T02:51:47Z |
| publishDate | 2022-12-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-4ed6b67ca4ab4b55a50f0fed45eb9e532022-12-22T03:50:57ZengFrontiers Media S.A.Frontiers in Psychology1664-10782022-12-011310.3389/fpsyg.2022.10826591082659Comparing the psychometric properties of two primary school Computational Thinking (CT) assessments for grades 3 and 4: The Beginners' CT test (BCTt) and the competent CT test (cCTt)Laila El-Hamamsy0Laila El-Hamamsy1María Zapata-Cáceres2Pedro Marcelino3Barbara Bruno4Jessica Dehler Zufferey5Estefanía Martín-Barroso6Marcos Román-González7MOBOTS Group, Ecole Polytechnique Fédérale de Lausanne, Lausanne, SwitzerlandLEARN - Center for Learning Sciences, Ecole Polytechnique Fédérale de Lausanne, Lausanne, SwitzerlandLaboratory of Information Technologies in Education, Rey Juan Carlos University, Madrid, SpainComputational Thinking Department, TreeTree2 (T2), Lisbon, PortugalCHILI Laboratory, Ecole Polytechnique Fédérale de Lausanne, Lausanne, SwitzerlandLEARN - Center for Learning Sciences, Ecole Polytechnique Fédérale de Lausanne, Lausanne, SwitzerlandLaboratory of Information Technologies in Education, Rey Juan Carlos University, Madrid, SpainFaculty of Education, Universidad Nacional de Educación a Distancia (UNED), Madrid, SpainIntroductionWith the increasing amount of research around Computational Thinking (CT) and endeavors introducing CT into curricula worldwide, assessing CT at all levels of formal education is of utmost importance to ensure that CT-related learning objectives are met. This has contributed to a progressive increase in the number of validated and reliable CT assessments for K-12, including primary school. Researchers and practitioners are thus required to choose among multiple instruments, often overlapping in their age validity.MethodsIn this study, we compare the psychometric properties of two of these instruments: the Beginners' CT test (BCTt), developed for grades 1–6, and the competent CT test (cCTt), validated for grades 3–4. Classical Test Theory and Item Response Theory (IRT) were employed on data acquired from 575 students in grades 3–4 to compare the properties of the two instruments and refine the limits of their validity.ResultsThe findings (i) establish the detailed psychometric properties of the BCTt in grades 3–4 for the first time, and (ii) through a comparison with students from the same country, indicate that the cCTt should be preferred for grades 3–4 as the cCTt is able to discriminate between students of low and medium ability. Conversely, while the BCTt, which is easier, shows a ceiling effect, it is better suited to discriminate between students in the low ability range. For these grades, the BCTt can thus be employed as a screening mechanism to identify low ability students.DiscussionIn addition to providing recomendations for use of these instruments, the findings highlight the importance of comparing the psychometric properties of existing assessments, so that researchers and practitioners, including teachers and policy makers involved in digital education curricular reforms, may take informed decisions when selecting assessments.https://www.frontiersin.org/articles/10.3389/fpsyg.2022.1082659/fullComputational Thinkingassessmentprimary schoolvalidationdevelopmental appropriatenesspsychometrics |
| spellingShingle | Laila El-Hamamsy Laila El-Hamamsy María Zapata-Cáceres Pedro Marcelino Barbara Bruno Jessica Dehler Zufferey Estefanía Martín-Barroso Marcos Román-González Comparing the psychometric properties of two primary school Computational Thinking (CT) assessments for grades 3 and 4: The Beginners' CT test (BCTt) and the competent CT test (cCTt) Frontiers in Psychology Computational Thinking assessment primary school validation developmental appropriateness psychometrics |
| title | Comparing the psychometric properties of two primary school Computational Thinking (CT) assessments for grades 3 and 4: The Beginners' CT test (BCTt) and the competent CT test (cCTt) |
| title_full | Comparing the psychometric properties of two primary school Computational Thinking (CT) assessments for grades 3 and 4: The Beginners' CT test (BCTt) and the competent CT test (cCTt) |
| title_fullStr | Comparing the psychometric properties of two primary school Computational Thinking (CT) assessments for grades 3 and 4: The Beginners' CT test (BCTt) and the competent CT test (cCTt) |
| title_full_unstemmed | Comparing the psychometric properties of two primary school Computational Thinking (CT) assessments for grades 3 and 4: The Beginners' CT test (BCTt) and the competent CT test (cCTt) |
| title_short | Comparing the psychometric properties of two primary school Computational Thinking (CT) assessments for grades 3 and 4: The Beginners' CT test (BCTt) and the competent CT test (cCTt) |
| title_sort | comparing the psychometric properties of two primary school computational thinking ct assessments for grades 3 and 4 the beginners ct test bctt and the competent ct test cctt |
| topic | Computational Thinking assessment primary school validation developmental appropriateness psychometrics |
| url | https://www.frontiersin.org/articles/10.3389/fpsyg.2022.1082659/full |
| work_keys_str_mv | AT lailaelhamamsy comparingthepsychometricpropertiesoftwoprimaryschoolcomputationalthinkingctassessmentsforgrades3and4thebeginnerscttestbcttandthecompetentcttestcctt AT lailaelhamamsy comparingthepsychometricpropertiesoftwoprimaryschoolcomputationalthinkingctassessmentsforgrades3and4thebeginnerscttestbcttandthecompetentcttestcctt AT mariazapatacaceres comparingthepsychometricpropertiesoftwoprimaryschoolcomputationalthinkingctassessmentsforgrades3and4thebeginnerscttestbcttandthecompetentcttestcctt AT pedromarcelino comparingthepsychometricpropertiesoftwoprimaryschoolcomputationalthinkingctassessmentsforgrades3and4thebeginnerscttestbcttandthecompetentcttestcctt AT barbarabruno comparingthepsychometricpropertiesoftwoprimaryschoolcomputationalthinkingctassessmentsforgrades3and4thebeginnerscttestbcttandthecompetentcttestcctt AT jessicadehlerzufferey comparingthepsychometricpropertiesoftwoprimaryschoolcomputationalthinkingctassessmentsforgrades3and4thebeginnerscttestbcttandthecompetentcttestcctt AT estefaniamartinbarroso comparingthepsychometricpropertiesoftwoprimaryschoolcomputationalthinkingctassessmentsforgrades3and4thebeginnerscttestbcttandthecompetentcttestcctt AT marcosromangonzalez comparingthepsychometricpropertiesoftwoprimaryschoolcomputationalthinkingctassessmentsforgrades3and4thebeginnerscttestbcttandthecompetentcttestcctt |