A Methodological Review of the Program Evaluations in K-12 Computer Science Education
Because of the potential for methodological reviews to improve practice, this article presents the results of a methodological review, and meta-analysis, of kindergarten through 12th grade computer science education evaluation reports published before March 2005. A search of major academic databases...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Vilnius University
2008-10-01
|
| Series: | Informatics in Education |
| Subjects: | |
| Online Access: | https://infedu.vu.lt/doi/10.15388/infedu.2008.15 |
| _version_ | 1798035594894376960 |
|---|---|
| author | Justus J. RANDOLPH |
| author_facet | Justus J. RANDOLPH |
| author_sort | Justus J. RANDOLPH |
| collection | DOAJ |
| description | Because of the potential for methodological reviews to improve practice, this article presents the results of a methodological review, and meta-analysis, of kindergarten through 12th grade computer science education evaluation reports published before March 2005. A search of major academic databases, the Internet, and a query to computer science education researchers resulted in 29 evaluation reports that met stringent criteria for inclusion. Those reports were coded in terms of their demographic characteristics, program characteristics, evaluation characteristics, and evaluation findings.
It was found that most of the programs offered direct computer science instruction to North American high school students. Stakeholder attitudes, program enrollment, academic achievement in core courses, and achievement in computer science courses were the most frequently measured outcomes. Questionnaires, existing sources of data, standardized tests, and teacher- or researcher-made tests were the most frequently used types of measures. Based on eight programs that offered direct computer science instruction, the average increase on tests of computer science achievement over the course of the program was 1.10 standard deviations, or the statistical equivalent of 73 out of 100 program participants having shown improvement. Some of the main challenges for the evaluation of computer science education programs are the absence of standardized, reliable, and valid measures of K-12 computer science education and coming to understand the causal links between program activities, gender, and program outcomes. |
| first_indexed | 2024-04-11T21:00:18Z |
| format | Article |
| id | doaj.art-8e9fa9e947d64447bfa6bb899cf55ac4 |
| institution | Directory Open Access Journal |
| issn | 1648-5831 2335-8971 |
| language | English |
| last_indexed | 2024-04-11T21:00:18Z |
| publishDate | 2008-10-01 |
| publisher | Vilnius University |
| record_format | Article |
| series | Informatics in Education |
| spelling | doaj.art-8e9fa9e947d64447bfa6bb899cf55ac42022-12-22T04:03:32ZengVilnius UniversityInformatics in Education1648-58312335-89712008-10-017223725810.15388/infedu.2008.15A Methodological Review of the Program Evaluations in K-12 Computer Science EducationJustus J. RANDOLPH0Department of Computer Science and Statistics, University of Joensuu P.O. Box 111, FIN-80101 Joensuu, FinlandBecause of the potential for methodological reviews to improve practice, this article presents the results of a methodological review, and meta-analysis, of kindergarten through 12th grade computer science education evaluation reports published before March 2005. A search of major academic databases, the Internet, and a query to computer science education researchers resulted in 29 evaluation reports that met stringent criteria for inclusion. Those reports were coded in terms of their demographic characteristics, program characteristics, evaluation characteristics, and evaluation findings. It was found that most of the programs offered direct computer science instruction to North American high school students. Stakeholder attitudes, program enrollment, academic achievement in core courses, and achievement in computer science courses were the most frequently measured outcomes. Questionnaires, existing sources of data, standardized tests, and teacher- or researcher-made tests were the most frequently used types of measures. Based on eight programs that offered direct computer science instruction, the average increase on tests of computer science achievement over the course of the program was 1.10 standard deviations, or the statistical equivalent of 73 out of 100 program participants having shown improvement. Some of the main challenges for the evaluation of computer science education programs are the absence of standardized, reliable, and valid measures of K-12 computer science education and coming to understand the causal links between program activities, gender, and program outcomes.https://infedu.vu.lt/doi/10.15388/infedu.2008.15methodological reviewmeta-analysiscomputer science educationevaluationmethods |
| spellingShingle | Justus J. RANDOLPH A Methodological Review of the Program Evaluations in K-12 Computer Science Education Informatics in Education methodological review meta-analysis computer science education evaluation methods |
| title | A Methodological Review of the Program Evaluations in K-12 Computer Science Education |
| title_full | A Methodological Review of the Program Evaluations in K-12 Computer Science Education |
| title_fullStr | A Methodological Review of the Program Evaluations in K-12 Computer Science Education |
| title_full_unstemmed | A Methodological Review of the Program Evaluations in K-12 Computer Science Education |
| title_short | A Methodological Review of the Program Evaluations in K-12 Computer Science Education |
| title_sort | methodological review of the program evaluations in k 12 computer science education |
| topic | methodological review meta-analysis computer science education evaluation methods |
| url | https://infedu.vu.lt/doi/10.15388/infedu.2008.15 |
| work_keys_str_mv | AT justusjrandolph amethodologicalreviewoftheprogramevaluationsink12computerscienceeducation AT justusjrandolph methodologicalreviewoftheprogramevaluationsink12computerscienceeducation |