Unintended Consequences of using Tests to Improve Learning: How Improvement-Oriented Resources Heighten Conceptions of Assessment as School Accountability
Over the past decade, the New Zealand government has created a set of resources to support teachers’ use of assessment for learning. These include Assessment Tools for Teaching and Learning (asTTle), a software program enabling teachers to create personalized but standardized tests for diagnostic pu...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
The Evaluation Center at Western Michigan University
2009-06-01
|
| Series: | Journal of MultiDisciplinary Evaluation |
| Subjects: | |
| Online Access: | http://survey.ate.wmich.edu/jmde/index.php/jmde_1/article/view/236/230 |
| _version_ | 1797722924429344768 |
|---|---|
| author | Gavin Brown Lois Harris |
| author_facet | Gavin Brown Lois Harris |
| author_sort | Gavin Brown |
| collection | DOAJ |
| description | Over the past decade, the New Zealand government has created a set of resources to support teachers’ use of assessment for learning. These include Assessment Tools for Teaching and Learning (asTTle), a software program enabling teachers to create personalized but standardized tests for diagnostic purposes, and Assess to Learn (AtoL), an intensive professional development program. These resources were expected to increase teacher agreement that improvement is the major purpose of assessment. Instead, a 2008 sample of teachers completing the Teacher Conceptions of Assessment questionnaire showed significantly higher agreement that assessment is about school accountability than participants in previous national surveys. Unlike previous surveys, the correlation between school accountability and improvement conceptions was not statistically significant. However, as only the improvement conception predicted the practices teachers used to define assessment (β = .32), it appears that these teachers still saw many of the practices they used in the classroom (e.g. oral and interactive assessments) as improvement-oriented. Interviews with twenty-six of the surveyed teachers identified that while a few saw the new resources as contributing to improvement and accountability purposes, a larger group failed to make that connection. This second group seemed to be unable to accept that tests, an assessment genre traditionally associated with school and student accountability, could be meaningfully used for improvement at the classroom level. These data show that schools and individuals mediate the implementation of any policy initiative and can therefore cause it to have a range of often unintended consequences. In light of this, the thinking of teachers and other educational stakeholders should be taken into account when enacting policy changes. |
| first_indexed | 2024-03-12T09:55:44Z |
| format | Article |
| id | doaj.art-aef2d741de3e45dd962270fca27c2339 |
| institution | Directory Open Access Journal |
| issn | 1556-8180 |
| language | English |
| last_indexed | 2024-03-12T09:55:44Z |
| publishDate | 2009-06-01 |
| publisher | The Evaluation Center at Western Michigan University |
| record_format | Article |
| series | Journal of MultiDisciplinary Evaluation |
| spelling | doaj.art-aef2d741de3e45dd962270fca27c23392023-09-02T12:16:12ZengThe Evaluation Center at Western Michigan UniversityJournal of MultiDisciplinary Evaluation1556-81802009-06-016126891Unintended Consequences of using Tests to Improve Learning: How Improvement-Oriented Resources Heighten Conceptions of Assessment as School AccountabilityGavin BrownLois HarrisOver the past decade, the New Zealand government has created a set of resources to support teachers’ use of assessment for learning. These include Assessment Tools for Teaching and Learning (asTTle), a software program enabling teachers to create personalized but standardized tests for diagnostic purposes, and Assess to Learn (AtoL), an intensive professional development program. These resources were expected to increase teacher agreement that improvement is the major purpose of assessment. Instead, a 2008 sample of teachers completing the Teacher Conceptions of Assessment questionnaire showed significantly higher agreement that assessment is about school accountability than participants in previous national surveys. Unlike previous surveys, the correlation between school accountability and improvement conceptions was not statistically significant. However, as only the improvement conception predicted the practices teachers used to define assessment (β = .32), it appears that these teachers still saw many of the practices they used in the classroom (e.g. oral and interactive assessments) as improvement-oriented. Interviews with twenty-six of the surveyed teachers identified that while a few saw the new resources as contributing to improvement and accountability purposes, a larger group failed to make that connection. This second group seemed to be unable to accept that tests, an assessment genre traditionally associated with school and student accountability, could be meaningfully used for improvement at the classroom level. These data show that schools and individuals mediate the implementation of any policy initiative and can therefore cause it to have a range of often unintended consequences. In light of this, the thinking of teachers and other educational stakeholders should be taken into account when enacting policy changes.http://survey.ate.wmich.edu/jmde/index.php/jmde_1/article/view/236/230teacher thinkingteacher attitudesconceptions of assessmentschool accountability/evaluationelementary and secondary teachersstandardized testsprofessional development |
| spellingShingle | Gavin Brown Lois Harris Unintended Consequences of using Tests to Improve Learning: How Improvement-Oriented Resources Heighten Conceptions of Assessment as School Accountability Journal of MultiDisciplinary Evaluation teacher thinking teacher attitudes conceptions of assessment school accountability/evaluation elementary and secondary teachers standardized tests professional development |
| title | Unintended Consequences of using Tests to Improve Learning: How Improvement-Oriented Resources Heighten Conceptions of Assessment as School Accountability |
| title_full | Unintended Consequences of using Tests to Improve Learning: How Improvement-Oriented Resources Heighten Conceptions of Assessment as School Accountability |
| title_fullStr | Unintended Consequences of using Tests to Improve Learning: How Improvement-Oriented Resources Heighten Conceptions of Assessment as School Accountability |
| title_full_unstemmed | Unintended Consequences of using Tests to Improve Learning: How Improvement-Oriented Resources Heighten Conceptions of Assessment as School Accountability |
| title_short | Unintended Consequences of using Tests to Improve Learning: How Improvement-Oriented Resources Heighten Conceptions of Assessment as School Accountability |
| title_sort | unintended consequences of using tests to improve learning how improvement oriented resources heighten conceptions of assessment as school accountability |
| topic | teacher thinking teacher attitudes conceptions of assessment school accountability/evaluation elementary and secondary teachers standardized tests professional development |
| url | http://survey.ate.wmich.edu/jmde/index.php/jmde_1/article/view/236/230 |
| work_keys_str_mv | AT gavinbrown unintendedconsequencesofusingteststoimprovelearninghowimprovementorientedresourcesheightenconceptionsofassessmentasschoolaccountability AT loisharris unintendedconsequencesofusingteststoimprovelearninghowimprovementorientedresourcesheightenconceptionsofassessmentasschoolaccountability |