Effects of testing conditions on conceptual survey results

Pre-testing and post-testing is a commonly used method in Physics Education Research to assess student learning gains. It is well recognized in the community that timings and incentives in delivering conceptual tests can impact test results. However, it is difficult to control these variables across...

Full description

Bibliographic Details
Main Authors: Lin Ding, Neville W. Reay, Albert Lee, Lei Bao
Format: Article
Language:English
Published: American Physical Society 2008-06-01
Series:Physical Review Special Topics. Physics Education Research
Online Access:http://link.aps.org/abstract/PRSTPER/v4/e010112
_version_ 1818929784622678016
author Lin Ding
Neville W. Reay
Albert Lee
Lei Bao
author_facet Lin Ding
Neville W. Reay
Albert Lee
Lei Bao
author_sort Lin Ding
collection DOAJ
description Pre-testing and post-testing is a commonly used method in Physics Education Research to assess student learning gains. It is well recognized in the community that timings and incentives in delivering conceptual tests can impact test results. However, it is difficult to control these variables across different studies. As a common practice, a pre-test is often administered either at or near the beginning of a course, while a post-test can be given either at or near the end of a course. Also, in conducting such tests there often is no norm as to whether incentives should be offered to students. Because these variations can significantly affect test results, it is important to study and document their impact. We analyzed five years of data that were collected at The Ohio State University from over 2100 students, who took both the pre-test and post-test of the Conceptual Survey of Electricity and Magnetism under various timings and incentives. We observed that the actual time frame for giving a test has a marked effect on the test results and that incentive granting also has a significant influence on test outcomes. These results suggest that one should carefully monitor and document the conditions under which tests are administered.
first_indexed 2024-12-20T03:50:18Z
format Article
id doaj.art-4bec55d124a44e77ae7f5ca7d6454738
institution Directory Open Access Journal
issn 1554-9178
language English
last_indexed 2024-12-20T03:50:18Z
publishDate 2008-06-01
publisher American Physical Society
record_format Article
series Physical Review Special Topics. Physics Education Research
spelling doaj.art-4bec55d124a44e77ae7f5ca7d64547382022-12-21T19:54:28ZengAmerican Physical SocietyPhysical Review Special Topics. Physics Education Research1554-91782008-06-0141Effects of testing conditions on conceptual survey resultsLin DingNeville W. ReayAlbert LeeLei BaoPre-testing and post-testing is a commonly used method in Physics Education Research to assess student learning gains. It is well recognized in the community that timings and incentives in delivering conceptual tests can impact test results. However, it is difficult to control these variables across different studies. As a common practice, a pre-test is often administered either at or near the beginning of a course, while a post-test can be given either at or near the end of a course. Also, in conducting such tests there often is no norm as to whether incentives should be offered to students. Because these variations can significantly affect test results, it is important to study and document their impact. We analyzed five years of data that were collected at The Ohio State University from over 2100 students, who took both the pre-test and post-test of the Conceptual Survey of Electricity and Magnetism under various timings and incentives. We observed that the actual time frame for giving a test has a marked effect on the test results and that incentive granting also has a significant influence on test outcomes. These results suggest that one should carefully monitor and document the conditions under which tests are administered.http://link.aps.org/abstract/PRSTPER/v4/e010112
spellingShingle Lin Ding
Neville W. Reay
Albert Lee
Lei Bao
Effects of testing conditions on conceptual survey results
Physical Review Special Topics. Physics Education Research
title Effects of testing conditions on conceptual survey results
title_full Effects of testing conditions on conceptual survey results
title_fullStr Effects of testing conditions on conceptual survey results
title_full_unstemmed Effects of testing conditions on conceptual survey results
title_short Effects of testing conditions on conceptual survey results
title_sort effects of testing conditions on conceptual survey results
url http://link.aps.org/abstract/PRSTPER/v4/e010112
work_keys_str_mv AT linding effectsoftestingconditionsonconceptualsurveyresults
AT nevillewreay effectsoftestingconditionsonconceptualsurveyresults
AT albertlee effectsoftestingconditionsonconceptualsurveyresults
AT leibao effectsoftestingconditionsonconceptualsurveyresults