The construction and validation of the primary scientific reasoning test

<p>A major task of science education is to foster scientific reasoning. Despite extensive research, it is still unclear how best to assess this cognitive proficiency; a limited consensus of its nature has arguably constrained the development of classroom assessments of scientific reasoning. Th...

Full description

Bibliographic Details
Main Author: Diana, N
Other Authors: Baird, J
Format: Thesis
Language:English
Published: 2018
Subjects:
_version_ 1797078471551221760
author Diana, N
author2 Baird, J
author_facet Baird, J
Diana, N
author_sort Diana, N
collection OXFORD
description <p>A major task of science education is to foster scientific reasoning. Despite extensive research, it is still unclear how best to assess this cognitive proficiency; a limited consensus of its nature has arguably constrained the development of classroom assessments of scientific reasoning. Therefore, this research aimed to develop a valid and reliable test of scientific reasoning – the Primary Scientific Reasoning Test (PSRT) – for primary-aged pupils. Developments in science education, as well as emerging and novel insights across substantive literature, formed the theoretical framework underlying the PSRT. </p> <p>A mixed methodology was used to develop and validate the PSRT over four phases. The first phase developed the theoretical framework and the draft items. In the next phase, an 18-member expert panel from Singapore and England evaluated and endorsed the conceptual validity of the construct and the content validity of the draft items. The third phase field-tested and refined the draft instrument with 138 Year 7 pupils from four Singapore secondary schools. In the fourth and last phase, 431 Year 6 pupils from six Singapore primary schools attempted the finalised 100-item PSRT. Results from psychometric analysis using Rasch modelling supported inferences of a unidimensional construct underlying the test, and examination of the item difficulty estimates produced evidence that the order of difficulties generally accorded with the framework of scientific reasoning. </p> <p>Given that the explanatory concepts in the framework generally explained the pupils’ performance and drawing on the strength and scope of other evidence, the thesis concludes that the PSRT displayed reasonably strong construct validity. This conclusion supports the use of PSRT as a valid and reliable measure of scientific reasoning for primary-aged pupils. The theoretical basis of the PSRT and its construction procedures also bear lessons for test developers and researchers. Overall, the study contributes clarification and understanding about the nature and assessment of scientific reasoning, particularly for primary-aged pupils.</p>
first_indexed 2024-03-07T00:32:19Z
format Thesis
id oxford-uuid:803ed746-57ae-4e54-b360-fd30ae2d7af6
institution University of Oxford
language English
last_indexed 2024-03-07T00:32:19Z
publishDate 2018
record_format dspace
spelling oxford-uuid:803ed746-57ae-4e54-b360-fd30ae2d7af62022-03-26T21:21:58ZThe construction and validation of the primary scientific reasoning testThesishttp://purl.org/coar/resource_type/c_db06uuid:803ed746-57ae-4e54-b360-fd30ae2d7af6Scientific ReasoningTest of Scientific ReasoningPrimary School ScienceScientific ThinkingConstruct ValidationEnglishORA Deposit2018Diana, NBaird, JMcGrane, J<p>A major task of science education is to foster scientific reasoning. Despite extensive research, it is still unclear how best to assess this cognitive proficiency; a limited consensus of its nature has arguably constrained the development of classroom assessments of scientific reasoning. Therefore, this research aimed to develop a valid and reliable test of scientific reasoning – the Primary Scientific Reasoning Test (PSRT) – for primary-aged pupils. Developments in science education, as well as emerging and novel insights across substantive literature, formed the theoretical framework underlying the PSRT. </p> <p>A mixed methodology was used to develop and validate the PSRT over four phases. The first phase developed the theoretical framework and the draft items. In the next phase, an 18-member expert panel from Singapore and England evaluated and endorsed the conceptual validity of the construct and the content validity of the draft items. The third phase field-tested and refined the draft instrument with 138 Year 7 pupils from four Singapore secondary schools. In the fourth and last phase, 431 Year 6 pupils from six Singapore primary schools attempted the finalised 100-item PSRT. Results from psychometric analysis using Rasch modelling supported inferences of a unidimensional construct underlying the test, and examination of the item difficulty estimates produced evidence that the order of difficulties generally accorded with the framework of scientific reasoning. </p> <p>Given that the explanatory concepts in the framework generally explained the pupils’ performance and drawing on the strength and scope of other evidence, the thesis concludes that the PSRT displayed reasonably strong construct validity. This conclusion supports the use of PSRT as a valid and reliable measure of scientific reasoning for primary-aged pupils. The theoretical basis of the PSRT and its construction procedures also bear lessons for test developers and researchers. Overall, the study contributes clarification and understanding about the nature and assessment of scientific reasoning, particularly for primary-aged pupils.</p>
spellingShingle Scientific Reasoning
Test of Scientific Reasoning
Primary School Science
Scientific Thinking
Construct Validation
Diana, N
The construction and validation of the primary scientific reasoning test
title The construction and validation of the primary scientific reasoning test
title_full The construction and validation of the primary scientific reasoning test
title_fullStr The construction and validation of the primary scientific reasoning test
title_full_unstemmed The construction and validation of the primary scientific reasoning test
title_short The construction and validation of the primary scientific reasoning test
title_sort construction and validation of the primary scientific reasoning test
topic Scientific Reasoning
Test of Scientific Reasoning
Primary School Science
Scientific Thinking
Construct Validation
work_keys_str_mv AT dianan theconstructionandvalidationoftheprimaryscientificreasoningtest
AT dianan constructionandvalidationoftheprimaryscientificreasoningtest