Assessment of Competencies in Scientific Inquiry Through the Application of Rasch Measurement Techniques
Achieving competence in scientific inquiry or mastering scientific practices is an essential element of scientific literacy. Clearly, if students’ Scientific Inquiry Competence (SIC) is to be improved, a critical step is to reliably measure it and provide from this measurement feedback for...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2018-10-01
|
| Series: | Education Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2227-7102/8/4/184 |
| _version_ | 1828136300015779840 |
|---|---|
| author | Julia C. Arnold William J. Boone Kerstin Kremer Jürgen Mayer |
| author_facet | Julia C. Arnold William J. Boone Kerstin Kremer Jürgen Mayer |
| author_sort | Julia C. Arnold |
| collection | DOAJ |
| description | Achieving competence in scientific inquiry or mastering scientific practices is an essential element of scientific literacy. Clearly, if students’ Scientific Inquiry Competence (SIC) is to be improved, a critical step is to reliably measure it and provide from this measurement feedback for teaching. Although numerous instruments were presented in literature to assess SIC, the specific potential of Rasch measurement for the integration of research assessment and individual feedback onto SIC is so far underestimated. This article presents details regarding the design and evaluation of a test instrument using an open-response format to measure students’ SIC in content-rich biology contexts at the upper secondary level. First, a set of three sub-competences (“generating hypotheses„, “designing experiments„ and “analyzing data„) each composed of five competence aspects is introduced from literature to define the SIC construct. The SIC instrument was then operationalized using six open-ended partial-credit items. After pilot testing, the instrument was administered to <i>N</i> = 220 students (ages 15⁻19) before and after an inquiry-based unit on enzymes. Instrument functioning was evaluated using the Rasch Partial-Credit Model and first results towards satisfactory instrument functioning (e.g., validity and reliability) are presented. Particularly noteworthy is that the observed pattern in competence difficulty matched the pattern predicted from theoretical considerations. We demonstrate how the SIC instrument can be used for competence assessment and the evaluation of the effectiveness of learning. |
| first_indexed | 2024-04-11T18:00:47Z |
| format | Article |
| id | doaj.art-3bda8473e159401cb488020a63c737af |
| institution | Directory Open Access Journal |
| issn | 2227-7102 |
| language | English |
| last_indexed | 2024-04-11T18:00:47Z |
| publishDate | 2018-10-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Education Sciences |
| spelling | doaj.art-3bda8473e159401cb488020a63c737af2022-12-22T04:10:28ZengMDPI AGEducation Sciences2227-71022018-10-018418410.3390/educsci8040184educsci8040184Assessment of Competencies in Scientific Inquiry Through the Application of Rasch Measurement TechniquesJulia C. Arnold0William J. Boone1Kerstin Kremer2Jürgen Mayer3Centre for Science and Technology Education, School of Education, University of Applied Sciences and Arts Northwestern Switzerland, 5210 Muttenz, SwitzerlandEducational Psychology, Miami University, Oxford, OH 45056, USABiology Education, IPN-Leibniz Institute for Science and Mathematics Education at Kiel University, 24118 Kiel, GermanyBiology Education, Kassel University, 34125 Kassel, GermanyAchieving competence in scientific inquiry or mastering scientific practices is an essential element of scientific literacy. Clearly, if students’ Scientific Inquiry Competence (SIC) is to be improved, a critical step is to reliably measure it and provide from this measurement feedback for teaching. Although numerous instruments were presented in literature to assess SIC, the specific potential of Rasch measurement for the integration of research assessment and individual feedback onto SIC is so far underestimated. This article presents details regarding the design and evaluation of a test instrument using an open-response format to measure students’ SIC in content-rich biology contexts at the upper secondary level. First, a set of three sub-competences (“generating hypotheses„, “designing experiments„ and “analyzing data„) each composed of five competence aspects is introduced from literature to define the SIC construct. The SIC instrument was then operationalized using six open-ended partial-credit items. After pilot testing, the instrument was administered to <i>N</i> = 220 students (ages 15⁻19) before and after an inquiry-based unit on enzymes. Instrument functioning was evaluated using the Rasch Partial-Credit Model and first results towards satisfactory instrument functioning (e.g., validity and reliability) are presented. Particularly noteworthy is that the observed pattern in competence difficulty matched the pattern predicted from theoretical considerations. We demonstrate how the SIC instrument can be used for competence assessment and the evaluation of the effectiveness of learning.https://www.mdpi.com/2227-7102/8/4/184scientific inquirycompetenceproblem-solvingbiologyRasch measurementinstrument development |
| spellingShingle | Julia C. Arnold William J. Boone Kerstin Kremer Jürgen Mayer Assessment of Competencies in Scientific Inquiry Through the Application of Rasch Measurement Techniques Education Sciences scientific inquiry competence problem-solving biology Rasch measurement instrument development |
| title | Assessment of Competencies in Scientific Inquiry Through the Application of Rasch Measurement Techniques |
| title_full | Assessment of Competencies in Scientific Inquiry Through the Application of Rasch Measurement Techniques |
| title_fullStr | Assessment of Competencies in Scientific Inquiry Through the Application of Rasch Measurement Techniques |
| title_full_unstemmed | Assessment of Competencies in Scientific Inquiry Through the Application of Rasch Measurement Techniques |
| title_short | Assessment of Competencies in Scientific Inquiry Through the Application of Rasch Measurement Techniques |
| title_sort | assessment of competencies in scientific inquiry through the application of rasch measurement techniques |
| topic | scientific inquiry competence problem-solving biology Rasch measurement instrument development |
| url | https://www.mdpi.com/2227-7102/8/4/184 |
| work_keys_str_mv | AT juliacarnold assessmentofcompetenciesinscientificinquirythroughtheapplicationofraschmeasurementtechniques AT williamjboone assessmentofcompetenciesinscientificinquirythroughtheapplicationofraschmeasurementtechniques AT kerstinkremer assessmentofcompetenciesinscientificinquirythroughtheapplicationofraschmeasurementtechniques AT jurgenmayer assessmentofcompetenciesinscientificinquirythroughtheapplicationofraschmeasurementtechniques |