Using process features to investigate scientific problem-solving in large-scale assessments
IntroductionThis study investigates the process data from scientific inquiry tasks of fair tests [requiring test-takers to manipulate a target variable while keeping other(s) constant] and exhaustive tests (requiring test-takers to construct all combinations of given variables) in the National Asses...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2023-04-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1131019/full |
| _version_ | 1797845024451330048 |
|---|---|
| author | Tao Gong Tao Gong Tao Gong Lan Shuai Yang Jiang Burcu Arslan |
| author_facet | Tao Gong Tao Gong Tao Gong Lan Shuai Yang Jiang Burcu Arslan |
| author_sort | Tao Gong |
| collection | DOAJ |
| description | IntroductionThis study investigates the process data from scientific inquiry tasks of fair tests [requiring test-takers to manipulate a target variable while keeping other(s) constant] and exhaustive tests (requiring test-takers to construct all combinations of given variables) in the National Assessment of Educational Progress program.MethodsWe identify significant associations between item scores and temporal features of preparation time, execution time, and mean execution time.ResultsReflecting, respectively, durations of action planning and execution, and execution efficiency, these process features quantitatively differentiate the high- and low-performing students: in the fair tests, high-performing students tended to exhibit shorter execution time than low-performing ones, but in the exhaustive tests, they showed longer execution time; and in both types of tests, high-performing students had shorter mean execution time than low-performing ones.DiscussionThis study enriches process features reflecting scientific problem-solving process and competence and sheds important light on how to improve performance in large-scale, online delivered scientific inquiry tasks. |
| first_indexed | 2024-04-09T17:31:52Z |
| format | Article |
| id | doaj.art-d0c38d4d7c84440db834e3feb31e1c5c |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-04-09T17:31:52Z |
| publishDate | 2023-04-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-d0c38d4d7c84440db834e3feb31e1c5c2023-04-18T04:48:43ZengFrontiers Media S.A.Frontiers in Psychology1664-10782023-04-011410.3389/fpsyg.2023.11310191131019Using process features to investigate scientific problem-solving in large-scale assessmentsTao Gong0Tao Gong1Tao Gong2Lan Shuai3Yang Jiang4Burcu Arslan5School of Foreign Languages, Zhejiang University of Finance and Economics, Hangzhou, Zhejiang, ChinaEducational Testing Service, Princeton, NJ, United StatesGoogle, New York, NY, United StatesEducational Testing Service, Princeton, NJ, United StatesEducational Testing Service, Princeton, NJ, United StatesEducational Testing Service, Princeton, NJ, United StatesIntroductionThis study investigates the process data from scientific inquiry tasks of fair tests [requiring test-takers to manipulate a target variable while keeping other(s) constant] and exhaustive tests (requiring test-takers to construct all combinations of given variables) in the National Assessment of Educational Progress program.MethodsWe identify significant associations between item scores and temporal features of preparation time, execution time, and mean execution time.ResultsReflecting, respectively, durations of action planning and execution, and execution efficiency, these process features quantitatively differentiate the high- and low-performing students: in the fair tests, high-performing students tended to exhibit shorter execution time than low-performing ones, but in the exhaustive tests, they showed longer execution time; and in both types of tests, high-performing students had shorter mean execution time than low-performing ones.DiscussionThis study enriches process features reflecting scientific problem-solving process and competence and sheds important light on how to improve performance in large-scale, online delivered scientific inquiry tasks.https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1131019/fullscientific problem solvingfair testexhaustive testpreparation timeexecution time |
| spellingShingle | Tao Gong Tao Gong Tao Gong Lan Shuai Yang Jiang Burcu Arslan Using process features to investigate scientific problem-solving in large-scale assessments Frontiers in Psychology scientific problem solving fair test exhaustive test preparation time execution time |
| title | Using process features to investigate scientific problem-solving in large-scale assessments |
| title_full | Using process features to investigate scientific problem-solving in large-scale assessments |
| title_fullStr | Using process features to investigate scientific problem-solving in large-scale assessments |
| title_full_unstemmed | Using process features to investigate scientific problem-solving in large-scale assessments |
| title_short | Using process features to investigate scientific problem-solving in large-scale assessments |
| title_sort | using process features to investigate scientific problem solving in large scale assessments |
| topic | scientific problem solving fair test exhaustive test preparation time execution time |
| url | https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1131019/full |
| work_keys_str_mv | AT taogong usingprocessfeaturestoinvestigatescientificproblemsolvinginlargescaleassessments AT taogong usingprocessfeaturestoinvestigatescientificproblemsolvinginlargescaleassessments AT taogong usingprocessfeaturestoinvestigatescientificproblemsolvinginlargescaleassessments AT lanshuai usingprocessfeaturestoinvestigatescientificproblemsolvinginlargescaleassessments AT yangjiang usingprocessfeaturestoinvestigatescientificproblemsolvinginlargescaleassessments AT burcuarslan usingprocessfeaturestoinvestigatescientificproblemsolvinginlargescaleassessments |