Assessing Complex Problem-Solving Skills in Under 20 Minutes
Abstract. Rationale: Assessing complex problem-solving skills (CPS) is of great interest to many researchers. However, existing assessments require long testing times making them difficult to include in many studies and experiments. Here, we propose a specific composition of microworlds based on the...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Hogrefe Publishing Group
2021-12-01
|
| Series: | Psychological Test Adaptation and Development |
| Subjects: | |
| Online Access: | https://econtent.hogrefe.com/doi/10.1027/2698-1866/a000009 |
| _version_ | 1797843611551793152 |
|---|---|
| author | Florian Krieger Matthias Stadler Markus Bühner Frank Fischer Samuel Greiff |
| author_facet | Florian Krieger Matthias Stadler Markus Bühner Frank Fischer Samuel Greiff |
| author_sort | Florian Krieger |
| collection | DOAJ |
| description | Abstract. Rationale: Assessing complex problem-solving skills (CPS) is of great interest to many researchers. However, existing assessments require long testing times making them difficult to include in many studies and experiments. Here, we propose a specific composition of microworlds based on the MicroDYN approach, which allows for valid estimation of CPS in a substantially reduced amount of time (<20 min). Methods: Based on the reanalysis of a sample of N = 232 university students who worked on 11 microworlds of increasing difficulty, we conducted multiple confirmatory factor analyses to test all possible combinations of microworlds, which were theoretically justified in advance. Results/Discussion: We demonstrate one best fitting set with five microworlds, which shows excellent factorial validity and relates to both conventional measures of intelligence and to school grades. We hope that this will allow other researchers to include CPS into their study designs even when testing time is limited. |
| first_indexed | 2024-04-09T17:08:06Z |
| format | Article |
| id | doaj.art-f160c1f7c5dd4af4a026abff5a6c790e |
| institution | Directory Open Access Journal |
| issn | 2698-1866 |
| language | English |
| last_indexed | 2024-04-09T17:08:06Z |
| publishDate | 2021-12-01 |
| publisher | Hogrefe Publishing Group |
| record_format | Article |
| series | Psychological Test Adaptation and Development |
| spelling | doaj.art-f160c1f7c5dd4af4a026abff5a6c790e2023-04-20T09:28:57ZengHogrefe Publishing GroupPsychological Test Adaptation and Development2698-18662021-12-0121809210.1027/2698-1866/a000009Assessing Complex Problem-Solving Skills in Under 20 MinutesFlorian Krieger0Matthias Stadler1Markus Bühner2Frank Fischer3Samuel Greiff4Cognitive Science & Assessment, University of Luxembourg, Esch-sur-Alzette, LuxembourgPsychology and Education, Ludwig-Maximilians-University of Munich, GermanyPsychology and Education, Ludwig-Maximilians-University of Munich, GermanyPsychology and Education, Ludwig-Maximilians-University of Munich, GermanyCognitive Science & Assessment, University of Luxembourg, Esch-sur-Alzette, LuxembourgAbstract. Rationale: Assessing complex problem-solving skills (CPS) is of great interest to many researchers. However, existing assessments require long testing times making them difficult to include in many studies and experiments. Here, we propose a specific composition of microworlds based on the MicroDYN approach, which allows for valid estimation of CPS in a substantially reduced amount of time (<20 min). Methods: Based on the reanalysis of a sample of N = 232 university students who worked on 11 microworlds of increasing difficulty, we conducted multiple confirmatory factor analyses to test all possible combinations of microworlds, which were theoretically justified in advance. Results/Discussion: We demonstrate one best fitting set with five microworlds, which shows excellent factorial validity and relates to both conventional measures of intelligence and to school grades. We hope that this will allow other researchers to include CPS into their study designs even when testing time is limited.https://econtent.hogrefe.com/doi/10.1027/2698-1866/a000009complex problem-solvingMicroDYNshort scaleintelligencevalidity |
| spellingShingle | Florian Krieger Matthias Stadler Markus Bühner Frank Fischer Samuel Greiff Assessing Complex Problem-Solving Skills in Under 20 Minutes Psychological Test Adaptation and Development complex problem-solving MicroDYN short scale intelligence validity |
| title | Assessing Complex Problem-Solving Skills in Under 20 Minutes |
| title_full | Assessing Complex Problem-Solving Skills in Under 20 Minutes |
| title_fullStr | Assessing Complex Problem-Solving Skills in Under 20 Minutes |
| title_full_unstemmed | Assessing Complex Problem-Solving Skills in Under 20 Minutes |
| title_short | Assessing Complex Problem-Solving Skills in Under 20 Minutes |
| title_sort | assessing complex problem solving skills in under 20 minutes |
| topic | complex problem-solving MicroDYN short scale intelligence validity |
| url | https://econtent.hogrefe.com/doi/10.1027/2698-1866/a000009 |
| work_keys_str_mv | AT floriankrieger assessingcomplexproblemsolvingskillsinunder20minutes AT matthiasstadler assessingcomplexproblemsolvingskillsinunder20minutes AT markusbuhner assessingcomplexproblemsolvingskillsinunder20minutes AT frankfischer assessingcomplexproblemsolvingskillsinunder20minutes AT samuelgreiff assessingcomplexproblemsolvingskillsinunder20minutes |