Construction and Validation of the HeiQ: An Operation-Oriented Figural Matrices Test
Figural matrices tests are among the most popular and well-investigated tests used to assess inductive reasoning abilities. Solving these tests requires the selection of a target that completes a figural matrix among distractors. Despite their generally good psychometric properties, previous matrice...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-04-01
|
| Series: | Journal of Intelligence |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2079-3200/11/4/73 |
| _version_ | 1797604848476094464 |
|---|---|
| author | Vanessa S. Pallentin Daniel Danner Jan Rummel |
| author_facet | Vanessa S. Pallentin Daniel Danner Jan Rummel |
| author_sort | Vanessa S. Pallentin |
| collection | DOAJ |
| description | Figural matrices tests are among the most popular and well-investigated tests used to assess inductive reasoning abilities. Solving these tests requires the selection of a target that completes a figural matrix among distractors. Despite their generally good psychometric properties, previous matrices tests have limitations associated with distractor construction that prevent them from realizing their full potential. Most tests allow participants to identify the correct response by eliminating distractors based on superficial features. The goal of this study was to develop a novel figural matrices test which is less prone to the use of response elimination strategies, and to test its psychometric properties. The new test consists of 48 items and was validated with <i>N</i> = 767 participants. Measurement models implied that the test is Rasch scalable, inferring a uniform underlying ability. The test showed good to very good reliability (retest-correlation: <i>r</i> = 0.88; Cronbach’s alpha: <i>α</i> = 0.93; split-half reliability: <i>r</i> = 0.88) and good construct validity (<i>r</i> = 0.81 with the Raven Progressive Matrices Test, <i>r</i> = 0.73 with global intelligence scores of the Intelligence Structure Test 2000R, and <i>r</i> = 0.58 with the global score of the Berlin Intelligence Structure Test). It even superseded the Raven Progressive Matrices Tests in criterion-related validity (correlation with final year high school grades (<i>r</i> = −0.49 <i>p</i> < .001)). We conclude that this novel test has excellent psychometric properties and can be a valuable tool for researchers interested in reasoning assessment. |
| first_indexed | 2024-03-11T04:52:34Z |
| format | Article |
| id | doaj.art-012a7a634ae043c1aa9bb4f63bfc92e9 |
| institution | Directory Open Access Journal |
| issn | 2079-3200 |
| language | English |
| last_indexed | 2024-03-11T04:52:34Z |
| publishDate | 2023-04-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Journal of Intelligence |
| spelling | doaj.art-012a7a634ae043c1aa9bb4f63bfc92e92023-11-17T19:54:03ZengMDPI AGJournal of Intelligence2079-32002023-04-011147310.3390/jintelligence11040073Construction and Validation of the HeiQ: An Operation-Oriented Figural Matrices TestVanessa S. Pallentin0Daniel Danner1Jan Rummel2Department of Psychology, Heidelberg University, Hauptstr. 47-51, 69117 Heidelberg, GermanySection Psychology, University of Applied Labour Studies, Seckenheimer Landstr. 16, 68163 Mannheim, GermanyDepartment of Psychology, Heidelberg University, Hauptstr. 47-51, 69117 Heidelberg, GermanyFigural matrices tests are among the most popular and well-investigated tests used to assess inductive reasoning abilities. Solving these tests requires the selection of a target that completes a figural matrix among distractors. Despite their generally good psychometric properties, previous matrices tests have limitations associated with distractor construction that prevent them from realizing their full potential. Most tests allow participants to identify the correct response by eliminating distractors based on superficial features. The goal of this study was to develop a novel figural matrices test which is less prone to the use of response elimination strategies, and to test its psychometric properties. The new test consists of 48 items and was validated with <i>N</i> = 767 participants. Measurement models implied that the test is Rasch scalable, inferring a uniform underlying ability. The test showed good to very good reliability (retest-correlation: <i>r</i> = 0.88; Cronbach’s alpha: <i>α</i> = 0.93; split-half reliability: <i>r</i> = 0.88) and good construct validity (<i>r</i> = 0.81 with the Raven Progressive Matrices Test, <i>r</i> = 0.73 with global intelligence scores of the Intelligence Structure Test 2000R, and <i>r</i> = 0.58 with the global score of the Berlin Intelligence Structure Test). It even superseded the Raven Progressive Matrices Tests in criterion-related validity (correlation with final year high school grades (<i>r</i> = −0.49 <i>p</i> < .001)). We conclude that this novel test has excellent psychometric properties and can be a valuable tool for researchers interested in reasoning assessment.https://www.mdpi.com/2079-3200/11/4/73figural matrices testintelligencereasoningRasch analysis |
| spellingShingle | Vanessa S. Pallentin Daniel Danner Jan Rummel Construction and Validation of the HeiQ: An Operation-Oriented Figural Matrices Test Journal of Intelligence figural matrices test intelligence reasoning Rasch analysis |
| title | Construction and Validation of the HeiQ: An Operation-Oriented Figural Matrices Test |
| title_full | Construction and Validation of the HeiQ: An Operation-Oriented Figural Matrices Test |
| title_fullStr | Construction and Validation of the HeiQ: An Operation-Oriented Figural Matrices Test |
| title_full_unstemmed | Construction and Validation of the HeiQ: An Operation-Oriented Figural Matrices Test |
| title_short | Construction and Validation of the HeiQ: An Operation-Oriented Figural Matrices Test |
| title_sort | construction and validation of the heiq an operation oriented figural matrices test |
| topic | figural matrices test intelligence reasoning Rasch analysis |
| url | https://www.mdpi.com/2079-3200/11/4/73 |
| work_keys_str_mv | AT vanessaspallentin constructionandvalidationoftheheiqanoperationorientedfiguralmatricestest AT danieldanner constructionandvalidationoftheheiqanoperationorientedfiguralmatricestest AT janrummel constructionandvalidationoftheheiqanoperationorientedfiguralmatricestest |