Visualizing Cross-Sections of 3D Objects: Developing Efficient Measures Using Item Response Theory
Spatial ability is important for success in STEM fields but is typically measured using a small number of tests that were not developed in the STEM context, have not been normed with recent samples, or have not been subjected to modern psychometric analyses. Here, an approach to developing valid, re...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-10-01
|
| Series: | Journal of Intelligence |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2079-3200/11/11/205 |
| _version_ | 1797458770217926656 |
|---|---|
| author | Mitchell E. Munns Chuanxiuyue He Alexis Topete Mary Hegarty |
| author_facet | Mitchell E. Munns Chuanxiuyue He Alexis Topete Mary Hegarty |
| author_sort | Mitchell E. Munns |
| collection | DOAJ |
| description | Spatial ability is important for success in STEM fields but is typically measured using a small number of tests that were not developed in the STEM context, have not been normed with recent samples, or have not been subjected to modern psychometric analyses. Here, an approach to developing valid, reliable, and efficient computer-based tests of spatial skills is proposed and illustrated via the development of an efficient test of the ability to visualize cross-sections of three-dimensional (3D) objects. After pilot testing, three measures of this ability were administered online to 498 participants (256 females, aged 18–20). Two of the measures, the Santa Barbara Solids and Planes of Reference tests had good psychometric properties and measured a domain-general ability to visualize cross-sections, with sub-factors related to item difficulty. Item-level statistics informed the development of the refined versions of these tests and a combined measure composed of the most informative test items. Sex and ethnicity had no significant effects on the combined measure after controlling for mathematics education, verbal ability, and age. The measures ofcross-sectioning ability developed in the context of geology education were found to be too difficult, likely because they measured domain knowledge in addition to cross-sectioning ability. Recommendations are made for the use of cross-section tests in selection and training and for the more general development of spatial ability measures. |
| first_indexed | 2024-03-09T16:42:56Z |
| format | Article |
| id | doaj.art-5856879f0c084fae94210150a83ebe83 |
| institution | Directory Open Access Journal |
| issn | 2079-3200 |
| language | English |
| last_indexed | 2024-03-09T16:42:56Z |
| publishDate | 2023-10-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Journal of Intelligence |
| spelling | doaj.art-5856879f0c084fae94210150a83ebe832023-11-24T14:50:07ZengMDPI AGJournal of Intelligence2079-32002023-10-01111120510.3390/jintelligence11110205Visualizing Cross-Sections of 3D Objects: Developing Efficient Measures Using Item Response TheoryMitchell E. Munns0Chuanxiuyue He1Alexis Topete2Mary Hegarty3Department of Psychological & Brain Sciences, University of California, Santa Barbara, CA 93106, USADepartment of Psychological & Brain Sciences, University of California, Santa Barbara, CA 93106, USADepartment of Psychological & Brain Sciences, University of California, Santa Barbara, CA 93106, USADepartment of Psychological & Brain Sciences, University of California, Santa Barbara, CA 93106, USASpatial ability is important for success in STEM fields but is typically measured using a small number of tests that were not developed in the STEM context, have not been normed with recent samples, or have not been subjected to modern psychometric analyses. Here, an approach to developing valid, reliable, and efficient computer-based tests of spatial skills is proposed and illustrated via the development of an efficient test of the ability to visualize cross-sections of three-dimensional (3D) objects. After pilot testing, three measures of this ability were administered online to 498 participants (256 females, aged 18–20). Two of the measures, the Santa Barbara Solids and Planes of Reference tests had good psychometric properties and measured a domain-general ability to visualize cross-sections, with sub-factors related to item difficulty. Item-level statistics informed the development of the refined versions of these tests and a combined measure composed of the most informative test items. Sex and ethnicity had no significant effects on the combined measure after controlling for mathematics education, verbal ability, and age. The measures ofcross-sectioning ability developed in the context of geology education were found to be too difficult, likely because they measured domain knowledge in addition to cross-sectioning ability. Recommendations are made for the use of cross-section tests in selection and training and for the more general development of spatial ability measures.https://www.mdpi.com/2079-3200/11/11/205spatial abilitycross-sectionSTEM educationitem response theorypersonnel selection |
| spellingShingle | Mitchell E. Munns Chuanxiuyue He Alexis Topete Mary Hegarty Visualizing Cross-Sections of 3D Objects: Developing Efficient Measures Using Item Response Theory Journal of Intelligence spatial ability cross-section STEM education item response theory personnel selection |
| title | Visualizing Cross-Sections of 3D Objects: Developing Efficient Measures Using Item Response Theory |
| title_full | Visualizing Cross-Sections of 3D Objects: Developing Efficient Measures Using Item Response Theory |
| title_fullStr | Visualizing Cross-Sections of 3D Objects: Developing Efficient Measures Using Item Response Theory |
| title_full_unstemmed | Visualizing Cross-Sections of 3D Objects: Developing Efficient Measures Using Item Response Theory |
| title_short | Visualizing Cross-Sections of 3D Objects: Developing Efficient Measures Using Item Response Theory |
| title_sort | visualizing cross sections of 3d objects developing efficient measures using item response theory |
| topic | spatial ability cross-section STEM education item response theory personnel selection |
| url | https://www.mdpi.com/2079-3200/11/11/205 |
| work_keys_str_mv | AT mitchellemunns visualizingcrosssectionsof3dobjectsdevelopingefficientmeasuresusingitemresponsetheory AT chuanxiuyuehe visualizingcrosssectionsof3dobjectsdevelopingefficientmeasuresusingitemresponsetheory AT alexistopete visualizingcrosssectionsof3dobjectsdevelopingefficientmeasuresusingitemresponsetheory AT maryhegarty visualizingcrosssectionsof3dobjectsdevelopingefficientmeasuresusingitemresponsetheory |