On doing multi-act arithmetic: A multitrait-multimethod approach of performance dimensions in integrated multitasking
Here we present a systematic plan to the experimental study of test–retest reliability in the multitasking domain, adopting the multitrait-multimethod (MTMM) approach to evaluate the psychometric properties of performance in Düker-type speeded multiple-act mental arithmetic. These form of tasks capa...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2022-08-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fpsyg.2022.946626/full |
| _version_ | 1798039096528994304 |
|---|---|
| author | Frank Schumann Michael B. Steinborn Hagen C. Flehmig Jens Kürten Robert Langner Robert Langner Lynn Huestegge |
| author_facet | Frank Schumann Michael B. Steinborn Hagen C. Flehmig Jens Kürten Robert Langner Robert Langner Lynn Huestegge |
| author_sort | Frank Schumann |
| collection | DOAJ |
| description | Here we present a systematic plan to the experimental study of test–retest reliability in the multitasking domain, adopting the multitrait-multimethod (MTMM) approach to evaluate the psychometric properties of performance in Düker-type speeded multiple-act mental arithmetic. These form of tasks capacitate the experimental analysis of integrated multi-step processing by combining multiple mental operations in flexible ways in the service of the overarching goal of completing the task. A particular focus was on scoring methodology, particularly measures of response speed variability. To this end, we present data of two experiments with regard to (a) test–retest reliability, (b) between-measures correlational structure, (c) and stability (test–retest practice effects). Finally, we compared participants with high versus low performance variability to assess ability-related differences in measurement precision (typically used as proxy to “simulate” patient populations), which is especially relevant in the applied fields of clinical neuropsychology. The participants performed two classic integrated multi-act arithmetic tasks, combining addition and verification (Exp. 1) and addition and comparison (Exp. 2). The results revealed excellent test–retest reliability for the standard and the variability measures. The analysis of between-measures correlational structure revealed the typical pattern of convergent and discriminant relationships, and also, that absolute response speed variability was highly correlated with average speed (r > 0.85), indicating that these measures mainly deliver redundant information. In contrast, speed-adjusted (relativized) variability revealed discriminant validity being correlated to a much lesser degree with average speed, indicating that this measure delivers additional information not already provided by the speed measure. Furthermore, speed-adjusted variability was virtually unaffected by test–retest practice, which makes this measure interesting in situations with repeated testing. |
| first_indexed | 2024-04-11T21:49:12Z |
| format | Article |
| id | doaj.art-2113d1dced784f8087a8560bf4b87be6 |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-04-11T21:49:12Z |
| publishDate | 2022-08-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-2113d1dced784f8087a8560bf4b87be62022-12-22T04:01:18ZengFrontiers Media S.A.Frontiers in Psychology1664-10782022-08-011310.3389/fpsyg.2022.946626946626On doing multi-act arithmetic: A multitrait-multimethod approach of performance dimensions in integrated multitaskingFrank Schumann0Michael B. Steinborn1Hagen C. Flehmig2Jens Kürten3Robert Langner4Robert Langner5Lynn Huestegge6Mittweida University of Applied Sciences, Mittweida, GermanyJulius-Maximilians-Universität Würzburg, Würzburg, GermanyTechnische Universität Dresden, Dresden, GermanyJulius-Maximilians-Universität Würzburg, Würzburg, GermanyMedical Faculty, Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, GermanyInstitute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Center Jülich, Jülich, GermanyJulius-Maximilians-Universität Würzburg, Würzburg, GermanyHere we present a systematic plan to the experimental study of test–retest reliability in the multitasking domain, adopting the multitrait-multimethod (MTMM) approach to evaluate the psychometric properties of performance in Düker-type speeded multiple-act mental arithmetic. These form of tasks capacitate the experimental analysis of integrated multi-step processing by combining multiple mental operations in flexible ways in the service of the overarching goal of completing the task. A particular focus was on scoring methodology, particularly measures of response speed variability. To this end, we present data of two experiments with regard to (a) test–retest reliability, (b) between-measures correlational structure, (c) and stability (test–retest practice effects). Finally, we compared participants with high versus low performance variability to assess ability-related differences in measurement precision (typically used as proxy to “simulate” patient populations), which is especially relevant in the applied fields of clinical neuropsychology. The participants performed two classic integrated multi-act arithmetic tasks, combining addition and verification (Exp. 1) and addition and comparison (Exp. 2). The results revealed excellent test–retest reliability for the standard and the variability measures. The analysis of between-measures correlational structure revealed the typical pattern of convergent and discriminant relationships, and also, that absolute response speed variability was highly correlated with average speed (r > 0.85), indicating that these measures mainly deliver redundant information. In contrast, speed-adjusted (relativized) variability revealed discriminant validity being correlated to a much lesser degree with average speed, indicating that this measure delivers additional information not already provided by the speed measure. Furthermore, speed-adjusted variability was virtually unaffected by test–retest practice, which makes this measure interesting in situations with repeated testing.https://www.frontiersin.org/articles/10.3389/fpsyg.2022.946626/fullsustained attentionconcentrationvigilancereliabilitycognitive control |
| spellingShingle | Frank Schumann Michael B. Steinborn Hagen C. Flehmig Jens Kürten Robert Langner Robert Langner Lynn Huestegge On doing multi-act arithmetic: A multitrait-multimethod approach of performance dimensions in integrated multitasking Frontiers in Psychology sustained attention concentration vigilance reliability cognitive control |
| title | On doing multi-act arithmetic: A multitrait-multimethod approach of performance dimensions in integrated multitasking |
| title_full | On doing multi-act arithmetic: A multitrait-multimethod approach of performance dimensions in integrated multitasking |
| title_fullStr | On doing multi-act arithmetic: A multitrait-multimethod approach of performance dimensions in integrated multitasking |
| title_full_unstemmed | On doing multi-act arithmetic: A multitrait-multimethod approach of performance dimensions in integrated multitasking |
| title_short | On doing multi-act arithmetic: A multitrait-multimethod approach of performance dimensions in integrated multitasking |
| title_sort | on doing multi act arithmetic a multitrait multimethod approach of performance dimensions in integrated multitasking |
| topic | sustained attention concentration vigilance reliability cognitive control |
| url | https://www.frontiersin.org/articles/10.3389/fpsyg.2022.946626/full |
| work_keys_str_mv | AT frankschumann ondoingmultiactarithmeticamultitraitmultimethodapproachofperformancedimensionsinintegratedmultitasking AT michaelbsteinborn ondoingmultiactarithmeticamultitraitmultimethodapproachofperformancedimensionsinintegratedmultitasking AT hagencflehmig ondoingmultiactarithmeticamultitraitmultimethodapproachofperformancedimensionsinintegratedmultitasking AT jenskurten ondoingmultiactarithmeticamultitraitmultimethodapproachofperformancedimensionsinintegratedmultitasking AT robertlangner ondoingmultiactarithmeticamultitraitmultimethodapproachofperformancedimensionsinintegratedmultitasking AT robertlangner ondoingmultiactarithmeticamultitraitmultimethodapproachofperformancedimensionsinintegratedmultitasking AT lynnhuestegge ondoingmultiactarithmeticamultitraitmultimethodapproachofperformancedimensionsinintegratedmultitasking |