Understanding Test Takers' Choices in a Self-Adapted Test: A Hidden Markov Modeling of Process Data
With the rise of more interactive assessments, such as simulation- and game-based assessment, process data are available to learn about students' cognitive processes as well as motivational aspects. Since process data can be complicated due to interdependencies in time, our traditional psychome...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2019-02-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/article/10.3389/fpsyg.2019.00083/full |
| _version_ | 1818173415314423808 |
|---|---|
| author | Meirav Arieli-Attali Meirav Arieli-Attali Lu Ou Vanessa R. Simmering |
| author_facet | Meirav Arieli-Attali Meirav Arieli-Attali Lu Ou Vanessa R. Simmering |
| author_sort | Meirav Arieli-Attali |
| collection | DOAJ |
| description | With the rise of more interactive assessments, such as simulation- and game-based assessment, process data are available to learn about students' cognitive processes as well as motivational aspects. Since process data can be complicated due to interdependencies in time, our traditional psychometric models may not necessarily fit, and we need to look for additional ways to analyze such data. In this study, we draw process data from a study on self-adapted test under different goal conditions (Arieli-Attali, 2016) and use hidden Markov models to learn about test takers' choice making behavior. Self-adapted test is designed to allow test takers to choose the level of difficulty of the items they receive. The data includes test results from two conditions of goal orientation (performance goal and learning goal), as well as confidence ratings on each question. We show that using HMM we can learn about transition probabilities from one state to another as dependent on the goal orientation, the accumulated score and accumulated confidence, and the interactions therein. The implications of such insights are discussed. |
| first_indexed | 2024-12-11T19:28:08Z |
| format | Article |
| id | doaj.art-d6f5777841ff4bc5b0a7d8f5eed4807d |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-12-11T19:28:08Z |
| publishDate | 2019-02-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-d6f5777841ff4bc5b0a7d8f5eed4807d2022-12-22T00:53:21ZengFrontiers Media S.A.Frontiers in Psychology1664-10782019-02-011010.3389/fpsyg.2019.00083422759Understanding Test Takers' Choices in a Self-Adapted Test: A Hidden Markov Modeling of Process DataMeirav Arieli-Attali0Meirav Arieli-Attali1Lu Ou2Vanessa R. Simmering3Department of Psychology, Fordham University, New York, NY, United StatesACTNext, ACT Inc., Iowa City, IA, United StatesACTNext, ACT Inc., Iowa City, IA, United StatesACTNext, ACT Inc., Iowa City, IA, United StatesWith the rise of more interactive assessments, such as simulation- and game-based assessment, process data are available to learn about students' cognitive processes as well as motivational aspects. Since process data can be complicated due to interdependencies in time, our traditional psychometric models may not necessarily fit, and we need to look for additional ways to analyze such data. In this study, we draw process data from a study on self-adapted test under different goal conditions (Arieli-Attali, 2016) and use hidden Markov models to learn about test takers' choice making behavior. Self-adapted test is designed to allow test takers to choose the level of difficulty of the items they receive. The data includes test results from two conditions of goal orientation (performance goal and learning goal), as well as confidence ratings on each question. We show that using HMM we can learn about transition probabilities from one state to another as dependent on the goal orientation, the accumulated score and accumulated confidence, and the interactions therein. The implications of such insights are discussed.https://www.frontiersin.org/article/10.3389/fpsyg.2019.00083/fullhidden Markov modelself-adapted testlikelihood ratio testgoal orientationconfidence |
| spellingShingle | Meirav Arieli-Attali Meirav Arieli-Attali Lu Ou Vanessa R. Simmering Understanding Test Takers' Choices in a Self-Adapted Test: A Hidden Markov Modeling of Process Data Frontiers in Psychology hidden Markov model self-adapted test likelihood ratio test goal orientation confidence |
| title | Understanding Test Takers' Choices in a Self-Adapted Test: A Hidden Markov Modeling of Process Data |
| title_full | Understanding Test Takers' Choices in a Self-Adapted Test: A Hidden Markov Modeling of Process Data |
| title_fullStr | Understanding Test Takers' Choices in a Self-Adapted Test: A Hidden Markov Modeling of Process Data |
| title_full_unstemmed | Understanding Test Takers' Choices in a Self-Adapted Test: A Hidden Markov Modeling of Process Data |
| title_short | Understanding Test Takers' Choices in a Self-Adapted Test: A Hidden Markov Modeling of Process Data |
| title_sort | understanding test takers choices in a self adapted test a hidden markov modeling of process data |
| topic | hidden Markov model self-adapted test likelihood ratio test goal orientation confidence |
| url | https://www.frontiersin.org/article/10.3389/fpsyg.2019.00083/full |
| work_keys_str_mv | AT meiravarieliattali understandingtesttakerschoicesinaselfadaptedtestahiddenmarkovmodelingofprocessdata AT meiravarieliattali understandingtesttakerschoicesinaselfadaptedtestahiddenmarkovmodelingofprocessdata AT luou understandingtesttakerschoicesinaselfadaptedtestahiddenmarkovmodelingofprocessdata AT vanessarsimmering understandingtesttakerschoicesinaselfadaptedtestahiddenmarkovmodelingofprocessdata |