A Bayesian latent mixture model approach to assessing performance in stock-flow reasoning

People often perform poorly on stock-flow reasoning tasks, with many (but not all) participants appearing to erroneously match the accumulation of the stock to the inflow – a response pattern attributed to the use of a “correlation heuristic”. Efforts to improve understanding of stock-flow systems h...

Full description

Bibliographic Details
Main Authors: Arthur Kary, Guy E. Hawkins, Brett K. Hayes, Ben R. Newell
Format: Article
Language:English
Published: Cambridge University Press 2017-09-01
Series:Judgment and Decision Making
Subjects:
Online Access:http://journal.sjdm.org/16/161207/jdm161207.pdf
_version_ 1797766396521742336
author Arthur Kary
Guy E. Hawkins
Brett K. Hayes
Ben R. Newell
author_facet Arthur Kary
Guy E. Hawkins
Brett K. Hayes
Ben R. Newell
author_sort Arthur Kary
collection DOAJ
description People often perform poorly on stock-flow reasoning tasks, with many (but not all) participants appearing to erroneously match the accumulation of the stock to the inflow – a response pattern attributed to the use of a “correlation heuristic”. Efforts to improve understanding of stock-flow systems have been limited by the lack of a principled approach to identifying and measuring individual differences in reasoning strategies. We present a principled inferential method known as Hierarchical Bayesian Latent Mixture Models (HBLMMs) to analyze stock-flow reasoning. HBLMMs use Bayesian inference to classify different patterns of responding as coming from multiple latent populations. We demonstrate the usefulness of this approach using a dataset from a stock-flow drawing task which compared performance in a problem presented in a climate change context, a problem in a financial context, and a problem in which the financial context was used as an analogy to assist understanding in the climate problem. The hierarchical Bayesian model showed that the proportion of responses consistent with the “correlation heuristic” was lower in the financial context and financial analogy context than in the pure climate context. We discuss the benefits of HBLMMs and implications for the role of contexts and analogy in improving stock-flow reasoning. % chages in abstract
first_indexed 2024-03-12T20:24:44Z
format Article
id doaj.art-ba893b07b8ec47219191f820ac9e1df0
institution Directory Open Access Journal
issn 1930-2975
language English
last_indexed 2024-03-12T20:24:44Z
publishDate 2017-09-01
publisher Cambridge University Press
record_format Article
series Judgment and Decision Making
spelling doaj.art-ba893b07b8ec47219191f820ac9e1df02023-08-02T00:37:34ZengCambridge University PressJudgment and Decision Making1930-29752017-09-01125430444A Bayesian latent mixture model approach to assessing performance in stock-flow reasoningArthur KaryGuy E. HawkinsBrett K. HayesBen R. NewellPeople often perform poorly on stock-flow reasoning tasks, with many (but not all) participants appearing to erroneously match the accumulation of the stock to the inflow – a response pattern attributed to the use of a “correlation heuristic”. Efforts to improve understanding of stock-flow systems have been limited by the lack of a principled approach to identifying and measuring individual differences in reasoning strategies. We present a principled inferential method known as Hierarchical Bayesian Latent Mixture Models (HBLMMs) to analyze stock-flow reasoning. HBLMMs use Bayesian inference to classify different patterns of responding as coming from multiple latent populations. We demonstrate the usefulness of this approach using a dataset from a stock-flow drawing task which compared performance in a problem presented in a climate change context, a problem in a financial context, and a problem in which the financial context was used as an analogy to assist understanding in the climate problem. The hierarchical Bayesian model showed that the proportion of responses consistent with the “correlation heuristic” was lower in the financial context and financial analogy context than in the pure climate context. We discuss the benefits of HBLMMs and implications for the role of contexts and analogy in improving stock-flow reasoning. % chages in abstracthttp://journal.sjdm.org/16/161207/jdm161207.pdfstock-flow reasoning climate change Bayesian models mixture modelsNAKeywords
spellingShingle Arthur Kary
Guy E. Hawkins
Brett K. Hayes
Ben R. Newell
A Bayesian latent mixture model approach to assessing performance in stock-flow reasoning
Judgment and Decision Making
stock-flow reasoning
climate change
Bayesian models
mixture modelsNAKeywords
title A Bayesian latent mixture model approach to assessing performance in stock-flow reasoning
title_full A Bayesian latent mixture model approach to assessing performance in stock-flow reasoning
title_fullStr A Bayesian latent mixture model approach to assessing performance in stock-flow reasoning
title_full_unstemmed A Bayesian latent mixture model approach to assessing performance in stock-flow reasoning
title_short A Bayesian latent mixture model approach to assessing performance in stock-flow reasoning
title_sort bayesian latent mixture model approach to assessing performance in stock flow reasoning
topic stock-flow reasoning
climate change
Bayesian models
mixture modelsNAKeywords
url http://journal.sjdm.org/16/161207/jdm161207.pdf
work_keys_str_mv AT arthurkary abayesianlatentmixturemodelapproachtoassessingperformanceinstockflowreasoning
AT guyehawkins abayesianlatentmixturemodelapproachtoassessingperformanceinstockflowreasoning
AT brettkhayes abayesianlatentmixturemodelapproachtoassessingperformanceinstockflowreasoning
AT benrnewell abayesianlatentmixturemodelapproachtoassessingperformanceinstockflowreasoning
AT arthurkary bayesianlatentmixturemodelapproachtoassessingperformanceinstockflowreasoning
AT guyehawkins bayesianlatentmixturemodelapproachtoassessingperformanceinstockflowreasoning
AT brettkhayes bayesianlatentmixturemodelapproachtoassessingperformanceinstockflowreasoning
AT benrnewell bayesianlatentmixturemodelapproachtoassessingperformanceinstockflowreasoning