How do humans learn about the reliability of automation?

Abstract In a range of settings, human operators make decisions with the assistance of automation, the reliability of which can vary depending upon context. Currently, the processes by which humans track the level of reliability of automation are unclear. In the current study, we test cognitive mode...

Descripción completa

Detalles Bibliográficos
Autores principales: Luke Strickland, Simon Farrell, Micah K. Wilson, Jack Hutchinson, Shayne Loft
Formato: Artículo
Lenguaje:English
Publicado: SpringerOpen 2024-02-01
Colección:Cognitive Research
Materias:
Acceso en línea:https://doi.org/10.1186/s41235-024-00533-1
_version_ 1827328794126450688
author Luke Strickland
Simon Farrell
Micah K. Wilson
Jack Hutchinson
Shayne Loft
author_facet Luke Strickland
Simon Farrell
Micah K. Wilson
Jack Hutchinson
Shayne Loft
author_sort Luke Strickland
collection DOAJ
description Abstract In a range of settings, human operators make decisions with the assistance of automation, the reliability of which can vary depending upon context. Currently, the processes by which humans track the level of reliability of automation are unclear. In the current study, we test cognitive models of learning that could potentially explain how humans track automation reliability. We fitted several alternative cognitive models to a series of participants’ judgements of automation reliability observed in a maritime classification task in which participants were provided with automated advice. We examined three experiments including eight between-subjects conditions and 240 participants in total. Our results favoured a two-kernel delta-rule model of learning, which specifies that humans learn by prediction error, and respond according to a learning rate that is sensitive to environmental volatility. However, we found substantial heterogeneity in learning processes across participants. These outcomes speak to the learning processes underlying how humans estimate automation reliability and thus have implications for practice.
first_indexed 2024-03-07T15:23:28Z
format Article
id doaj.art-014a96e1e76a4a6697595d3bfda614e9
institution Directory Open Access Journal
issn 2365-7464
language English
last_indexed 2024-03-07T15:23:28Z
publishDate 2024-02-01
publisher SpringerOpen
record_format Article
series Cognitive Research
spelling doaj.art-014a96e1e76a4a6697595d3bfda614e92024-03-05T17:24:59ZengSpringerOpenCognitive Research2365-74642024-02-019112010.1186/s41235-024-00533-1How do humans learn about the reliability of automation?Luke Strickland0Simon Farrell1Micah K. Wilson2Jack Hutchinson3Shayne Loft4The Future of Work Institute, Curtin UniversityThe School of Psychological Science, The University of Western AustraliaThe Future of Work Institute, Curtin UniversityThe School of Psychological Science, The University of Western AustraliaThe School of Psychological Science, The University of Western AustraliaAbstract In a range of settings, human operators make decisions with the assistance of automation, the reliability of which can vary depending upon context. Currently, the processes by which humans track the level of reliability of automation are unclear. In the current study, we test cognitive models of learning that could potentially explain how humans track automation reliability. We fitted several alternative cognitive models to a series of participants’ judgements of automation reliability observed in a maritime classification task in which participants were provided with automated advice. We examined three experiments including eight between-subjects conditions and 240 participants in total. Our results favoured a two-kernel delta-rule model of learning, which specifies that humans learn by prediction error, and respond according to a learning rate that is sensitive to environmental volatility. However, we found substantial heterogeneity in learning processes across participants. These outcomes speak to the learning processes underlying how humans estimate automation reliability and thus have implications for practice.https://doi.org/10.1186/s41235-024-00533-1Human-automation teamingAutomation reliabilityCognitive modelLearning
spellingShingle Luke Strickland
Simon Farrell
Micah K. Wilson
Jack Hutchinson
Shayne Loft
How do humans learn about the reliability of automation?
Cognitive Research
Human-automation teaming
Automation reliability
Cognitive model
Learning
title How do humans learn about the reliability of automation?
title_full How do humans learn about the reliability of automation?
title_fullStr How do humans learn about the reliability of automation?
title_full_unstemmed How do humans learn about the reliability of automation?
title_short How do humans learn about the reliability of automation?
title_sort how do humans learn about the reliability of automation
topic Human-automation teaming
Automation reliability
Cognitive model
Learning
url https://doi.org/10.1186/s41235-024-00533-1
work_keys_str_mv AT lukestrickland howdohumanslearnaboutthereliabilityofautomation
AT simonfarrell howdohumanslearnaboutthereliabilityofautomation
AT micahkwilson howdohumanslearnaboutthereliabilityofautomation
AT jackhutchinson howdohumanslearnaboutthereliabilityofautomation
AT shayneloft howdohumanslearnaboutthereliabilityofautomation