Plans or Outcomes: How Do We Attribute Intelligence to Others?

Humans routinely make inferences about both the contents and the workings of other minds based on observed actions. People consider what others want or know, but also how intelligent, rational, or attentive they might be. Here, we introduce a new methodology for quantitatively studying the mechanism...

Full description

Bibliographic Details
Main Authors: Kryven, Marta, Ullman, Tomer D, Cowan, William, Tenenbaum, Joshua B
Other Authors: Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
Format: Article
Language:English
Published: Wiley 2021
Online Access:https://hdl.handle.net/1721.1/138377
_version_ 1826217463965024256
author Kryven, Marta
Ullman, Tomer D
Cowan, William
Tenenbaum, Joshua B
author2 Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
author_facet Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
Kryven, Marta
Ullman, Tomer D
Cowan, William
Tenenbaum, Joshua B
author_sort Kryven, Marta
collection MIT
description Humans routinely make inferences about both the contents and the workings of other minds based on observed actions. People consider what others want or know, but also how intelligent, rational, or attentive they might be. Here, we introduce a new methodology for quantitatively studying the mechanisms people use to attribute intelligence to others based on their behavior. We focus on two key judgments previously proposed in the literature: judgments based on observed outcomes (you're smart if you won the game) and judgments based on evaluating the quality of an agent's planning that led to their outcomes (you're smart if you made the right choice, even if you didn't succeed). We present a novel task, the maze search task (MST), in which participants rate the intelligence of agents searching a maze for a hidden goal. We model outcome-based attributions based on the observed utility of the agent upon achieving a goal, with higher utilities indicating higher intelligence, and model planning-based attributions by measuring the proximity of the observed actions to an ideal planner, such that agents who produce closer approximations of optimal plans are seen as more intelligent. We examine human attributions of intelligence in three experiments that use MST and find that participants used both outcome and planning as indicators of intelligence. However, observing the outcome was not necessary, and participants still made planning-based attributions of intelligence when the outcome was not observed. We also found that the weights individuals placed on plans and on outcome correlated with an individual's ability to engage in cognitive reflection. Our results suggest that people attribute intelligence based on plans given sufficient context and cognitive resources and rely on the outcome when computational resources or context are limited.
first_indexed 2024-09-23T17:04:04Z
format Article
id mit-1721.1/138377
institution Massachusetts Institute of Technology
language English
last_indexed 2024-09-23T17:04:04Z
publishDate 2021
publisher Wiley
record_format dspace
spelling mit-1721.1/1383772023-06-22T18:19:47Z Plans or Outcomes: How Do We Attribute Intelligence to Others? Kryven, Marta Ullman, Tomer D Cowan, William Tenenbaum, Joshua B Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences Humans routinely make inferences about both the contents and the workings of other minds based on observed actions. People consider what others want or know, but also how intelligent, rational, or attentive they might be. Here, we introduce a new methodology for quantitatively studying the mechanisms people use to attribute intelligence to others based on their behavior. We focus on two key judgments previously proposed in the literature: judgments based on observed outcomes (you're smart if you won the game) and judgments based on evaluating the quality of an agent's planning that led to their outcomes (you're smart if you made the right choice, even if you didn't succeed). We present a novel task, the maze search task (MST), in which participants rate the intelligence of agents searching a maze for a hidden goal. We model outcome-based attributions based on the observed utility of the agent upon achieving a goal, with higher utilities indicating higher intelligence, and model planning-based attributions by measuring the proximity of the observed actions to an ideal planner, such that agents who produce closer approximations of optimal plans are seen as more intelligent. We examine human attributions of intelligence in three experiments that use MST and find that participants used both outcome and planning as indicators of intelligence. However, observing the outcome was not necessary, and participants still made planning-based attributions of intelligence when the outcome was not observed. We also found that the weights individuals placed on plans and on outcome correlated with an individual's ability to engage in cognitive reflection. Our results suggest that people attribute intelligence based on plans given sufficient context and cognitive resources and rely on the outcome when computational resources or context are limited. 2021-12-08T15:49:08Z 2021-12-08T15:49:08Z 2021-09 2021-12-08T15:42:52Z Article http://purl.org/eprint/type/JournalArticle https://hdl.handle.net/1721.1/138377 Kryven, Marta, Ullman, Tomer D, Cowan, William and Tenenbaum, Joshua B. 2021. "Plans or Outcomes: How Do We Attribute Intelligence to Others?." Cognitive Science, 45 (9). en 10.1111/cogs.13041 Cognitive Science Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Wiley PsyArXiv
spellingShingle Kryven, Marta
Ullman, Tomer D
Cowan, William
Tenenbaum, Joshua B
Plans or Outcomes: How Do We Attribute Intelligence to Others?
title Plans or Outcomes: How Do We Attribute Intelligence to Others?
title_full Plans or Outcomes: How Do We Attribute Intelligence to Others?
title_fullStr Plans or Outcomes: How Do We Attribute Intelligence to Others?
title_full_unstemmed Plans or Outcomes: How Do We Attribute Intelligence to Others?
title_short Plans or Outcomes: How Do We Attribute Intelligence to Others?
title_sort plans or outcomes how do we attribute intelligence to others
url https://hdl.handle.net/1721.1/138377
work_keys_str_mv AT kryvenmarta plansoroutcomeshowdoweattributeintelligencetoothers
AT ullmantomerd plansoroutcomeshowdoweattributeintelligencetoothers
AT cowanwilliam plansoroutcomeshowdoweattributeintelligencetoothers
AT tenenbaumjoshuab plansoroutcomeshowdoweattributeintelligencetoothers