An integrative computational architecture for object-driven cortex

Objects in motion activate multiple cortical regions in every lobe of the human brain. Do these regions represent a collection of independent systems, or is there an overarching functional architecture spanning all of object-driven cortex? Inspired by recent work in artificial intelligence (AI), mac...

Full description

Bibliographic Details
Main Authors: Yildirim, Ilker, Wu, Jiajun, Kanwisher, Nancy, Tenenbaum, Joshua B
Other Authors: McGovern Institute for Brain Research at MIT
Format: Article
Language:English
Published: Elsevier BV 2020
Online Access:https://hdl.handle.net/1721.1/124676
_version_ 1826210154305028096
author Yildirim, Ilker
Wu, Jiajun
Kanwisher, Nancy
Tenenbaum, Joshua B
author2 McGovern Institute for Brain Research at MIT
author_facet McGovern Institute for Brain Research at MIT
Yildirim, Ilker
Wu, Jiajun
Kanwisher, Nancy
Tenenbaum, Joshua B
author_sort Yildirim, Ilker
collection MIT
description Objects in motion activate multiple cortical regions in every lobe of the human brain. Do these regions represent a collection of independent systems, or is there an overarching functional architecture spanning all of object-driven cortex? Inspired by recent work in artificial intelligence (AI), machine learning, and cognitive science, we consider the hypothesis that these regions can be understood as a coherent network implementing an integrative computational system that unifies the functions needed to perceive, predict, reason about, and plan with physical objects—as in the paradigmatic case of using or making tools. Our proposal draws on a modeling framework that combines multiple AI methods, including causal generative models, hybrid symbolic-continuous planning algorithms, and neural recognition networks, with object-centric, physics-based representations. We review evidence relating specific components of our proposal to the specific regions that comprise object-driven cortex, and lay out future research directions with the goal of building a complete functional and mechanistic account of this system. ©2019
first_indexed 2024-09-23T14:44:45Z
format Article
id mit-1721.1/124676
institution Massachusetts Institute of Technology
language English
last_indexed 2024-09-23T14:44:45Z
publishDate 2020
publisher Elsevier BV
record_format dspace
spelling mit-1721.1/1246762022-10-01T22:14:24Z An integrative computational architecture for object-driven cortex Yildirim, Ilker Wu, Jiajun Kanwisher, Nancy Tenenbaum, Joshua B McGovern Institute for Brain Research at MIT Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences Objects in motion activate multiple cortical regions in every lobe of the human brain. Do these regions represent a collection of independent systems, or is there an overarching functional architecture spanning all of object-driven cortex? Inspired by recent work in artificial intelligence (AI), machine learning, and cognitive science, we consider the hypothesis that these regions can be understood as a coherent network implementing an integrative computational system that unifies the functions needed to perceive, predict, reason about, and plan with physical objects—as in the paradigmatic case of using or making tools. Our proposal draws on a modeling framework that combines multiple AI methods, including causal generative models, hybrid symbolic-continuous planning algorithms, and neural recognition networks, with object-centric, physics-based representations. We review evidence relating specific components of our proposal to the specific regions that comprise object-driven cortex, and lay out future research directions with the goal of building a complete functional and mechanistic account of this system. ©2019 NSF STC (award no.: CCF-1231216) ONR MURI (no. N00014-13-1-0333) NIH (no. DP1HD091947) 2020-04-15T20:02:28Z 2020-04-15T20:02:28Z 2019-04 2019-02 2020-04-06T17:02:42Z Article http://purl.org/eprint/type/JournalArticle 1873-6882 0959-4388 https://hdl.handle.net/1721.1/124676 Yildirim, Ilker, Jiajun Wu, Nancy Kanwisher, and Joshua B. Tenenbaum, "An integrative computational architecture for object-driven cortex." Current opinion in neurobiology 55 (April 2019): p. 73-81 doi 10.1016/J.CONB.2019.01.010 ©2019 Author(s) en 10.1016/J.CONB.2019.01.010 Current opinion in neurobiology Creative Commons Attribution-NonCommercial-NoDerivs License http://creativecommons.org/licenses/by-nc-nd/4.0/ application/pdf Elsevier BV PMC
spellingShingle Yildirim, Ilker
Wu, Jiajun
Kanwisher, Nancy
Tenenbaum, Joshua B
An integrative computational architecture for object-driven cortex
title An integrative computational architecture for object-driven cortex
title_full An integrative computational architecture for object-driven cortex
title_fullStr An integrative computational architecture for object-driven cortex
title_full_unstemmed An integrative computational architecture for object-driven cortex
title_short An integrative computational architecture for object-driven cortex
title_sort integrative computational architecture for object driven cortex
url https://hdl.handle.net/1721.1/124676
work_keys_str_mv AT yildirimilker anintegrativecomputationalarchitectureforobjectdrivencortex
AT wujiajun anintegrativecomputationalarchitectureforobjectdrivencortex
AT kanwishernancy anintegrativecomputationalarchitectureforobjectdrivencortex
AT tenenbaumjoshuab anintegrativecomputationalarchitectureforobjectdrivencortex
AT yildirimilker integrativecomputationalarchitectureforobjectdrivencortex
AT wujiajun integrativecomputationalarchitectureforobjectdrivencortex
AT kanwishernancy integrativecomputationalarchitectureforobjectdrivencortex
AT tenenbaumjoshuab integrativecomputationalarchitectureforobjectdrivencortex