Deep learning models for the perception of human social interactions

This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.

Bibliographic Details
Main Author: Eastman, Elizabeth Merritt.
Other Authors: Nancy Kanwisher.
Format: Thesis
Language:eng
Published: Massachusetts Institute of Technology 2019
Subjects:
Online Access:https://hdl.handle.net/1721.1/123019
_version_ 1826217263558033408
author Eastman, Elizabeth Merritt.
author2 Nancy Kanwisher.
author_facet Nancy Kanwisher.
Eastman, Elizabeth Merritt.
author_sort Eastman, Elizabeth Merritt.
collection MIT
description This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.
first_indexed 2024-09-23T17:00:36Z
format Thesis
id mit-1721.1/123019
institution Massachusetts Institute of Technology
language eng
last_indexed 2024-09-23T17:00:36Z
publishDate 2019
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/1230192019-11-22T03:01:03Z Deep learning models for the perception of human social interactions Eastman, Elizabeth Merritt. Nancy Kanwisher. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Electrical Engineering and Computer Science. This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections. Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2019 Cataloged from student-submitted PDF version of thesis. Includes bibliographical references (pages 59-61). Social interaction perception is an important part of humans' visual experience. How- ever, little is known about the way the human brain processes visual input in order to understand social interactions. In comparison, other vision problems, such as object recognition tasks, have been studied extensively and seen success by comparing state of the art computer vision models to neuroimaging data. In this thesis, I employ a similar method in order to study social interaction perception with deep learning models and magnetoencephalography (MEG) data. Specically, I implement dierent deep learning computer vision models and test their performance on a social inter- action detection task as well as their match to neural data from the same task. I nd that detecting social interactions most likely requires extensive cortical process- ing and/or recurrent computations. In addition, I nd that experience with action recognition does not improve social interaction detection. by Elizabeth Merritt Eastman. M. Eng. M.Eng. Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science 2019-11-22T00:02:39Z 2019-11-22T00:02:39Z 2019 2019 Thesis https://hdl.handle.net/1721.1/123019 1127630161 eng MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission. http://dspace.mit.edu/handle/1721.1/7582 61 pages application/pdf Massachusetts Institute of Technology
spellingShingle Electrical Engineering and Computer Science.
Eastman, Elizabeth Merritt.
Deep learning models for the perception of human social interactions
title Deep learning models for the perception of human social interactions
title_full Deep learning models for the perception of human social interactions
title_fullStr Deep learning models for the perception of human social interactions
title_full_unstemmed Deep learning models for the perception of human social interactions
title_short Deep learning models for the perception of human social interactions
title_sort deep learning models for the perception of human social interactions
topic Electrical Engineering and Computer Science.
url https://hdl.handle.net/1721.1/123019
work_keys_str_mv AT eastmanelizabethmerritt deeplearningmodelsfortheperceptionofhumansocialinteractions