Recognizing actions using embodiment & empathy

Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2014.

Bibliographic Details
Main Author: McIntyre, Robert Louis
Other Authors: Patrick H. Winston.
Format: Thesis
Language:eng
Published: Massachusetts Institute of Technology 2014
Subjects:
Online Access:http://hdl.handle.net/1721.1/91697
_version_ 1811085448185905152
author McIntyre, Robert Louis
author2 Patrick H. Winston.
author_facet Patrick H. Winston.
McIntyre, Robert Louis
author_sort McIntyre, Robert Louis
collection MIT
description Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2014.
first_indexed 2024-09-23T13:09:45Z
format Thesis
id mit-1721.1/91697
institution Massachusetts Institute of Technology
language eng
last_indexed 2024-09-23T13:09:45Z
publishDate 2014
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/916972019-04-11T11:19:37Z Recognizing actions using embodiment & empathy Recognizing actions using embodiment and empathy McIntyre, Robert Louis Patrick H. Winston. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2014. This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections. Cataloged from student-submitted PDF version of thesis. Includes bibliographical references (pages 83-85). Here I demonstrate the power of using embodied artificial intelligence to attack the action recognition problem, which is the challenge of recognizing actions performed by a creature given limited data about the creature's actions, such as a video recording. I solve this problem in the case of a worm-like creature performing actions such as curling and wiggling. To attack the action recognition problem, I developed a computational model of empathy (EMPATH) which allows me to recognize actions using simple, embodied representations of actions (which require rich sensory data), even when that sensory data is not actually available. The missing sense data is imagined by combining previous experiences gained from unsupervised free play. The worm is a five-segment creature equipped with touch, proprioception, and muscle tension senses. It recognizes actions using only proprioception data. In order to build this empathic, action-recognizing system, I created a program called CORTEX, which is a complete platform for embodied AI research. It provides multiple senses for simulated creatures, including vision, touch, proprioception, muscle tension, and hearing. Each of these senses provides a wealth of parameters that are biologically inspired. CORTEX is able to simulate any number of creatures and senses, and provides facilities for easily modeling and creating new creatures. As a research platform it is more complete than any other system currently available. by Robert Louis McIntyre. M. Eng. 2014-11-24T16:16:19Z 2014-11-24T16:16:19Z 2014 2014 Thesis http://hdl.handle.net/1721.1/91697 894249493 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 85 pages application/pdf Massachusetts Institute of Technology
spellingShingle Electrical Engineering and Computer Science.
McIntyre, Robert Louis
Recognizing actions using embodiment & empathy
title Recognizing actions using embodiment & empathy
title_full Recognizing actions using embodiment & empathy
title_fullStr Recognizing actions using embodiment & empathy
title_full_unstemmed Recognizing actions using embodiment & empathy
title_short Recognizing actions using embodiment & empathy
title_sort recognizing actions using embodiment empathy
topic Electrical Engineering and Computer Science.
url http://hdl.handle.net/1721.1/91697
work_keys_str_mv AT mcintyrerobertlouis recognizingactionsusingembodimentempathy
AT mcintyrerobertlouis recognizingactionsusingembodimentandempathy