Embodied object schemas for grounding language use
Thesis (Ph. D.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2007.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2008
|
| Subjects: | |
| Online Access: | http://dspace.mit.edu/handle/1721.1/39258 http://hdl.handle.net/1721.1/39258 |
| _version_ | 1826208505302876160 |
|---|---|
| author | Hsiao, Kai-yuh, 1977- |
| author2 | Deb K. Roy. |
| author_facet | Deb K. Roy. Hsiao, Kai-yuh, 1977- |
| author_sort | Hsiao, Kai-yuh, 1977- |
| collection | MIT |
| description | Thesis (Ph. D.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2007. |
| first_indexed | 2024-09-23T14:06:24Z |
| format | Thesis |
| id | mit-1721.1/39258 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T14:06:24Z |
| publishDate | 2008 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/392582019-04-12T09:40:47Z Embodied object schemas for grounding language use Hsiao, Kai-yuh, 1977- Deb K. Roy. Massachusetts Institute of Technology. Dept. of Architecture. Program In Media Arts and Sciences Massachusetts Institute of Technology. Dept. of Architecture. Program In Media Arts and Sciences Architecture. Program In Media Arts and Sciences Thesis (Ph. D.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2007. This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections. Includes bibliographical references (p. 139-146). This thesis presents the Object Schema Model (OSM) for grounded language interaction. Dynamic representations of objects are used as the central point of coordination between actions, sensations, planning, and language use. Objects are modeled as object schemas -- sets of multimodal, object-directed behavior processes -- each of which can make predictions, take actions, and collate sensations, in the modalities of touch, vision, and motor control. This process-centered view allows the system to respond continuously to real-world activity, while still viewing objects as stabilized representations for planning and speech interaction. The model can be described from four perspectives, each organizing and manipulating behavior processes in a different way. The first perspective views behavior processes like thread objects, running concurrently to carry out their respective functions. The second perspective organizes the behavior processes into object schemas. The third perspective organizes the behavior processes into plan hierarchies to coordinate actions. The fourth perspective creates new behavior processes in response to language input. (cont.) Results from interactions with objects are used to update the object schemas, which then influence subsequent plans and actions. A continuous planning algorithm examines the current object schemas to choose between candidate processes according to a set of primary motivations, such as responding to collisions, exploring objects, and interacting with the human. An instance of the model has been implemented using a physical robotic manipulator. The implemented system is able to interpret basic speech acts that relate to perception of, and actions upon, objects in the robot's physical environment. by Kai-yuh Hsiao. Ph.D. 2008-04-23T12:34:23Z 2008-04-23T12:34:23Z 2007 2007 Thesis http://dspace.mit.edu/handle/1721.1/39258 http://hdl.handle.net/1721.1/39258 173610680 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/39258 http://dspace.mit.edu/handle/1721.1/7582 146 p. application/pdf Massachusetts Institute of Technology |
| spellingShingle | Architecture. Program In Media Arts and Sciences Hsiao, Kai-yuh, 1977- Embodied object schemas for grounding language use |
| title | Embodied object schemas for grounding language use |
| title_full | Embodied object schemas for grounding language use |
| title_fullStr | Embodied object schemas for grounding language use |
| title_full_unstemmed | Embodied object schemas for grounding language use |
| title_short | Embodied object schemas for grounding language use |
| title_sort | embodied object schemas for grounding language use |
| topic | Architecture. Program In Media Arts and Sciences |
| url | http://dspace.mit.edu/handle/1721.1/39258 http://hdl.handle.net/1721.1/39258 |
| work_keys_str_mv | AT hsiaokaiyuh1977 embodiedobjectschemasforgroundinglanguageuse |