Representation and recognition of action in interactive spaces
Thesis (Ph.D.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 1999.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2011
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/62342 |
| _version_ | 1826200845446807552 |
|---|---|
| author | Pinhanez, Claudio S |
| author2 | Aaron F. Bobick. |
| author_facet | Aaron F. Bobick. Pinhanez, Claudio S |
| author_sort | Pinhanez, Claudio S |
| collection | MIT |
| description | Thesis (Ph.D.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 1999. |
| first_indexed | 2024-09-23T11:42:38Z |
| format | Thesis |
| id | mit-1721.1/62342 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T11:42:38Z |
| publishDate | 2011 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/623422019-04-10T23:11:10Z Representation and recognition of action in interactive spaces Pinhanez, Claudio S Aaron F. Bobick. Massachusetts Institute of Technology. Dept. of Architecture. Program In Media Arts and Sciences. Massachusetts Institute of Technology. Dept. of Architecture. Program In Media Arts and Sciences. Architecture. Program In Media Arts and Sciences. Thesis (Ph.D.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 1999. Includes bibliographical references (p. 246-258). This thesis presents new theory and technology for the representation and recognition of complex, context-sensitive human actions in interactive spaces. To represent action and interaction a symbolic framework has been developed based on Roger Schank's conceptualizations, augmented by a mechanism to represent the temporal structure of the sub-actions based on Allen's interval algebra networks. To overcome the exponential nature of temporal constraint propagation in such networks, we have developed the PNF propagation algorithm based on the projection of IA-networks into simplified, 3-valued (past, now, future) constraint networks called PNF-networks. The PNF propagation algorithm has been applied to an action recognition vision system that handles actions composed of multiple, parallel threads of sub-actions, in situations that can not be efficiently dealt by the commonly used temporal representation schemes such as finite-state machines and HMMs. The PNF propagation algorithm is also the basis of interval scripts, a scripting paradigm for interactive systems that represents interaction as a set of temporal constraints between the individual components of the interaction. Unlike previously proposed non-procedural scripting methods, we use a strong temporal representation (allowing, for example, mutually exclusive actions) and perform control by propagating the temporal constraints in real-time. These concepts have been tested in the context of four projects involving story-driven interactive spaces. The action representation framework has been used in the Intelligent Studio project to enhance the control of automatic cameras in a TV studio. Interval scripts have been extensively employed in the development of "SingSong ", a short interactive performance that introduced the idea of live interaction with computer graphics characters; in "It/I", a full-length computer theater play; and in "It", an interactive art installation based on the play "It /I" that realizes our concept of immersive stages, that is, interactive spaces that can be used both by performers and public. by Claudio Santos Pinhanez. Ph.D. 2011-04-25T15:44:08Z 2011-04-25T15:44:08Z 1999 1999 Thesis http://hdl.handle.net/1721.1/62342 43923528 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 258 p. application/pdf Massachusetts Institute of Technology |
| spellingShingle | Architecture. Program In Media Arts and Sciences. Pinhanez, Claudio S Representation and recognition of action in interactive spaces |
| title | Representation and recognition of action in interactive spaces |
| title_full | Representation and recognition of action in interactive spaces |
| title_fullStr | Representation and recognition of action in interactive spaces |
| title_full_unstemmed | Representation and recognition of action in interactive spaces |
| title_short | Representation and recognition of action in interactive spaces |
| title_sort | representation and recognition of action in interactive spaces |
| topic | Architecture. Program In Media Arts and Sciences. |
| url | http://hdl.handle.net/1721.1/62342 |
| work_keys_str_mv | AT pinhanezclaudios representationandrecognitionofactionininteractivespaces |