A gestural media framework : tools for expressive gesture recognition and mapping in rehearsal and performance

Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2010.

Bibliographic Details
Main Author: Jessop, Elena Naomi
Other Authors: Tod Machover.
Format: Thesis
Language:eng
Published: Massachusetts Institute of Technology 2010
Subjects:
Online Access:http://hdl.handle.net/1721.1/57806
_version_ 1811083607810244608
author Jessop, Elena Naomi
author2 Tod Machover.
author_facet Tod Machover.
Jessop, Elena Naomi
author_sort Jessop, Elena Naomi
collection MIT
description Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2010.
first_indexed 2024-09-23T12:35:29Z
format Thesis
id mit-1721.1/57806
institution Massachusetts Institute of Technology
language eng
last_indexed 2024-09-23T12:35:29Z
publishDate 2010
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/578062019-04-10T12:41:49Z A gestural media framework : tools for expressive gesture recognition and mapping in rehearsal and performance Tools for expressive gesture recognition and mapping in rehearsal and performance Jessop, Elena Naomi Tod Machover. Massachusetts Institute of Technology. Dept. of Architecture. Program in Media Arts and Sciences. Massachusetts Institute of Technology. Dept. of Architecture. Program in Media Arts and Sciences. Architecture. Program in Media Arts and Sciences. Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2010. Cataloged from PDF version of thesis. Includes bibliographical references (p. 97-101). As human movement is an incredibly rich mode of communication and expression, performance artists working with digital media often use performers' movement and gestures to control and shape that digital media as part of a theatrical, choreographic, or musical performance. In my own work, I have found that strong, semantically-meaningful mappings between gesture and sound or visuals are necessary to create compelling performance interactions. However, the existing systems for developing mappings between incoming data streams and output media have extremely low-level concepts of "gesture." The actual programming process focuses on low-level sensor data, such as the voltage values of a particular sensor, which limits the user in his or her thinking process, requires users to have significant programming experience, and loses the expressive, meaningful, and metaphor-rich content of the movement. To remedy these difficulties, I have created a new framework and development environment for gestural control of media in rehearsal and performance, allowing users to create clear and intuitive mappings in a simple and flexible manner by using high-level descriptions of gestures and of gestural qualities. This approach, the Gestural Media Framework, recognizes continuous gesture and translates Laban Effort Notation into the realm of technological gesture analysis, allowing for the abstraction and encapsulation of sensor data into movement descriptions. As part of the evaluation of this system, I choreographed four performance pieces that use this system throughout the performance and rehearsal process to map dancers' movements to manipulation of sound and visual elements. This work has been supported by the MIT Media Laboratory. by Elena Naomi Jessop. S.M. 2010-08-31T14:52:40Z 2010-08-31T14:52:40Z 2010 2010 Thesis http://hdl.handle.net/1721.1/57806 656274171 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 101 p. application/pdf Massachusetts Institute of Technology
spellingShingle Architecture. Program in Media Arts and Sciences.
Jessop, Elena Naomi
A gestural media framework : tools for expressive gesture recognition and mapping in rehearsal and performance
title A gestural media framework : tools for expressive gesture recognition and mapping in rehearsal and performance
title_full A gestural media framework : tools for expressive gesture recognition and mapping in rehearsal and performance
title_fullStr A gestural media framework : tools for expressive gesture recognition and mapping in rehearsal and performance
title_full_unstemmed A gestural media framework : tools for expressive gesture recognition and mapping in rehearsal and performance
title_short A gestural media framework : tools for expressive gesture recognition and mapping in rehearsal and performance
title_sort gestural media framework tools for expressive gesture recognition and mapping in rehearsal and performance
topic Architecture. Program in Media Arts and Sciences.
url http://hdl.handle.net/1721.1/57806
work_keys_str_mv AT jessopelenanaomi agesturalmediaframeworktoolsforexpressivegesturerecognitionandmappinginrehearsalandperformance
AT jessopelenanaomi toolsforexpressivegesturerecognitionandmappinginrehearsalandperformance
AT jessopelenanaomi gesturalmediaframeworktoolsforexpressivegesturerecognitionandmappinginrehearsalandperformance