Inside the conductor's jacket : analysis, interpretation and musical synthesis of expressive gesture
Thesis (Ph.D.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2000.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2005
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/9165 |
| _version_ | 1826190540822020096 |
|---|---|
| author | Marrin Nakra, Teresa (Teresa Anne), 1970- |
| author2 | Tod Machover and Rosalind W. Picard. |
| author_facet | Tod Machover and Rosalind W. Picard. Marrin Nakra, Teresa (Teresa Anne), 1970- |
| author_sort | Marrin Nakra, Teresa (Teresa Anne), 1970- |
| collection | MIT |
| description | Thesis (Ph.D.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2000. |
| first_indexed | 2024-09-23T08:41:51Z |
| format | Thesis |
| id | mit-1721.1/9165 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T08:41:51Z |
| publishDate | 2005 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/91652019-04-09T19:16:08Z Inside the conductor's jacket : analysis, interpretation and musical synthesis of expressive gesture Marrin Nakra, Teresa (Teresa Anne), 1970- Tod Machover and Rosalind W. Picard. Massachusetts Institute of Technology. Dept. of Architecture. Program in Media Arts and Sciences. Massachusetts Institute of Technology. Dept. of Architecture. Program in Media Arts and Sciences. Architecture. Program in Media Arts and Sciences. Thesis (Ph.D.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2000. Includes bibliographical references (leaves 154-167). We present the design and implementation of the Conductor's Jacket, a unique wearable device that measures physiological and gestural signals, together with the Gesture Construction, a musical software system that interprets these signals and applies them expressively in a musical context. Sixteen sensors have been incorporated into the Conductor's Jacket in such a way as to not encumber or interfere with the gestures of a working orchestra conductor. The Conductor's Jacket system gathers up to sixteen data channels reliably at rates of 3 kHz per channel, and also provides mcal-time graphical feedback. Unlike many gesture-sensing systems it not only gathers positional and accelerational data but also senses muscle tension from several locations on each arm. The Conductor's Jacket was used to gather conducting data from six subjects, three professional conductors and three students, during twelve hours of rehearsals and performances. Analyses of the data yielded thirty-five significant features that seem to reflect intuitive and natural gestural tendencies, including context-based hand switching, anticipatory 'flatlining' effects, and correlations between respiration and phrasing. The results indicate that muscle tension and respiration signals reflect several significant and expressive characteristics of a conductor's gestures. From these results we present nine hypotheses about human musical expression, including ideas about efficiency, intentionality, polyphony, signal-to-noise ratios, and musical flow state. Finally, this thesis describes the Gesture Construction, a musical software system that analyzes and performs music in real-time based on the performer's gestures and breathing signals. A bank of software filters extracts several of the features that were found in the conductor study, including beat intensities and the alternation between arms. These features are then used to generate real-time expressive effects by shaping the beats, tempos, articulations, dynamics, and note lengths in a musical score. by Teresa Marrin Nakra. Ph.D. 2005-08-22T23:13:21Z 2005-08-22T23:13:21Z 2000 2000 Thesis http://hdl.handle.net/1721.1/9165 45303525 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 170 leaves 17577875 bytes 17577633 bytes application/pdf application/pdf application/pdf Massachusetts Institute of Technology |
| spellingShingle | Architecture. Program in Media Arts and Sciences. Marrin Nakra, Teresa (Teresa Anne), 1970- Inside the conductor's jacket : analysis, interpretation and musical synthesis of expressive gesture |
| title | Inside the conductor's jacket : analysis, interpretation and musical synthesis of expressive gesture |
| title_full | Inside the conductor's jacket : analysis, interpretation and musical synthesis of expressive gesture |
| title_fullStr | Inside the conductor's jacket : analysis, interpretation and musical synthesis of expressive gesture |
| title_full_unstemmed | Inside the conductor's jacket : analysis, interpretation and musical synthesis of expressive gesture |
| title_short | Inside the conductor's jacket : analysis, interpretation and musical synthesis of expressive gesture |
| title_sort | inside the conductor s jacket analysis interpretation and musical synthesis of expressive gesture |
| topic | Architecture. Program in Media Arts and Sciences. |
| url | http://hdl.handle.net/1721.1/9165 |
| work_keys_str_mv | AT marrinnakrateresateresaanne1970 insidetheconductorsjacketanalysisinterpretationandmusicalsynthesisofexpressivegesture |