VisualSoundtrack: An Approach to Style Transfer in the Context of Soundtrack Prototyping

© 2017 Ishwarya Ananthabhotla et al. In this work, we present VisualSoundtrack, a system designed as a tool for soundtrack composers to experiment with original musical content in differing musical "styles". The system allows a user to rapidly prototype musical ideas with respect to the ta...

Full description

Bibliographic Details
Main Authors: Ananthanbhotla, Ishwarya, Paradiso, Joseph A.
Other Authors: Massachusetts Institute of Technology. Responsive Environments Group
Format: Article
Language:English
Published: 2021
Online Access:https://hdl.handle.net/1721.1/137478
_version_ 1826198010505199616
author Ananthanbhotla, Ishwarya
Paradiso, Joseph A.
author2 Massachusetts Institute of Technology. Responsive Environments Group
author_facet Massachusetts Institute of Technology. Responsive Environments Group
Ananthanbhotla, Ishwarya
Paradiso, Joseph A.
author_sort Ananthanbhotla, Ishwarya
collection MIT
description © 2017 Ishwarya Ananthabhotla et al. In this work, we present VisualSoundtrack, a system designed as a tool for soundtrack composers to experiment with original musical content in differing musical "styles". The system allows a user to rapidly prototype musical ideas with respect to the target media (such as a film or podcast) by having him/her input original musical motifs, capitalizing on a corpus of existing soundtrack samples to source various styles, and allowing the user to identify the most appropriate style sources for the target media by visually architecting a path through a highly abstracted feature space. The contributions of this paper include the presentation of the novel concept, a description of the fully-functional system design, a focus on the approach taken to achieve the "style transfer", and an initial evaluation of its effectiveness.
first_indexed 2024-09-23T10:57:28Z
format Article
id mit-1721.1/137478
institution Massachusetts Institute of Technology
language English
last_indexed 2024-09-23T10:57:28Z
publishDate 2021
record_format dspace
spelling mit-1721.1/1374782021-11-06T03:29:54Z VisualSoundtrack: An Approach to Style Transfer in the Context of Soundtrack Prototyping Ananthanbhotla, Ishwarya Paradiso, Joseph A. Massachusetts Institute of Technology. Responsive Environments Group Massachusetts Institute of Technology. Media Laboratory © 2017 Ishwarya Ananthabhotla et al. In this work, we present VisualSoundtrack, a system designed as a tool for soundtrack composers to experiment with original musical content in differing musical "styles". The system allows a user to rapidly prototype musical ideas with respect to the target media (such as a film or podcast) by having him/her input original musical motifs, capitalizing on a corpus of existing soundtrack samples to source various styles, and allowing the user to identify the most appropriate style sources for the target media by visually architecting a path through a highly abstracted feature space. The contributions of this paper include the presentation of the novel concept, a description of the fully-functional system design, a focus on the approach taken to achieve the "style transfer", and an initial evaluation of its effectiveness. 2021-11-05T14:25:16Z 2021-11-05T14:25:16Z 2017 2019-07-24T17:56:44Z Article http://purl.org/eprint/type/ConferencePaper https://hdl.handle.net/1721.1/137478 Ananthanbhotla, Ishwarya and Paradiso, Joseph A. 2017. "VisualSoundtrack: An Approach to Style Transfer in the Context of Soundtrack Prototyping." en Creative Commons Attribution 3.0 unported license https://creativecommons.org/licenses/by/3.0/ application/pdf MIT web domain
spellingShingle Ananthanbhotla, Ishwarya
Paradiso, Joseph A.
VisualSoundtrack: An Approach to Style Transfer in the Context of Soundtrack Prototyping
title VisualSoundtrack: An Approach to Style Transfer in the Context of Soundtrack Prototyping
title_full VisualSoundtrack: An Approach to Style Transfer in the Context of Soundtrack Prototyping
title_fullStr VisualSoundtrack: An Approach to Style Transfer in the Context of Soundtrack Prototyping
title_full_unstemmed VisualSoundtrack: An Approach to Style Transfer in the Context of Soundtrack Prototyping
title_short VisualSoundtrack: An Approach to Style Transfer in the Context of Soundtrack Prototyping
title_sort visualsoundtrack an approach to style transfer in the context of soundtrack prototyping
url https://hdl.handle.net/1721.1/137478
work_keys_str_mv AT ananthanbhotlaishwarya visualsoundtrackanapproachtostyletransferinthecontextofsoundtrackprototyping
AT paradisojosepha visualsoundtrackanapproachtostyletransferinthecontextofsoundtrackprototyping