Foley Music: Learning to Generate Music from Videos
In this paper, we introduce Foley Music, a system that can synthesize plausible music for a silent video clip about people playing musical instruments. We first identify two key intermediate representations for a successful video to music generator: body keypoints from videos and MIDI events from au...
Main Authors: | Gan, Chuang, Huang, Deng, Chen, Peihao, Tenenbaum, Joshua B, Torralba, Antonio |
---|---|
Other Authors: | MIT-IBM Watson AI Lab |
Format: | Book |
Language: | English |
Published: |
Springer International Publishing
2021
|
Online Access: | https://hdl.handle.net/1721.1/130350 |
Similar Items
-
Music Gesture for Visual Sound Separation
by: Gan, Chuang, et al.
Published: (2021) -
Double Linear Transformer for Background Music Generation from Videos
by: Xueting Yang, et al.
Published: (2022-05-01) -
Exploring Music Video Experiences and Their Influence on Music Perception
by: Johanna N. Dasovich-Wilson, et al.
Published: (2022-08-01) -
Controllable music : supervised learning of disentangled representations for music generation
by: Watcharasupat, Karn N.
Published: (2021) -
Learning to generate emotional music correlated with music structure features
by: Lin Ma, et al.
Published: (2022-06-01)