Foley Music: Learning to Generate Music from Videos

In this paper, we introduce Foley Music, a system that can synthesize plausible music for a silent video clip about people playing musical instruments. We first identify two key intermediate representations for a successful video to music generator: body keypoints from videos and MIDI events from au...

Full description

Bibliographic Details
Main Authors: Gan, Chuang, Huang, Deng, Chen, Peihao, Tenenbaum, Joshua B, Torralba, Antonio
Other Authors: MIT-IBM Watson AI Lab
Format: Book
Language:English
Published: Springer International Publishing 2021
Online Access:https://hdl.handle.net/1721.1/130350

Similar Items