Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplers

With proliferation of smart devices such as smart phones, it is common that an event is recorded by multiple individuals creating several audio and video perspectives. Such user generated content is mostly unorganized (not synchronized). In this work, we consider the problem of aligning of multiple...

Full description

Bibliographic Details
Main Authors: Dogac Basaran, Ali Taylan Cemgil, Emin Anarim
Format: Article
Language:English
Published: Elsevier 2018-07-01
Series:SoftwareX
Online Access:http://www.sciencedirect.com/science/article/pii/S235271101730064X
_version_ 1818968349619519488
author Dogac Basaran
Ali Taylan Cemgil
Emin Anarim
author_facet Dogac Basaran
Ali Taylan Cemgil
Emin Anarim
author_sort Dogac Basaran
collection DOAJ
description With proliferation of smart devices such as smart phones, it is common that an event is recorded by multiple individuals creating several audio and video perspectives. Such user generated content is mostly unorganized (not synchronized). In this work, we consider the problem of aligning of multiple unsynchronized audio sequences and propose a multiresolution alignment algorithm using Sequential Monte Carlo samplers in a course to fine structure. The proposed method is evaluated with a real-life dataset from Jiku Mobile Video Datasets and has proven to be competitive with the baseline fingerprinting based alignment methods, with the proper choice of parameters. Keywords: Multiple audio alignment, Multiresolution alignment, Audio fingerprint, Bayesian inference, Sequential Monte Carlo samplers, Sequential alignment
first_indexed 2024-12-20T14:03:17Z
format Article
id doaj.art-b0c2c8db182c406b9f1f2c0c676b1495
institution Directory Open Access Journal
issn 2352-7110
language English
last_indexed 2024-12-20T14:03:17Z
publishDate 2018-07-01
publisher Elsevier
record_format Article
series SoftwareX
spelling doaj.art-b0c2c8db182c406b9f1f2c0c676b14952022-12-21T19:38:20ZengElsevierSoftwareX2352-71102018-07-0183338Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplersDogac Basaran0Ali Taylan Cemgil1Emin Anarim2Signal and Image Processing Department, Telecom-Paristech University, 46 Rue Barrault, Paris, France; Corresponding author.Computer Engineering Department, Bogazici University, 34342 Bebek, Istanbul, TurkeyElectrical and Electronics Engineering Department, Bogazici University, 34342 Bebek, Istanbul, TurkeyWith proliferation of smart devices such as smart phones, it is common that an event is recorded by multiple individuals creating several audio and video perspectives. Such user generated content is mostly unorganized (not synchronized). In this work, we consider the problem of aligning of multiple unsynchronized audio sequences and propose a multiresolution alignment algorithm using Sequential Monte Carlo samplers in a course to fine structure. The proposed method is evaluated with a real-life dataset from Jiku Mobile Video Datasets and has proven to be competitive with the baseline fingerprinting based alignment methods, with the proper choice of parameters. Keywords: Multiple audio alignment, Multiresolution alignment, Audio fingerprint, Bayesian inference, Sequential Monte Carlo samplers, Sequential alignmenthttp://www.sciencedirect.com/science/article/pii/S235271101730064X
spellingShingle Dogac Basaran
Ali Taylan Cemgil
Emin Anarim
Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplers
SoftwareX
title Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplers
title_full Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplers
title_fullStr Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplers
title_full_unstemmed Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplers
title_short Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplers
title_sort multiresolution alignment for multiple unsynchronized audio sequences using sequential monte carlo samplers
url http://www.sciencedirect.com/science/article/pii/S235271101730064X
work_keys_str_mv AT dogacbasaran multiresolutionalignmentformultipleunsynchronizedaudiosequencesusingsequentialmontecarlosamplers
AT alitaylancemgil multiresolutionalignmentformultipleunsynchronizedaudiosequencesusingsequentialmontecarlosamplers
AT eminanarim multiresolutionalignmentformultipleunsynchronizedaudiosequencesusingsequentialmontecarlosamplers