Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplers
With proliferation of smart devices such as smart phones, it is common that an event is recorded by multiple individuals creating several audio and video perspectives. Such user generated content is mostly unorganized (not synchronized). In this work, we consider the problem of aligning of multiple...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Elsevier
2018-07-01
|
Series: | SoftwareX |
Online Access: | http://www.sciencedirect.com/science/article/pii/S235271101730064X |
_version_ | 1818968349619519488 |
---|---|
author | Dogac Basaran Ali Taylan Cemgil Emin Anarim |
author_facet | Dogac Basaran Ali Taylan Cemgil Emin Anarim |
author_sort | Dogac Basaran |
collection | DOAJ |
description | With proliferation of smart devices such as smart phones, it is common that an event is recorded by multiple individuals creating several audio and video perspectives. Such user generated content is mostly unorganized (not synchronized). In this work, we consider the problem of aligning of multiple unsynchronized audio sequences and propose a multiresolution alignment algorithm using Sequential Monte Carlo samplers in a course to fine structure. The proposed method is evaluated with a real-life dataset from Jiku Mobile Video Datasets and has proven to be competitive with the baseline fingerprinting based alignment methods, with the proper choice of parameters. Keywords: Multiple audio alignment, Multiresolution alignment, Audio fingerprint, Bayesian inference, Sequential Monte Carlo samplers, Sequential alignment |
first_indexed | 2024-12-20T14:03:17Z |
format | Article |
id | doaj.art-b0c2c8db182c406b9f1f2c0c676b1495 |
institution | Directory Open Access Journal |
issn | 2352-7110 |
language | English |
last_indexed | 2024-12-20T14:03:17Z |
publishDate | 2018-07-01 |
publisher | Elsevier |
record_format | Article |
series | SoftwareX |
spelling | doaj.art-b0c2c8db182c406b9f1f2c0c676b14952022-12-21T19:38:20ZengElsevierSoftwareX2352-71102018-07-0183338Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplersDogac Basaran0Ali Taylan Cemgil1Emin Anarim2Signal and Image Processing Department, Telecom-Paristech University, 46 Rue Barrault, Paris, France; Corresponding author.Computer Engineering Department, Bogazici University, 34342 Bebek, Istanbul, TurkeyElectrical and Electronics Engineering Department, Bogazici University, 34342 Bebek, Istanbul, TurkeyWith proliferation of smart devices such as smart phones, it is common that an event is recorded by multiple individuals creating several audio and video perspectives. Such user generated content is mostly unorganized (not synchronized). In this work, we consider the problem of aligning of multiple unsynchronized audio sequences and propose a multiresolution alignment algorithm using Sequential Monte Carlo samplers in a course to fine structure. The proposed method is evaluated with a real-life dataset from Jiku Mobile Video Datasets and has proven to be competitive with the baseline fingerprinting based alignment methods, with the proper choice of parameters. Keywords: Multiple audio alignment, Multiresolution alignment, Audio fingerprint, Bayesian inference, Sequential Monte Carlo samplers, Sequential alignmenthttp://www.sciencedirect.com/science/article/pii/S235271101730064X |
spellingShingle | Dogac Basaran Ali Taylan Cemgil Emin Anarim Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplers SoftwareX |
title | Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplers |
title_full | Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplers |
title_fullStr | Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplers |
title_full_unstemmed | Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplers |
title_short | Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplers |
title_sort | multiresolution alignment for multiple unsynchronized audio sequences using sequential monte carlo samplers |
url | http://www.sciencedirect.com/science/article/pii/S235271101730064X |
work_keys_str_mv | AT dogacbasaran multiresolutionalignmentformultipleunsynchronizedaudiosequencesusingsequentialmontecarlosamplers AT alitaylancemgil multiresolutionalignmentformultipleunsynchronizedaudiosequencesusingsequentialmontecarlosamplers AT eminanarim multiresolutionalignmentformultipleunsynchronizedaudiosequencesusingsequentialmontecarlosamplers |