Auralization based on multi-perspective ambisonic room impulse responses

Most often, virtual acoustic rendering employs real-time updated room acoustic simulations to accomplish auralization for a variable listener perspective. As an alternative, we propose and test a technique to interpolate room impulse responses, specifically Ambisonic room impulse responses (ARIRs) a...

Full description

Bibliographic Details
Main Authors: Müller Kaspar, Zotter Franz
Format: Article
Language:English
Published: EDP Sciences 2020-01-01
Series:Acta Acustica
Subjects:
Online Access:https://acta-acustica.edpsciences.org/articles/aacus/full_html/2020/06/aacus200038/aacus200038.html
_version_ 1797712858626129920
author Müller Kaspar
Zotter Franz
author_facet Müller Kaspar
Zotter Franz
author_sort Müller Kaspar
collection DOAJ
description Most often, virtual acoustic rendering employs real-time updated room acoustic simulations to accomplish auralization for a variable listener perspective. As an alternative, we propose and test a technique to interpolate room impulse responses, specifically Ambisonic room impulse responses (ARIRs) available at a grid of spatially distributed receiver perspectives, measured or simulated in a desired acoustic environment. In particular, we extrapolate a triplet of neighboring ARIRs to the variable listener perspective, preceding their linear interpolation. The extrapolation is achieved by decomposing each ARIR into localized sound events and re-assigning their direction, time, and level to what could be observed at the listener perspective, with as much temporal, directional, and perspective context as possible. We propose to undertake this decomposition in two levels: Peaks in the early ARIRs are decomposed into jointly localized sound events, based on time differences of arrival observed in either an ARIR triplet, or all ARIRs observing the direct sound. Sound events that could not be jointly localized are treated as residuals whose less precise localization utilizes direction-of-arrival detection and the estimated time of arrival. For the interpolated rendering, suitable parameter settings are found by evaluating the proposed method in a listening experiment, using both measured and simulated ARIR data sets, under static and time-varying conditions.
first_indexed 2024-03-12T07:28:00Z
format Article
id doaj.art-35e532c17f75474989e7e199a0744d0c
institution Directory Open Access Journal
issn 2681-4617
language English
last_indexed 2024-03-12T07:28:00Z
publishDate 2020-01-01
publisher EDP Sciences
record_format Article
series Acta Acustica
spelling doaj.art-35e532c17f75474989e7e199a0744d0c2023-09-02T21:59:55ZengEDP SciencesActa Acustica2681-46172020-01-01462510.1051/aacus/2020024aacus200038Auralization based on multi-perspective ambisonic room impulse responsesMüller KasparZotter Franzhttps://orcid.org/0000-0002-6201-1106Most often, virtual acoustic rendering employs real-time updated room acoustic simulations to accomplish auralization for a variable listener perspective. As an alternative, we propose and test a technique to interpolate room impulse responses, specifically Ambisonic room impulse responses (ARIRs) available at a grid of spatially distributed receiver perspectives, measured or simulated in a desired acoustic environment. In particular, we extrapolate a triplet of neighboring ARIRs to the variable listener perspective, preceding their linear interpolation. The extrapolation is achieved by decomposing each ARIR into localized sound events and re-assigning their direction, time, and level to what could be observed at the listener perspective, with as much temporal, directional, and perspective context as possible. We propose to undertake this decomposition in two levels: Peaks in the early ARIRs are decomposed into jointly localized sound events, based on time differences of arrival observed in either an ARIR triplet, or all ARIRs observing the direct sound. Sound events that could not be jointly localized are treated as residuals whose less precise localization utilizes direction-of-arrival detection and the estimated time of arrival. For the interpolated rendering, suitable parameter settings are found by evaluating the proposed method in a listening experiment, using both measured and simulated ARIR data sets, under static and time-varying conditions.https://acta-acustica.edpsciences.org/articles/aacus/full_html/2020/06/aacus200038/aacus200038.html6dof renderingroom impulse responsesvariable-perspective renderingvirtual acoustics
spellingShingle Müller Kaspar
Zotter Franz
Auralization based on multi-perspective ambisonic room impulse responses
Acta Acustica
6dof rendering
room impulse responses
variable-perspective rendering
virtual acoustics
title Auralization based on multi-perspective ambisonic room impulse responses
title_full Auralization based on multi-perspective ambisonic room impulse responses
title_fullStr Auralization based on multi-perspective ambisonic room impulse responses
title_full_unstemmed Auralization based on multi-perspective ambisonic room impulse responses
title_short Auralization based on multi-perspective ambisonic room impulse responses
title_sort auralization based on multi perspective ambisonic room impulse responses
topic 6dof rendering
room impulse responses
variable-perspective rendering
virtual acoustics
url https://acta-acustica.edpsciences.org/articles/aacus/full_html/2020/06/aacus200038/aacus200038.html
work_keys_str_mv AT mullerkaspar auralizationbasedonmultiperspectiveambisonicroomimpulseresponses
AT zotterfranz auralizationbasedonmultiperspectiveambisonicroomimpulseresponses