Auralization based on multi-perspective ambisonic room impulse responses
Most often, virtual acoustic rendering employs real-time updated room acoustic simulations to accomplish auralization for a variable listener perspective. As an alternative, we propose and test a technique to interpolate room impulse responses, specifically Ambisonic room impulse responses (ARIRs) a...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
EDP Sciences
2020-01-01
|
Series: | Acta Acustica |
Subjects: | |
Online Access: | https://acta-acustica.edpsciences.org/articles/aacus/full_html/2020/06/aacus200038/aacus200038.html |
_version_ | 1797712858626129920 |
---|---|
author | Müller Kaspar Zotter Franz |
author_facet | Müller Kaspar Zotter Franz |
author_sort | Müller Kaspar |
collection | DOAJ |
description | Most often, virtual acoustic rendering employs real-time updated room acoustic simulations to accomplish auralization for a variable listener perspective. As an alternative, we propose and test a technique to interpolate room impulse responses, specifically Ambisonic room impulse responses (ARIRs) available at a grid of spatially distributed receiver perspectives, measured or simulated in a desired acoustic environment. In particular, we extrapolate a triplet of neighboring ARIRs to the variable listener perspective, preceding their linear interpolation. The extrapolation is achieved by decomposing each ARIR into localized sound events and re-assigning their direction, time, and level to what could be observed at the listener perspective, with as much temporal, directional, and perspective context as possible. We propose to undertake this decomposition in two levels: Peaks in the early ARIRs are decomposed into jointly localized sound events, based on time differences of arrival observed in either an ARIR triplet, or all ARIRs observing the direct sound. Sound events that could not be jointly localized are treated as residuals whose less precise localization utilizes direction-of-arrival detection and the estimated time of arrival. For the interpolated rendering, suitable parameter settings are found by evaluating the proposed method in a listening experiment, using both measured and simulated ARIR data sets, under static and time-varying conditions. |
first_indexed | 2024-03-12T07:28:00Z |
format | Article |
id | doaj.art-35e532c17f75474989e7e199a0744d0c |
institution | Directory Open Access Journal |
issn | 2681-4617 |
language | English |
last_indexed | 2024-03-12T07:28:00Z |
publishDate | 2020-01-01 |
publisher | EDP Sciences |
record_format | Article |
series | Acta Acustica |
spelling | doaj.art-35e532c17f75474989e7e199a0744d0c2023-09-02T21:59:55ZengEDP SciencesActa Acustica2681-46172020-01-01462510.1051/aacus/2020024aacus200038Auralization based on multi-perspective ambisonic room impulse responsesMüller KasparZotter Franzhttps://orcid.org/0000-0002-6201-1106Most often, virtual acoustic rendering employs real-time updated room acoustic simulations to accomplish auralization for a variable listener perspective. As an alternative, we propose and test a technique to interpolate room impulse responses, specifically Ambisonic room impulse responses (ARIRs) available at a grid of spatially distributed receiver perspectives, measured or simulated in a desired acoustic environment. In particular, we extrapolate a triplet of neighboring ARIRs to the variable listener perspective, preceding their linear interpolation. The extrapolation is achieved by decomposing each ARIR into localized sound events and re-assigning their direction, time, and level to what could be observed at the listener perspective, with as much temporal, directional, and perspective context as possible. We propose to undertake this decomposition in two levels: Peaks in the early ARIRs are decomposed into jointly localized sound events, based on time differences of arrival observed in either an ARIR triplet, or all ARIRs observing the direct sound. Sound events that could not be jointly localized are treated as residuals whose less precise localization utilizes direction-of-arrival detection and the estimated time of arrival. For the interpolated rendering, suitable parameter settings are found by evaluating the proposed method in a listening experiment, using both measured and simulated ARIR data sets, under static and time-varying conditions.https://acta-acustica.edpsciences.org/articles/aacus/full_html/2020/06/aacus200038/aacus200038.html6dof renderingroom impulse responsesvariable-perspective renderingvirtual acoustics |
spellingShingle | Müller Kaspar Zotter Franz Auralization based on multi-perspective ambisonic room impulse responses Acta Acustica 6dof rendering room impulse responses variable-perspective rendering virtual acoustics |
title | Auralization based on multi-perspective ambisonic room impulse responses |
title_full | Auralization based on multi-perspective ambisonic room impulse responses |
title_fullStr | Auralization based on multi-perspective ambisonic room impulse responses |
title_full_unstemmed | Auralization based on multi-perspective ambisonic room impulse responses |
title_short | Auralization based on multi-perspective ambisonic room impulse responses |
title_sort | auralization based on multi perspective ambisonic room impulse responses |
topic | 6dof rendering room impulse responses variable-perspective rendering virtual acoustics |
url | https://acta-acustica.edpsciences.org/articles/aacus/full_html/2020/06/aacus200038/aacus200038.html |
work_keys_str_mv | AT mullerkaspar auralizationbasedonmultiperspectiveambisonicroomimpulseresponses AT zotterfranz auralizationbasedonmultiperspectiveambisonicroomimpulseresponses |