Perceptual Relevance of Haptic Feedback during Virtual Plucking, Bowing and Rubbing of Physically-Based Musical Resonators

The physics-based design and realization of a digital musical interface asks for the modeling and implementation of the contact-point interaction with the performer. Musical instruments always include a resonator that converts the input energy into sound, meanwhile feeding part of it back to the per...

Full description

Bibliographic Details
Main Authors: Marius George Onofrei, Federico Fontana, Stefania Serafin
Format: Article
Language:English
Published: MDPI AG 2023-07-01
Series:Arts
Subjects:
Online Access:https://www.mdpi.com/2076-0752/12/4/144
_version_ 1797585528480071680
author Marius George Onofrei
Federico Fontana
Stefania Serafin
author_facet Marius George Onofrei
Federico Fontana
Stefania Serafin
author_sort Marius George Onofrei
collection DOAJ
description The physics-based design and realization of a digital musical interface asks for the modeling and implementation of the contact-point interaction with the performer. Musical instruments always include a resonator that converts the input energy into sound, meanwhile feeding part of it back to the performer through the same point. Specifically during plucking or bowing interactions, musicians receive a handful of information from the force feedback and vibrations coming from the contact points. This paper focuses on the design and realization of digital music interfaces realizing two physical interactions along with a musically unconventional one, rubbing, rarely encountered in assimilable forms across the centuries on a few instruments. Therefore, it aims to highlight the significance of haptic rendering in improving quality during a musical experience as opposed to interfaces provided with a passive contact point. Current challenges are posed by the specific requirements of the haptic device, as well as the computational effort needed for realizing such interactions without occurrence during the performance of typical digital artifacts such as latency and model instability. Both are however seemingly transitory due to the constant evolution of computer systems for virtual reality and the progressive popularization of haptic interfaces in the sonic interaction design community. In summary, our results speak in favor of adopting nowadays haptic technologies as an essential component for digital musical interfaces affording point-wise contact interactions in the personal performance space.
first_indexed 2024-03-11T00:08:23Z
format Article
id doaj.art-5e2dba03130440a4a56f274a60282065
institution Directory Open Access Journal
issn 2076-0752
language English
last_indexed 2024-03-11T00:08:23Z
publishDate 2023-07-01
publisher MDPI AG
record_format Article
series Arts
spelling doaj.art-5e2dba03130440a4a56f274a602820652023-11-19T00:10:52ZengMDPI AGArts2076-07522023-07-0112414410.3390/arts12040144Perceptual Relevance of Haptic Feedback during Virtual Plucking, Bowing and Rubbing of Physically-Based Musical ResonatorsMarius George Onofrei0Federico Fontana1Stefania Serafin2Multisensory Experience Lab, CREATE, Aalborg University, 9220 Aalborg, DenmarkHuman Computer Interaction Lab, University of Udine, 33100 Udine, ItalyMultisensory Experience Lab, CREATE, Aalborg University, 9220 Aalborg, DenmarkThe physics-based design and realization of a digital musical interface asks for the modeling and implementation of the contact-point interaction with the performer. Musical instruments always include a resonator that converts the input energy into sound, meanwhile feeding part of it back to the performer through the same point. Specifically during plucking or bowing interactions, musicians receive a handful of information from the force feedback and vibrations coming from the contact points. This paper focuses on the design and realization of digital music interfaces realizing two physical interactions along with a musically unconventional one, rubbing, rarely encountered in assimilable forms across the centuries on a few instruments. Therefore, it aims to highlight the significance of haptic rendering in improving quality during a musical experience as opposed to interfaces provided with a passive contact point. Current challenges are posed by the specific requirements of the haptic device, as well as the computational effort needed for realizing such interactions without occurrence during the performance of typical digital artifacts such as latency and model instability. Both are however seemingly transitory due to the constant evolution of computer systems for virtual reality and the progressive popularization of haptic interfaces in the sonic interaction design community. In summary, our results speak in favor of adopting nowadays haptic technologies as an essential component for digital musical interfaces affording point-wise contact interactions in the personal performance space.https://www.mdpi.com/2076-0752/12/4/144physical modeling synthesismusical hapticsvibrotactile feedbackmusical interfaces
spellingShingle Marius George Onofrei
Federico Fontana
Stefania Serafin
Perceptual Relevance of Haptic Feedback during Virtual Plucking, Bowing and Rubbing of Physically-Based Musical Resonators
Arts
physical modeling synthesis
musical haptics
vibrotactile feedback
musical interfaces
title Perceptual Relevance of Haptic Feedback during Virtual Plucking, Bowing and Rubbing of Physically-Based Musical Resonators
title_full Perceptual Relevance of Haptic Feedback during Virtual Plucking, Bowing and Rubbing of Physically-Based Musical Resonators
title_fullStr Perceptual Relevance of Haptic Feedback during Virtual Plucking, Bowing and Rubbing of Physically-Based Musical Resonators
title_full_unstemmed Perceptual Relevance of Haptic Feedback during Virtual Plucking, Bowing and Rubbing of Physically-Based Musical Resonators
title_short Perceptual Relevance of Haptic Feedback during Virtual Plucking, Bowing and Rubbing of Physically-Based Musical Resonators
title_sort perceptual relevance of haptic feedback during virtual plucking bowing and rubbing of physically based musical resonators
topic physical modeling synthesis
musical haptics
vibrotactile feedback
musical interfaces
url https://www.mdpi.com/2076-0752/12/4/144
work_keys_str_mv AT mariusgeorgeonofrei perceptualrelevanceofhapticfeedbackduringvirtualpluckingbowingandrubbingofphysicallybasedmusicalresonators
AT federicofontana perceptualrelevanceofhapticfeedbackduringvirtualpluckingbowingandrubbingofphysicallybasedmusicalresonators
AT stefaniaserafin perceptualrelevanceofhapticfeedbackduringvirtualpluckingbowingandrubbingofphysicallybasedmusicalresonators