Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope

Quality care for patients requires effective communication amongst medical teams. Increasingly, communication is required not only between team members themselves, but between members and the medical devices monitoring and managing patient well-being. Most human–computer interfaces use either audito...

Full description

Bibliographic Details
Main Authors: Sharmila Sreetharan, Michael Schutz
Format: Article
Language:English
Published: MDPI AG 2019-01-01
Series:Multimodal Technologies and Interaction
Subjects:
Online Access:https://www.mdpi.com/2414-4088/3/1/4
_version_ 1819163769530482688
author Sharmila Sreetharan
Michael Schutz
author_facet Sharmila Sreetharan
Michael Schutz
author_sort Sharmila Sreetharan
collection DOAJ
description Quality care for patients requires effective communication amongst medical teams. Increasingly, communication is required not only between team members themselves, but between members and the medical devices monitoring and managing patient well-being. Most human–computer interfaces use either auditory or visual displays, and despite significant experimentation, they still elicit well-documented concerns. Curiously, few interfaces explore the benefits of multimodal communication, despite extensive documentation of the brain’s sensitivity to multimodal signals. New approaches built on insights from basic audiovisual integration research hold the potential to improve future human–computer interfaces. In particular, recent discoveries regarding the acoustic property of amplitude envelope illustrate that it can enhance audiovisual integration while also lowering annoyance. Here, we share key insights from recent research with the potential to inform applications related to human–computer interface design. Ultimately, this could lead to a cost-effective way to improve communication in medical contexts—with signification implications for both human health and the burgeoning medical device industry.
first_indexed 2024-12-22T17:49:24Z
format Article
id doaj.art-82cf57dbfe384c60ace8047a0714ee08
institution Directory Open Access Journal
issn 2414-4088
language English
last_indexed 2024-12-22T17:49:24Z
publishDate 2019-01-01
publisher MDPI AG
record_format Article
series Multimodal Technologies and Interaction
spelling doaj.art-82cf57dbfe384c60ace8047a0714ee082022-12-21T18:18:13ZengMDPI AGMultimodal Technologies and Interaction2414-40882019-01-0131410.3390/mti3010004mti3010004Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude EnvelopeSharmila Sreetharan0Michael Schutz1Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, ON L8S 4L8, CanadaSchool of the Arts, McMaster University, Hamilton, ON L8S 4L8, CanadaQuality care for patients requires effective communication amongst medical teams. Increasingly, communication is required not only between team members themselves, but between members and the medical devices monitoring and managing patient well-being. Most human–computer interfaces use either auditory or visual displays, and despite significant experimentation, they still elicit well-documented concerns. Curiously, few interfaces explore the benefits of multimodal communication, despite extensive documentation of the brain’s sensitivity to multimodal signals. New approaches built on insights from basic audiovisual integration research hold the potential to improve future human–computer interfaces. In particular, recent discoveries regarding the acoustic property of amplitude envelope illustrate that it can enhance audiovisual integration while also lowering annoyance. Here, we share key insights from recent research with the potential to inform applications related to human–computer interface design. Ultimately, this could lead to a cost-effective way to improve communication in medical contexts—with signification implications for both human health and the burgeoning medical device industry.https://www.mdpi.com/2414-4088/3/1/4auditory alarmshuman–computer interface designauditory perceptionamplitude envelopeaudiovisual integrationaesthetics
spellingShingle Sharmila Sreetharan
Michael Schutz
Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope
Multimodal Technologies and Interaction
auditory alarms
human–computer interface design
auditory perception
amplitude envelope
audiovisual integration
aesthetics
title Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope
title_full Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope
title_fullStr Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope
title_full_unstemmed Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope
title_short Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope
title_sort improving human computer interface design through application of basic research on audiovisual integration and amplitude envelope
topic auditory alarms
human–computer interface design
auditory perception
amplitude envelope
audiovisual integration
aesthetics
url https://www.mdpi.com/2414-4088/3/1/4
work_keys_str_mv AT sharmilasreetharan improvinghumancomputerinterfacedesignthroughapplicationofbasicresearchonaudiovisualintegrationandamplitudeenvelope
AT michaelschutz improvinghumancomputerinterfacedesignthroughapplicationofbasicresearchonaudiovisualintegrationandamplitudeenvelope