Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope
Quality care for patients requires effective communication amongst medical teams. Increasingly, communication is required not only between team members themselves, but between members and the medical devices monitoring and managing patient well-being. Most human–computer interfaces use either audito...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2019-01-01
|
Series: | Multimodal Technologies and Interaction |
Subjects: | |
Online Access: | https://www.mdpi.com/2414-4088/3/1/4 |
_version_ | 1819163769530482688 |
---|---|
author | Sharmila Sreetharan Michael Schutz |
author_facet | Sharmila Sreetharan Michael Schutz |
author_sort | Sharmila Sreetharan |
collection | DOAJ |
description | Quality care for patients requires effective communication amongst medical teams. Increasingly, communication is required not only between team members themselves, but between members and the medical devices monitoring and managing patient well-being. Most human–computer interfaces use either auditory or visual displays, and despite significant experimentation, they still elicit well-documented concerns. Curiously, few interfaces explore the benefits of multimodal communication, despite extensive documentation of the brain’s sensitivity to multimodal signals. New approaches built on insights from basic audiovisual integration research hold the potential to improve future human–computer interfaces. In particular, recent discoveries regarding the acoustic property of amplitude envelope illustrate that it can enhance audiovisual integration while also lowering annoyance. Here, we share key insights from recent research with the potential to inform applications related to human–computer interface design. Ultimately, this could lead to a cost-effective way to improve communication in medical contexts—with signification implications for both human health and the burgeoning medical device industry. |
first_indexed | 2024-12-22T17:49:24Z |
format | Article |
id | doaj.art-82cf57dbfe384c60ace8047a0714ee08 |
institution | Directory Open Access Journal |
issn | 2414-4088 |
language | English |
last_indexed | 2024-12-22T17:49:24Z |
publishDate | 2019-01-01 |
publisher | MDPI AG |
record_format | Article |
series | Multimodal Technologies and Interaction |
spelling | doaj.art-82cf57dbfe384c60ace8047a0714ee082022-12-21T18:18:13ZengMDPI AGMultimodal Technologies and Interaction2414-40882019-01-0131410.3390/mti3010004mti3010004Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude EnvelopeSharmila Sreetharan0Michael Schutz1Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, ON L8S 4L8, CanadaSchool of the Arts, McMaster University, Hamilton, ON L8S 4L8, CanadaQuality care for patients requires effective communication amongst medical teams. Increasingly, communication is required not only between team members themselves, but between members and the medical devices monitoring and managing patient well-being. Most human–computer interfaces use either auditory or visual displays, and despite significant experimentation, they still elicit well-documented concerns. Curiously, few interfaces explore the benefits of multimodal communication, despite extensive documentation of the brain’s sensitivity to multimodal signals. New approaches built on insights from basic audiovisual integration research hold the potential to improve future human–computer interfaces. In particular, recent discoveries regarding the acoustic property of amplitude envelope illustrate that it can enhance audiovisual integration while also lowering annoyance. Here, we share key insights from recent research with the potential to inform applications related to human–computer interface design. Ultimately, this could lead to a cost-effective way to improve communication in medical contexts—with signification implications for both human health and the burgeoning medical device industry.https://www.mdpi.com/2414-4088/3/1/4auditory alarmshuman–computer interface designauditory perceptionamplitude envelopeaudiovisual integrationaesthetics |
spellingShingle | Sharmila Sreetharan Michael Schutz Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope Multimodal Technologies and Interaction auditory alarms human–computer interface design auditory perception amplitude envelope audiovisual integration aesthetics |
title | Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope |
title_full | Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope |
title_fullStr | Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope |
title_full_unstemmed | Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope |
title_short | Improving Human–Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope |
title_sort | improving human computer interface design through application of basic research on audiovisual integration and amplitude envelope |
topic | auditory alarms human–computer interface design auditory perception amplitude envelope audiovisual integration aesthetics |
url | https://www.mdpi.com/2414-4088/3/1/4 |
work_keys_str_mv | AT sharmilasreetharan improvinghumancomputerinterfacedesignthroughapplicationofbasicresearchonaudiovisualintegrationandamplitudeenvelope AT michaelschutz improvinghumancomputerinterfacedesignthroughapplicationofbasicresearchonaudiovisualintegrationandamplitudeenvelope |