Using augmented reality filters to display time-based visual cues

Introduction: Healthcare education commonly uses practices like moulage to represent visual cues (e.g., symptoms). Unfortunately, current practices have limitations in accurately representing visual symptoms that develop over time. To address this challenge, we applied augmented reality (AR) filters...

Full description

Bibliographic Details
Main Authors: Jacob Stuart, Anita Stephen, Karen Aul, Michael D. Bumbach, Shari Huffman, Brooke Russo, Benjamin Lok 
Format: Article
Language:English
Published: Frontiers Media S.A. 2023-04-01
Series:Frontiers in Virtual Reality
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frvir.2023.1127000/full
_version_ 1797846701828997120
author Jacob Stuart
Anita Stephen
Karen Aul
Michael D. Bumbach
Shari Huffman
Brooke Russo
Benjamin Lok 
author_facet Jacob Stuart
Anita Stephen
Karen Aul
Michael D. Bumbach
Shari Huffman
Brooke Russo
Benjamin Lok 
author_sort Jacob Stuart
collection DOAJ
description Introduction: Healthcare education commonly uses practices like moulage to represent visual cues (e.g., symptoms). Unfortunately, current practices have limitations in accurately representing visual symptoms that develop over time. To address this challenge, we applied augmented reality (AR) filters to images displayed on computer screens to enable real-time interactive visualizations of symptom development. Additionally, this study explores the impact of object and filter fidelity on users’ perceptions of visual cues during training, providing evidence-based recommendations on the effective use of filters in healthcare education.Methods: We conducted a 2 × 2 within-subjects study that involved second-year nursing students (N = 55) from the University of Florida. The study manipulated two factors: filter fidelity and object fidelity. Filter fidelity was manipulated by applying either a filter based on a medical illustration image or a filter based on a real symptom image. Object fidelity was manipulated by overlaying the filter on either a medical manikin image or a real person image. To ensure that potential confounding variables such as lighting or 3D tracking did not affect the results, 101 images were pre-generated for each of the four conditions. These images mapped to the transparency levels of the filters, which ranged from 0 to 100. Participants interacted with the images on a computer screen using visual analog scales, manipulating the transparency of the symptoms until they identified changes occurring on the image and distinct symptom patterns. Participants also rated the severity and realism of each condition and provided feedback on how the filter and object fidelities impacted their perceptions.Results: We found evidence that object and filter fidelity impacted user perceptions of symptom realism and severity and even affected users’ abilities to identify the symptoms. This includes symptoms being seen as more realistic when overlaid on the real person, symptoms being identified at earlier stages of development when overlaid on the manikin, and symptoms being seen as most severe when the real-image filter was overlayed on the manikin.Conclusion: This work implemented a novel approach that uses AR filters to display visual cues that develop over time. Additionally, this work’s investigation into fidelity allows us to provide evidence-based recommendations on how and when AR filters can be effectively used in healthcare education.
first_indexed 2024-04-09T17:59:15Z
format Article
id doaj.art-971263b5a1e04b84be8264270bbee68a
institution Directory Open Access Journal
issn 2673-4192
language English
last_indexed 2024-04-09T17:59:15Z
publishDate 2023-04-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Virtual Reality
spelling doaj.art-971263b5a1e04b84be8264270bbee68a2023-04-14T08:53:24ZengFrontiers Media S.A.Frontiers in Virtual Reality2673-41922023-04-01410.3389/frvir.2023.11270001127000Using augmented reality filters to display time-based visual cuesJacob Stuart0Anita Stephen1Karen Aul2Michael D. Bumbach3Shari Huffman4Brooke Russo5Benjamin Lok 6Department of Computer and Information Science and Engineering, Virtual Experiences Research Group, University of Florida, Gainesville, FL, Untited StatesCollege of Nursing, University of Florida, Gainesville, FL, Untited StatesCollege of Nursing, University of South Florida, Tampa, FL, Untited StatesCollege of Nursing, University of Florida, Gainesville, FL, Untited StatesCollege of Nursing, University of Florida, Gainesville, FL, Untited StatesCollege of Nursing, University of Florida, Gainesville, FL, Untited StatesDepartment of Computer and Information Science and Engineering, Virtual Experiences Research Group, University of Florida, Gainesville, FL, Untited StatesIntroduction: Healthcare education commonly uses practices like moulage to represent visual cues (e.g., symptoms). Unfortunately, current practices have limitations in accurately representing visual symptoms that develop over time. To address this challenge, we applied augmented reality (AR) filters to images displayed on computer screens to enable real-time interactive visualizations of symptom development. Additionally, this study explores the impact of object and filter fidelity on users’ perceptions of visual cues during training, providing evidence-based recommendations on the effective use of filters in healthcare education.Methods: We conducted a 2 × 2 within-subjects study that involved second-year nursing students (N = 55) from the University of Florida. The study manipulated two factors: filter fidelity and object fidelity. Filter fidelity was manipulated by applying either a filter based on a medical illustration image or a filter based on a real symptom image. Object fidelity was manipulated by overlaying the filter on either a medical manikin image or a real person image. To ensure that potential confounding variables such as lighting or 3D tracking did not affect the results, 101 images were pre-generated for each of the four conditions. These images mapped to the transparency levels of the filters, which ranged from 0 to 100. Participants interacted with the images on a computer screen using visual analog scales, manipulating the transparency of the symptoms until they identified changes occurring on the image and distinct symptom patterns. Participants also rated the severity and realism of each condition and provided feedback on how the filter and object fidelities impacted their perceptions.Results: We found evidence that object and filter fidelity impacted user perceptions of symptom realism and severity and even affected users’ abilities to identify the symptoms. This includes symptoms being seen as more realistic when overlaid on the real person, symptoms being identified at earlier stages of development when overlaid on the manikin, and symptoms being seen as most severe when the real-image filter was overlayed on the manikin.Conclusion: This work implemented a novel approach that uses AR filters to display visual cues that develop over time. Additionally, this work’s investigation into fidelity allows us to provide evidence-based recommendations on how and when AR filters can be effectively used in healthcare education.https://www.frontiersin.org/articles/10.3389/frvir.2023.1127000/fullaugmented realityvisual cue traininghealthcaresimulationsymptomsfidelity
spellingShingle Jacob Stuart
Anita Stephen
Karen Aul
Michael D. Bumbach
Shari Huffman
Brooke Russo
Benjamin Lok 
Using augmented reality filters to display time-based visual cues
Frontiers in Virtual Reality
augmented reality
visual cue training
healthcare
simulation
symptoms
fidelity
title Using augmented reality filters to display time-based visual cues
title_full Using augmented reality filters to display time-based visual cues
title_fullStr Using augmented reality filters to display time-based visual cues
title_full_unstemmed Using augmented reality filters to display time-based visual cues
title_short Using augmented reality filters to display time-based visual cues
title_sort using augmented reality filters to display time based visual cues
topic augmented reality
visual cue training
healthcare
simulation
symptoms
fidelity
url https://www.frontiersin.org/articles/10.3389/frvir.2023.1127000/full
work_keys_str_mv AT jacobstuart usingaugmentedrealityfilterstodisplaytimebasedvisualcues
AT anitastephen usingaugmentedrealityfilterstodisplaytimebasedvisualcues
AT karenaul usingaugmentedrealityfilterstodisplaytimebasedvisualcues
AT michaeldbumbach usingaugmentedrealityfilterstodisplaytimebasedvisualcues
AT sharihuffman usingaugmentedrealityfilterstodisplaytimebasedvisualcues
AT brookerusso usingaugmentedrealityfilterstodisplaytimebasedvisualcues
AT benjaminlok usingaugmentedrealityfilterstodisplaytimebasedvisualcues