Virtual and Augmented Reality Direct Ophthalmoscopy Tool: A Comparison between Interactions Methods

Direct ophthalmoscopy (DO) is a medical procedure whereby a health professional, using a direct ophthalmoscope, examines the eye fundus. DO skills are in decline due to the use of interactive diagnostic equipment and insufficient practice with the direct ophthalmoscope. To address the loss of DO ski...

Full description

Bibliographic Details
Main Authors: Michael Chan, Alvaro Uribe-Quevedo, Bill Kapralos, Michael Jenkin, Norman Jaimes, Kamen Kanev
Format: Article
Language:English
Published: MDPI AG 2021-10-01
Series:Multimodal Technologies and Interaction
Subjects:
Online Access:https://www.mdpi.com/2414-4088/5/11/66
_version_ 1797509054317199360
author Michael Chan
Alvaro Uribe-Quevedo
Bill Kapralos
Michael Jenkin
Norman Jaimes
Kamen Kanev
author_facet Michael Chan
Alvaro Uribe-Quevedo
Bill Kapralos
Michael Jenkin
Norman Jaimes
Kamen Kanev
author_sort Michael Chan
collection DOAJ
description Direct ophthalmoscopy (DO) is a medical procedure whereby a health professional, using a direct ophthalmoscope, examines the eye fundus. DO skills are in decline due to the use of interactive diagnostic equipment and insufficient practice with the direct ophthalmoscope. To address the loss of DO skills, physical and computer-based simulators have been developed to offer additional training. Among the computer-based simulations, virtual and augmented reality (VR and AR, respectively) allow simulated immersive and interactive scenarios with eye fundus conditions that are difficult to replicate in the classroom. VR and AR require employing 3D user interfaces (3DUIs) to perform the virtual eye examination. Using a combination of a between-subjects and within-subjects paradigm with two groups of five participants, this paper builds upon a previous preliminary usability study that compared the use of the HTC Vive controller, the Valve Index controller, and the Microsoft HoloLens 1 hand gesticulation interaction methods when performing a virtual direct ophthalmoscopy eye examination. The work described in this paper extends our prior work by considering the interactions with the Oculus Quest controller and Oculus Quest hand-tracking system to perform a virtual direct ophthalmoscopy eye examination while allowing us to compare these methods without our prior interaction techniques. Ultimately, this helps us develop a greater understanding of usability effects for virtual DO examinations and virtual reality in general. Although the number of participants was limited, n = 5 for Stage 1 (including the HTC Vive controller, the Valve Index controller, and the Microsoft HoloLens hand gesticulations), and n = 13 for Stage 2 (including the Oculus Quest controller and the Oculus Quest hand tracking), given the COVID-19 restrictions, our initial results comparing VR and AR 3D user interactions for direct ophthalmoscopy are consistent with our previous preliminary study where the physical controllers resulted in higher usability scores, while the Oculus Quest’s more accurate hand motion capture resulted in higher usability when compared to the Microsoft HoloLens hand gesticulation.
first_indexed 2024-03-10T05:13:29Z
format Article
id doaj.art-1220d243eca542debc4b7c4d2a4a4806
institution Directory Open Access Journal
issn 2414-4088
language English
last_indexed 2024-03-10T05:13:29Z
publishDate 2021-10-01
publisher MDPI AG
record_format Article
series Multimodal Technologies and Interaction
spelling doaj.art-1220d243eca542debc4b7c4d2a4a48062023-11-23T00:38:01ZengMDPI AGMultimodal Technologies and Interaction2414-40882021-10-015116610.3390/mti5110066Virtual and Augmented Reality Direct Ophthalmoscopy Tool: A Comparison between Interactions MethodsMichael Chan0Alvaro Uribe-Quevedo1Bill Kapralos2Michael Jenkin3Norman Jaimes4Kamen Kanev5Software and Informatics Research Centre, Ontario Tech University, Oshawa, ON L1G 0C5, CanadaSoftware and Informatics Research Centre, Ontario Tech University, Oshawa, ON L1G 0C5, CanadaSoftware and Informatics Research Centre, Ontario Tech University, Oshawa, ON L1G 0C5, CanadaDepartment of Electrical Engineering & Computer Science, York University, Toronto, ON M3J 1P3, CanadaFaculty of Medicine, Universidad Militar Nueva Granada, Bogotá 110231, ColombiaResearch Institute of Electronics, Shizuoka University, Hamamatsu 432-8011, JapanDirect ophthalmoscopy (DO) is a medical procedure whereby a health professional, using a direct ophthalmoscope, examines the eye fundus. DO skills are in decline due to the use of interactive diagnostic equipment and insufficient practice with the direct ophthalmoscope. To address the loss of DO skills, physical and computer-based simulators have been developed to offer additional training. Among the computer-based simulations, virtual and augmented reality (VR and AR, respectively) allow simulated immersive and interactive scenarios with eye fundus conditions that are difficult to replicate in the classroom. VR and AR require employing 3D user interfaces (3DUIs) to perform the virtual eye examination. Using a combination of a between-subjects and within-subjects paradigm with two groups of five participants, this paper builds upon a previous preliminary usability study that compared the use of the HTC Vive controller, the Valve Index controller, and the Microsoft HoloLens 1 hand gesticulation interaction methods when performing a virtual direct ophthalmoscopy eye examination. The work described in this paper extends our prior work by considering the interactions with the Oculus Quest controller and Oculus Quest hand-tracking system to perform a virtual direct ophthalmoscopy eye examination while allowing us to compare these methods without our prior interaction techniques. Ultimately, this helps us develop a greater understanding of usability effects for virtual DO examinations and virtual reality in general. Although the number of participants was limited, n = 5 for Stage 1 (including the HTC Vive controller, the Valve Index controller, and the Microsoft HoloLens hand gesticulations), and n = 13 for Stage 2 (including the Oculus Quest controller and the Oculus Quest hand tracking), given the COVID-19 restrictions, our initial results comparing VR and AR 3D user interactions for direct ophthalmoscopy are consistent with our previous preliminary study where the physical controllers resulted in higher usability scores, while the Oculus Quest’s more accurate hand motion capture resulted in higher usability when compared to the Microsoft HoloLens hand gesticulation.https://www.mdpi.com/2414-4088/5/11/66augmented realitydirect ophthalmoscopycontrollerhand trackingtrainingvirtual reality
spellingShingle Michael Chan
Alvaro Uribe-Quevedo
Bill Kapralos
Michael Jenkin
Norman Jaimes
Kamen Kanev
Virtual and Augmented Reality Direct Ophthalmoscopy Tool: A Comparison between Interactions Methods
Multimodal Technologies and Interaction
augmented reality
direct ophthalmoscopy
controller
hand tracking
training
virtual reality
title Virtual and Augmented Reality Direct Ophthalmoscopy Tool: A Comparison between Interactions Methods
title_full Virtual and Augmented Reality Direct Ophthalmoscopy Tool: A Comparison between Interactions Methods
title_fullStr Virtual and Augmented Reality Direct Ophthalmoscopy Tool: A Comparison between Interactions Methods
title_full_unstemmed Virtual and Augmented Reality Direct Ophthalmoscopy Tool: A Comparison between Interactions Methods
title_short Virtual and Augmented Reality Direct Ophthalmoscopy Tool: A Comparison between Interactions Methods
title_sort virtual and augmented reality direct ophthalmoscopy tool a comparison between interactions methods
topic augmented reality
direct ophthalmoscopy
controller
hand tracking
training
virtual reality
url https://www.mdpi.com/2414-4088/5/11/66
work_keys_str_mv AT michaelchan virtualandaugmentedrealitydirectophthalmoscopytoolacomparisonbetweeninteractionsmethods
AT alvarouribequevedo virtualandaugmentedrealitydirectophthalmoscopytoolacomparisonbetweeninteractionsmethods
AT billkapralos virtualandaugmentedrealitydirectophthalmoscopytoolacomparisonbetweeninteractionsmethods
AT michaeljenkin virtualandaugmentedrealitydirectophthalmoscopytoolacomparisonbetweeninteractionsmethods
AT normanjaimes virtualandaugmentedrealitydirectophthalmoscopytoolacomparisonbetweeninteractionsmethods
AT kamenkanev virtualandaugmentedrealitydirectophthalmoscopytoolacomparisonbetweeninteractionsmethods