Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools

Visuo-haptic mixed reality (VHMR) adds virtual objects to a real scene and enables users to see and also touch them via a see-through display and a haptic device. Most studies with kinesthetic feedback use general-purpose haptic devices, which require the user to continuously hold an attached stylus...

Full description

Bibliographic Details
Main Authors: Mehmet Murat Aygün, Yusuf Çağrı Öğüt, Hulusi Baysal, Yiğit Taşcıoğlu
Format: Article
Language:English
Published: MDPI AG 2020-08-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/10/15/5344
_version_ 1827711779136864256
author Mehmet Murat Aygün
Yusuf Çağrı Öğüt
Hulusi Baysal
Yiğit Taşcıoğlu
author_facet Mehmet Murat Aygün
Yusuf Çağrı Öğüt
Hulusi Baysal
Yiğit Taşcıoğlu
author_sort Mehmet Murat Aygün
collection DOAJ
description Visuo-haptic mixed reality (VHMR) adds virtual objects to a real scene and enables users to see and also touch them via a see-through display and a haptic device. Most studies with kinesthetic feedback use general-purpose haptic devices, which require the user to continuously hold an attached stylus. This approach constrains users to the mechanical limits of the device even when it is not needed. In this paper, we propose a novel VHMR concept with an encountered-type haptic display (ETHD), which consists of a precision hexapod positioner and a six-axis force/torque transducer. The main contribution is that the users work with unbound real-life tools with tracking markers. ETHD’s end-effector remains inside the virtual object and follows the tooltip to engage only during an interaction. We have developed a simulation setup and experimentally evaluated the relative accuracy and synchronization of the three major processes, namely tool tracking, haptic rendering, and visual rendering. The experiments successfully build-up to a simple simulation scenario where a tennis ball with a fixed center is deformed by the user.
first_indexed 2024-03-10T18:01:29Z
format Article
id doaj.art-c402e911f0ce480fa02495e7a78c670a
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-10T18:01:29Z
publishDate 2020-08-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-c402e911f0ce480fa02495e7a78c670a2023-11-20T08:52:44ZengMDPI AGApplied Sciences2076-34172020-08-011015534410.3390/app10155344Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld ToolsMehmet Murat Aygün0Yusuf Çağrı Öğüt1Hulusi Baysal2Yiğit Taşcıoğlu3Department of Mechanical Engineering, TOBB University of Economics and Technology—Sogutozu No. 43 Cankaya, 06560 Ankara, TurkeyHAVELSAN, Inc., Cankaya, 06510 Ankara, TurkeyHAVELSAN, Inc., Cankaya, 06510 Ankara, TurkeyDepartment of Mechanical Engineering, TED University—Ziya Gokalp No. 48 Cankaya, 06420 Ankara, TurkeyVisuo-haptic mixed reality (VHMR) adds virtual objects to a real scene and enables users to see and also touch them via a see-through display and a haptic device. Most studies with kinesthetic feedback use general-purpose haptic devices, which require the user to continuously hold an attached stylus. This approach constrains users to the mechanical limits of the device even when it is not needed. In this paper, we propose a novel VHMR concept with an encountered-type haptic display (ETHD), which consists of a precision hexapod positioner and a six-axis force/torque transducer. The main contribution is that the users work with unbound real-life tools with tracking markers. ETHD’s end-effector remains inside the virtual object and follows the tooltip to engage only during an interaction. We have developed a simulation setup and experimentally evaluated the relative accuracy and synchronization of the three major processes, namely tool tracking, haptic rendering, and visual rendering. The experiments successfully build-up to a simple simulation scenario where a tennis ball with a fixed center is deformed by the user.https://www.mdpi.com/2076-3417/10/15/5344visuo-hapticmixed realityencountered-type haptic displayhaptic interfaces
spellingShingle Mehmet Murat Aygün
Yusuf Çağrı Öğüt
Hulusi Baysal
Yiğit Taşcıoğlu
Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools
Applied Sciences
visuo-haptic
mixed reality
encountered-type haptic display
haptic interfaces
title Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools
title_full Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools
title_fullStr Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools
title_full_unstemmed Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools
title_short Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools
title_sort visuo haptic mixed reality simulation using unbound handheld tools
topic visuo-haptic
mixed reality
encountered-type haptic display
haptic interfaces
url https://www.mdpi.com/2076-3417/10/15/5344
work_keys_str_mv AT mehmetmurataygun visuohapticmixedrealitysimulationusingunboundhandheldtools
AT yusufcagrıogut visuohapticmixedrealitysimulationusingunboundhandheldtools
AT hulusibaysal visuohapticmixedrealitysimulationusingunboundhandheldtools
AT yigittascıoglu visuohapticmixedrealitysimulationusingunboundhandheldtools