Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools
Visuo-haptic mixed reality (VHMR) adds virtual objects to a real scene and enables users to see and also touch them via a see-through display and a haptic device. Most studies with kinesthetic feedback use general-purpose haptic devices, which require the user to continuously hold an attached stylus...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2020-08-01
|
Series: | Applied Sciences |
Subjects: | |
Online Access: | https://www.mdpi.com/2076-3417/10/15/5344 |
_version_ | 1827711779136864256 |
---|---|
author | Mehmet Murat Aygün Yusuf Çağrı Öğüt Hulusi Baysal Yiğit Taşcıoğlu |
author_facet | Mehmet Murat Aygün Yusuf Çağrı Öğüt Hulusi Baysal Yiğit Taşcıoğlu |
author_sort | Mehmet Murat Aygün |
collection | DOAJ |
description | Visuo-haptic mixed reality (VHMR) adds virtual objects to a real scene and enables users to see and also touch them via a see-through display and a haptic device. Most studies with kinesthetic feedback use general-purpose haptic devices, which require the user to continuously hold an attached stylus. This approach constrains users to the mechanical limits of the device even when it is not needed. In this paper, we propose a novel VHMR concept with an encountered-type haptic display (ETHD), which consists of a precision hexapod positioner and a six-axis force/torque transducer. The main contribution is that the users work with unbound real-life tools with tracking markers. ETHD’s end-effector remains inside the virtual object and follows the tooltip to engage only during an interaction. We have developed a simulation setup and experimentally evaluated the relative accuracy and synchronization of the three major processes, namely tool tracking, haptic rendering, and visual rendering. The experiments successfully build-up to a simple simulation scenario where a tennis ball with a fixed center is deformed by the user. |
first_indexed | 2024-03-10T18:01:29Z |
format | Article |
id | doaj.art-c402e911f0ce480fa02495e7a78c670a |
institution | Directory Open Access Journal |
issn | 2076-3417 |
language | English |
last_indexed | 2024-03-10T18:01:29Z |
publishDate | 2020-08-01 |
publisher | MDPI AG |
record_format | Article |
series | Applied Sciences |
spelling | doaj.art-c402e911f0ce480fa02495e7a78c670a2023-11-20T08:52:44ZengMDPI AGApplied Sciences2076-34172020-08-011015534410.3390/app10155344Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld ToolsMehmet Murat Aygün0Yusuf Çağrı Öğüt1Hulusi Baysal2Yiğit Taşcıoğlu3Department of Mechanical Engineering, TOBB University of Economics and Technology—Sogutozu No. 43 Cankaya, 06560 Ankara, TurkeyHAVELSAN, Inc., Cankaya, 06510 Ankara, TurkeyHAVELSAN, Inc., Cankaya, 06510 Ankara, TurkeyDepartment of Mechanical Engineering, TED University—Ziya Gokalp No. 48 Cankaya, 06420 Ankara, TurkeyVisuo-haptic mixed reality (VHMR) adds virtual objects to a real scene and enables users to see and also touch them via a see-through display and a haptic device. Most studies with kinesthetic feedback use general-purpose haptic devices, which require the user to continuously hold an attached stylus. This approach constrains users to the mechanical limits of the device even when it is not needed. In this paper, we propose a novel VHMR concept with an encountered-type haptic display (ETHD), which consists of a precision hexapod positioner and a six-axis force/torque transducer. The main contribution is that the users work with unbound real-life tools with tracking markers. ETHD’s end-effector remains inside the virtual object and follows the tooltip to engage only during an interaction. We have developed a simulation setup and experimentally evaluated the relative accuracy and synchronization of the three major processes, namely tool tracking, haptic rendering, and visual rendering. The experiments successfully build-up to a simple simulation scenario where a tennis ball with a fixed center is deformed by the user.https://www.mdpi.com/2076-3417/10/15/5344visuo-hapticmixed realityencountered-type haptic displayhaptic interfaces |
spellingShingle | Mehmet Murat Aygün Yusuf Çağrı Öğüt Hulusi Baysal Yiğit Taşcıoğlu Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools Applied Sciences visuo-haptic mixed reality encountered-type haptic display haptic interfaces |
title | Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools |
title_full | Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools |
title_fullStr | Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools |
title_full_unstemmed | Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools |
title_short | Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools |
title_sort | visuo haptic mixed reality simulation using unbound handheld tools |
topic | visuo-haptic mixed reality encountered-type haptic display haptic interfaces |
url | https://www.mdpi.com/2076-3417/10/15/5344 |
work_keys_str_mv | AT mehmetmurataygun visuohapticmixedrealitysimulationusingunboundhandheldtools AT yusufcagrıogut visuohapticmixedrealitysimulationusingunboundhandheldtools AT hulusibaysal visuohapticmixedrealitysimulationusingunboundhandheldtools AT yigittascıoglu visuohapticmixedrealitysimulationusingunboundhandheldtools |