Virtual assembling using hand tracking with leap motion controller

The hand tracking device Leap Motion Controller has been applied in many areas since it was released. Most applications are related to gaming and sign language recognition, where high precision is not a necessity. However, in places like surgical training and virtual assembly, the precision could b...

Full description

Bibliographic Details
Main Author: Mu, Siyi
Other Authors: Alexei Sourin
Format: Final Year Project (FYP)
Language:English
Published: Nanyang Technological University 2021
Subjects:
Online Access:https://hdl.handle.net/10356/147966
_version_ 1826122271421366272
author Mu, Siyi
author2 Alexei Sourin
author_facet Alexei Sourin
Mu, Siyi
author_sort Mu, Siyi
collection NTU
description The hand tracking device Leap Motion Controller has been applied in many areas since it was released. Most applications are related to gaming and sign language recognition, where high precision is not a necessity. However, in places like surgical training and virtual assembly, the precision could be fatal. With the aim of higher precision, a new interaction mechanism is designed to manipulate objects, in which collision detection between the virtual hand and objects is not required. Instead, it controls the grasping and releasing with the gestures of one hand and moves the object with the other hand's displacement. This mechanism is implemented in Unity 20.1.2 with Leap Motion SDK 4.1.0 and Leap Motion Unity Module 4.7.1. After several tests, the mechanism is proven to have reasonably high precision. It allows the users to adjust the parameters to create customized systems, leading to an optimal outcome.
first_indexed 2024-10-01T05:45:26Z
format Final Year Project (FYP)
id ntu-10356/147966
institution Nanyang Technological University
language English
last_indexed 2024-10-01T05:45:26Z
publishDate 2021
publisher Nanyang Technological University
record_format dspace
spelling ntu-10356/1479662021-04-21T05:27:51Z Virtual assembling using hand tracking with leap motion controller Mu, Siyi Alexei Sourin School of Computer Science and Engineering assourin@ntu.edu.sg Engineering::Computer science and engineering The hand tracking device Leap Motion Controller has been applied in many areas since it was released. Most applications are related to gaming and sign language recognition, where high precision is not a necessity. However, in places like surgical training and virtual assembly, the precision could be fatal. With the aim of higher precision, a new interaction mechanism is designed to manipulate objects, in which collision detection between the virtual hand and objects is not required. Instead, it controls the grasping and releasing with the gestures of one hand and moves the object with the other hand's displacement. This mechanism is implemented in Unity 20.1.2 with Leap Motion SDK 4.1.0 and Leap Motion Unity Module 4.7.1. After several tests, the mechanism is proven to have reasonably high precision. It allows the users to adjust the parameters to create customized systems, leading to an optimal outcome. Bachelor of Engineering (Computer Science) 2021-04-21T05:27:51Z 2021-04-21T05:27:51Z 2021 Final Year Project (FYP) Mu, S. (2021). Virtual assembling using hand tracking with leap motion controller. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/147966 https://hdl.handle.net/10356/147966 en SCSE20-0002 application/pdf Nanyang Technological University
spellingShingle Engineering::Computer science and engineering
Mu, Siyi
Virtual assembling using hand tracking with leap motion controller
title Virtual assembling using hand tracking with leap motion controller
title_full Virtual assembling using hand tracking with leap motion controller
title_fullStr Virtual assembling using hand tracking with leap motion controller
title_full_unstemmed Virtual assembling using hand tracking with leap motion controller
title_short Virtual assembling using hand tracking with leap motion controller
title_sort virtual assembling using hand tracking with leap motion controller
topic Engineering::Computer science and engineering
url https://hdl.handle.net/10356/147966
work_keys_str_mv AT musiyi virtualassemblingusinghandtrackingwithleapmotioncontroller