Wearable Drone Controller: Machine Learning-Based Hand Gesture Recognition and Vibrotactile Feedback
We proposed a wearable drone controller with hand gesture recognition and vibrotactile feedback. The intended hand motions of the user are sensed by an inertial measurement unit (IMU) placed on the back of the hand, and the signals are analyzed and classified using machine learning models. The recog...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-02-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/23/5/2666 |
| _version_ | 1797614291712475136 |
|---|---|
| author | Ji-Won Lee Kee-Ho Yu |
| author_facet | Ji-Won Lee Kee-Ho Yu |
| author_sort | Ji-Won Lee |
| collection | DOAJ |
| description | We proposed a wearable drone controller with hand gesture recognition and vibrotactile feedback. The intended hand motions of the user are sensed by an inertial measurement unit (IMU) placed on the back of the hand, and the signals are analyzed and classified using machine learning models. The recognized hand gestures control the drone, and the obstacle information in the heading direction of the drone is fed back to the user by activating the vibration motor attached to the wrist. Simulation experiments for drone operation were performed, and the participants’ subjective evaluations regarding the controller’s convenience and effectiveness were investigated. Finally, experiments with a real drone were conducted and discussed to validate the proposed controller. |
| first_indexed | 2024-03-11T07:10:26Z |
| format | Article |
| id | doaj.art-6bb56c645bc64aa4bbd75af06a169588 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-11T07:10:26Z |
| publishDate | 2023-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-6bb56c645bc64aa4bbd75af06a1695882023-11-17T08:38:00ZengMDPI AGSensors1424-82202023-02-01235266610.3390/s23052666Wearable Drone Controller: Machine Learning-Based Hand Gesture Recognition and Vibrotactile FeedbackJi-Won Lee0Kee-Ho Yu1KEPCO Research Institute, Daejeon 34056, Republic of KoreaDepartment of Aerospace Engineering, Jeonbuk National University, Jeonju 54896, Republic of KoreaWe proposed a wearable drone controller with hand gesture recognition and vibrotactile feedback. The intended hand motions of the user are sensed by an inertial measurement unit (IMU) placed on the back of the hand, and the signals are analyzed and classified using machine learning models. The recognized hand gestures control the drone, and the obstacle information in the heading direction of the drone is fed back to the user by activating the vibration motor attached to the wrist. Simulation experiments for drone operation were performed, and the participants’ subjective evaluations regarding the controller’s convenience and effectiveness were investigated. Finally, experiments with a real drone were conducted and discussed to validate the proposed controller.https://www.mdpi.com/1424-8220/23/5/2666human–drone interfacewearable devicehand gesture recognitionmachine learningvibrotactile feedback |
| spellingShingle | Ji-Won Lee Kee-Ho Yu Wearable Drone Controller: Machine Learning-Based Hand Gesture Recognition and Vibrotactile Feedback Sensors human–drone interface wearable device hand gesture recognition machine learning vibrotactile feedback |
| title | Wearable Drone Controller: Machine Learning-Based Hand Gesture Recognition and Vibrotactile Feedback |
| title_full | Wearable Drone Controller: Machine Learning-Based Hand Gesture Recognition and Vibrotactile Feedback |
| title_fullStr | Wearable Drone Controller: Machine Learning-Based Hand Gesture Recognition and Vibrotactile Feedback |
| title_full_unstemmed | Wearable Drone Controller: Machine Learning-Based Hand Gesture Recognition and Vibrotactile Feedback |
| title_short | Wearable Drone Controller: Machine Learning-Based Hand Gesture Recognition and Vibrotactile Feedback |
| title_sort | wearable drone controller machine learning based hand gesture recognition and vibrotactile feedback |
| topic | human–drone interface wearable device hand gesture recognition machine learning vibrotactile feedback |
| url | https://www.mdpi.com/1424-8220/23/5/2666 |
| work_keys_str_mv | AT jiwonlee wearabledronecontrollermachinelearningbasedhandgesturerecognitionandvibrotactilefeedback AT keehoyu wearabledronecontrollermachinelearningbasedhandgesturerecognitionandvibrotactilefeedback |