Radar-based human gesture recognition
Radar technology is becoming popular in modern industrial settings due to its ability to create intelligent systems that enhance productivity and ensure safety. It's particularly promising in human gesture recognition, which allows radar sensors to detect human worker movements and interpret th...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2023
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/166731 |
| _version_ | 1826114151131381760 |
|---|---|
| author | Li, Zhuoxin |
| author2 | Wen Bihan |
| author_facet | Wen Bihan Li, Zhuoxin |
| author_sort | Li, Zhuoxin |
| collection | NTU |
| description | Radar technology is becoming popular in modern industrial settings due to its ability to create intelligent systems that enhance productivity and ensure safety. It's particularly promising in human gesture recognition, which allows radar sensors to detect human worker movements and interpret them with deep learning technics for more efficient and accurate robotic arm performance. In this project, we developed a radar-based human gesture recognition system for robotic arms in a factory. We first collected raw radar data from three volunteers using TI’s AW1642 FMCW radar. Then we designed a data processing pipeline, which converted the radar raw data into Micro-Doppler feature maps. A hand gesture classification dataset was built with more than 4000 data. Finally, a convolutional neural network (CNN) model was proposed to perform classification on the dataset which reached an average accuracy of 92.79% on 7 hand gesture classes. To improve the performance on unseen people, we modified the current model and proposed an end-to-end complex-valued CNN model, which accepts our complex radar data as inputs. The proposed complex network increased the classification accuracy up to 2% to 4% when testing on different scenarios. |
| first_indexed | 2024-10-01T03:34:48Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/166731 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T03:34:48Z |
| publishDate | 2023 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1667312023-07-07T16:16:22Z Radar-based human gesture recognition Li, Zhuoxin Wen Bihan School of Electrical and Electronic Engineering bihan.wen@ntu.edu.sg Engineering::Electrical and electronic engineering Radar technology is becoming popular in modern industrial settings due to its ability to create intelligent systems that enhance productivity and ensure safety. It's particularly promising in human gesture recognition, which allows radar sensors to detect human worker movements and interpret them with deep learning technics for more efficient and accurate robotic arm performance. In this project, we developed a radar-based human gesture recognition system for robotic arms in a factory. We first collected raw radar data from three volunteers using TI’s AW1642 FMCW radar. Then we designed a data processing pipeline, which converted the radar raw data into Micro-Doppler feature maps. A hand gesture classification dataset was built with more than 4000 data. Finally, a convolutional neural network (CNN) model was proposed to perform classification on the dataset which reached an average accuracy of 92.79% on 7 hand gesture classes. To improve the performance on unseen people, we modified the current model and proposed an end-to-end complex-valued CNN model, which accepts our complex radar data as inputs. The proposed complex network increased the classification accuracy up to 2% to 4% when testing on different scenarios. Bachelor of Engineering (Electrical and Electronic Engineering) 2023-05-10T05:50:06Z 2023-05-10T05:50:06Z 2023 Final Year Project (FYP) Li, Z. (2023). Radar-based human gesture recognition. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/166731 https://hdl.handle.net/10356/166731 en A3272-221 application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Electrical and electronic engineering Li, Zhuoxin Radar-based human gesture recognition |
| title | Radar-based human gesture recognition |
| title_full | Radar-based human gesture recognition |
| title_fullStr | Radar-based human gesture recognition |
| title_full_unstemmed | Radar-based human gesture recognition |
| title_short | Radar-based human gesture recognition |
| title_sort | radar based human gesture recognition |
| topic | Engineering::Electrical and electronic engineering |
| url | https://hdl.handle.net/10356/166731 |
| work_keys_str_mv | AT lizhuoxin radarbasedhumangesturerecognition |