MM-Wave Radar-Based Recognition of Multiple Hand Gestures Using Long Short-Term Memory (LSTM) Neural Network
The paper proposes a simple machine learning solution for hand-gesture classification, based on processed MM-wave radar signal. It investigates the classification up to 12 different intuitive and ergonomic gestures, which are intended to serve as a contactless user interface. The system is based on...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-03-01
|
| Series: | Electronics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2079-9292/11/5/787 |
| _version_ | 1797475361742651392 |
|---|---|
| author | Piotr Grobelny Adam Narbudowicz |
| author_facet | Piotr Grobelny Adam Narbudowicz |
| author_sort | Piotr Grobelny |
| collection | DOAJ |
| description | The paper proposes a simple machine learning solution for hand-gesture classification, based on processed MM-wave radar signal. It investigates the classification up to 12 different intuitive and ergonomic gestures, which are intended to serve as a contactless user interface. The system is based on AWR1642 boost Frequency-Modulated Continuous-Wave (FMCW) radar, which allows capturing standardized data to support the scalability of the proposed solution. More than 4000 samples were collected from 4 different people, with all signatures extracted from the radar hardware available in open-access database accompanying the publication. Collected data were processed and used to train Long short-term memory (LSTM) and artificial recurrent neural network (RNN) architecture. The work studies the impact of different input parameters, the number of hidden layers, and the number of neurons in those layers. The proposed LSTM network allows for classification of different gestures, with the total accuracy ranging from 94.4% to 100% depending on use-case scenario, with a relatively small architecture of only 2 hidden layers with 32 neurons in each. The solution is also tested with additional data recorded from subjects not involved in the original training set, resulting in an accuracy drop of no more than 2.24%. This demonstrates that the proposed solution is robust and scalable, allowing quick and reliable creation of larger databases of gestures to expand the use of machine learning with radar technologies. |
| first_indexed | 2024-03-09T20:43:04Z |
| format | Article |
| id | doaj.art-bfb2236bcf1f43e4be474ca9a2434f97 |
| institution | Directory Open Access Journal |
| issn | 2079-9292 |
| language | English |
| last_indexed | 2024-03-09T20:43:04Z |
| publishDate | 2022-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Electronics |
| spelling | doaj.art-bfb2236bcf1f43e4be474ca9a2434f972023-11-23T22:53:58ZengMDPI AGElectronics2079-92922022-03-0111578710.3390/electronics11050787MM-Wave Radar-Based Recognition of Multiple Hand Gestures Using Long Short-Term Memory (LSTM) Neural NetworkPiotr Grobelny0Adam Narbudowicz1Department of Telecommunications and Teleinformatics, Wrocław University of Science and Technology, 50-370 Wrocław, PolandDepartment of Telecommunications and Teleinformatics, Wrocław University of Science and Technology, 50-370 Wrocław, PolandThe paper proposes a simple machine learning solution for hand-gesture classification, based on processed MM-wave radar signal. It investigates the classification up to 12 different intuitive and ergonomic gestures, which are intended to serve as a contactless user interface. The system is based on AWR1642 boost Frequency-Modulated Continuous-Wave (FMCW) radar, which allows capturing standardized data to support the scalability of the proposed solution. More than 4000 samples were collected from 4 different people, with all signatures extracted from the radar hardware available in open-access database accompanying the publication. Collected data were processed and used to train Long short-term memory (LSTM) and artificial recurrent neural network (RNN) architecture. The work studies the impact of different input parameters, the number of hidden layers, and the number of neurons in those layers. The proposed LSTM network allows for classification of different gestures, with the total accuracy ranging from 94.4% to 100% depending on use-case scenario, with a relatively small architecture of only 2 hidden layers with 32 neurons in each. The solution is also tested with additional data recorded from subjects not involved in the original training set, resulting in an accuracy drop of no more than 2.24%. This demonstrates that the proposed solution is robust and scalable, allowing quick and reliable creation of larger databases of gestures to expand the use of machine learning with radar technologies.https://www.mdpi.com/2079-9292/11/5/787radarMM-wave radarFMCW radarhand-gesture recognitionmachine learningneural network |
| spellingShingle | Piotr Grobelny Adam Narbudowicz MM-Wave Radar-Based Recognition of Multiple Hand Gestures Using Long Short-Term Memory (LSTM) Neural Network Electronics radar MM-wave radar FMCW radar hand-gesture recognition machine learning neural network |
| title | MM-Wave Radar-Based Recognition of Multiple Hand Gestures Using Long Short-Term Memory (LSTM) Neural Network |
| title_full | MM-Wave Radar-Based Recognition of Multiple Hand Gestures Using Long Short-Term Memory (LSTM) Neural Network |
| title_fullStr | MM-Wave Radar-Based Recognition of Multiple Hand Gestures Using Long Short-Term Memory (LSTM) Neural Network |
| title_full_unstemmed | MM-Wave Radar-Based Recognition of Multiple Hand Gestures Using Long Short-Term Memory (LSTM) Neural Network |
| title_short | MM-Wave Radar-Based Recognition of Multiple Hand Gestures Using Long Short-Term Memory (LSTM) Neural Network |
| title_sort | mm wave radar based recognition of multiple hand gestures using long short term memory lstm neural network |
| topic | radar MM-wave radar FMCW radar hand-gesture recognition machine learning neural network |
| url | https://www.mdpi.com/2079-9292/11/5/787 |
| work_keys_str_mv | AT piotrgrobelny mmwaveradarbasedrecognitionofmultiplehandgesturesusinglongshorttermmemorylstmneuralnetwork AT adamnarbudowicz mmwaveradarbasedrecognitionofmultiplehandgesturesusinglongshorttermmemorylstmneuralnetwork |