Hand Gesture Recognition With Acoustic Myography and Wavelet Scattering Transform
In the past decade, improving upper limb prostheses control methods with pattern recognition (PR) has been the focus of an extended amount of research. However, several challenges associated with the processing of the Electromyogram (EMG) signals still need to be tackled to enable widespread and cli...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9911623/ |
| _version_ | 1798020376639307776 |
|---|---|
| author | Ali H. Al-Timemy Youssef Serrestou Rami N. Khushaba Slim Yacoub Kosai Raoof |
| author_facet | Ali H. Al-Timemy Youssef Serrestou Rami N. Khushaba Slim Yacoub Kosai Raoof |
| author_sort | Ali H. Al-Timemy |
| collection | DOAJ |
| description | In the past decade, improving upper limb prostheses control methods with pattern recognition (PR) has been the focus of an extended amount of research. However, several challenges associated with the processing of the Electromyogram (EMG) signals still need to be tackled to enable widespread and clinical implementation of upper limb prostheses with PR. As a result, alternative modalities functioning as promising control signals have been proposed as source of control input rather than the surface EMG, such as Acoustic myography (AMG) and Force myography. In this paper, eight high sensitivity array microphones were utilized to acquire the AMG signals, with 8 custom-built 3D printed microphone housing developed for the purpose of this research. Twenty subjects were recruited for data collection in this paper with the hardware design developed specifically by our research team, making our database the largest open-access dataset in the AMG literature. We proposed a novel feature extraction (FE) method based on the Wavelet Scattering Transform (WST) to tackle the challenge of extracting the relevant information from AMG to classify 14 hand and finger movement classes. The WST is a translation-invariant non-linear signal representation that has a strong theoretical support as it maintains stability to time-warping deformations, while preserving a high degree of discriminability. The performance results showed that WST outperformed all state-of-the-art FE methods with an accuracy of 88% on average across 20 subjects when classified with Quadratic Discriminant Analysis (QDA) classifier for a large dataset of AMG signals. These results suggest that the AMG signals can be utilized as a reliable source of control, especially when the windows sizes and number of channels are carefully selected. The AMG dataset is available from the link <uri>https://drive.google.com/drive/folders/1r0rBnrNG5c8qegffKUhAYYHQUT8cGVHD?usp=sharing</uri>. |
| first_indexed | 2024-04-11T16:55:10Z |
| format | Article |
| id | doaj.art-35c83eb053c34d4e8169107527184349 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-11T16:55:10Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-35c83eb053c34d4e81691075271843492022-12-22T04:13:16ZengIEEEIEEE Access2169-35362022-01-011010752610753510.1109/ACCESS.2022.32121469911623Hand Gesture Recognition With Acoustic Myography and Wavelet Scattering TransformAli H. Al-Timemy0https://orcid.org/0000-0003-2738-8896Youssef Serrestou1https://orcid.org/0000-0002-9748-4560Rami N. Khushaba2https://orcid.org/0000-0001-8528-8979Slim Yacoub3Kosai Raoof4Biomedical Engineering Department, Al-Khwarizmi College of Engineering, University of Baghdad, Baghdad, IraqLAUM, Le Mans University, Le Mans, FranceAustralian Center for Field Robotics, The University of Sydney, Sydney, NSW, AustraliaINSAT-Carthage University, Tunis, LTSIRS, TunisiaINSAT-Carthage University, Tunis, LTSIRS, TunisiaIn the past decade, improving upper limb prostheses control methods with pattern recognition (PR) has been the focus of an extended amount of research. However, several challenges associated with the processing of the Electromyogram (EMG) signals still need to be tackled to enable widespread and clinical implementation of upper limb prostheses with PR. As a result, alternative modalities functioning as promising control signals have been proposed as source of control input rather than the surface EMG, such as Acoustic myography (AMG) and Force myography. In this paper, eight high sensitivity array microphones were utilized to acquire the AMG signals, with 8 custom-built 3D printed microphone housing developed for the purpose of this research. Twenty subjects were recruited for data collection in this paper with the hardware design developed specifically by our research team, making our database the largest open-access dataset in the AMG literature. We proposed a novel feature extraction (FE) method based on the Wavelet Scattering Transform (WST) to tackle the challenge of extracting the relevant information from AMG to classify 14 hand and finger movement classes. The WST is a translation-invariant non-linear signal representation that has a strong theoretical support as it maintains stability to time-warping deformations, while preserving a high degree of discriminability. The performance results showed that WST outperformed all state-of-the-art FE methods with an accuracy of 88% on average across 20 subjects when classified with Quadratic Discriminant Analysis (QDA) classifier for a large dataset of AMG signals. These results suggest that the AMG signals can be utilized as a reliable source of control, especially when the windows sizes and number of channels are carefully selected. The AMG dataset is available from the link <uri>https://drive.google.com/drive/folders/1r0rBnrNG5c8qegffKUhAYYHQUT8cGVHD?usp=sharing</uri>.https://ieeexplore.ieee.org/document/9911623/Acoustic myographypattern recognitionwavelet scatteringhand gesture recognitionupper limb prostheses |
| spellingShingle | Ali H. Al-Timemy Youssef Serrestou Rami N. Khushaba Slim Yacoub Kosai Raoof Hand Gesture Recognition With Acoustic Myography and Wavelet Scattering Transform IEEE Access Acoustic myography pattern recognition wavelet scattering hand gesture recognition upper limb prostheses |
| title | Hand Gesture Recognition With Acoustic Myography and Wavelet Scattering Transform |
| title_full | Hand Gesture Recognition With Acoustic Myography and Wavelet Scattering Transform |
| title_fullStr | Hand Gesture Recognition With Acoustic Myography and Wavelet Scattering Transform |
| title_full_unstemmed | Hand Gesture Recognition With Acoustic Myography and Wavelet Scattering Transform |
| title_short | Hand Gesture Recognition With Acoustic Myography and Wavelet Scattering Transform |
| title_sort | hand gesture recognition with acoustic myography and wavelet scattering transform |
| topic | Acoustic myography pattern recognition wavelet scattering hand gesture recognition upper limb prostheses |
| url | https://ieeexplore.ieee.org/document/9911623/ |
| work_keys_str_mv | AT alihaltimemy handgesturerecognitionwithacousticmyographyandwaveletscatteringtransform AT youssefserrestou handgesturerecognitionwithacousticmyographyandwaveletscatteringtransform AT raminkhushaba handgesturerecognitionwithacousticmyographyandwaveletscatteringtransform AT slimyacoub handgesturerecognitionwithacousticmyographyandwaveletscatteringtransform AT kosairaoof handgesturerecognitionwithacousticmyographyandwaveletscatteringtransform |