The Impact of Load Style Variation on Gait Recognition Based on sEMG Images Using a Convolutional Neural Network
Surface electromyogram (sEMG) signals are widely employed as a neural control source for lower-limb exoskeletons, in which gait recognition based on sEMG is particularly important. Many scholars have taken measures to improve the accuracy of gait recognition, but several real-time limitations affect...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-12-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/21/24/8365 |
| _version_ | 1827669696521961472 |
|---|---|
| author | Xianfu Zhang Yuping Hu Ruimin Luo Chao Li Zhichuan Tang |
| author_facet | Xianfu Zhang Yuping Hu Ruimin Luo Chao Li Zhichuan Tang |
| author_sort | Xianfu Zhang |
| collection | DOAJ |
| description | Surface electromyogram (sEMG) signals are widely employed as a neural control source for lower-limb exoskeletons, in which gait recognition based on sEMG is particularly important. Many scholars have taken measures to improve the accuracy of gait recognition, but several real-time limitations affect its applicability, of which variation in the load styles is obvious. The purposes of this study are to (1) investigate the impact of different load styles on gait recognition; (2) study whether good gait recognition performance can be obtained when a convolutional neural network (CNN) is used to deal with the sEMG image from sparse multichannel sEMG (SMC-sEMG); and (3) explore whether the control system of the lower-limb exoskeleton trained by sEMG from part of the load styles still works efficiently in a real-time environment where multiload styles are required. In addition, we discuss an effective method to improve gait recognition at the levels of the load styles. In our experiment, fifteen able-bodied male graduate students with load (20% of body weight) and using three load styles (SBP = backpack, SCS = cross shoulder, SSS = straight shoulder) were asked to walk uniformly on a treadmill. Each subject performed 50 continuous gait cycles under three speeds (V3 = 3 km/h, V5 = 5 km/h, and V7 = 7 km/h). A CNN was employed to deal with sEMG images from sEMG signals for gait recognition, and back propagation neural networks (BPNNs) and support vector machines (SVMs) were used for comparison by dealing with the same sEMG signal. The results indicated that (1) different load styles had remarkable impact on the gait recognition at three speeds under three load styles (<i>p</i> < 0.001); (2) the performance of gait recognition from the CNN was better than that from the SVM and BPNN at each speed (84.83%, 81.63%, and 83.76% at V3; 93.40%, 88.48%, and 92.36% at V5; and 90.1%, 86.32%, and 85.42% at V7, respectively); and (3) when all the data from three load styles were pooled as testing sets at each speed, more load styles were included in the training set, better performance was obtained, and the statistical analysis suggested that the kinds of load styles included in training set had a significant effect on gait recognition (<i>p</i> = 0.002), from which it can be concluded that the control system of a lower-limb exoskeleton trained by sEMG using only some load styles is not sufficient in a real-time environment. |
| first_indexed | 2024-03-10T03:08:45Z |
| format | Article |
| id | doaj.art-76ee0ad5ef7a4c40bc6f8d5761b93fd3 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-10T03:08:45Z |
| publishDate | 2021-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-76ee0ad5ef7a4c40bc6f8d5761b93fd32023-11-23T10:30:26ZengMDPI AGSensors1424-82202021-12-012124836510.3390/s21248365The Impact of Load Style Variation on Gait Recognition Based on sEMG Images Using a Convolutional Neural NetworkXianfu Zhang0Yuping Hu1Ruimin Luo2Chao Li3Zhichuan Tang4Schlool of Jewelry and Art Design, Wuzhou University, Wuzhou 543002, ChinaSchlool of Jewelry and Art Design, Wuzhou University, Wuzhou 543002, ChinaCollege of Computer Science and Technology, Zhejiang University, Hangzhou 310027, ChinaCollege of Computer Science and Technology, Zhejiang University, Hangzhou 310027, ChinaIndustrial Design Institute, Zhejiang University of Technology, Hangzhou 310023, ChinaSurface electromyogram (sEMG) signals are widely employed as a neural control source for lower-limb exoskeletons, in which gait recognition based on sEMG is particularly important. Many scholars have taken measures to improve the accuracy of gait recognition, but several real-time limitations affect its applicability, of which variation in the load styles is obvious. The purposes of this study are to (1) investigate the impact of different load styles on gait recognition; (2) study whether good gait recognition performance can be obtained when a convolutional neural network (CNN) is used to deal with the sEMG image from sparse multichannel sEMG (SMC-sEMG); and (3) explore whether the control system of the lower-limb exoskeleton trained by sEMG from part of the load styles still works efficiently in a real-time environment where multiload styles are required. In addition, we discuss an effective method to improve gait recognition at the levels of the load styles. In our experiment, fifteen able-bodied male graduate students with load (20% of body weight) and using three load styles (SBP = backpack, SCS = cross shoulder, SSS = straight shoulder) were asked to walk uniformly on a treadmill. Each subject performed 50 continuous gait cycles under three speeds (V3 = 3 km/h, V5 = 5 km/h, and V7 = 7 km/h). A CNN was employed to deal with sEMG images from sEMG signals for gait recognition, and back propagation neural networks (BPNNs) and support vector machines (SVMs) were used for comparison by dealing with the same sEMG signal. The results indicated that (1) different load styles had remarkable impact on the gait recognition at three speeds under three load styles (<i>p</i> < 0.001); (2) the performance of gait recognition from the CNN was better than that from the SVM and BPNN at each speed (84.83%, 81.63%, and 83.76% at V3; 93.40%, 88.48%, and 92.36% at V5; and 90.1%, 86.32%, and 85.42% at V7, respectively); and (3) when all the data from three load styles were pooled as testing sets at each speed, more load styles were included in the training set, better performance was obtained, and the statistical analysis suggested that the kinds of load styles included in training set had a significant effect on gait recognition (<i>p</i> = 0.002), from which it can be concluded that the control system of a lower-limb exoskeleton trained by sEMG using only some load styles is not sufficient in a real-time environment.https://www.mdpi.com/1424-8220/21/24/8365sEMG imageload stylegait recognition |
| spellingShingle | Xianfu Zhang Yuping Hu Ruimin Luo Chao Li Zhichuan Tang The Impact of Load Style Variation on Gait Recognition Based on sEMG Images Using a Convolutional Neural Network Sensors sEMG image load style gait recognition |
| title | The Impact of Load Style Variation on Gait Recognition Based on sEMG Images Using a Convolutional Neural Network |
| title_full | The Impact of Load Style Variation on Gait Recognition Based on sEMG Images Using a Convolutional Neural Network |
| title_fullStr | The Impact of Load Style Variation on Gait Recognition Based on sEMG Images Using a Convolutional Neural Network |
| title_full_unstemmed | The Impact of Load Style Variation on Gait Recognition Based on sEMG Images Using a Convolutional Neural Network |
| title_short | The Impact of Load Style Variation on Gait Recognition Based on sEMG Images Using a Convolutional Neural Network |
| title_sort | impact of load style variation on gait recognition based on semg images using a convolutional neural network |
| topic | sEMG image load style gait recognition |
| url | https://www.mdpi.com/1424-8220/21/24/8365 |
| work_keys_str_mv | AT xianfuzhang theimpactofloadstylevariationongaitrecognitionbasedonsemgimagesusingaconvolutionalneuralnetwork AT yupinghu theimpactofloadstylevariationongaitrecognitionbasedonsemgimagesusingaconvolutionalneuralnetwork AT ruiminluo theimpactofloadstylevariationongaitrecognitionbasedonsemgimagesusingaconvolutionalneuralnetwork AT chaoli theimpactofloadstylevariationongaitrecognitionbasedonsemgimagesusingaconvolutionalneuralnetwork AT zhichuantang theimpactofloadstylevariationongaitrecognitionbasedonsemgimagesusingaconvolutionalneuralnetwork AT xianfuzhang impactofloadstylevariationongaitrecognitionbasedonsemgimagesusingaconvolutionalneuralnetwork AT yupinghu impactofloadstylevariationongaitrecognitionbasedonsemgimagesusingaconvolutionalneuralnetwork AT ruiminluo impactofloadstylevariationongaitrecognitionbasedonsemgimagesusingaconvolutionalneuralnetwork AT chaoli impactofloadstylevariationongaitrecognitionbasedonsemgimagesusingaconvolutionalneuralnetwork AT zhichuantang impactofloadstylevariationongaitrecognitionbasedonsemgimagesusingaconvolutionalneuralnetwork |