Human Anomalous Gait Termination Recognition via Through-the-wall Radar Based on Micro-Doppler Corner Features and Non-Local Mechanism

Through-the-wall radar can penetrate walls and realize indoor human target detection. Deep learning is commonly used to extract the micro-Doppler signature of a target, which can be used to effectively identify human activities behind obstacles. However, the test accuracy of the deep-learning-based...

Full description

Bibliographic Details
Main Authors: Xiaopeng YANG, Weicheng GAO, Xiaodong QU
Format: Article
Language:English
Published: China Science Publishing & Media Ltd. (CSPM) 2024-02-01
Series:Leida xuebao
Subjects:
Online Access:https://radars.ac.cn/cn/article/doi/10.12000/JR23181
_version_ 1797354379083251712
author Xiaopeng YANG
Weicheng GAO
Xiaodong QU
author_facet Xiaopeng YANG
Weicheng GAO
Xiaodong QU
author_sort Xiaopeng YANG
collection DOAJ
description Through-the-wall radar can penetrate walls and realize indoor human target detection. Deep learning is commonly used to extract the micro-Doppler signature of a target, which can be used to effectively identify human activities behind obstacles. However, the test accuracy of the deep-learning-based recognition methods is low with poor generalization ability when different testers are invited to generate the training set and test set. Therefore, this study proposes a method for recognition of anomalous human gait termination based on micro-Doppler corner features and Non-Local mechanism. In this method, Harris and Moravec detectors are utilized to extract the corner features of the radar image, and the corner feature dataset is established in this manner. Thereafter, multilink parallel convolutions and the Non-Local mechanism are utilized to construct the global contextual information extraction network to learn the global distribution characteristics of the image pixels. The semantic feature maps are generated by repeating four times the global contextual information extraction network. Finally, the probabilities of human activities are predicted using a multilayer perceptron. The numerical simulation and experimental results demonstrate that the proposed method can effectively identify such abnormal gait termination activities as sitting, lying down, and falling, among others, which occur in the process of indoor human walking, and successfully control the generalization accuracy error to be no more than \begin{document}$ 6.4\% $\end{document} under the premise of increasing the recognition accuracy and robustness.
first_indexed 2024-03-08T13:48:38Z
format Article
id doaj.art-be1fcb9090b94e9c9c085dc6279a6ee6
institution Directory Open Access Journal
issn 2095-283X
language English
last_indexed 2024-03-08T13:48:38Z
publishDate 2024-02-01
publisher China Science Publishing & Media Ltd. (CSPM)
record_format Article
series Leida xuebao
spelling doaj.art-be1fcb9090b94e9c9c085dc6279a6ee62024-01-16T07:27:39ZengChina Science Publishing & Media Ltd. (CSPM)Leida xuebao2095-283X2024-02-01131688610.12000/JR23181R23181Human Anomalous Gait Termination Recognition via Through-the-wall Radar Based on Micro-Doppler Corner Features and Non-Local MechanismXiaopeng YANG0Weicheng GAO1Xiaodong QU2School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, ChinaSchool of Information and Electronics, Beijing Institute of Technology, Beijing 100081, ChinaSchool of Information and Electronics, Beijing Institute of Technology, Beijing 100081, ChinaThrough-the-wall radar can penetrate walls and realize indoor human target detection. Deep learning is commonly used to extract the micro-Doppler signature of a target, which can be used to effectively identify human activities behind obstacles. However, the test accuracy of the deep-learning-based recognition methods is low with poor generalization ability when different testers are invited to generate the training set and test set. Therefore, this study proposes a method for recognition of anomalous human gait termination based on micro-Doppler corner features and Non-Local mechanism. In this method, Harris and Moravec detectors are utilized to extract the corner features of the radar image, and the corner feature dataset is established in this manner. Thereafter, multilink parallel convolutions and the Non-Local mechanism are utilized to construct the global contextual information extraction network to learn the global distribution characteristics of the image pixels. The semantic feature maps are generated by repeating four times the global contextual information extraction network. Finally, the probabilities of human activities are predicted using a multilayer perceptron. The numerical simulation and experimental results demonstrate that the proposed method can effectively identify such abnormal gait termination activities as sitting, lying down, and falling, among others, which occur in the process of indoor human walking, and successfully control the generalization accuracy error to be no more than \begin{document}$ 6.4\% $\end{document} under the premise of increasing the recognition accuracy and robustness.https://radars.ac.cn/cn/article/doi/10.12000/JR23181through-the-wall radarhuman activity recognitionmicro-doppler signaturecorner featureneural networks
spellingShingle Xiaopeng YANG
Weicheng GAO
Xiaodong QU
Human Anomalous Gait Termination Recognition via Through-the-wall Radar Based on Micro-Doppler Corner Features and Non-Local Mechanism
Leida xuebao
through-the-wall radar
human activity recognition
micro-doppler signature
corner feature
neural networks
title Human Anomalous Gait Termination Recognition via Through-the-wall Radar Based on Micro-Doppler Corner Features and Non-Local Mechanism
title_full Human Anomalous Gait Termination Recognition via Through-the-wall Radar Based on Micro-Doppler Corner Features and Non-Local Mechanism
title_fullStr Human Anomalous Gait Termination Recognition via Through-the-wall Radar Based on Micro-Doppler Corner Features and Non-Local Mechanism
title_full_unstemmed Human Anomalous Gait Termination Recognition via Through-the-wall Radar Based on Micro-Doppler Corner Features and Non-Local Mechanism
title_short Human Anomalous Gait Termination Recognition via Through-the-wall Radar Based on Micro-Doppler Corner Features and Non-Local Mechanism
title_sort human anomalous gait termination recognition via through the wall radar based on micro doppler corner features and non local mechanism
topic through-the-wall radar
human activity recognition
micro-doppler signature
corner feature
neural networks
url https://radars.ac.cn/cn/article/doi/10.12000/JR23181
work_keys_str_mv AT xiaopengyang humananomalousgaitterminationrecognitionviathroughthewallradarbasedonmicrodopplercornerfeaturesandnonlocalmechanism
AT weichenggao humananomalousgaitterminationrecognitionviathroughthewallradarbasedonmicrodopplercornerfeaturesandnonlocalmechanism
AT xiaodongqu humananomalousgaitterminationrecognitionviathroughthewallradarbasedonmicrodopplercornerfeaturesandnonlocalmechanism