Intelligent 3D garment system of the human body based on deep spiking neural network
Background: Intelligent garments, a burgeoning class of wearable devices, have extensive applications in domains such as sports training and medical rehabilitation. Nonetheless, existing research in the smart wearables domain predominantly emphasizes sensor functionality and quantity, often skipping...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
KeAi Communications Co., Ltd.
2024-02-01
|
| Series: | Virtual Reality & Intelligent Hardware |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S209657962300044X |
| _version_ | 1797292954746880000 |
|---|---|
| author | Minghua Jiang Zhangyuan Tian Chenyu Yu Yankang Shi Li Liu Tao Peng Xinrong Hu Feng Yu |
| author_facet | Minghua Jiang Zhangyuan Tian Chenyu Yu Yankang Shi Li Liu Tao Peng Xinrong Hu Feng Yu |
| author_sort | Minghua Jiang |
| collection | DOAJ |
| description | Background: Intelligent garments, a burgeoning class of wearable devices, have extensive applications in domains such as sports training and medical rehabilitation. Nonetheless, existing research in the smart wearables domain predominantly emphasizes sensor functionality and quantity, often skipping crucial aspects related to user experience and interaction. Methods: To address this gap, this study introduces a novel real-time 3D interactive system based on intelligent garments. The system utilizes lightweight sensor modules to collect human motion data and introduces a dual-stream fusion network based on pulsed neural units to classify and recognize human movements, thereby achieving real-time interaction between users and sensors. Additionally, the system in- corporates 3D human visualization functionality, which visualizes sensor data and recognizes human actions as 3D models in realtime, providing accurate and comprehensive visual feedback to help users better understand and analyze the details and features of human motion. This system has significant potential for applications in motion detection, medical monitoring, virtual reality, and other fields. The accurate classification of human actions con- tributes to the development of personalized training plans and injury prevention strategies. Conclusions: This study has substantial implications in the domains of intelligent garments, human motion monitoring, and digital twin visualization. The advancement of this system is expected to propel the progress of wearable technology and foster a deeper comprehension of human motion. |
| first_indexed | 2024-03-07T20:04:55Z |
| format | Article |
| id | doaj.art-4654e906b8904aaaa0d4acb995b6b94b |
| institution | Directory Open Access Journal |
| issn | 2096-5796 |
| language | English |
| last_indexed | 2024-03-07T20:04:55Z |
| publishDate | 2024-02-01 |
| publisher | KeAi Communications Co., Ltd. |
| record_format | Article |
| series | Virtual Reality & Intelligent Hardware |
| spelling | doaj.art-4654e906b8904aaaa0d4acb995b6b94b2024-02-28T05:13:14ZengKeAi Communications Co., Ltd.Virtual Reality & Intelligent Hardware2096-57962024-02-01614355Intelligent 3D garment system of the human body based on deep spiking neural networkMinghua Jiang0Zhangyuan Tian1Chenyu Yu2Yankang Shi3Li Liu4Tao Peng5Xinrong Hu6Feng Yu7School of Computer and Artificial Intelligence, Wuhan Textile University, Wuhan 430200, China;; Engineering Research Center of Hubei Province for Clothing Information, Wuhan 430200,ChinaSchool of Computer and Artificial Intelligence, Wuhan Textile University, Wuhan 430200, China;School of Computer and Artificial Intelligence, Wuhan Textile University, Wuhan 430200, China;School of Computer and Artificial Intelligence, Wuhan Textile University, Wuhan 430200, China;School of Computer and Artificial Intelligence, Wuhan Textile University, Wuhan 430200, China;; Engineering Research Center of Hubei Province for Clothing Information, Wuhan 430200,ChinaSchool of Computer and Artificial Intelligence, Wuhan Textile University, Wuhan 430200, China;School of Computer and Artificial Intelligence, Wuhan Textile University, Wuhan 430200, China;School of Computer and Artificial Intelligence, Wuhan Textile University, Wuhan 430200, China;; Engineering Research Center of Hubei Province for Clothing Information, Wuhan 430200,China; Corresponding author.Background: Intelligent garments, a burgeoning class of wearable devices, have extensive applications in domains such as sports training and medical rehabilitation. Nonetheless, existing research in the smart wearables domain predominantly emphasizes sensor functionality and quantity, often skipping crucial aspects related to user experience and interaction. Methods: To address this gap, this study introduces a novel real-time 3D interactive system based on intelligent garments. The system utilizes lightweight sensor modules to collect human motion data and introduces a dual-stream fusion network based on pulsed neural units to classify and recognize human movements, thereby achieving real-time interaction between users and sensors. Additionally, the system in- corporates 3D human visualization functionality, which visualizes sensor data and recognizes human actions as 3D models in realtime, providing accurate and comprehensive visual feedback to help users better understand and analyze the details and features of human motion. This system has significant potential for applications in motion detection, medical monitoring, virtual reality, and other fields. The accurate classification of human actions con- tributes to the development of personalized training plans and injury prevention strategies. Conclusions: This study has substantial implications in the domains of intelligent garments, human motion monitoring, and digital twin visualization. The advancement of this system is expected to propel the progress of wearable technology and foster a deeper comprehension of human motion.http://www.sciencedirect.com/science/article/pii/S209657962300044XIntelligent garment systemInternet of thingsHuman action recognitionDeep learning3D visualization |
| spellingShingle | Minghua Jiang Zhangyuan Tian Chenyu Yu Yankang Shi Li Liu Tao Peng Xinrong Hu Feng Yu Intelligent 3D garment system of the human body based on deep spiking neural network Virtual Reality & Intelligent Hardware Intelligent garment system Internet of things Human action recognition Deep learning 3D visualization |
| title | Intelligent 3D garment system of the human body based on deep spiking neural network |
| title_full | Intelligent 3D garment system of the human body based on deep spiking neural network |
| title_fullStr | Intelligent 3D garment system of the human body based on deep spiking neural network |
| title_full_unstemmed | Intelligent 3D garment system of the human body based on deep spiking neural network |
| title_short | Intelligent 3D garment system of the human body based on deep spiking neural network |
| title_sort | intelligent 3d garment system of the human body based on deep spiking neural network |
| topic | Intelligent garment system Internet of things Human action recognition Deep learning 3D visualization |
| url | http://www.sciencedirect.com/science/article/pii/S209657962300044X |
| work_keys_str_mv | AT minghuajiang intelligent3dgarmentsystemofthehumanbodybasedondeepspikingneuralnetwork AT zhangyuantian intelligent3dgarmentsystemofthehumanbodybasedondeepspikingneuralnetwork AT chenyuyu intelligent3dgarmentsystemofthehumanbodybasedondeepspikingneuralnetwork AT yankangshi intelligent3dgarmentsystemofthehumanbodybasedondeepspikingneuralnetwork AT liliu intelligent3dgarmentsystemofthehumanbodybasedondeepspikingneuralnetwork AT taopeng intelligent3dgarmentsystemofthehumanbodybasedondeepspikingneuralnetwork AT xinronghu intelligent3dgarmentsystemofthehumanbodybasedondeepspikingneuralnetwork AT fengyu intelligent3dgarmentsystemofthehumanbodybasedondeepspikingneuralnetwork |