Deep learning-based semantic segmentation of human features in bath scrubbing robots

With the rise in the aging population, an increase in the number of semidisabled elderly individuals has been noted, leading to notable challenges in medical and healthcare, exacerbated by a shortage of nursing staff. This study aims to enhance the human feature recognition capabilities of bath scru...

Full description

Bibliographic Details
Main Authors: Chao Zhuang, Tianyi Ma, Bokai Xuan, Cheng Chang, Baichuan An, Minghuan Yin, Hao Sun
Format: Article
Language:English
Published: Elsevier 2024-03-01
Series:Biomimetic Intelligence and Robotics
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2667379724000019
_version_ 1797262808486772736
author Chao Zhuang
Tianyi Ma
Bokai Xuan
Cheng Chang
Baichuan An
Minghuan Yin
Hao Sun
author_facet Chao Zhuang
Tianyi Ma
Bokai Xuan
Cheng Chang
Baichuan An
Minghuan Yin
Hao Sun
author_sort Chao Zhuang
collection DOAJ
description With the rise in the aging population, an increase in the number of semidisabled elderly individuals has been noted, leading to notable challenges in medical and healthcare, exacerbated by a shortage of nursing staff. This study aims to enhance the human feature recognition capabilities of bath scrubbing robots operating in a water fog environment. The investigation focuses on semantic segmentation of human features using deep learning methodologies. Initially, 3D point cloud data of human bodies with varying sizes are gathered through light detection and ranging to establish human models. Subsequently, a hybrid filtering algorithm was employed to address the impact of the water fog environment on the modeling and extraction of human regions. Finally, the network is refined by integrating the spatial feature extraction module and the channel attention module based on PointNet. The results indicate that the algorithm adeptly identifies feature information for 3D human models of diverse body sizes, achieving an overall accuracy of 95.7%. This represents a 4.5% improvement compared with the PointNet network and a 2.5% enhancement over mean intersection over union. In conclusion, this study substantially augments the human feature segmentation capabilities, facilitating effective collaboration with bath scrubbing robots for caregiving tasks, thereby possessing significant engineering application value.
first_indexed 2024-03-08T06:20:39Z
format Article
id doaj.art-b30b74f02141412b8ba6502ccdd73cff
institution Directory Open Access Journal
issn 2667-3797
language English
last_indexed 2024-04-25T00:03:00Z
publishDate 2024-03-01
publisher Elsevier
record_format Article
series Biomimetic Intelligence and Robotics
spelling doaj.art-b30b74f02141412b8ba6502ccdd73cff2024-03-14T06:16:58ZengElsevierBiomimetic Intelligence and Robotics2667-37972024-03-0141100143Deep learning-based semantic segmentation of human features in bath scrubbing robotsChao Zhuang0Tianyi Ma1Bokai Xuan2Cheng Chang3Baichuan An4Minghuan Yin5Hao Sun6School of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin 300401, ChinaSchool of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin 300401, ChinaSchool of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin 300401, China; Engineering Research Center of Intelligent Rehabilitation Device and Detection Technology, Ministry of Education, Tianjin 300401, ChinaSchool of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin 300401, ChinaSchool of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin 300401, ChinaSchool of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin 300401, ChinaSchool of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin 300401, China; Engineering Research Center of Intelligent Rehabilitation Device and Detection Technology, Ministry of Education, Tianjin 300401, China; Corresponding author.With the rise in the aging population, an increase in the number of semidisabled elderly individuals has been noted, leading to notable challenges in medical and healthcare, exacerbated by a shortage of nursing staff. This study aims to enhance the human feature recognition capabilities of bath scrubbing robots operating in a water fog environment. The investigation focuses on semantic segmentation of human features using deep learning methodologies. Initially, 3D point cloud data of human bodies with varying sizes are gathered through light detection and ranging to establish human models. Subsequently, a hybrid filtering algorithm was employed to address the impact of the water fog environment on the modeling and extraction of human regions. Finally, the network is refined by integrating the spatial feature extraction module and the channel attention module based on PointNet. The results indicate that the algorithm adeptly identifies feature information for 3D human models of diverse body sizes, achieving an overall accuracy of 95.7%. This represents a 4.5% improvement compared with the PointNet network and a 2.5% enhancement over mean intersection over union. In conclusion, this study substantially augments the human feature segmentation capabilities, facilitating effective collaboration with bath scrubbing robots for caregiving tasks, thereby possessing significant engineering application value.http://www.sciencedirect.com/science/article/pii/S26673797240000193D point cloudHuman modelLiDARSemantic segmentation
spellingShingle Chao Zhuang
Tianyi Ma
Bokai Xuan
Cheng Chang
Baichuan An
Minghuan Yin
Hao Sun
Deep learning-based semantic segmentation of human features in bath scrubbing robots
Biomimetic Intelligence and Robotics
3D point cloud
Human model
LiDAR
Semantic segmentation
title Deep learning-based semantic segmentation of human features in bath scrubbing robots
title_full Deep learning-based semantic segmentation of human features in bath scrubbing robots
title_fullStr Deep learning-based semantic segmentation of human features in bath scrubbing robots
title_full_unstemmed Deep learning-based semantic segmentation of human features in bath scrubbing robots
title_short Deep learning-based semantic segmentation of human features in bath scrubbing robots
title_sort deep learning based semantic segmentation of human features in bath scrubbing robots
topic 3D point cloud
Human model
LiDAR
Semantic segmentation
url http://www.sciencedirect.com/science/article/pii/S2667379724000019
work_keys_str_mv AT chaozhuang deeplearningbasedsemanticsegmentationofhumanfeaturesinbathscrubbingrobots
AT tianyima deeplearningbasedsemanticsegmentationofhumanfeaturesinbathscrubbingrobots
AT bokaixuan deeplearningbasedsemanticsegmentationofhumanfeaturesinbathscrubbingrobots
AT chengchang deeplearningbasedsemanticsegmentationofhumanfeaturesinbathscrubbingrobots
AT baichuanan deeplearningbasedsemanticsegmentationofhumanfeaturesinbathscrubbingrobots
AT minghuanyin deeplearningbasedsemanticsegmentationofhumanfeaturesinbathscrubbingrobots
AT haosun deeplearningbasedsemanticsegmentationofhumanfeaturesinbathscrubbingrobots