Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor Environments
Simultaneous localization and mapping (SLAM), a core technology of mobile robots and autonomous driving, has received more and more attention in recent years. However, most of the existing visual SLAM algorithms do not consider the impact of dynamic objects on the visual SLAM system, resulting in si...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9804480/ |
| _version_ | 1818535878525452288 |
|---|---|
| author | Shiqiang Yang Cheng Zhao Zhengkun Wu Yan Wang Guodong Wang Dexin Li |
| author_facet | Shiqiang Yang Cheng Zhao Zhengkun Wu Yan Wang Guodong Wang Dexin Li |
| author_sort | Shiqiang Yang |
| collection | DOAJ |
| description | Simultaneous localization and mapping (SLAM), a core technology of mobile robots and autonomous driving, has received more and more attention in recent years. However, most of the existing visual SLAM algorithms do not consider the impact of dynamic objects on the visual SLAM system, resulting in significant system positioning errors and high map redundancy. Based on the ORB-SLAM2 algorithm, this paper combines semantic information and a geometric constraint algorithm based on feature point homogenization to improve the positioning accuracy of the SLAM system. Aiming at the problem that the feature points extracted by the ORB-SLAM2 algorithm are easily concentrated, and the extraction rate is low in the weak texture area, a feature point homogenization algorithm based on quadtree and adaptive threshold is proposed to improve the uniformity of feature point extraction. In addition, in view of the impact of dynamic targets on the SLAM system, the dynamic information in the scene is filtered out through the semantic segmentation network and the motion consistency detection algorithm, and the static feature points obtained after filtering are used to estimate the camera pose. Then, a semantic map is constructed after filtering out the dynamic point cloud according to the semantic information. Finally, the test results on Oxford and TUM datasets show that the uniformity of feature points extracted by the improved algorithm is increased by 56.3%. The positioning error of visual SLAM is reduced by 68.8% on average, and the constructed semantic map has rich semantic information and less redundancy. |
| first_indexed | 2024-12-11T18:30:47Z |
| format | Article |
| id | doaj.art-9264de6deaf04f7a9de62933ecd143e3 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-11T18:30:47Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-9264de6deaf04f7a9de62933ecd143e32022-12-22T00:54:55ZengIEEEIEEE Access2169-35362022-01-0110696366964910.1109/ACCESS.2022.31857669804480Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor EnvironmentsShiqiang Yang0https://orcid.org/0000-0001-5356-4094Cheng Zhao1Zhengkun Wu2Yan Wang3https://orcid.org/0000-0002-6747-9891Guodong Wang4Dexin Li5https://orcid.org/0000-0001-6102-6085School of Mechanical and Precision Instrument Engineering, Xi’an University of Technology, Xi’an, ChinaSchool of Mechanical and Precision Instrument Engineering, Xi’an University of Technology, Xi’an, ChinaThe Sixth Research Institute of China Aerospace Science and Industry Corporation 210, Xi’an, ChinaSchool of Mechanical and Precision Instrument Engineering, Xi’an University of Technology, Xi’an, ChinaSchool of Mechanical and Precision Instrument Engineering, Xi’an University of Technology, Xi’an, ChinaSchool of Mechanical and Precision Instrument Engineering, Xi’an University of Technology, Xi’an, ChinaSimultaneous localization and mapping (SLAM), a core technology of mobile robots and autonomous driving, has received more and more attention in recent years. However, most of the existing visual SLAM algorithms do not consider the impact of dynamic objects on the visual SLAM system, resulting in significant system positioning errors and high map redundancy. Based on the ORB-SLAM2 algorithm, this paper combines semantic information and a geometric constraint algorithm based on feature point homogenization to improve the positioning accuracy of the SLAM system. Aiming at the problem that the feature points extracted by the ORB-SLAM2 algorithm are easily concentrated, and the extraction rate is low in the weak texture area, a feature point homogenization algorithm based on quadtree and adaptive threshold is proposed to improve the uniformity of feature point extraction. In addition, in view of the impact of dynamic targets on the SLAM system, the dynamic information in the scene is filtered out through the semantic segmentation network and the motion consistency detection algorithm, and the static feature points obtained after filtering are used to estimate the camera pose. Then, a semantic map is constructed after filtering out the dynamic point cloud according to the semantic information. Finally, the test results on Oxford and TUM datasets show that the uniformity of feature points extracted by the improved algorithm is increased by 56.3%. The positioning error of visual SLAM is reduced by 68.8% on average, and the constructed semantic map has rich semantic information and less redundancy.https://ieeexplore.ieee.org/document/9804480/Visual SLAMORB-SLAM2dynamic feature filteringsemantic map |
| spellingShingle | Shiqiang Yang Cheng Zhao Zhengkun Wu Yan Wang Guodong Wang Dexin Li Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor Environments IEEE Access Visual SLAM ORB-SLAM2 dynamic feature filtering semantic map |
| title | Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor Environments |
| title_full | Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor Environments |
| title_fullStr | Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor Environments |
| title_full_unstemmed | Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor Environments |
| title_short | Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor Environments |
| title_sort | visual slam based on semantic segmentation and geometric constraints for dynamic indoor environments |
| topic | Visual SLAM ORB-SLAM2 dynamic feature filtering semantic map |
| url | https://ieeexplore.ieee.org/document/9804480/ |
| work_keys_str_mv | AT shiqiangyang visualslambasedonsemanticsegmentationandgeometricconstraintsfordynamicindoorenvironments AT chengzhao visualslambasedonsemanticsegmentationandgeometricconstraintsfordynamicindoorenvironments AT zhengkunwu visualslambasedonsemanticsegmentationandgeometricconstraintsfordynamicindoorenvironments AT yanwang visualslambasedonsemanticsegmentationandgeometricconstraintsfordynamicindoorenvironments AT guodongwang visualslambasedonsemanticsegmentationandgeometricconstraintsfordynamicindoorenvironments AT dexinli visualslambasedonsemanticsegmentationandgeometricconstraintsfordynamicindoorenvironments |