Real-Time SLAM Based on Dynamic Feature Point Elimination in Dynamic Environment

Slam (simultaneous localization and mapping) play an important role in the field of artificial and driverless intelligence. A real-time dynamic visual SLAM algorithm based on an object detection network is proposed to address the robustness and camera localization accuracy issues caused by dynamic o...

Full description

Bibliographic Details
Main Authors: Ruizhen Gao, Ziheng Li, Junfu Li, Baihua Li, Jingjun Zhang, Jun Liu
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10283827/
_version_ 1797655672488198144
author Ruizhen Gao
Ziheng Li
Junfu Li
Baihua Li
Jingjun Zhang
Jun Liu
author_facet Ruizhen Gao
Ziheng Li
Junfu Li
Baihua Li
Jingjun Zhang
Jun Liu
author_sort Ruizhen Gao
collection DOAJ
description Slam (simultaneous localization and mapping) play an important role in the field of artificial and driverless intelligence. A real-time dynamic visual SLAM algorithm based on an object detection network is proposed to address the robustness and camera localization accuracy issues caused by dynamic objects in indoor dynamic scenes. The YOLOv5s model, which has the smallest depth and feature map width in the YOLOv5 series, is chosen as the object detection network. The backbone network is replaced with the lightweight ShuffleNetv2 network. Experimental results on the VOC2007 dataset show that the YOLOv5-LITE model reduces the network parameters by 41.89% and speeds up the runtime by 39.00% compared to the YOLOv5s model. A motion level division strategy is adopted to provide prior information to the object detection network. In the tracking thread of the visual SLAM system, a parallel thread combining the improved object detection network and multi-view geometry is introduced to eliminate dynamic feature points. The experimental results demonstrate that in dynamic scenes, the proposed algorithm improves the camera localization accuracy by an average of 85.38% compared to ORB-SLAM2. Finally, experiments in a real environment are conducted to validate the effectiveness of the algorithm.
first_indexed 2024-03-11T17:17:58Z
format Article
id doaj.art-d049d2e8b97945f388236afa6e8e5d4c
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-03-11T17:17:58Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-d049d2e8b97945f388236afa6e8e5d4c2023-10-19T23:00:34ZengIEEEIEEE Access2169-35362023-01-011111395211396410.1109/ACCESS.2023.332414610283827Real-Time SLAM Based on Dynamic Feature Point Elimination in Dynamic EnvironmentRuizhen Gao0Ziheng Li1https://orcid.org/0009-0003-1296-9986Junfu Li2Baihua Li3Jingjun Zhang4Jun Liu5School of Mechanical and Equipment Engineering, Hebei University of Engineering, Handan, ChinaSchool of Mechanical and Equipment Engineering, Hebei University of Engineering, Handan, ChinaSchool of Earth Science and Engineering, Hebei University of Engineering, Handan, ChinaDepartment of Computer Science, Loughborough University, Loughborough, Leicestershire, U.K.School of Mechanical and Equipment Engineering, Hebei University of Engineering, Handan, ChinaHandan Textile Machinery Company Ltd., Handan, ChinaSlam (simultaneous localization and mapping) play an important role in the field of artificial and driverless intelligence. A real-time dynamic visual SLAM algorithm based on an object detection network is proposed to address the robustness and camera localization accuracy issues caused by dynamic objects in indoor dynamic scenes. The YOLOv5s model, which has the smallest depth and feature map width in the YOLOv5 series, is chosen as the object detection network. The backbone network is replaced with the lightweight ShuffleNetv2 network. Experimental results on the VOC2007 dataset show that the YOLOv5-LITE model reduces the network parameters by 41.89% and speeds up the runtime by 39.00% compared to the YOLOv5s model. A motion level division strategy is adopted to provide prior information to the object detection network. In the tracking thread of the visual SLAM system, a parallel thread combining the improved object detection network and multi-view geometry is introduced to eliminate dynamic feature points. The experimental results demonstrate that in dynamic scenes, the proposed algorithm improves the camera localization accuracy by an average of 85.38% compared to ORB-SLAM2. Finally, experiments in a real environment are conducted to validate the effectiveness of the algorithm.https://ieeexplore.ieee.org/document/10283827/YOLOv5-LITEdynamic environmentSLAMdynamic feature point removal
spellingShingle Ruizhen Gao
Ziheng Li
Junfu Li
Baihua Li
Jingjun Zhang
Jun Liu
Real-Time SLAM Based on Dynamic Feature Point Elimination in Dynamic Environment
IEEE Access
YOLOv5-LITE
dynamic environment
SLAM
dynamic feature point removal
title Real-Time SLAM Based on Dynamic Feature Point Elimination in Dynamic Environment
title_full Real-Time SLAM Based on Dynamic Feature Point Elimination in Dynamic Environment
title_fullStr Real-Time SLAM Based on Dynamic Feature Point Elimination in Dynamic Environment
title_full_unstemmed Real-Time SLAM Based on Dynamic Feature Point Elimination in Dynamic Environment
title_short Real-Time SLAM Based on Dynamic Feature Point Elimination in Dynamic Environment
title_sort real time slam based on dynamic feature point elimination in dynamic environment
topic YOLOv5-LITE
dynamic environment
SLAM
dynamic feature point removal
url https://ieeexplore.ieee.org/document/10283827/
work_keys_str_mv AT ruizhengao realtimeslambasedondynamicfeaturepointeliminationindynamicenvironment
AT zihengli realtimeslambasedondynamicfeaturepointeliminationindynamicenvironment
AT junfuli realtimeslambasedondynamicfeaturepointeliminationindynamicenvironment
AT baihuali realtimeslambasedondynamicfeaturepointeliminationindynamicenvironment
AT jingjunzhang realtimeslambasedondynamicfeaturepointeliminationindynamicenvironment
AT junliu realtimeslambasedondynamicfeaturepointeliminationindynamicenvironment