SDF-SLAM: Semantic Depth Filter SLAM for Dynamic Environments

Simultaneous Localization and Mapping (SLAM) has been widely applied in computer vision and robotics. For the dynamic environments which are very common in the real word, traditional visual SLAM system faces significant drop in localization and mapping accuracy due to the static world assumption. Re...

Full description

Bibliographic Details
Main Authors: Linyan Cui, Chaowei Ma
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9093003/
_version_ 1818444241235345408
author Linyan Cui
Chaowei Ma
author_facet Linyan Cui
Chaowei Ma
author_sort Linyan Cui
collection DOAJ
description Simultaneous Localization and Mapping (SLAM) has been widely applied in computer vision and robotics. For the dynamic environments which are very common in the real word, traditional visual SLAM system faces significant drop in localization and mapping accuracy due to the static world assumption. Recently, the semantic visual SLAM systems towards dynamic scenes have gradually attracted more and more attentions, which use the semantic information of images to help remove dynamic feature points. Existing semantic visual SLAM systems commonly detect the dynamic feature points by the semantic prior, geometry constraint or the combine of them, then map points corresponding to dynamic feature points are removed. In the visual SLAM framework, pose calculation is essentially around the 3D map points, so the essence of improving the accuracy of visual SLAM system is to build a more accurate and reliable map. These existing semantic visual SLAM systems are actually adopting an indirect way to acquire reliable map points, and several drawbacks exist. In this paper, we present SDF-SLAM: Semantic Depth Filter SLAM, a visual semantic SLAM system towards dynamic environments, which utilizes the technology of depth filter to directly judge whether a 3D map point is dynamic or not. First, the semantic information is integrated into the original pure geometry SLAM system by the semantic optical flow method to perform reliable map initialization. Second, design the semantic depth filter that satisfies the Gaussian Uniform mixture distribution to describe the inverse depth of each map point. Third, updating the inverse depth of 3D map point in a Bayesian estimation framework, and dividing the 3D map point into active one or inactive one. Last, only the active map points are utilized to achieve robust camera pose tracking. Experiments on TUM dataset demonstrate that our approach outperforms original ORB-SLAM2 and other state-of-the-art semantic SLAM systems.
first_indexed 2024-12-14T19:12:48Z
format Article
id doaj.art-caf2a5a4fbc44ffc8539478440075ad1
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-14T19:12:48Z
publishDate 2020-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-caf2a5a4fbc44ffc8539478440075ad12022-12-21T22:50:41ZengIEEEIEEE Access2169-35362020-01-018953019531110.1109/ACCESS.2020.29943489093003SDF-SLAM: Semantic Depth Filter SLAM for Dynamic EnvironmentsLinyan Cui0https://orcid.org/0000-0002-4176-482XChaowei Ma1https://orcid.org/0000-0002-5497-0358Image Processing Center, School of Astronautics, Beihang University, Beijing, ChinaImage Processing Center, School of Astronautics, Beihang University, Beijing, ChinaSimultaneous Localization and Mapping (SLAM) has been widely applied in computer vision and robotics. For the dynamic environments which are very common in the real word, traditional visual SLAM system faces significant drop in localization and mapping accuracy due to the static world assumption. Recently, the semantic visual SLAM systems towards dynamic scenes have gradually attracted more and more attentions, which use the semantic information of images to help remove dynamic feature points. Existing semantic visual SLAM systems commonly detect the dynamic feature points by the semantic prior, geometry constraint or the combine of them, then map points corresponding to dynamic feature points are removed. In the visual SLAM framework, pose calculation is essentially around the 3D map points, so the essence of improving the accuracy of visual SLAM system is to build a more accurate and reliable map. These existing semantic visual SLAM systems are actually adopting an indirect way to acquire reliable map points, and several drawbacks exist. In this paper, we present SDF-SLAM: Semantic Depth Filter SLAM, a visual semantic SLAM system towards dynamic environments, which utilizes the technology of depth filter to directly judge whether a 3D map point is dynamic or not. First, the semantic information is integrated into the original pure geometry SLAM system by the semantic optical flow method to perform reliable map initialization. Second, design the semantic depth filter that satisfies the Gaussian Uniform mixture distribution to describe the inverse depth of each map point. Third, updating the inverse depth of 3D map point in a Bayesian estimation framework, and dividing the 3D map point into active one or inactive one. Last, only the active map points are utilized to achieve robust camera pose tracking. Experiments on TUM dataset demonstrate that our approach outperforms original ORB-SLAM2 and other state-of-the-art semantic SLAM systems.https://ieeexplore.ieee.org/document/9093003/Dynamic scenesdepth filtersemantic segmentationsimultaneous localization and mapping
spellingShingle Linyan Cui
Chaowei Ma
SDF-SLAM: Semantic Depth Filter SLAM for Dynamic Environments
IEEE Access
Dynamic scenes
depth filter
semantic segmentation
simultaneous localization and mapping
title SDF-SLAM: Semantic Depth Filter SLAM for Dynamic Environments
title_full SDF-SLAM: Semantic Depth Filter SLAM for Dynamic Environments
title_fullStr SDF-SLAM: Semantic Depth Filter SLAM for Dynamic Environments
title_full_unstemmed SDF-SLAM: Semantic Depth Filter SLAM for Dynamic Environments
title_short SDF-SLAM: Semantic Depth Filter SLAM for Dynamic Environments
title_sort sdf slam semantic depth filter slam for dynamic environments
topic Dynamic scenes
depth filter
semantic segmentation
simultaneous localization and mapping
url https://ieeexplore.ieee.org/document/9093003/
work_keys_str_mv AT linyancui sdfslamsemanticdepthfilterslamfordynamicenvironments
AT chaoweima sdfslamsemanticdepthfilterslamfordynamicenvironments