Cascaded Contextual Reasoning for Large-Scale Point Cloud Semantic Segmentation

Large-scale point cloud semantic segmentation aims to efficiently process millions of points and classify each point into the correct class. Most traditional methods are designed for indoor scenes and are inpractical to process large-scale point clouds directly. To improve efficiency, appropriate po...

Full description

Bibliographic Details
Main Authors: Fengyi Zhang, Xiuyu Xia
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10052647/
_version_ 1811159138289319936
author Fengyi Zhang
Xiuyu Xia
author_facet Fengyi Zhang
Xiuyu Xia
author_sort Fengyi Zhang
collection DOAJ
description Large-scale point cloud semantic segmentation aims to efficiently process millions of points and classify each point into the correct class. Most traditional methods are designed for indoor scenes and are inpractical to process large-scale point clouds directly. To improve efficiency, appropriate point reduction strategies such as random sampling are necessary to reduce points significantly. However, it brings some problems. First, such reduction leads to serious information loss during encoding phase. Second, to recover from the reduction of points, low-level features need to be carefully fused after upsampling for refinement. To address above issues, we propose a Cascaded Contextual Reasoning network (PointCCR) for large-scale point cloud semantic segmentation. We propose a Dilated Graph Convolution (DGC) module to exploit local structure of point clouds and efficiently increase receptive fields. To make compensation for the information loss caused by reducing points, we propose a Cross-level Feature Enrichment (CFE) module which models cross-level contextual dependencies. DGC and CFE together constitute the Multi-level Cascade Aggregation (MCA) module as encoder. Furthermore, we build a Class-aware Attentive Refinement (CAR) module to selectively fuse low-level features for refinement after upsampling. Extensive experimental results demonstrate our method achieves superior performance compared with other state-of-the-arts on three large-scale point cloud datasets (i.e., Semantic3D, SemanticKITTI and S3DIS).
first_indexed 2024-04-10T05:35:58Z
format Article
id doaj.art-bc743b10ea9d45919274c4c3b88a115d
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-04-10T05:35:58Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-bc743b10ea9d45919274c4c3b88a115d2023-03-07T00:00:38ZengIEEEIEEE Access2169-35362023-01-0111207552076810.1109/ACCESS.2023.324896310052647Cascaded Contextual Reasoning for Large-Scale Point Cloud Semantic SegmentationFengyi Zhang0https://orcid.org/0009-0004-8476-3028Xiuyu Xia1College of Information Engineering, Chengdu Vocational and Technical College of Industry, Chengdu, ChinaCollege of Electronics and Information Engineering, Sichuan University, Chengdu, ChinaLarge-scale point cloud semantic segmentation aims to efficiently process millions of points and classify each point into the correct class. Most traditional methods are designed for indoor scenes and are inpractical to process large-scale point clouds directly. To improve efficiency, appropriate point reduction strategies such as random sampling are necessary to reduce points significantly. However, it brings some problems. First, such reduction leads to serious information loss during encoding phase. Second, to recover from the reduction of points, low-level features need to be carefully fused after upsampling for refinement. To address above issues, we propose a Cascaded Contextual Reasoning network (PointCCR) for large-scale point cloud semantic segmentation. We propose a Dilated Graph Convolution (DGC) module to exploit local structure of point clouds and efficiently increase receptive fields. To make compensation for the information loss caused by reducing points, we propose a Cross-level Feature Enrichment (CFE) module which models cross-level contextual dependencies. DGC and CFE together constitute the Multi-level Cascade Aggregation (MCA) module as encoder. Furthermore, we build a Class-aware Attentive Refinement (CAR) module to selectively fuse low-level features for refinement after upsampling. Extensive experimental results demonstrate our method achieves superior performance compared with other state-of-the-arts on three large-scale point cloud datasets (i.e., Semantic3D, SemanticKITTI and S3DIS).https://ieeexplore.ieee.org/document/10052647/Large-scale point cloudsemantic segmentationcascaded contextual reasoning
spellingShingle Fengyi Zhang
Xiuyu Xia
Cascaded Contextual Reasoning for Large-Scale Point Cloud Semantic Segmentation
IEEE Access
Large-scale point cloud
semantic segmentation
cascaded contextual reasoning
title Cascaded Contextual Reasoning for Large-Scale Point Cloud Semantic Segmentation
title_full Cascaded Contextual Reasoning for Large-Scale Point Cloud Semantic Segmentation
title_fullStr Cascaded Contextual Reasoning for Large-Scale Point Cloud Semantic Segmentation
title_full_unstemmed Cascaded Contextual Reasoning for Large-Scale Point Cloud Semantic Segmentation
title_short Cascaded Contextual Reasoning for Large-Scale Point Cloud Semantic Segmentation
title_sort cascaded contextual reasoning for large scale point cloud semantic segmentation
topic Large-scale point cloud
semantic segmentation
cascaded contextual reasoning
url https://ieeexplore.ieee.org/document/10052647/
work_keys_str_mv AT fengyizhang cascadedcontextualreasoningforlargescalepointcloudsemanticsegmentation
AT xiuyuxia cascadedcontextualreasoningforlargescalepointcloudsemanticsegmentation