3D Point Cloud Instance Segmentation Considering Global Shape Contour Constraints
Aiming to solve the problem that spatially distributed similar instances cannot be distinguished in 3D point cloud instance segmentation, a 3D point cloud instance segmentation network, considering the global shape contour, was proposed. This research used the global-to-local design idea and added t...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-10-01
|
| Series: | Remote Sensing |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-4292/15/20/4939 |
| _version_ | 1797572404530118656 |
|---|---|
| author | Jiabin Xv Fei Deng |
| author_facet | Jiabin Xv Fei Deng |
| author_sort | Jiabin Xv |
| collection | DOAJ |
| description | Aiming to solve the problem that spatially distributed similar instances cannot be distinguished in 3D point cloud instance segmentation, a 3D point cloud instance segmentation network, considering the global shape contour, was proposed. This research used the global-to-local design idea and added the global shape constraint to solve this problem. A Transformer module (Global Shape Attention, GSA) that can capture the shape contour information of the instance in the scene was designed. This module encoded the shape contour information into the Transformer structure as a Key-Value and extracted the instance fused with the global shape contour features, for instance, segmentation. At the same time, the network directly predicted the instance mask in an end-to-end mode, avoiding heavy post-processing algorithms. Many experiments have been conducted on the S3DIS, ScanNet, and STPL3D datasets, and our experimental results showed that our proposed network can efficiently capture the shape contour information of scene instances and can help to alleviate the problem of the difficulty distinguishing between spatially distributed similar instances in a scene, improving the efficiency and stability of instance segmentation. |
| first_indexed | 2024-03-10T20:55:47Z |
| format | Article |
| id | doaj.art-8a9833c2fd9d4566bbdb3ebfdfe08f28 |
| institution | Directory Open Access Journal |
| issn | 2072-4292 |
| language | English |
| last_indexed | 2024-03-10T20:55:47Z |
| publishDate | 2023-10-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Remote Sensing |
| spelling | doaj.art-8a9833c2fd9d4566bbdb3ebfdfe08f282023-11-19T17:58:33ZengMDPI AGRemote Sensing2072-42922023-10-011520493910.3390/rs152049393D Point Cloud Instance Segmentation Considering Global Shape Contour ConstraintsJiabin Xv0Fei Deng1School of Geodesy and Geomatics, Wuhan University, Wuhan 430072, ChinaSchool of Geodesy and Geomatics, Wuhan University, Wuhan 430072, ChinaAiming to solve the problem that spatially distributed similar instances cannot be distinguished in 3D point cloud instance segmentation, a 3D point cloud instance segmentation network, considering the global shape contour, was proposed. This research used the global-to-local design idea and added the global shape constraint to solve this problem. A Transformer module (Global Shape Attention, GSA) that can capture the shape contour information of the instance in the scene was designed. This module encoded the shape contour information into the Transformer structure as a Key-Value and extracted the instance fused with the global shape contour features, for instance, segmentation. At the same time, the network directly predicted the instance mask in an end-to-end mode, avoiding heavy post-processing algorithms. Many experiments have been conducted on the S3DIS, ScanNet, and STPL3D datasets, and our experimental results showed that our proposed network can efficiently capture the shape contour information of scene instances and can help to alleviate the problem of the difficulty distinguishing between spatially distributed similar instances in a scene, improving the efficiency and stability of instance segmentation.https://www.mdpi.com/2072-4292/15/20/49393D point cloudTransformerinstance segmentationshape contour |
| spellingShingle | Jiabin Xv Fei Deng 3D Point Cloud Instance Segmentation Considering Global Shape Contour Constraints Remote Sensing 3D point cloud Transformer instance segmentation shape contour |
| title | 3D Point Cloud Instance Segmentation Considering Global Shape Contour Constraints |
| title_full | 3D Point Cloud Instance Segmentation Considering Global Shape Contour Constraints |
| title_fullStr | 3D Point Cloud Instance Segmentation Considering Global Shape Contour Constraints |
| title_full_unstemmed | 3D Point Cloud Instance Segmentation Considering Global Shape Contour Constraints |
| title_short | 3D Point Cloud Instance Segmentation Considering Global Shape Contour Constraints |
| title_sort | 3d point cloud instance segmentation considering global shape contour constraints |
| topic | 3D point cloud Transformer instance segmentation shape contour |
| url | https://www.mdpi.com/2072-4292/15/20/4939 |
| work_keys_str_mv | AT jiabinxv 3dpointcloudinstancesegmentationconsideringglobalshapecontourconstraints AT feideng 3dpointcloudinstancesegmentationconsideringglobalshapecontourconstraints |