A Lightweight Network for Point Cloud Analysis via the Fusion of Local Features and Distribution Characteristics
Effectively integrating the local features and their spatial distribution information for more effective point cloud analysis is a subject that has been explored for a long time. Inspired by convolutional neural networks (CNNs), this paper studies the relationship between local features and their sp...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-06-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/22/13/4742 |
| _version_ | 1797434029080838144 |
|---|---|
| author | Qiang Zheng Jian Sun Wei Chen |
| author_facet | Qiang Zheng Jian Sun Wei Chen |
| author_sort | Qiang Zheng |
| collection | DOAJ |
| description | Effectively integrating the local features and their spatial distribution information for more effective point cloud analysis is a subject that has been explored for a long time. Inspired by convolutional neural networks (CNNs), this paper studies the relationship between local features and their spatial characteristics and proposes a concise architecture to effectively integrate them instead of designing more sophisticated feature extraction modules. Different positions in the feature map of the 2D image correspond to different weights in the convolution kernel, making the obtained features that are sensitive to local distribution characteristics. Thus, the spatial distribution of the input features of the point cloud within the receptive field is critical for capturing abstract regional aggregated features. We design a lightweight structure to extract local features by explicitly supplementing the distribution information of the input features to obtain distinctive features for point cloud analysis. Compared with the baseline, our model shows improvements in accuracy and convergence speed, and these advantages facilitate the introduction of the snapshot ensemble. Aiming at the shortcomings of the commonly used cosine annealing learning schedule, we design a new annealing schedule that can be flexibly adjusted for the snapshot ensemble technology, which significantly improves the performance by a large margin. Extensive experiments on typical benchmarks verify that, although it adopts the basic shared multi-layer perceptrons (MLPs) as feature extractors, the proposed model with a lightweight structure achieves on-par performance with previous state-of-the-art (SOTA) methods (e.g., MoldeNet40 classification, 0.98 million parameters and 93.5% accuracy; S3DIS segmentation, 1.4 million parameters and 68.7% mIoU). |
| first_indexed | 2024-03-09T10:25:27Z |
| format | Article |
| id | doaj.art-9aaf40a89c964f50a26e7032624da1fb |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-09T10:25:27Z |
| publishDate | 2022-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-9aaf40a89c964f50a26e7032624da1fb2023-12-01T21:41:25ZengMDPI AGSensors1424-82202022-06-012213474210.3390/s22134742A Lightweight Network for Point Cloud Analysis via the Fusion of Local Features and Distribution CharacteristicsQiang Zheng0Jian Sun1Wei Chen2State Key Laboratory for Strength and Vibration of Mechanical Structures, School of Aerospace Engineering, Xi’an Jiaotong University, Xi’an 710049, ChinaState Key Laboratory for Strength and Vibration of Mechanical Structures, School of Aerospace Engineering, Xi’an Jiaotong University, Xi’an 710049, ChinaState Key Laboratory for Strength and Vibration of Mechanical Structures, School of Aerospace Engineering, Xi’an Jiaotong University, Xi’an 710049, ChinaEffectively integrating the local features and their spatial distribution information for more effective point cloud analysis is a subject that has been explored for a long time. Inspired by convolutional neural networks (CNNs), this paper studies the relationship between local features and their spatial characteristics and proposes a concise architecture to effectively integrate them instead of designing more sophisticated feature extraction modules. Different positions in the feature map of the 2D image correspond to different weights in the convolution kernel, making the obtained features that are sensitive to local distribution characteristics. Thus, the spatial distribution of the input features of the point cloud within the receptive field is critical for capturing abstract regional aggregated features. We design a lightweight structure to extract local features by explicitly supplementing the distribution information of the input features to obtain distinctive features for point cloud analysis. Compared with the baseline, our model shows improvements in accuracy and convergence speed, and these advantages facilitate the introduction of the snapshot ensemble. Aiming at the shortcomings of the commonly used cosine annealing learning schedule, we design a new annealing schedule that can be flexibly adjusted for the snapshot ensemble technology, which significantly improves the performance by a large margin. Extensive experiments on typical benchmarks verify that, although it adopts the basic shared multi-layer perceptrons (MLPs) as feature extractors, the proposed model with a lightweight structure achieves on-par performance with previous state-of-the-art (SOTA) methods (e.g., MoldeNet40 classification, 0.98 million parameters and 93.5% accuracy; S3DIS segmentation, 1.4 million parameters and 68.7% mIoU).https://www.mdpi.com/1424-8220/22/13/4742lightweight networkdeep learningpoint cloud classificationpoint cloud segmentation |
| spellingShingle | Qiang Zheng Jian Sun Wei Chen A Lightweight Network for Point Cloud Analysis via the Fusion of Local Features and Distribution Characteristics Sensors lightweight network deep learning point cloud classification point cloud segmentation |
| title | A Lightweight Network for Point Cloud Analysis via the Fusion of Local Features and Distribution Characteristics |
| title_full | A Lightweight Network for Point Cloud Analysis via the Fusion of Local Features and Distribution Characteristics |
| title_fullStr | A Lightweight Network for Point Cloud Analysis via the Fusion of Local Features and Distribution Characteristics |
| title_full_unstemmed | A Lightweight Network for Point Cloud Analysis via the Fusion of Local Features and Distribution Characteristics |
| title_short | A Lightweight Network for Point Cloud Analysis via the Fusion of Local Features and Distribution Characteristics |
| title_sort | lightweight network for point cloud analysis via the fusion of local features and distribution characteristics |
| topic | lightweight network deep learning point cloud classification point cloud segmentation |
| url | https://www.mdpi.com/1424-8220/22/13/4742 |
| work_keys_str_mv | AT qiangzheng alightweightnetworkforpointcloudanalysisviathefusionoflocalfeaturesanddistributioncharacteristics AT jiansun alightweightnetworkforpointcloudanalysisviathefusionoflocalfeaturesanddistributioncharacteristics AT weichen alightweightnetworkforpointcloudanalysisviathefusionoflocalfeaturesanddistributioncharacteristics AT qiangzheng lightweightnetworkforpointcloudanalysisviathefusionoflocalfeaturesanddistributioncharacteristics AT jiansun lightweightnetworkforpointcloudanalysisviathefusionoflocalfeaturesanddistributioncharacteristics AT weichen lightweightnetworkforpointcloudanalysisviathefusionoflocalfeaturesanddistributioncharacteristics |