Automated Semantic Segmentation of Indoor Point Clouds from Close-Range Images with Three-Dimensional Deep Learning
The creation of building information models requires acquiring real building conditions. The generation of a three-dimensional (3D) model from 3D point clouds involves classification, outline extraction, and boundary regularization for semantic segmentation. The number of 3D point clouds generated u...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-02-01
|
| Series: | Buildings |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2075-5309/13/2/468 |
| _version_ | 1827758172732915712 |
|---|---|
| author | Chia-Sheng Hsieh Xiang-Jie Ruan |
| author_facet | Chia-Sheng Hsieh Xiang-Jie Ruan |
| author_sort | Chia-Sheng Hsieh |
| collection | DOAJ |
| description | The creation of building information models requires acquiring real building conditions. The generation of a three-dimensional (3D) model from 3D point clouds involves classification, outline extraction, and boundary regularization for semantic segmentation. The number of 3D point clouds generated using close-range images is smaller and tends to be unevenly distributed, which is not conducive to automated modeling processing. In this paper, we propose an efficient solution for the semantic segmentation of indoor point clouds from close-range images. A 3D deep learning framework that achieves better results is further proposed. A dynamic graph convolutional neural network (DGCNN) 3D deep learning method is used in this study. This method was selected to learn point cloud semantic features. Moreover, more efficient operations can be designed to build a module for extracting point cloud features such that the problem of inadequate beam and column classification can be resolved. First, DGCNN is applied to learn and classify the indoor point cloud into five categories: columns, beams, walls, floors, and ceilings. Then, the proposed semantic segmentation and modeling method is utilized to obtain the geometric parameters of each object to be integrated into building information modeling software. The experimental results show that the overall accuracy rates of the three experimental sections of Area_1 in the Stanford 3D semantic dataset test results are 86.9%, 97.4%, and 92.5%. The segmentation accuracy of corridor 2F in a civil engineering building is 94.2%. In comparing the length with the actual on-site measurement, the root mean square error is found to be ±0.03 m. The proposed method is demonstrated to be capable of automatic semantic segmentation from 3D point clouds with indoor close-range images. |
| first_indexed | 2024-03-11T09:03:56Z |
| format | Article |
| id | doaj.art-4fdce1b0f1ad4d008a531f5330a47e8e |
| institution | Directory Open Access Journal |
| issn | 2075-5309 |
| language | English |
| last_indexed | 2024-03-11T09:03:56Z |
| publishDate | 2023-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Buildings |
| spelling | doaj.art-4fdce1b0f1ad4d008a531f5330a47e8e2023-11-16T19:33:07ZengMDPI AGBuildings2075-53092023-02-0113246810.3390/buildings13020468Automated Semantic Segmentation of Indoor Point Clouds from Close-Range Images with Three-Dimensional Deep LearningChia-Sheng Hsieh0Xiang-Jie Ruan1Department of Civil Engineering, National Kaohsiung University of Science and Technology, Kaohsiung 807, TaiwanDepartment of Civil Engineering, National Kaohsiung University of Science and Technology, Kaohsiung 807, TaiwanThe creation of building information models requires acquiring real building conditions. The generation of a three-dimensional (3D) model from 3D point clouds involves classification, outline extraction, and boundary regularization for semantic segmentation. The number of 3D point clouds generated using close-range images is smaller and tends to be unevenly distributed, which is not conducive to automated modeling processing. In this paper, we propose an efficient solution for the semantic segmentation of indoor point clouds from close-range images. A 3D deep learning framework that achieves better results is further proposed. A dynamic graph convolutional neural network (DGCNN) 3D deep learning method is used in this study. This method was selected to learn point cloud semantic features. Moreover, more efficient operations can be designed to build a module for extracting point cloud features such that the problem of inadequate beam and column classification can be resolved. First, DGCNN is applied to learn and classify the indoor point cloud into five categories: columns, beams, walls, floors, and ceilings. Then, the proposed semantic segmentation and modeling method is utilized to obtain the geometric parameters of each object to be integrated into building information modeling software. The experimental results show that the overall accuracy rates of the three experimental sections of Area_1 in the Stanford 3D semantic dataset test results are 86.9%, 97.4%, and 92.5%. The segmentation accuracy of corridor 2F in a civil engineering building is 94.2%. In comparing the length with the actual on-site measurement, the root mean square error is found to be ±0.03 m. The proposed method is demonstrated to be capable of automatic semantic segmentation from 3D point clouds with indoor close-range images.https://www.mdpi.com/2075-5309/13/2/468building information model3D point cloudsemantic segmentationdeep learning |
| spellingShingle | Chia-Sheng Hsieh Xiang-Jie Ruan Automated Semantic Segmentation of Indoor Point Clouds from Close-Range Images with Three-Dimensional Deep Learning Buildings building information model 3D point cloud semantic segmentation deep learning |
| title | Automated Semantic Segmentation of Indoor Point Clouds from Close-Range Images with Three-Dimensional Deep Learning |
| title_full | Automated Semantic Segmentation of Indoor Point Clouds from Close-Range Images with Three-Dimensional Deep Learning |
| title_fullStr | Automated Semantic Segmentation of Indoor Point Clouds from Close-Range Images with Three-Dimensional Deep Learning |
| title_full_unstemmed | Automated Semantic Segmentation of Indoor Point Clouds from Close-Range Images with Three-Dimensional Deep Learning |
| title_short | Automated Semantic Segmentation of Indoor Point Clouds from Close-Range Images with Three-Dimensional Deep Learning |
| title_sort | automated semantic segmentation of indoor point clouds from close range images with three dimensional deep learning |
| topic | building information model 3D point cloud semantic segmentation deep learning |
| url | https://www.mdpi.com/2075-5309/13/2/468 |
| work_keys_str_mv | AT chiashenghsieh automatedsemanticsegmentationofindoorpointcloudsfromcloserangeimageswiththreedimensionaldeeplearning AT xiangjieruan automatedsemanticsegmentationofindoorpointcloudsfromcloserangeimageswiththreedimensionaldeeplearning |