A framework for reconstructing building parametric models with hierarchical relationships from point clouds
Parametric reconstruction based on point clouds of 3D scenes has attracted much attention due to its application prospects in many fields. This paper proposes a novel framework for reconstructing parametric models of buildings with hierarchical relationships from point clouds. Different from traditi...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2023-05-01
|
| Series: | International Journal of Applied Earth Observations and Geoinformation |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S1569843223001498 |
| _version_ | 1797828178088034304 |
|---|---|
| author | Zongcheng Zuo Yuanxiang Li |
| author_facet | Zongcheng Zuo Yuanxiang Li |
| author_sort | Zongcheng Zuo |
| collection | DOAJ |
| description | Parametric reconstruction based on point clouds of 3D scenes has attracted much attention due to its application prospects in many fields. This paper proposes a novel framework for reconstructing parametric models of buildings with hierarchical relationships from point clouds. Different from traditional approaches focusing on extracting geometric primitives, this work aims to combine the semantic hierarchy of building components with edge measurements based on vertex connections to output parametric models. We show a three-stage automated pipeline for reconstructing parametric models from point clouds of buildings. Regarding to the first stage, we design a deep network architecture to achieve the task of hierarchical segmentation, and propose a metric to evaluate the semantic consistency of different hierarchies. In the second stage, in order to predict the position of corners and filter the correct connections to construct the skeleton-graph of the model, we present a deep network architecture that converts point clouds into skeleton-graph model. The network takes the labeled 3D points output by the semantic hierarchical segmentation network as input, and then outputs the skeleton-graph of the point clouds, which is a set of edge segments connected by corner points. In the third stage, the semantic hierarchical segmentation information of the point clouds is embedded as attributes, and then the geometric parameters are measured according to the edges connected by vertices, and finally the semantic information and geometric features are mapped into the schema of CityGML. We pre-train and validate the reliability of our framework on a finely crafted synthetic dataset and finally we conduct transfer learning and fine-tune the framework on a real scene dataset. Experiments show that our method not only generates high-quality hierarchical parametric models but also recovers clean features and is robust to noise. This study provides practical guidance and technical references for developing more intelligent modeling algorithms that could support data-driven decision-making in smart cities. |
| first_indexed | 2024-04-09T13:00:16Z |
| format | Article |
| id | doaj.art-364538a4d3fa47b0b7dd9c0faf4243aa |
| institution | Directory Open Access Journal |
| issn | 1569-8432 |
| language | English |
| last_indexed | 2024-04-09T13:00:16Z |
| publishDate | 2023-05-01 |
| publisher | Elsevier |
| record_format | Article |
| series | International Journal of Applied Earth Observations and Geoinformation |
| spelling | doaj.art-364538a4d3fa47b0b7dd9c0faf4243aa2023-05-13T04:24:37ZengElsevierInternational Journal of Applied Earth Observations and Geoinformation1569-84322023-05-01119103327A framework for reconstructing building parametric models with hierarchical relationships from point cloudsZongcheng Zuo0Yuanxiang Li1School of Aeronautics and Astronautics, Shanghai Jiao Tong University, Shanghai, PR ChinaCorresponding author.; School of Aeronautics and Astronautics, Shanghai Jiao Tong University, Shanghai, PR ChinaParametric reconstruction based on point clouds of 3D scenes has attracted much attention due to its application prospects in many fields. This paper proposes a novel framework for reconstructing parametric models of buildings with hierarchical relationships from point clouds. Different from traditional approaches focusing on extracting geometric primitives, this work aims to combine the semantic hierarchy of building components with edge measurements based on vertex connections to output parametric models. We show a three-stage automated pipeline for reconstructing parametric models from point clouds of buildings. Regarding to the first stage, we design a deep network architecture to achieve the task of hierarchical segmentation, and propose a metric to evaluate the semantic consistency of different hierarchies. In the second stage, in order to predict the position of corners and filter the correct connections to construct the skeleton-graph of the model, we present a deep network architecture that converts point clouds into skeleton-graph model. The network takes the labeled 3D points output by the semantic hierarchical segmentation network as input, and then outputs the skeleton-graph of the point clouds, which is a set of edge segments connected by corner points. In the third stage, the semantic hierarchical segmentation information of the point clouds is embedded as attributes, and then the geometric parameters are measured according to the edges connected by vertices, and finally the semantic information and geometric features are mapped into the schema of CityGML. We pre-train and validate the reliability of our framework on a finely crafted synthetic dataset and finally we conduct transfer learning and fine-tune the framework on a real scene dataset. Experiments show that our method not only generates high-quality hierarchical parametric models but also recovers clean features and is robust to noise. This study provides practical guidance and technical references for developing more intelligent modeling algorithms that could support data-driven decision-making in smart cities.http://www.sciencedirect.com/science/article/pii/S1569843223001498Parametric reconstruction3D ModelingSemantic segmentationHierarchical understandingPoint clouds |
| spellingShingle | Zongcheng Zuo Yuanxiang Li A framework for reconstructing building parametric models with hierarchical relationships from point clouds International Journal of Applied Earth Observations and Geoinformation Parametric reconstruction 3D Modeling Semantic segmentation Hierarchical understanding Point clouds |
| title | A framework for reconstructing building parametric models with hierarchical relationships from point clouds |
| title_full | A framework for reconstructing building parametric models with hierarchical relationships from point clouds |
| title_fullStr | A framework for reconstructing building parametric models with hierarchical relationships from point clouds |
| title_full_unstemmed | A framework for reconstructing building parametric models with hierarchical relationships from point clouds |
| title_short | A framework for reconstructing building parametric models with hierarchical relationships from point clouds |
| title_sort | framework for reconstructing building parametric models with hierarchical relationships from point clouds |
| topic | Parametric reconstruction 3D Modeling Semantic segmentation Hierarchical understanding Point clouds |
| url | http://www.sciencedirect.com/science/article/pii/S1569843223001498 |
| work_keys_str_mv | AT zongchengzuo aframeworkforreconstructingbuildingparametricmodelswithhierarchicalrelationshipsfrompointclouds AT yuanxiangli aframeworkforreconstructingbuildingparametricmodelswithhierarchicalrelationshipsfrompointclouds AT zongchengzuo frameworkforreconstructingbuildingparametricmodelswithhierarchicalrelationshipsfrompointclouds AT yuanxiangli frameworkforreconstructingbuildingparametricmodelswithhierarchicalrelationshipsfrompointclouds |