Building façade element extraction based on multidimensional virtual semantic feature map ensemble learning and hierarchical clustering
Building façade elements are an important foundation for smart cities. As buildings exhibit an array of textures and geometric forms, the process of image acquisition is easily affected, although the robustness of texture in scenes (e.g., dilapidated buildings) is poor, with high point cloud data, a...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2022-11-01
|
| Series: | International Journal of Applied Earth Observations and Geoinformation |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S1569843222002564 |
| _version_ | 1811334250240147456 |
|---|---|
| author | Rongchun Zhang Yiting He Liang Cheng Xuefeng Yi Guanming Lu Lijun Yang |
| author_facet | Rongchun Zhang Yiting He Liang Cheng Xuefeng Yi Guanming Lu Lijun Yang |
| author_sort | Rongchun Zhang |
| collection | DOAJ |
| description | Building façade elements are an important foundation for smart cities. As buildings exhibit an array of textures and geometric forms, the process of image acquisition is easily affected, although the robustness of texture in scenes (e.g., dilapidated buildings) is poor, with high point cloud data, and low recognition efficiency; therefore, the accuracy of building element extraction based on a single data source remains limited. In this research, a method for building façade element extraction based on multidimensional virtual semantic feature map ensemble learning and hierarchical clustering is proposed. Point clouds were obtained by multi-view images, and then the multidimensional virtual semantic feature maps, including color, texture, orientation, and curvature semantics, were acquired via reprojection. The multi-semantic feature block pre-segmentation, considering multiple features, was obtained by ensemble learning, and a hierarchical clustering strategy was established for to achieve fine extraction of building façade elements. Experiments were conducted across multiple building types, and the results showed that: 1) The method can use different virtual semantic feature map and clustering strategies to achieve accurate extraction of diverse building façade elements; 2) The method achieved joint learning tasks in both 2D and 3D space; and, 3) The proposed method achieved fine extraction of building elements with pixel accuracy (PA) over 70% in all experiments and mean intersection over union (mIoU) up to 95%, which were better than the image based method. In summary, this method offers a novel, more reliable method for segmenting and extracting building façade elements, which has important theoretical and practical significance. |
| first_indexed | 2024-04-13T17:05:01Z |
| format | Article |
| id | doaj.art-4a15524eab8a4a5981e7d18db8715239 |
| institution | Directory Open Access Journal |
| issn | 1569-8432 |
| language | English |
| last_indexed | 2024-04-13T17:05:01Z |
| publishDate | 2022-11-01 |
| publisher | Elsevier |
| record_format | Article |
| series | International Journal of Applied Earth Observations and Geoinformation |
| spelling | doaj.art-4a15524eab8a4a5981e7d18db87152392022-12-22T02:38:30ZengElsevierInternational Journal of Applied Earth Observations and Geoinformation1569-84322022-11-01114103068Building façade element extraction based on multidimensional virtual semantic feature map ensemble learning and hierarchical clusteringRongchun Zhang0Yiting He1Liang Cheng2Xuefeng Yi3Guanming Lu4Lijun Yang5School of Geographic and Biologic Information, Nanjing University of Posts and Telecommunications, Nanjing 210023, China; School of Communication and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, ChinaSchool of Geographic and Biologic Information, Nanjing University of Posts and Telecommunications, Nanjing 210023, ChinaSchool of Geography and Oceam Science, Nanjing University, Nanjing 210008, China; Corresponding author.School of Earth Sciences and Engineering, Hohai University, Nanjing 211100, ChinaSchool of Communication and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, ChinaSchool of Geographic and Biologic Information, Nanjing University of Posts and Telecommunications, Nanjing 210023, ChinaBuilding façade elements are an important foundation for smart cities. As buildings exhibit an array of textures and geometric forms, the process of image acquisition is easily affected, although the robustness of texture in scenes (e.g., dilapidated buildings) is poor, with high point cloud data, and low recognition efficiency; therefore, the accuracy of building element extraction based on a single data source remains limited. In this research, a method for building façade element extraction based on multidimensional virtual semantic feature map ensemble learning and hierarchical clustering is proposed. Point clouds were obtained by multi-view images, and then the multidimensional virtual semantic feature maps, including color, texture, orientation, and curvature semantics, were acquired via reprojection. The multi-semantic feature block pre-segmentation, considering multiple features, was obtained by ensemble learning, and a hierarchical clustering strategy was established for to achieve fine extraction of building façade elements. Experiments were conducted across multiple building types, and the results showed that: 1) The method can use different virtual semantic feature map and clustering strategies to achieve accurate extraction of diverse building façade elements; 2) The method achieved joint learning tasks in both 2D and 3D space; and, 3) The proposed method achieved fine extraction of building elements with pixel accuracy (PA) over 70% in all experiments and mean intersection over union (mIoU) up to 95%, which were better than the image based method. In summary, this method offers a novel, more reliable method for segmenting and extracting building façade elements, which has important theoretical and practical significance.http://www.sciencedirect.com/science/article/pii/S1569843222002564Building façadesEnsemble learningFeature extractionSemantic segmentation |
| spellingShingle | Rongchun Zhang Yiting He Liang Cheng Xuefeng Yi Guanming Lu Lijun Yang Building façade element extraction based on multidimensional virtual semantic feature map ensemble learning and hierarchical clustering International Journal of Applied Earth Observations and Geoinformation Building façades Ensemble learning Feature extraction Semantic segmentation |
| title | Building façade element extraction based on multidimensional virtual semantic feature map ensemble learning and hierarchical clustering |
| title_full | Building façade element extraction based on multidimensional virtual semantic feature map ensemble learning and hierarchical clustering |
| title_fullStr | Building façade element extraction based on multidimensional virtual semantic feature map ensemble learning and hierarchical clustering |
| title_full_unstemmed | Building façade element extraction based on multidimensional virtual semantic feature map ensemble learning and hierarchical clustering |
| title_short | Building façade element extraction based on multidimensional virtual semantic feature map ensemble learning and hierarchical clustering |
| title_sort | building facade element extraction based on multidimensional virtual semantic feature map ensemble learning and hierarchical clustering |
| topic | Building façades Ensemble learning Feature extraction Semantic segmentation |
| url | http://www.sciencedirect.com/science/article/pii/S1569843222002564 |
| work_keys_str_mv | AT rongchunzhang buildingfacadeelementextractionbasedonmultidimensionalvirtualsemanticfeaturemapensemblelearningandhierarchicalclustering AT yitinghe buildingfacadeelementextractionbasedonmultidimensionalvirtualsemanticfeaturemapensemblelearningandhierarchicalclustering AT liangcheng buildingfacadeelementextractionbasedonmultidimensionalvirtualsemanticfeaturemapensemblelearningandhierarchicalclustering AT xuefengyi buildingfacadeelementextractionbasedonmultidimensionalvirtualsemanticfeaturemapensemblelearningandhierarchicalclustering AT guanminglu buildingfacadeelementextractionbasedonmultidimensionalvirtualsemanticfeaturemapensemblelearningandhierarchicalclustering AT lijunyang buildingfacadeelementextractionbasedonmultidimensionalvirtualsemanticfeaturemapensemblelearningandhierarchicalclustering |