COMBINING VISIBILITY ANALYSIS AND DEEP LEARNING FOR REFINEMENT OF SEMANTIC 3D BUILDING MODELS BY CONFLICT CLASSIFICATION
Semantic 3D building models are widely available and used in numerous applications. Such 3D building models display rich semantics but no façade openings, chiefly owing to their aerial acquisition techniques. Hence, refining models’ façades using dense, street-level, terrestrial point clouds seems a...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2022-10-01
|
| Series: | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/X-4-W2-2022/289/2022/isprs-annals-X-4-W2-2022-289-2022.pdf |
| _version_ | 1798019916915277824 |
|---|---|
| author | O. Wysocki E. Grilli L. Hoegner L. Hoegner U. Stilla |
| author_facet | O. Wysocki E. Grilli L. Hoegner L. Hoegner U. Stilla |
| author_sort | O. Wysocki |
| collection | DOAJ |
| description | Semantic 3D building models are widely available and used in numerous applications. Such 3D building models display rich semantics but no façade openings, chiefly owing to their aerial acquisition techniques. Hence, refining models’ façades using dense, street-level, terrestrial point clouds seems a promising strategy. In this paper, we propose a method of combining visibility analysis and neural networks for enriching 3D models with window and door features. In the method, occupancy voxels are fused with classified point clouds, which provides semantics to voxels. Voxels are also used to identify conflicts between laser observations and 3D models. The semantic voxels and conflicts are combined in a Bayesian network to classify and delineate façade openings, which are reconstructed using a 3D model library. Unaffected building semantics is preserved while the updated one is added, thereby upgrading the building model to LoD3. Moreover, Bayesian network results are back-projected onto point clouds to improve points’ classification accuracy. We tested our method on a municipal CityGML LoD2 repository and the open point cloud datasets: TUM-MLS-2016 and TUM-FAÇADE. Validation results revealed that the method improves the accuracy of point cloud semantic segmentation and upgrades buildings with façade elements. The method can be applied to enhance the accuracy of urban simulations and facilitate the development of semantic segmentation algorithms. |
| first_indexed | 2024-04-11T16:49:08Z |
| format | Article |
| id | doaj.art-a67ffa443b864aa58cfc5322c3fb3325 |
| institution | Directory Open Access Journal |
| issn | 2194-9042 2194-9050 |
| language | English |
| last_indexed | 2024-04-11T16:49:08Z |
| publishDate | 2022-10-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj.art-a67ffa443b864aa58cfc5322c3fb33252022-12-22T04:13:30ZengCopernicus PublicationsISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences2194-90422194-90502022-10-01X-4-W2-202228929610.5194/isprs-annals-X-4-W2-2022-289-2022COMBINING VISIBILITY ANALYSIS AND DEEP LEARNING FOR REFINEMENT OF SEMANTIC 3D BUILDING MODELS BY CONFLICT CLASSIFICATIONO. Wysocki0E. Grilli1L. Hoegner2L. Hoegner3U. Stilla4Photogrammetry and Remote Sensing, TUM School of Engineering and Design, Technical University of Munich (TUM), Munich, Germany3D Optical Metrology (3DOM) unit, Bruno Kessler Foundation (FBK), Trento, ItalyPhotogrammetry and Remote Sensing, TUM School of Engineering and Design, Technical University of Munich (TUM), Munich, GermanyDepartment of Geoinformatics, University of Applied Science (HM), Munich, GermanyPhotogrammetry and Remote Sensing, TUM School of Engineering and Design, Technical University of Munich (TUM), Munich, GermanySemantic 3D building models are widely available and used in numerous applications. Such 3D building models display rich semantics but no façade openings, chiefly owing to their aerial acquisition techniques. Hence, refining models’ façades using dense, street-level, terrestrial point clouds seems a promising strategy. In this paper, we propose a method of combining visibility analysis and neural networks for enriching 3D models with window and door features. In the method, occupancy voxels are fused with classified point clouds, which provides semantics to voxels. Voxels are also used to identify conflicts between laser observations and 3D models. The semantic voxels and conflicts are combined in a Bayesian network to classify and delineate façade openings, which are reconstructed using a 3D model library. Unaffected building semantics is preserved while the updated one is added, thereby upgrading the building model to LoD3. Moreover, Bayesian network results are back-projected onto point clouds to improve points’ classification accuracy. We tested our method on a municipal CityGML LoD2 repository and the open point cloud datasets: TUM-MLS-2016 and TUM-FAÇADE. Validation results revealed that the method improves the accuracy of point cloud semantic segmentation and upgrades buildings with façade elements. The method can be applied to enhance the accuracy of urban simulations and facilitate the development of semantic segmentation algorithms.https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/X-4-W2-2022/289/2022/isprs-annals-X-4-W2-2022-289-2022.pdf |
| spellingShingle | O. Wysocki E. Grilli L. Hoegner L. Hoegner U. Stilla COMBINING VISIBILITY ANALYSIS AND DEEP LEARNING FOR REFINEMENT OF SEMANTIC 3D BUILDING MODELS BY CONFLICT CLASSIFICATION ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | COMBINING VISIBILITY ANALYSIS AND DEEP LEARNING FOR REFINEMENT OF SEMANTIC 3D BUILDING MODELS BY CONFLICT CLASSIFICATION |
| title_full | COMBINING VISIBILITY ANALYSIS AND DEEP LEARNING FOR REFINEMENT OF SEMANTIC 3D BUILDING MODELS BY CONFLICT CLASSIFICATION |
| title_fullStr | COMBINING VISIBILITY ANALYSIS AND DEEP LEARNING FOR REFINEMENT OF SEMANTIC 3D BUILDING MODELS BY CONFLICT CLASSIFICATION |
| title_full_unstemmed | COMBINING VISIBILITY ANALYSIS AND DEEP LEARNING FOR REFINEMENT OF SEMANTIC 3D BUILDING MODELS BY CONFLICT CLASSIFICATION |
| title_short | COMBINING VISIBILITY ANALYSIS AND DEEP LEARNING FOR REFINEMENT OF SEMANTIC 3D BUILDING MODELS BY CONFLICT CLASSIFICATION |
| title_sort | combining visibility analysis and deep learning for refinement of semantic 3d building models by conflict classification |
| url | https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/X-4-W2-2022/289/2022/isprs-annals-X-4-W2-2022-289-2022.pdf |
| work_keys_str_mv | AT owysocki combiningvisibilityanalysisanddeeplearningforrefinementofsemantic3dbuildingmodelsbyconflictclassification AT egrilli combiningvisibilityanalysisanddeeplearningforrefinementofsemantic3dbuildingmodelsbyconflictclassification AT lhoegner combiningvisibilityanalysisanddeeplearningforrefinementofsemantic3dbuildingmodelsbyconflictclassification AT lhoegner combiningvisibilityanalysisanddeeplearningforrefinementofsemantic3dbuildingmodelsbyconflictclassification AT ustilla combiningvisibilityanalysisanddeeplearningforrefinementofsemantic3dbuildingmodelsbyconflictclassification |