Snake-Based Model for Automatic Roof Boundary Extraction in the Object Space Integrating a High-Resolution Aerial Images Stereo Pair and 3D Roof Models
The accelerated urban development over the last decades has made it necessary to update spatial information rapidly and constantly. Therefore, cities’ three-dimensional models have been widely used as a study base for various urban problems. However, although many efforts have been made to develop n...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-04-01
|
| Series: | Remote Sensing |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-4292/13/8/1429 |
| _version_ | 1797538483186696192 |
|---|---|
| author | Michelle S. Y. Ywata Aluir P. Dal Poz Milton H. Shimabukuro Henrique C. de Oliveira |
| author_facet | Michelle S. Y. Ywata Aluir P. Dal Poz Milton H. Shimabukuro Henrique C. de Oliveira |
| author_sort | Michelle S. Y. Ywata |
| collection | DOAJ |
| description | The accelerated urban development over the last decades has made it necessary to update spatial information rapidly and constantly. Therefore, cities’ three-dimensional models have been widely used as a study base for various urban problems. However, although many efforts have been made to develop new building extraction methods, reliable and automatic extraction is still a major challenge for the remote sensing and computer vision communities, mainly due to the complexity and variability of urban scenes. This paper presents a method to extract building roof boundaries in the object space by integrating a high-resolution aerial images stereo pair, three-dimensional roof models reconstructed from light detection and ranging (LiDAR) data, and contextual information of the scenes involved. The proposed method focuses on overcoming three types of common problems that can disturb the automatic roof extraction in the urban environment: perspective occlusions caused by high buildings, occlusions caused by vegetation covering the roof, and shadows that are adjacent to the roofs, which can be misinterpreted as roof edges. For this, an improved Snake-based mathematical model is developed considering the radiometric and geometric properties of roofs to represent the roof boundary in the image space. A new approach for calculating the corner response and a shadow compensation factor was added to the model. The created model is then adapted to represent the boundaries in the object space considering a stereo pair of aerial images. Finally, the optimal polyline, representing a selected roof boundary, is obtained by optimizing the proposed Snake-based model using a dynamic programming (DP) approach considering the contextual information of the scene. The results showed that the proposed method works properly in boundary extraction of roofs with occlusion and shadows areas, presenting completeness and correctness average values above 90%, RMSE average values below 0.5 m for <i>E</i> and <i>N</i> components, and below 1 m for <i>H</i> component. |
| first_indexed | 2024-03-10T12:32:03Z |
| format | Article |
| id | doaj.art-8ad5dc2464f948808f04de5b8df6a5a0 |
| institution | Directory Open Access Journal |
| issn | 2072-4292 |
| language | English |
| last_indexed | 2024-03-10T12:32:03Z |
| publishDate | 2021-04-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Remote Sensing |
| spelling | doaj.art-8ad5dc2464f948808f04de5b8df6a5a02023-11-21T14:36:05ZengMDPI AGRemote Sensing2072-42922021-04-01138142910.3390/rs13081429Snake-Based Model for Automatic Roof Boundary Extraction in the Object Space Integrating a High-Resolution Aerial Images Stereo Pair and 3D Roof ModelsMichelle S. Y. Ywata0Aluir P. Dal Poz1Milton H. Shimabukuro2Henrique C. de Oliveira3Department of Cartography, School of Sciences and Technology, São Paulo State University (UNESP), Presidente Prudente 19060-900, SP, BrazilDepartment of Cartography, School of Sciences and Technology, São Paulo State University (UNESP), Presidente Prudente 19060-900, SP, BrazilDepartment of Mathematics and Computer Science, School of Sciences and Technology, São Paulo State University (UNESP), Presidente Prudente 19060-900, SP, BrazilDepartment of Infrastructure and Environment, School of Civil Engineering, Architecture, Urban Planning, University of Campinas (UNICAMP), Campinas 13083-889, SP, BrazilThe accelerated urban development over the last decades has made it necessary to update spatial information rapidly and constantly. Therefore, cities’ three-dimensional models have been widely used as a study base for various urban problems. However, although many efforts have been made to develop new building extraction methods, reliable and automatic extraction is still a major challenge for the remote sensing and computer vision communities, mainly due to the complexity and variability of urban scenes. This paper presents a method to extract building roof boundaries in the object space by integrating a high-resolution aerial images stereo pair, three-dimensional roof models reconstructed from light detection and ranging (LiDAR) data, and contextual information of the scenes involved. The proposed method focuses on overcoming three types of common problems that can disturb the automatic roof extraction in the urban environment: perspective occlusions caused by high buildings, occlusions caused by vegetation covering the roof, and shadows that are adjacent to the roofs, which can be misinterpreted as roof edges. For this, an improved Snake-based mathematical model is developed considering the radiometric and geometric properties of roofs to represent the roof boundary in the image space. A new approach for calculating the corner response and a shadow compensation factor was added to the model. The created model is then adapted to represent the boundaries in the object space considering a stereo pair of aerial images. Finally, the optimal polyline, representing a selected roof boundary, is obtained by optimizing the proposed Snake-based model using a dynamic programming (DP) approach considering the contextual information of the scene. The results showed that the proposed method works properly in boundary extraction of roofs with occlusion and shadows areas, presenting completeness and correctness average values above 90%, RMSE average values below 0.5 m for <i>E</i> and <i>N</i> components, and below 1 m for <i>H</i> component.https://www.mdpi.com/2072-4292/13/8/1429building roof boundary extractionairborne LiDARhigh-resolution imagestereo pair of imagesSnake modelthree-dimensional roof model |
| spellingShingle | Michelle S. Y. Ywata Aluir P. Dal Poz Milton H. Shimabukuro Henrique C. de Oliveira Snake-Based Model for Automatic Roof Boundary Extraction in the Object Space Integrating a High-Resolution Aerial Images Stereo Pair and 3D Roof Models Remote Sensing building roof boundary extraction airborne LiDAR high-resolution image stereo pair of images Snake model three-dimensional roof model |
| title | Snake-Based Model for Automatic Roof Boundary Extraction in the Object Space Integrating a High-Resolution Aerial Images Stereo Pair and 3D Roof Models |
| title_full | Snake-Based Model for Automatic Roof Boundary Extraction in the Object Space Integrating a High-Resolution Aerial Images Stereo Pair and 3D Roof Models |
| title_fullStr | Snake-Based Model for Automatic Roof Boundary Extraction in the Object Space Integrating a High-Resolution Aerial Images Stereo Pair and 3D Roof Models |
| title_full_unstemmed | Snake-Based Model for Automatic Roof Boundary Extraction in the Object Space Integrating a High-Resolution Aerial Images Stereo Pair and 3D Roof Models |
| title_short | Snake-Based Model for Automatic Roof Boundary Extraction in the Object Space Integrating a High-Resolution Aerial Images Stereo Pair and 3D Roof Models |
| title_sort | snake based model for automatic roof boundary extraction in the object space integrating a high resolution aerial images stereo pair and 3d roof models |
| topic | building roof boundary extraction airborne LiDAR high-resolution image stereo pair of images Snake model three-dimensional roof model |
| url | https://www.mdpi.com/2072-4292/13/8/1429 |
| work_keys_str_mv | AT michellesyywata snakebasedmodelforautomaticroofboundaryextractionintheobjectspaceintegratingahighresolutionaerialimagesstereopairand3droofmodels AT aluirpdalpoz snakebasedmodelforautomaticroofboundaryextractionintheobjectspaceintegratingahighresolutionaerialimagesstereopairand3droofmodels AT miltonhshimabukuro snakebasedmodelforautomaticroofboundaryextractionintheobjectspaceintegratingahighresolutionaerialimagesstereopairand3droofmodels AT henriquecdeoliveira snakebasedmodelforautomaticroofboundaryextractionintheobjectspaceintegratingahighresolutionaerialimagesstereopairand3droofmodels |