3D Modeling of Façade Elements Using Multi-View Images from Mobile Scanning Systems
There is a growing demand for detailed building façade models (Level-of-Detail 3: LoD 3) in a variety of applications. Despite the increasing number of papers addressing this issue in the literature, occlusions are still a significant problem when processing building façade elements. Conversely, dep...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Taylor & Francis Group
2024-12-01
|
| Series: | Canadian Journal of Remote Sensing |
| Online Access: | http://dx.doi.org/10.1080/07038992.2024.2309895 |
| _version_ | 1797270656098762752 |
|---|---|
| author | Abbas Salehitangrizi Shabnam Jabari Michael Sheng Yun Zhang |
| author_facet | Abbas Salehitangrizi Shabnam Jabari Michael Sheng Yun Zhang |
| author_sort | Abbas Salehitangrizi |
| collection | DOAJ |
| description | There is a growing demand for detailed building façade models (Level-of-Detail 3: LoD 3) in a variety of applications. Despite the increasing number of papers addressing this issue in the literature, occlusions are still a significant problem when processing building façade elements. Conversely, depending on the view angle of the images, the detected elements might not be projected to their accurate locations causing uncertainties in their 3D locations. In this paper, we address the aforementioned issues utilizing multi-view images. Using a building footprint layer, we first locate the points belonging to buildings. We then detect the 2D windows and doors in images by combining Faster R-CNN and Segment Anything (SAM) deep learning models. The 2D borders are projected into the 3D object space using a pinhole camera model and collinearity equations. Utilizing the multi-view capabilities of mobile scanning systems, this method effectively mitigates uncertainties associated with occlusion and exterior orientation parameters (EOP). This study provides a comprehensive evaluation of 3D spatial accuracy, achieving an average of 84% Intersection over Union (IoU) accuracy for 12 different single-sided façades over 750 multi-view images for 312 windows and doors of various sizes with rectangular and curved shapes. |
| first_indexed | 2024-04-25T02:07:44Z |
| format | Article |
| id | doaj.art-da0da67286ad47f49de8f1685ffb9189 |
| institution | Directory Open Access Journal |
| issn | 1712-7971 |
| language | English |
| last_indexed | 2024-04-25T02:07:44Z |
| publishDate | 2024-12-01 |
| publisher | Taylor & Francis Group |
| record_format | Article |
| series | Canadian Journal of Remote Sensing |
| spelling | doaj.art-da0da67286ad47f49de8f1685ffb91892024-03-07T14:28:18ZengTaylor & Francis GroupCanadian Journal of Remote Sensing1712-79712024-12-0150110.1080/07038992.2024.230989523098953D Modeling of Façade Elements Using Multi-View Images from Mobile Scanning SystemsAbbas Salehitangrizi0Shabnam Jabari1Michael Sheng2Yun Zhang3Department of Geodesy & Geomatics Engineering, University of New BrunswickDepartment of Geodesy & Geomatics Engineering, University of New BrunswickDepartment of Geodesy & Geomatics Engineering, University of New BrunswickDepartment of Geodesy & Geomatics Engineering, University of New BrunswickThere is a growing demand for detailed building façade models (Level-of-Detail 3: LoD 3) in a variety of applications. Despite the increasing number of papers addressing this issue in the literature, occlusions are still a significant problem when processing building façade elements. Conversely, depending on the view angle of the images, the detected elements might not be projected to their accurate locations causing uncertainties in their 3D locations. In this paper, we address the aforementioned issues utilizing multi-view images. Using a building footprint layer, we first locate the points belonging to buildings. We then detect the 2D windows and doors in images by combining Faster R-CNN and Segment Anything (SAM) deep learning models. The 2D borders are projected into the 3D object space using a pinhole camera model and collinearity equations. Utilizing the multi-view capabilities of mobile scanning systems, this method effectively mitigates uncertainties associated with occlusion and exterior orientation parameters (EOP). This study provides a comprehensive evaluation of 3D spatial accuracy, achieving an average of 84% Intersection over Union (IoU) accuracy for 12 different single-sided façades over 750 multi-view images for 312 windows and doors of various sizes with rectangular and curved shapes.http://dx.doi.org/10.1080/07038992.2024.2309895 |
| spellingShingle | Abbas Salehitangrizi Shabnam Jabari Michael Sheng Yun Zhang 3D Modeling of Façade Elements Using Multi-View Images from Mobile Scanning Systems Canadian Journal of Remote Sensing |
| title | 3D Modeling of Façade Elements Using Multi-View Images from Mobile Scanning Systems |
| title_full | 3D Modeling of Façade Elements Using Multi-View Images from Mobile Scanning Systems |
| title_fullStr | 3D Modeling of Façade Elements Using Multi-View Images from Mobile Scanning Systems |
| title_full_unstemmed | 3D Modeling of Façade Elements Using Multi-View Images from Mobile Scanning Systems |
| title_short | 3D Modeling of Façade Elements Using Multi-View Images from Mobile Scanning Systems |
| title_sort | 3d modeling of facade elements using multi view images from mobile scanning systems |
| url | http://dx.doi.org/10.1080/07038992.2024.2309895 |
| work_keys_str_mv | AT abbassalehitangrizi 3dmodelingoffacadeelementsusingmultiviewimagesfrommobilescanningsystems AT shabnamjabari 3dmodelingoffacadeelementsusingmultiviewimagesfrommobilescanningsystems AT michaelsheng 3dmodelingoffacadeelementsusingmultiviewimagesfrommobilescanningsystems AT yunzhang 3dmodelingoffacadeelementsusingmultiviewimagesfrommobilescanningsystems |