Full-automatic high-precision scene 3D reconstruction method with water-area intelligent complementation and mesh optimization for UAV images
ABSTRACTFast and high-precision urban scene 3D modeling is the foundational data infrastructure for the digital earth and smart cities. However, due to challenges such as water-area matching difficulties and issues like data redundancy and insufficient observations, existing full-automatic 3D modeli...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Taylor & Francis Group
2024-12-01
|
| Series: | International Journal of Digital Earth |
| Subjects: | |
| Online Access: | https://www.tandfonline.com/doi/10.1080/17538947.2024.2317441 |
| _version_ | 1797305006785822720 |
|---|---|
| author | Bingxuan Guo Yingwei Ge Xiongwu Xiao Chao Wang Jianya Gong Deren Li |
| author_facet | Bingxuan Guo Yingwei Ge Xiongwu Xiao Chao Wang Jianya Gong Deren Li |
| author_sort | Bingxuan Guo |
| collection | DOAJ |
| description | ABSTRACTFast and high-precision urban scene 3D modeling is the foundational data infrastructure for the digital earth and smart cities. However, due to challenges such as water-area matching difficulties and issues like data redundancy and insufficient observations, existing full-automatic 3D modeling methods often result in water-area missing and many small holes in the models and insufficient local-model accuracy. To overcome these challenges, full-automatic high-precision scene 3D reconstruction method with water-area intelligent complementation on depth maps and mesh optimization is proposed. Firstly, SfM was used to calculated image poses and PatchMatch was used to generated initial depth maps. Secondly, a simplified GAN extracted water-area masks and ray tracing was used achieve high-precision auto-completed water-area depth values. Thirdly, fully connected CRF optimized water-areas and arounds in depth maps. Fourthly, high-precision 3D point clouds were obtained using depth map fusion based on clustering culling and depth least squares. Then, mesh was generated and optimized using similarity measurement and vertex gradients to obtain refined mesh. Finally, high-precision scene 3D models without water-area missing or holes were generated. The results showed that: to compare with the-state-of-art ContextCapture, the proposed method enhances model completeness by 14.3%, raises average accuracy by 14.5% and improves processing efficiency by 63.6%. |
| first_indexed | 2024-03-08T00:19:37Z |
| format | Article |
| id | doaj.art-07b794fcb8ba4513a2d70f960f95b3de |
| institution | Directory Open Access Journal |
| issn | 1753-8947 1753-8955 |
| language | English |
| last_indexed | 2024-03-08T00:19:37Z |
| publishDate | 2024-12-01 |
| publisher | Taylor & Francis Group |
| record_format | Article |
| series | International Journal of Digital Earth |
| spelling | doaj.art-07b794fcb8ba4513a2d70f960f95b3de2024-02-16T11:59:09ZengTaylor & Francis GroupInternational Journal of Digital Earth1753-89471753-89552024-12-0117110.1080/17538947.2024.2317441Full-automatic high-precision scene 3D reconstruction method with water-area intelligent complementation and mesh optimization for UAV imagesBingxuan Guo0Yingwei Ge1Xiongwu Xiao2Chao Wang3Jianya Gong4Deren Li5State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan, People’s Republic of ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan, People’s Republic of ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan, People’s Republic of ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan, People’s Republic of ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan, People’s Republic of ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan, People’s Republic of ChinaABSTRACTFast and high-precision urban scene 3D modeling is the foundational data infrastructure for the digital earth and smart cities. However, due to challenges such as water-area matching difficulties and issues like data redundancy and insufficient observations, existing full-automatic 3D modeling methods often result in water-area missing and many small holes in the models and insufficient local-model accuracy. To overcome these challenges, full-automatic high-precision scene 3D reconstruction method with water-area intelligent complementation on depth maps and mesh optimization is proposed. Firstly, SfM was used to calculated image poses and PatchMatch was used to generated initial depth maps. Secondly, a simplified GAN extracted water-area masks and ray tracing was used achieve high-precision auto-completed water-area depth values. Thirdly, fully connected CRF optimized water-areas and arounds in depth maps. Fourthly, high-precision 3D point clouds were obtained using depth map fusion based on clustering culling and depth least squares. Then, mesh was generated and optimized using similarity measurement and vertex gradients to obtain refined mesh. Finally, high-precision scene 3D models without water-area missing or holes were generated. The results showed that: to compare with the-state-of-art ContextCapture, the proposed method enhances model completeness by 14.3%, raises average accuracy by 14.5% and improves processing efficiency by 63.6%.https://www.tandfonline.com/doi/10.1080/17538947.2024.2317441High-completeness scene 3D modelingUAV imageswater-area intelligent complementationdepth map optimizationmesh refinement |
| spellingShingle | Bingxuan Guo Yingwei Ge Xiongwu Xiao Chao Wang Jianya Gong Deren Li Full-automatic high-precision scene 3D reconstruction method with water-area intelligent complementation and mesh optimization for UAV images International Journal of Digital Earth High-completeness scene 3D modeling UAV images water-area intelligent complementation depth map optimization mesh refinement |
| title | Full-automatic high-precision scene 3D reconstruction method with water-area intelligent complementation and mesh optimization for UAV images |
| title_full | Full-automatic high-precision scene 3D reconstruction method with water-area intelligent complementation and mesh optimization for UAV images |
| title_fullStr | Full-automatic high-precision scene 3D reconstruction method with water-area intelligent complementation and mesh optimization for UAV images |
| title_full_unstemmed | Full-automatic high-precision scene 3D reconstruction method with water-area intelligent complementation and mesh optimization for UAV images |
| title_short | Full-automatic high-precision scene 3D reconstruction method with water-area intelligent complementation and mesh optimization for UAV images |
| title_sort | full automatic high precision scene 3d reconstruction method with water area intelligent complementation and mesh optimization for uav images |
| topic | High-completeness scene 3D modeling UAV images water-area intelligent complementation depth map optimization mesh refinement |
| url | https://www.tandfonline.com/doi/10.1080/17538947.2024.2317441 |
| work_keys_str_mv | AT bingxuanguo fullautomatichighprecisionscene3dreconstructionmethodwithwaterareaintelligentcomplementationandmeshoptimizationforuavimages AT yingweige fullautomatichighprecisionscene3dreconstructionmethodwithwaterareaintelligentcomplementationandmeshoptimizationforuavimages AT xiongwuxiao fullautomatichighprecisionscene3dreconstructionmethodwithwaterareaintelligentcomplementationandmeshoptimizationforuavimages AT chaowang fullautomatichighprecisionscene3dreconstructionmethodwithwaterareaintelligentcomplementationandmeshoptimizationforuavimages AT jianyagong fullautomatichighprecisionscene3dreconstructionmethodwithwaterareaintelligentcomplementationandmeshoptimizationforuavimages AT derenli fullautomatichighprecisionscene3dreconstructionmethodwithwaterareaintelligentcomplementationandmeshoptimizationforuavimages |