High Precision Mesh-Based Drone Image Stitching Based on Salient Structure Preservation and Regular Boundaries
Addressing problems such as obvious ghost, dislocation, and distortion resulting from the traditional stitching method, a novel drone image-stitching method is proposed using mesh-based local double-feature bundle adjustment and salient structure preservation which aims to obtain more natural panora...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-03-01
|
| Series: | Drones |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2504-446X/7/4/230 |
| _version_ | 1797605743295201280 |
|---|---|
| author | Qiuze Yu Ruikai Wang Fanghong Liu Jinsheng Xiao Jiachun An Jin Liu |
| author_facet | Qiuze Yu Ruikai Wang Fanghong Liu Jinsheng Xiao Jiachun An Jin Liu |
| author_sort | Qiuze Yu |
| collection | DOAJ |
| description | Addressing problems such as obvious ghost, dislocation, and distortion resulting from the traditional stitching method, a novel drone image-stitching method is proposed using mesh-based local double-feature bundle adjustment and salient structure preservation which aims to obtain more natural panoramas.The proposed method is divided into the following steps. First, reducing parallax error is considered from both global and local aspects. Global bundle adjustment is introduced to minimize global transfer error, and then the local mesh-based feature-alignment model is incorporated into the optimization framework to achieve more accurate alignment. Considering the sensitivity of human eyes to linear structure, the global linear structure that runs through the images obtained by segment fusion is introduced to prevent distortions and align matching line segments better. Rectangular panoramas usually have better visual effects. Therefore, regular boundary constraint combined with mesh-based shape-preserving transform can make the results more natural while preserving mesh geometry. Two new evaluation metrics are also developed to quantify the performance of linear structure preservation and the alignment difference of matching line segments. Extensive experiments show that our proposed method can eliminate parallax and preserve global linear structures better than other state-of-the-art stitching methods and obtain more natural-looking stitching results. |
| first_indexed | 2024-03-11T05:05:23Z |
| format | Article |
| id | doaj.art-c6df662189fa40969cbf82bfce1ddc81 |
| institution | Directory Open Access Journal |
| issn | 2504-446X |
| language | English |
| last_indexed | 2024-03-11T05:05:23Z |
| publishDate | 2023-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Drones |
| spelling | doaj.art-c6df662189fa40969cbf82bfce1ddc812023-11-17T18:57:49ZengMDPI AGDrones2504-446X2023-03-017423010.3390/drones7040230High Precision Mesh-Based Drone Image Stitching Based on Salient Structure Preservation and Regular BoundariesQiuze Yu0Ruikai Wang1Fanghong Liu2Jinsheng Xiao3Jiachun An4Jin Liu5Electronic Information School, Wuhan University, Wuhan 430072, ChinaElectronic Information School, Wuhan University, Wuhan 430072, ChinaElectronic Information School, Wuhan University, Wuhan 430072, ChinaElectronic Information School, Wuhan University, Wuhan 430072, ChinaChinese Antarctic Center of Surveying and Mapping, Wuhan University, Wuhan 430079, ChinaState Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan 430079, ChinaAddressing problems such as obvious ghost, dislocation, and distortion resulting from the traditional stitching method, a novel drone image-stitching method is proposed using mesh-based local double-feature bundle adjustment and salient structure preservation which aims to obtain more natural panoramas.The proposed method is divided into the following steps. First, reducing parallax error is considered from both global and local aspects. Global bundle adjustment is introduced to minimize global transfer error, and then the local mesh-based feature-alignment model is incorporated into the optimization framework to achieve more accurate alignment. Considering the sensitivity of human eyes to linear structure, the global linear structure that runs through the images obtained by segment fusion is introduced to prevent distortions and align matching line segments better. Rectangular panoramas usually have better visual effects. Therefore, regular boundary constraint combined with mesh-based shape-preserving transform can make the results more natural while preserving mesh geometry. Two new evaluation metrics are also developed to quantify the performance of linear structure preservation and the alignment difference of matching line segments. Extensive experiments show that our proposed method can eliminate parallax and preserve global linear structures better than other state-of-the-art stitching methods and obtain more natural-looking stitching results.https://www.mdpi.com/2504-446X/7/4/230drone image stitchingbundle adjustmentmesh optimizationboundary constraintstructure preservationunmanned aerial vehicle images |
| spellingShingle | Qiuze Yu Ruikai Wang Fanghong Liu Jinsheng Xiao Jiachun An Jin Liu High Precision Mesh-Based Drone Image Stitching Based on Salient Structure Preservation and Regular Boundaries Drones drone image stitching bundle adjustment mesh optimization boundary constraint structure preservation unmanned aerial vehicle images |
| title | High Precision Mesh-Based Drone Image Stitching Based on Salient Structure Preservation and Regular Boundaries |
| title_full | High Precision Mesh-Based Drone Image Stitching Based on Salient Structure Preservation and Regular Boundaries |
| title_fullStr | High Precision Mesh-Based Drone Image Stitching Based on Salient Structure Preservation and Regular Boundaries |
| title_full_unstemmed | High Precision Mesh-Based Drone Image Stitching Based on Salient Structure Preservation and Regular Boundaries |
| title_short | High Precision Mesh-Based Drone Image Stitching Based on Salient Structure Preservation and Regular Boundaries |
| title_sort | high precision mesh based drone image stitching based on salient structure preservation and regular boundaries |
| topic | drone image stitching bundle adjustment mesh optimization boundary constraint structure preservation unmanned aerial vehicle images |
| url | https://www.mdpi.com/2504-446X/7/4/230 |
| work_keys_str_mv | AT qiuzeyu highprecisionmeshbaseddroneimagestitchingbasedonsalientstructurepreservationandregularboundaries AT ruikaiwang highprecisionmeshbaseddroneimagestitchingbasedonsalientstructurepreservationandregularboundaries AT fanghongliu highprecisionmeshbaseddroneimagestitchingbasedonsalientstructurepreservationandregularboundaries AT jinshengxiao highprecisionmeshbaseddroneimagestitchingbasedonsalientstructurepreservationandregularboundaries AT jiachunan highprecisionmeshbaseddroneimagestitchingbasedonsalientstructurepreservationandregularboundaries AT jinliu highprecisionmeshbaseddroneimagestitchingbasedonsalientstructurepreservationandregularboundaries |