UAV Image Stitching Based on Mesh-Guided Deformation and Ground Constraint
This article introduces a drone image stitching based on mesh-guided deformation and ground constraint, which can closely match the characteristics of images and achieve precise registration and acquire ideal stitching effect. The traditional methods use the homography model to align the image, whic...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2021-01-01
|
| Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9361080/ |
| _version_ | 1818822397125459968 |
|---|---|
| author | Quan Xu Jun Chen Linbo Luo Wenping Gong Yong Wang |
| author_facet | Quan Xu Jun Chen Linbo Luo Wenping Gong Yong Wang |
| author_sort | Quan Xu |
| collection | DOAJ |
| description | This article introduces a drone image stitching based on mesh-guided deformation and ground constraint, which can closely match the characteristics of images and achieve precise registration and acquire ideal stitching effect. The traditional methods use the homography model to align the image, which causes artifacts in the result of stitching the images with parallax. To overcome this situation, the image is divided into meshes and the mesh vertices of the target image are used to guide the warping. A new energy function is designed to represent the deformation characteristics of the image. We propose a new alignment term by using local homography and a local scale term by using the edge information of the mesh. The established mesh-guided deformation model can overcome image parallax caused by some external factors and eliminate the ghostly parts of the result. Moreover, imaged scene is not effectively planar and some fluctuations exist in the scene of the images, which will distort the stitching result. We propose a ground constraint with the ground plane as the main plane to reduce projection distortions in non-overlapping areas between images. Finally, the method of creating groundtruth is proposed, which can evaluate the naturalness of results and make comparison more reasonable. Several sets of challenging drone images are tested, and the experimental results show that our stitching system has good results. |
| first_indexed | 2024-12-18T23:23:26Z |
| format | Article |
| id | doaj.art-d831f15bc0cd4e72b915fa944193574a |
| institution | Directory Open Access Journal |
| issn | 2151-1535 |
| language | English |
| last_indexed | 2024-12-18T23:23:26Z |
| publishDate | 2021-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| spelling | doaj.art-d831f15bc0cd4e72b915fa944193574a2022-12-21T20:47:53ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352021-01-01144465447510.1109/JSTARS.2021.30615059361080UAV Image Stitching Based on Mesh-Guided Deformation and Ground ConstraintQuan Xu0Jun Chen1https://orcid.org/0000-0001-9005-6849Linbo Luo2Wenping Gong3Yong Wang4https://orcid.org/0000-0002-0954-2856School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan, ChinaSchool of Automation, Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems, China University of Geosciences, Wuhan, ChinaSchool of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan, ChinaFaculty of Engineering, China University of Geosciences, Wuhan, ChinaSchool of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan, ChinaThis article introduces a drone image stitching based on mesh-guided deformation and ground constraint, which can closely match the characteristics of images and achieve precise registration and acquire ideal stitching effect. The traditional methods use the homography model to align the image, which causes artifacts in the result of stitching the images with parallax. To overcome this situation, the image is divided into meshes and the mesh vertices of the target image are used to guide the warping. A new energy function is designed to represent the deformation characteristics of the image. We propose a new alignment term by using local homography and a local scale term by using the edge information of the mesh. The established mesh-guided deformation model can overcome image parallax caused by some external factors and eliminate the ghostly parts of the result. Moreover, imaged scene is not effectively planar and some fluctuations exist in the scene of the images, which will distort the stitching result. We propose a ground constraint with the ground plane as the main plane to reduce projection distortions in non-overlapping areas between images. Finally, the method of creating groundtruth is proposed, which can evaluate the naturalness of results and make comparison more reasonable. Several sets of challenging drone images are tested, and the experimental results show that our stitching system has good results.https://ieeexplore.ieee.org/document/9361080/Ground constraintimage matchingmesh-guided deformationunmanned aerial vehicle (UAV) image stitching |
| spellingShingle | Quan Xu Jun Chen Linbo Luo Wenping Gong Yong Wang UAV Image Stitching Based on Mesh-Guided Deformation and Ground Constraint IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Ground constraint image matching mesh-guided deformation unmanned aerial vehicle (UAV) image stitching |
| title | UAV Image Stitching Based on Mesh-Guided Deformation and Ground Constraint |
| title_full | UAV Image Stitching Based on Mesh-Guided Deformation and Ground Constraint |
| title_fullStr | UAV Image Stitching Based on Mesh-Guided Deformation and Ground Constraint |
| title_full_unstemmed | UAV Image Stitching Based on Mesh-Guided Deformation and Ground Constraint |
| title_short | UAV Image Stitching Based on Mesh-Guided Deformation and Ground Constraint |
| title_sort | uav image stitching based on mesh guided deformation and ground constraint |
| topic | Ground constraint image matching mesh-guided deformation unmanned aerial vehicle (UAV) image stitching |
| url | https://ieeexplore.ieee.org/document/9361080/ |
| work_keys_str_mv | AT quanxu uavimagestitchingbasedonmeshguideddeformationandgroundconstraint AT junchen uavimagestitchingbasedonmeshguideddeformationandgroundconstraint AT linboluo uavimagestitchingbasedonmeshguideddeformationandgroundconstraint AT wenpinggong uavimagestitchingbasedonmeshguideddeformationandgroundconstraint AT yongwang uavimagestitchingbasedonmeshguideddeformationandgroundconstraint |