A method for stitching remote sensing images with Delaunay triangle feature constraints
AbstractThe process of synthesizing multiple images into a seamless panoramic image is referred to as remote sensing image stitching. Existing studies focus less on the influence of topography on the appearance and texture of images and the perturbation of image spectra by topographic changes. This...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Taylor & Francis Group
2023-12-01
|
| Series: | Geocarto International |
| Subjects: | |
| Online Access: | https://www.tandfonline.com/doi/10.1080/10106049.2023.2285356 |
| _version_ | 1797449960393801728 |
|---|---|
| author | Weibo Zeng Qiuyan Deng Xingyue Zhao Dehua Li Xinran Min |
| author_facet | Weibo Zeng Qiuyan Deng Xingyue Zhao Dehua Li Xinran Min |
| author_sort | Weibo Zeng |
| collection | DOAJ |
| description | AbstractThe process of synthesizing multiple images into a seamless panoramic image is referred to as remote sensing image stitching. Existing studies focus less on the influence of topography on the appearance and texture of images and the perturbation of image spectra by topographic changes. This paper presents a remote sensing image stitching method that considers the impact of topography and geomorphology. First, the feature matching was optimized using the Euclidean distance similarity of texture features and the nearest neighbor distance ratio of feature points in remote sensing images as constraints. Then, the Delaunay triangle mesh of feature points in the image overlapping region was constructed, the geometric features of Delaunay triangles were used to optimize the triangle matching and reduce the matching redundancy, and the affine transformation matrix was solved based on the comprehensive consideration of the geometric features of Delaunay triangles and the texture features of the remote sensing images. Finally, the weighted fusion algorithm was applied to stitch and fuse the images. Three image datasets were selected for the experiments, one in which there were large terrain undulations in the imaging regions, one in which the main body of the imaging regions was water, and one in which the overall terrain of the imaging regions had relatively gentle slopes but obscuring features were also present. The results showed that the average correct rates of method feature matching were 89.78%, 94.99%, and 96.17%, which were the best for each algorithm, and the average feature matching times were 4.13, 8.27 and 7.19 s. These times are much lower than those obtained with the APAP and AANAP algorithms and basically the same as those achieved with the SPHP and SURF algorithms. In terms of visual effect, the AG, [Formula: see text] and [Formula: see text] indices of the proposed method were all significantly improved compared to the APAP, SPHP, AANAP, and SURF algorithms, the advantages were most obvious when dealing with datasets with large topographic relief in the imaging regions, with the maximum improvement of the AG, [Formula: see text] and [Formula: see text] indices were 85.61%, 95.68%, and 93.12%, respectively. Therefore, it is possible to conclude that the proposed method is more suitable for remote sensing image stitching and fusion of different topographic and geomorphological conditions. |
| first_indexed | 2024-03-09T14:33:44Z |
| format | Article |
| id | doaj.art-61d6b7404a054ebaac10702a2d419924 |
| institution | Directory Open Access Journal |
| issn | 1010-6049 1752-0762 |
| language | English |
| last_indexed | 2024-03-09T14:33:44Z |
| publishDate | 2023-12-01 |
| publisher | Taylor & Francis Group |
| record_format | Article |
| series | Geocarto International |
| spelling | doaj.art-61d6b7404a054ebaac10702a2d4199242023-11-27T16:36:57ZengTaylor & Francis GroupGeocarto International1010-60491752-07622023-12-0138110.1080/10106049.2023.2285356A method for stitching remote sensing images with Delaunay triangle feature constraintsWeibo Zeng0Qiuyan Deng1Xingyue Zhao2Dehua Li3Xinran Min4School of Geographic Information and Tourism, Chuzhou University, Chuzhou, ChinaSchool of Geographic Information and Tourism, Chuzhou University, Chuzhou, ChinaSchool of Geographic Information and Tourism, Chuzhou University, Chuzhou, ChinaThe Second Clinical Medical College, Nanjing Medical University, Nanjing, ChinaSchool of Geographic Information and Tourism, Chuzhou University, Chuzhou, ChinaAbstractThe process of synthesizing multiple images into a seamless panoramic image is referred to as remote sensing image stitching. Existing studies focus less on the influence of topography on the appearance and texture of images and the perturbation of image spectra by topographic changes. This paper presents a remote sensing image stitching method that considers the impact of topography and geomorphology. First, the feature matching was optimized using the Euclidean distance similarity of texture features and the nearest neighbor distance ratio of feature points in remote sensing images as constraints. Then, the Delaunay triangle mesh of feature points in the image overlapping region was constructed, the geometric features of Delaunay triangles were used to optimize the triangle matching and reduce the matching redundancy, and the affine transformation matrix was solved based on the comprehensive consideration of the geometric features of Delaunay triangles and the texture features of the remote sensing images. Finally, the weighted fusion algorithm was applied to stitch and fuse the images. Three image datasets were selected for the experiments, one in which there were large terrain undulations in the imaging regions, one in which the main body of the imaging regions was water, and one in which the overall terrain of the imaging regions had relatively gentle slopes but obscuring features were also present. The results showed that the average correct rates of method feature matching were 89.78%, 94.99%, and 96.17%, which were the best for each algorithm, and the average feature matching times were 4.13, 8.27 and 7.19 s. These times are much lower than those obtained with the APAP and AANAP algorithms and basically the same as those achieved with the SPHP and SURF algorithms. In terms of visual effect, the AG, [Formula: see text] and [Formula: see text] indices of the proposed method were all significantly improved compared to the APAP, SPHP, AANAP, and SURF algorithms, the advantages were most obvious when dealing with datasets with large topographic relief in the imaging regions, with the maximum improvement of the AG, [Formula: see text] and [Formula: see text] indices were 85.61%, 95.68%, and 93.12%, respectively. Therefore, it is possible to conclude that the proposed method is more suitable for remote sensing image stitching and fusion of different topographic and geomorphological conditions.https://www.tandfonline.com/doi/10.1080/10106049.2023.2285356Delaunay triangle meshfeature constraintsimage stitchingtextural featurestopographic and geomorphic features |
| spellingShingle | Weibo Zeng Qiuyan Deng Xingyue Zhao Dehua Li Xinran Min A method for stitching remote sensing images with Delaunay triangle feature constraints Geocarto International Delaunay triangle mesh feature constraints image stitching textural features topographic and geomorphic features |
| title | A method for stitching remote sensing images with Delaunay triangle feature constraints |
| title_full | A method for stitching remote sensing images with Delaunay triangle feature constraints |
| title_fullStr | A method for stitching remote sensing images with Delaunay triangle feature constraints |
| title_full_unstemmed | A method for stitching remote sensing images with Delaunay triangle feature constraints |
| title_short | A method for stitching remote sensing images with Delaunay triangle feature constraints |
| title_sort | method for stitching remote sensing images with delaunay triangle feature constraints |
| topic | Delaunay triangle mesh feature constraints image stitching textural features topographic and geomorphic features |
| url | https://www.tandfonline.com/doi/10.1080/10106049.2023.2285356 |
| work_keys_str_mv | AT weibozeng amethodforstitchingremotesensingimageswithdelaunaytrianglefeatureconstraints AT qiuyandeng amethodforstitchingremotesensingimageswithdelaunaytrianglefeatureconstraints AT xingyuezhao amethodforstitchingremotesensingimageswithdelaunaytrianglefeatureconstraints AT dehuali amethodforstitchingremotesensingimageswithdelaunaytrianglefeatureconstraints AT xinranmin amethodforstitchingremotesensingimageswithdelaunaytrianglefeatureconstraints AT weibozeng methodforstitchingremotesensingimageswithdelaunaytrianglefeatureconstraints AT qiuyandeng methodforstitchingremotesensingimageswithdelaunaytrianglefeatureconstraints AT xingyuezhao methodforstitchingremotesensingimageswithdelaunaytrianglefeatureconstraints AT dehuali methodforstitchingremotesensingimageswithdelaunaytrianglefeatureconstraints AT xinranmin methodforstitchingremotesensingimageswithdelaunaytrianglefeatureconstraints |