MULTI-ORIENTATION EDGE-BASED SATELLITE IMAGE MATCHING METHOD FOR OPTICAL AND SAR IMAGES
Multi-sensor image matching is a key technology to fully exploit complementary information on images from multiple sources. In particular, the nonlinear radiance distortion between optical and SAR images makes image matching very difficult. Focusing on satellite optical and SAR image matching, this...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2023-12-01
|
| Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | https://isprs-archives.copernicus.org/articles/XLVIII-1-W2-2023/1417/2023/isprs-archives-XLVIII-1-W2-2023-1417-2023.pdf |
| _version_ | 1797391462347833344 |
|---|---|
| author | Y. Lin Y. Lin L. Li L. Wei L. Liu J. Yu |
| author_facet | Y. Lin Y. Lin L. Li L. Wei L. Liu J. Yu |
| author_sort | Y. Lin |
| collection | DOAJ |
| description | Multi-sensor image matching is a key technology to fully exploit complementary information on images from multiple sources. In particular, the nonlinear radiance distortion between optical and SAR images makes image matching very difficult. Focusing on satellite optical and SAR image matching, this paper proposed an oriented edge-based template image matching, namely Multiple Orientation Edge Feature Correlation (MOEFC). Firstly, the edge feature was extracted by the Sobel operator to construct oriented gradient channels on optical and SAR images. Then spatial filtering was performed separately by a two-dimensional and a one-dimensional kernel. Finally, the similarity was determined by stacking the normalized cross correlation (NCC) of each oriented gradient channel. To validate the new method, it was compared with other four edge-based template image matching methods detected by Sobel, Canny, Laplacian and phase congruency-based methods on satellite optical-SAR image pairs, which were tested in rural and urban areas. And the results show that the proposed MOEFC method can obtain the largest number of correct matching (NCM) with the least root mean square error (RMSE) in both areas. In the rural area, the NCM of the MOEFC method is higher than the other four methods, and the improvement ranges from 54.1% to 74.3%. And the RMSE of the MOEFC method is 0.645 pixel. In the urban area, the NCM of the MOEFC method can also be improved by 3.6% to 46.4%. And the RMSE of the MOEFC method equals 0.489 pixel. |
| first_indexed | 2024-03-08T23:33:01Z |
| format | Article |
| id | doaj.art-a82e02425fe3473caaea865ddb29bb70 |
| institution | Directory Open Access Journal |
| issn | 1682-1750 2194-9034 |
| language | English |
| last_indexed | 2024-03-08T23:33:01Z |
| publishDate | 2023-12-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj.art-a82e02425fe3473caaea865ddb29bb702023-12-14T09:47:16ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342023-12-01XLVIII-1-W2-20231417142310.5194/isprs-archives-XLVIII-1-W2-2023-1417-2023MULTI-ORIENTATION EDGE-BASED SATELLITE IMAGE MATCHING METHOD FOR OPTICAL AND SAR IMAGESY. Lin0Y. Lin1L. Li2L. Wei3L. Liu4J. Yu5College of Surveying and Geo-Informatics, Tongji University, 200092 Shanghai, ChinaResearch Center of Remote Sensing Technology and Application, Tongji University, 200092 Shanghai, ChinaCollege of Surveying and Geo-Informatics, Tongji University, 200092 Shanghai, ChinaCollege of Surveying and Geo-Informatics, Tongji University, 200092 Shanghai, ChinaShanghai Ubiquitous Navigation Technology Co., Ltd., 201702 Shanghai, ChinaCollege of Surveying and Geo-Informatics, Tongji University, 200092 Shanghai, ChinaMulti-sensor image matching is a key technology to fully exploit complementary information on images from multiple sources. In particular, the nonlinear radiance distortion between optical and SAR images makes image matching very difficult. Focusing on satellite optical and SAR image matching, this paper proposed an oriented edge-based template image matching, namely Multiple Orientation Edge Feature Correlation (MOEFC). Firstly, the edge feature was extracted by the Sobel operator to construct oriented gradient channels on optical and SAR images. Then spatial filtering was performed separately by a two-dimensional and a one-dimensional kernel. Finally, the similarity was determined by stacking the normalized cross correlation (NCC) of each oriented gradient channel. To validate the new method, it was compared with other four edge-based template image matching methods detected by Sobel, Canny, Laplacian and phase congruency-based methods on satellite optical-SAR image pairs, which were tested in rural and urban areas. And the results show that the proposed MOEFC method can obtain the largest number of correct matching (NCM) with the least root mean square error (RMSE) in both areas. In the rural area, the NCM of the MOEFC method is higher than the other four methods, and the improvement ranges from 54.1% to 74.3%. And the RMSE of the MOEFC method is 0.645 pixel. In the urban area, the NCM of the MOEFC method can also be improved by 3.6% to 46.4%. And the RMSE of the MOEFC method equals 0.489 pixel.https://isprs-archives.copernicus.org/articles/XLVIII-1-W2-2023/1417/2023/isprs-archives-XLVIII-1-W2-2023-1417-2023.pdf |
| spellingShingle | Y. Lin Y. Lin L. Li L. Wei L. Liu J. Yu MULTI-ORIENTATION EDGE-BASED SATELLITE IMAGE MATCHING METHOD FOR OPTICAL AND SAR IMAGES The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | MULTI-ORIENTATION EDGE-BASED SATELLITE IMAGE MATCHING METHOD FOR OPTICAL AND SAR IMAGES |
| title_full | MULTI-ORIENTATION EDGE-BASED SATELLITE IMAGE MATCHING METHOD FOR OPTICAL AND SAR IMAGES |
| title_fullStr | MULTI-ORIENTATION EDGE-BASED SATELLITE IMAGE MATCHING METHOD FOR OPTICAL AND SAR IMAGES |
| title_full_unstemmed | MULTI-ORIENTATION EDGE-BASED SATELLITE IMAGE MATCHING METHOD FOR OPTICAL AND SAR IMAGES |
| title_short | MULTI-ORIENTATION EDGE-BASED SATELLITE IMAGE MATCHING METHOD FOR OPTICAL AND SAR IMAGES |
| title_sort | multi orientation edge based satellite image matching method for optical and sar images |
| url | https://isprs-archives.copernicus.org/articles/XLVIII-1-W2-2023/1417/2023/isprs-archives-XLVIII-1-W2-2023-1417-2023.pdf |
| work_keys_str_mv | AT ylin multiorientationedgebasedsatelliteimagematchingmethodforopticalandsarimages AT ylin multiorientationedgebasedsatelliteimagematchingmethodforopticalandsarimages AT lli multiorientationedgebasedsatelliteimagematchingmethodforopticalandsarimages AT lwei multiorientationedgebasedsatelliteimagematchingmethodforopticalandsarimages AT lliu multiorientationedgebasedsatelliteimagematchingmethodforopticalandsarimages AT jyu multiorientationedgebasedsatelliteimagematchingmethodforopticalandsarimages |