DENSE MATCHING COMPARISON BETWEEN CLASSICAL AND DEEP LEARNING BASED ALGORITHMS FOR REMOTE SENSING DATA
Deep learning and convolutional neural networks (CNN) have obtained a great success in image processing, by means of its powerful feature extraction ability to learn specific tasks. Many deep learning based algorithms have been developed for dense image matching, which is a hot topic in the communit...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2020-08-01
|
| Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/521/2020/isprs-archives-XLIII-B2-2020-521-2020.pdf |
| _version_ | 1818339414810558464 |
|---|---|
| author | Y. Xia P. d’Angelo J. Tian P. Reinartz |
| author_facet | Y. Xia P. d’Angelo J. Tian P. Reinartz |
| author_sort | Y. Xia |
| collection | DOAJ |
| description | Deep learning and convolutional neural networks (CNN) have obtained a great success in image processing, by means of its powerful feature extraction ability to learn specific tasks. Many deep learning based algorithms have been developed for dense image matching, which is a hot topic in the community of computer vision. These methods are tested for close-range or street-view stereo data, however, not well studied with remote sensing datasets, including aerial and satellite data. As more high-quality datasets are collected by recent airborne and spaceborne sensors, it is necessary to compare the performance of these algorithms to classical dense matching algorithms on remote sensing data. In this paper, Guided Aggregation Net (GA-Net), which belongs to the most competitive algorithms on KITTI 2015 benchmark (street-view dataset), is tested and compared with Semi-Global Matching (SGM) on satellite and airborne data. GA-Net is an end-to-end neural network, which starts from an stereo pair and directly outputs a disparity map indicating the scene’s depth information. It is based on a differentiable approximation of SGM embedded into a neural network, performing well for ill-posed regions, such as textureless areas, slanted surfaces, etc. The results demonstrate that GA-Net is capable of producing a smoother disparity map with less errors, particularly for across track data acquired at different dates. |
| first_indexed | 2024-12-13T15:26:38Z |
| format | Article |
| id | doaj.art-c4a8dd14f8e74b509619e581474294f6 |
| institution | Directory Open Access Journal |
| issn | 1682-1750 2194-9034 |
| language | English |
| last_indexed | 2024-12-13T15:26:38Z |
| publishDate | 2020-08-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj.art-c4a8dd14f8e74b509619e581474294f62022-12-21T23:40:19ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342020-08-01XLIII-B2-202052152510.5194/isprs-archives-XLIII-B2-2020-521-2020DENSE MATCHING COMPARISON BETWEEN CLASSICAL AND DEEP LEARNING BASED ALGORITHMS FOR REMOTE SENSING DATAY. Xia0P. d’Angelo1J. Tian2P. Reinartz3German Aerospace Center (DLR), Remote Sensing Technology Institute, 82234 Wessling, GermanyGerman Aerospace Center (DLR), Remote Sensing Technology Institute, 82234 Wessling, GermanyGerman Aerospace Center (DLR), Remote Sensing Technology Institute, 82234 Wessling, GermanyGerman Aerospace Center (DLR), Remote Sensing Technology Institute, 82234 Wessling, GermanyDeep learning and convolutional neural networks (CNN) have obtained a great success in image processing, by means of its powerful feature extraction ability to learn specific tasks. Many deep learning based algorithms have been developed for dense image matching, which is a hot topic in the community of computer vision. These methods are tested for close-range or street-view stereo data, however, not well studied with remote sensing datasets, including aerial and satellite data. As more high-quality datasets are collected by recent airborne and spaceborne sensors, it is necessary to compare the performance of these algorithms to classical dense matching algorithms on remote sensing data. In this paper, Guided Aggregation Net (GA-Net), which belongs to the most competitive algorithms on KITTI 2015 benchmark (street-view dataset), is tested and compared with Semi-Global Matching (SGM) on satellite and airborne data. GA-Net is an end-to-end neural network, which starts from an stereo pair and directly outputs a disparity map indicating the scene’s depth information. It is based on a differentiable approximation of SGM embedded into a neural network, performing well for ill-posed regions, such as textureless areas, slanted surfaces, etc. The results demonstrate that GA-Net is capable of producing a smoother disparity map with less errors, particularly for across track data acquired at different dates.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/521/2020/isprs-archives-XLIII-B2-2020-521-2020.pdf |
| spellingShingle | Y. Xia P. d’Angelo J. Tian P. Reinartz DENSE MATCHING COMPARISON BETWEEN CLASSICAL AND DEEP LEARNING BASED ALGORITHMS FOR REMOTE SENSING DATA The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | DENSE MATCHING COMPARISON BETWEEN CLASSICAL AND DEEP LEARNING BASED ALGORITHMS FOR REMOTE SENSING DATA |
| title_full | DENSE MATCHING COMPARISON BETWEEN CLASSICAL AND DEEP LEARNING BASED ALGORITHMS FOR REMOTE SENSING DATA |
| title_fullStr | DENSE MATCHING COMPARISON BETWEEN CLASSICAL AND DEEP LEARNING BASED ALGORITHMS FOR REMOTE SENSING DATA |
| title_full_unstemmed | DENSE MATCHING COMPARISON BETWEEN CLASSICAL AND DEEP LEARNING BASED ALGORITHMS FOR REMOTE SENSING DATA |
| title_short | DENSE MATCHING COMPARISON BETWEEN CLASSICAL AND DEEP LEARNING BASED ALGORITHMS FOR REMOTE SENSING DATA |
| title_sort | dense matching comparison between classical and deep learning based algorithms for remote sensing data |
| url | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/521/2020/isprs-archives-XLIII-B2-2020-521-2020.pdf |
| work_keys_str_mv | AT yxia densematchingcomparisonbetweenclassicalanddeeplearningbasedalgorithmsforremotesensingdata AT pdangelo densematchingcomparisonbetweenclassicalanddeeplearningbasedalgorithmsforremotesensingdata AT jtian densematchingcomparisonbetweenclassicalanddeeplearningbasedalgorithmsforremotesensingdata AT preinartz densematchingcomparisonbetweenclassicalanddeeplearningbasedalgorithmsforremotesensingdata |