PRECISE DISPARITY ESTIMATION FOR NARROW BASELINE STEREO BASED ON MULTISCALE SUPERPIXELS AND PHASE CORRELATION
With the rapid development of subpixel matching algorithms, the estimation of image shifts with an accuracy of higher than 0.05 pixels is achieved, which makes the narrow baseline stereovision possible. Based on the subpixel matching algorithm using the robust phase correlation (PC), in this work, w...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2019-06-01
|
| Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2-W13/147/2019/isprs-archives-XLII-2-W13-147-2019.pdf |
| _version_ | 1819038428641099776 |
|---|---|
| author | Z. Ye Y. Xu L. Hoegner X. Tong U. Stilla |
| author_facet | Z. Ye Y. Xu L. Hoegner X. Tong U. Stilla |
| author_sort | Z. Ye |
| collection | DOAJ |
| description | With the rapid development of subpixel matching algorithms, the estimation of image shifts with an accuracy of higher than 0.05 pixels is achieved, which makes the narrow baseline stereovision possible. Based on the subpixel matching algorithm using the robust phase correlation (PC), in this work, we present a novel hierarchical and adaptive disparity estimation scheme for narrow baseline stereo, which consists of three main steps: image coregistration, pixel-level disparity estimation, and subpixel refinement. The Fourier-Mellin transform with subpixel PC is used to co-register two input images. Then, the pixel-level disparities are estimated in an iterative manner, which is achieved through multiscale superpixels. The pixel-level PC is performed with the window sizes and locations adaptively determined according to superpixels, with the disparity values calcualted. Fast weighted median filtering based on edge-aware filter is adopted to refine the disparity results. At last, the accurate disparities are calculated via a robust subpixel PC method. The combination of multiscale superpixel hierarchy, adaptive determination of the window size and location of correlation, fast weighted median filtering and subpixel PC make the proposed scheme be able to overcome the issues of either low-texture areas or fattening effect. Experimental results on a pair of UAV images and the comparison with the fixed-window PC methods, the iterative scheme with fixed variation strategy, and a sophisticated implementation using global optimization demonstrate the superiority and reliability of the proposed scheme. |
| first_indexed | 2024-12-21T08:37:09Z |
| format | Article |
| id | doaj.art-38d6214ba55b48a9a9728d35fcf7c87c |
| institution | Directory Open Access Journal |
| issn | 1682-1750 2194-9034 |
| language | English |
| last_indexed | 2024-12-21T08:37:09Z |
| publishDate | 2019-06-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj.art-38d6214ba55b48a9a9728d35fcf7c87c2022-12-21T19:10:02ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342019-06-01XLII-2-W1314715310.5194/isprs-archives-XLII-2-W13-147-2019PRECISE DISPARITY ESTIMATION FOR NARROW BASELINE STEREO BASED ON MULTISCALE SUPERPIXELS AND PHASE CORRELATIONZ. Ye0Y. Xu1L. Hoegner2X. Tong3U. Stilla4Photogrammetry and Remote Sensing, Technische Universität München, 80333 Munich, GermanyPhotogrammetry and Remote Sensing, Technische Universität München, 80333 Munich, GermanyPhotogrammetry and Remote Sensing, Technische Universität München, 80333 Munich, GermanyCollege of Surveying and Geo-Informatics, Tongji University, Shanghai 200092, ChinaPhotogrammetry and Remote Sensing, Technische Universität München, 80333 Munich, GermanyWith the rapid development of subpixel matching algorithms, the estimation of image shifts with an accuracy of higher than 0.05 pixels is achieved, which makes the narrow baseline stereovision possible. Based on the subpixel matching algorithm using the robust phase correlation (PC), in this work, we present a novel hierarchical and adaptive disparity estimation scheme for narrow baseline stereo, which consists of three main steps: image coregistration, pixel-level disparity estimation, and subpixel refinement. The Fourier-Mellin transform with subpixel PC is used to co-register two input images. Then, the pixel-level disparities are estimated in an iterative manner, which is achieved through multiscale superpixels. The pixel-level PC is performed with the window sizes and locations adaptively determined according to superpixels, with the disparity values calcualted. Fast weighted median filtering based on edge-aware filter is adopted to refine the disparity results. At last, the accurate disparities are calculated via a robust subpixel PC method. The combination of multiscale superpixel hierarchy, adaptive determination of the window size and location of correlation, fast weighted median filtering and subpixel PC make the proposed scheme be able to overcome the issues of either low-texture areas or fattening effect. Experimental results on a pair of UAV images and the comparison with the fixed-window PC methods, the iterative scheme with fixed variation strategy, and a sophisticated implementation using global optimization demonstrate the superiority and reliability of the proposed scheme.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2-W13/147/2019/isprs-archives-XLII-2-W13-147-2019.pdf |
| spellingShingle | Z. Ye Y. Xu L. Hoegner X. Tong U. Stilla PRECISE DISPARITY ESTIMATION FOR NARROW BASELINE STEREO BASED ON MULTISCALE SUPERPIXELS AND PHASE CORRELATION The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | PRECISE DISPARITY ESTIMATION FOR NARROW BASELINE STEREO BASED ON MULTISCALE SUPERPIXELS AND PHASE CORRELATION |
| title_full | PRECISE DISPARITY ESTIMATION FOR NARROW BASELINE STEREO BASED ON MULTISCALE SUPERPIXELS AND PHASE CORRELATION |
| title_fullStr | PRECISE DISPARITY ESTIMATION FOR NARROW BASELINE STEREO BASED ON MULTISCALE SUPERPIXELS AND PHASE CORRELATION |
| title_full_unstemmed | PRECISE DISPARITY ESTIMATION FOR NARROW BASELINE STEREO BASED ON MULTISCALE SUPERPIXELS AND PHASE CORRELATION |
| title_short | PRECISE DISPARITY ESTIMATION FOR NARROW BASELINE STEREO BASED ON MULTISCALE SUPERPIXELS AND PHASE CORRELATION |
| title_sort | precise disparity estimation for narrow baseline stereo based on multiscale superpixels and phase correlation |
| url | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2-W13/147/2019/isprs-archives-XLII-2-W13-147-2019.pdf |
| work_keys_str_mv | AT zye precisedisparityestimationfornarrowbaselinestereobasedonmultiscalesuperpixelsandphasecorrelation AT yxu precisedisparityestimationfornarrowbaselinestereobasedonmultiscalesuperpixelsandphasecorrelation AT lhoegner precisedisparityestimationfornarrowbaselinestereobasedonmultiscalesuperpixelsandphasecorrelation AT xtong precisedisparityestimationfornarrowbaselinestereobasedonmultiscalesuperpixelsandphasecorrelation AT ustilla precisedisparityestimationfornarrowbaselinestereobasedonmultiscalesuperpixelsandphasecorrelation |