Stitching for Multi-View Videos With Large Parallax Based on Adaptive Pixel Warping
Conventional stitching techniques for images and videos are based on smooth warping models, and therefore, they often fail to work on multi-view images and videos with large parallax captured by cameras with wide baselines. In this paper, we propose a novel video stitching algorithm for such challen...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2018-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/8357884/ |
| _version_ | 1819172084334460928 |
|---|---|
| author | Kyu-Yul Lee Jae-Young Sim |
| author_facet | Kyu-Yul Lee Jae-Young Sim |
| author_sort | Kyu-Yul Lee |
| collection | DOAJ |
| description | Conventional stitching techniques for images and videos are based on smooth warping models, and therefore, they often fail to work on multi-view images and videos with large parallax captured by cameras with wide baselines. In this paper, we propose a novel video stitching algorithm for such challenging multi-view videos. We estimate the parameters of ground plane homography, fundamental matrix, and vertical vanishing points reliably, using both of the appearance and activity-based feature matches validated by geometric constraints. We alleviate the parallax artifacts in stitching by adaptively warping the off-plane pixels into geometrically accurate matching positions through their ground plane pixels based on the epipolar geometry. We also exploit the inter-view and inter-frame correspondence matching information together to estimate the ground plane pixels reliably, which are then refined by energy minimization. Experimental results show that the proposed algorithm provides geometrically accurate stitching results of multi-view videos with large parallax and outperforms the state-of-the-art stitching methods qualitatively and quantitatively. |
| first_indexed | 2024-12-22T20:01:33Z |
| format | Article |
| id | doaj.art-7cbd52da78a0447997758607e912712e |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-22T20:01:33Z |
| publishDate | 2018-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-7cbd52da78a0447997758607e912712e2022-12-21T18:14:16ZengIEEEIEEE Access2169-35362018-01-016269042691710.1109/ACCESS.2018.28356598357884Stitching for Multi-View Videos With Large Parallax Based on Adaptive Pixel WarpingKyu-Yul Lee0Jae-Young Sim1https://orcid.org/0000-0003-2636-7444School of Electrical and Computer Engineering, Ulsan National Institute of Science and Technology, Ulsan, South KoreaSchool of Electrical and Computer Engineering, Ulsan National Institute of Science and Technology, Ulsan, South KoreaConventional stitching techniques for images and videos are based on smooth warping models, and therefore, they often fail to work on multi-view images and videos with large parallax captured by cameras with wide baselines. In this paper, we propose a novel video stitching algorithm for such challenging multi-view videos. We estimate the parameters of ground plane homography, fundamental matrix, and vertical vanishing points reliably, using both of the appearance and activity-based feature matches validated by geometric constraints. We alleviate the parallax artifacts in stitching by adaptively warping the off-plane pixels into geometrically accurate matching positions through their ground plane pixels based on the epipolar geometry. We also exploit the inter-view and inter-frame correspondence matching information together to estimate the ground plane pixels reliably, which are then refined by energy minimization. Experimental results show that the proposed algorithm provides geometrically accurate stitching results of multi-view videos with large parallax and outperforms the state-of-the-art stitching methods qualitatively and quantitatively.https://ieeexplore.ieee.org/document/8357884/Multi-view videosvideo stitchingimage stitchinglarge parallaxadaptive pixel warpingepipolar geometry |
| spellingShingle | Kyu-Yul Lee Jae-Young Sim Stitching for Multi-View Videos With Large Parallax Based on Adaptive Pixel Warping IEEE Access Multi-view videos video stitching image stitching large parallax adaptive pixel warping epipolar geometry |
| title | Stitching for Multi-View Videos With Large Parallax Based on Adaptive Pixel Warping |
| title_full | Stitching for Multi-View Videos With Large Parallax Based on Adaptive Pixel Warping |
| title_fullStr | Stitching for Multi-View Videos With Large Parallax Based on Adaptive Pixel Warping |
| title_full_unstemmed | Stitching for Multi-View Videos With Large Parallax Based on Adaptive Pixel Warping |
| title_short | Stitching for Multi-View Videos With Large Parallax Based on Adaptive Pixel Warping |
| title_sort | stitching for multi view videos with large parallax based on adaptive pixel warping |
| topic | Multi-view videos video stitching image stitching large parallax adaptive pixel warping epipolar geometry |
| url | https://ieeexplore.ieee.org/document/8357884/ |
| work_keys_str_mv | AT kyuyullee stitchingformultiviewvideoswithlargeparallaxbasedonadaptivepixelwarping AT jaeyoungsim stitchingformultiviewvideoswithlargeparallaxbasedonadaptivepixelwarping |