Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement
We propose a novel real-time video stitching method using camera path estimation and homography refinement. The method can stably stitch multiple frames acquired from moving cameras in real time. In the proposed method, one initial between-camera (BC) homography and each camera path (CP) homography...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2017-12-01
|
Series: | Symmetry |
Subjects: | |
Online Access: | https://www.mdpi.com/2073-8994/10/1/4 |
_version_ | 1797999817117401088 |
---|---|
author | Jaeyoung Yoon Daeho Lee |
author_facet | Jaeyoung Yoon Daeho Lee |
author_sort | Jaeyoung Yoon |
collection | DOAJ |
description | We propose a novel real-time video stitching method using camera path estimation and homography refinement. The method can stably stitch multiple frames acquired from moving cameras in real time. In the proposed method, one initial between-camera (BC) homography and each camera path (CP) homography are used to estimate the BC homography at every frame. The BC homography is refined by using block matching to adjust the errors of estimated CPs (homography refinement). For fast processing, we extract features using the difference of intensities and use the optical flow to estimate camera motion (CM) homographies, which are multiplied with the previous CMs to calculate CPs (camera path estimations). In experiments, we demonstrated the performance of the CP estimation and homography refinement approach by comparing it with other methods. The experimental results show that the proposed method can stably stitch two image sequences at a rate exceeding 13 fps (frames per second). |
first_indexed | 2024-04-11T11:10:45Z |
format | Article |
id | doaj.art-71aa4c40a12f49c18a060abd897e3bac |
institution | Directory Open Access Journal |
issn | 2073-8994 |
language | English |
last_indexed | 2024-04-11T11:10:45Z |
publishDate | 2017-12-01 |
publisher | MDPI AG |
record_format | Article |
series | Symmetry |
spelling | doaj.art-71aa4c40a12f49c18a060abd897e3bac2022-12-22T04:27:28ZengMDPI AGSymmetry2073-89942017-12-01101410.3390/sym10010004sym10010004Real-Time Video Stitching Using Camera Path Estimation and Homography RefinementJaeyoung Yoon0Daeho Lee1Department of Electronics Engineering, Kyung Hee University, Yongin 17104, KoreaHumanitas College, Kyung Hee University, Yongin 17104, KoreaWe propose a novel real-time video stitching method using camera path estimation and homography refinement. The method can stably stitch multiple frames acquired from moving cameras in real time. In the proposed method, one initial between-camera (BC) homography and each camera path (CP) homography are used to estimate the BC homography at every frame. The BC homography is refined by using block matching to adjust the errors of estimated CPs (homography refinement). For fast processing, we extract features using the difference of intensities and use the optical flow to estimate camera motion (CM) homographies, which are multiplied with the previous CMs to calculate CPs (camera path estimations). In experiments, we demonstrated the performance of the CP estimation and homography refinement approach by comparing it with other methods. The experimental results show that the proposed method can stably stitch two image sequences at a rate exceeding 13 fps (frames per second).https://www.mdpi.com/2073-8994/10/1/4image stitchingvideo stitchingcamera path estimationoptical flow |
spellingShingle | Jaeyoung Yoon Daeho Lee Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement Symmetry image stitching video stitching camera path estimation optical flow |
title | Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement |
title_full | Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement |
title_fullStr | Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement |
title_full_unstemmed | Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement |
title_short | Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement |
title_sort | real time video stitching using camera path estimation and homography refinement |
topic | image stitching video stitching camera path estimation optical flow |
url | https://www.mdpi.com/2073-8994/10/1/4 |
work_keys_str_mv | AT jaeyoungyoon realtimevideostitchingusingcamerapathestimationandhomographyrefinement AT daeholee realtimevideostitchingusingcamerapathestimationandhomographyrefinement |