Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement

We propose a novel real-time video stitching method using camera path estimation and homography refinement. The method can stably stitch multiple frames acquired from moving cameras in real time. In the proposed method, one initial between-camera (BC) homography and each camera path (CP) homography...

Full description

Bibliographic Details
Main Authors: Jaeyoung Yoon, Daeho Lee
Format: Article
Language:English
Published: MDPI AG 2017-12-01
Series:Symmetry
Subjects:
Online Access:https://www.mdpi.com/2073-8994/10/1/4
_version_ 1797999817117401088
author Jaeyoung Yoon
Daeho Lee
author_facet Jaeyoung Yoon
Daeho Lee
author_sort Jaeyoung Yoon
collection DOAJ
description We propose a novel real-time video stitching method using camera path estimation and homography refinement. The method can stably stitch multiple frames acquired from moving cameras in real time. In the proposed method, one initial between-camera (BC) homography and each camera path (CP) homography are used to estimate the BC homography at every frame. The BC homography is refined by using block matching to adjust the errors of estimated CPs (homography refinement). For fast processing, we extract features using the difference of intensities and use the optical flow to estimate camera motion (CM) homographies, which are multiplied with the previous CMs to calculate CPs (camera path estimations). In experiments, we demonstrated the performance of the CP estimation and homography refinement approach by comparing it with other methods. The experimental results show that the proposed method can stably stitch two image sequences at a rate exceeding 13 fps (frames per second).
first_indexed 2024-04-11T11:10:45Z
format Article
id doaj.art-71aa4c40a12f49c18a060abd897e3bac
institution Directory Open Access Journal
issn 2073-8994
language English
last_indexed 2024-04-11T11:10:45Z
publishDate 2017-12-01
publisher MDPI AG
record_format Article
series Symmetry
spelling doaj.art-71aa4c40a12f49c18a060abd897e3bac2022-12-22T04:27:28ZengMDPI AGSymmetry2073-89942017-12-01101410.3390/sym10010004sym10010004Real-Time Video Stitching Using Camera Path Estimation and Homography RefinementJaeyoung Yoon0Daeho Lee1Department of Electronics Engineering, Kyung Hee University, Yongin 17104, KoreaHumanitas College, Kyung Hee University, Yongin 17104, KoreaWe propose a novel real-time video stitching method using camera path estimation and homography refinement. The method can stably stitch multiple frames acquired from moving cameras in real time. In the proposed method, one initial between-camera (BC) homography and each camera path (CP) homography are used to estimate the BC homography at every frame. The BC homography is refined by using block matching to adjust the errors of estimated CPs (homography refinement). For fast processing, we extract features using the difference of intensities and use the optical flow to estimate camera motion (CM) homographies, which are multiplied with the previous CMs to calculate CPs (camera path estimations). In experiments, we demonstrated the performance of the CP estimation and homography refinement approach by comparing it with other methods. The experimental results show that the proposed method can stably stitch two image sequences at a rate exceeding 13 fps (frames per second).https://www.mdpi.com/2073-8994/10/1/4image stitchingvideo stitchingcamera path estimationoptical flow
spellingShingle Jaeyoung Yoon
Daeho Lee
Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement
Symmetry
image stitching
video stitching
camera path estimation
optical flow
title Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement
title_full Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement
title_fullStr Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement
title_full_unstemmed Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement
title_short Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement
title_sort real time video stitching using camera path estimation and homography refinement
topic image stitching
video stitching
camera path estimation
optical flow
url https://www.mdpi.com/2073-8994/10/1/4
work_keys_str_mv AT jaeyoungyoon realtimevideostitchingusingcamerapathestimationandhomographyrefinement
AT daeholee realtimevideostitchingusingcamerapathestimationandhomographyrefinement