A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder Network

Camera shakes cause video motion blur. Video deblurring has been studied for years, and however, there are still unresolved problems, such as video frame alignment, frame selection, and frame ambiguity evaluation. We propose a video deblurring algorithm based on the motion vector and an encoder-deco...

Full description

Bibliographic Details
Main Authors: Shanqing Zhang, Pengcheng Li, Yiheng Meng, Li Li, Qili Zhou, Xiaofeng Fu
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8747422/
_version_ 1818737280090636288
author Shanqing Zhang
Pengcheng Li
Yiheng Meng
Li Li
Qili Zhou
Xiaofeng Fu
author_facet Shanqing Zhang
Pengcheng Li
Yiheng Meng
Li Li
Qili Zhou
Xiaofeng Fu
author_sort Shanqing Zhang
collection DOAJ
description Camera shakes cause video motion blur. Video deblurring has been studied for years, and however, there are still unresolved problems, such as video frame alignment, frame selection, and frame ambiguity evaluation. We propose a video deblurring algorithm based on the motion vector and an encoder-decoder network. Our algorithm consists of four steps: first, the blurry image blocks in a video frame are located using a blurred image quality evaluation algorithm based on a response function of singular values. Second, the corresponding candidates of the blurry image block in the consecutive frames are searched using the motion vector, and the optimal candidate blocks are obtained using an objective function. Third, the blurry image block and the optimal candidate blocks are served as samples, which are inputted to an encoder-decoder network, so that the blurry image block is repaired. Finally, all blurry image blocks are replaced with the repaired ones, the boundary artifacts are eliminated, and the entire video frame is repaired. The experiments show that our algorithm yields sharper repair results, and the overall performance of our algorithm is better than other related algorithms.
first_indexed 2024-12-18T00:50:32Z
format Article
id doaj.art-fcc1d91c2fe448ec8a750d5104fd1f08
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-18T00:50:32Z
publishDate 2019-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-fcc1d91c2fe448ec8a750d5104fd1f082022-12-21T21:26:42ZengIEEEIEEE Access2169-35362019-01-017867788678810.1109/ACCESS.2019.29237598747422A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder NetworkShanqing Zhang0Pengcheng Li1Yiheng Meng2https://orcid.org/0000-0002-6072-935XLi Li3Qili Zhou4Xiaofeng Fu5School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, ChinaSchool of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, ChinaSchool of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, ChinaSchool of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, ChinaSchool of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, ChinaSchool of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, ChinaCamera shakes cause video motion blur. Video deblurring has been studied for years, and however, there are still unresolved problems, such as video frame alignment, frame selection, and frame ambiguity evaluation. We propose a video deblurring algorithm based on the motion vector and an encoder-decoder network. Our algorithm consists of four steps: first, the blurry image blocks in a video frame are located using a blurred image quality evaluation algorithm based on a response function of singular values. Second, the corresponding candidates of the blurry image block in the consecutive frames are searched using the motion vector, and the optimal candidate blocks are obtained using an objective function. Third, the blurry image block and the optimal candidate blocks are served as samples, which are inputted to an encoder-decoder network, so that the blurry image block is repaired. Finally, all blurry image blocks are replaced with the repaired ones, the boundary artifacts are eliminated, and the entire video frame is repaired. The experiments show that our algorithm yields sharper repair results, and the overall performance of our algorithm is better than other related algorithms.https://ieeexplore.ieee.org/document/8747422/Video deblurringblur quality evaluationmotion vectorencoder-decoder network
spellingShingle Shanqing Zhang
Pengcheng Li
Yiheng Meng
Li Li
Qili Zhou
Xiaofeng Fu
A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder Network
IEEE Access
Video deblurring
blur quality evaluation
motion vector
encoder-decoder network
title A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder Network
title_full A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder Network
title_fullStr A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder Network
title_full_unstemmed A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder Network
title_short A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder Network
title_sort video deblurring algorithm based on motion vector and an encorder decoder network
topic Video deblurring
blur quality evaluation
motion vector
encoder-decoder network
url https://ieeexplore.ieee.org/document/8747422/
work_keys_str_mv AT shanqingzhang avideodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork
AT pengchengli avideodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork
AT yihengmeng avideodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork
AT lili avideodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork
AT qilizhou avideodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork
AT xiaofengfu avideodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork
AT shanqingzhang videodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork
AT pengchengli videodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork
AT yihengmeng videodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork
AT lili videodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork
AT qilizhou videodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork
AT xiaofengfu videodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork