A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder Network
Camera shakes cause video motion blur. Video deblurring has been studied for years, and however, there are still unresolved problems, such as video frame alignment, frame selection, and frame ambiguity evaluation. We propose a video deblurring algorithm based on the motion vector and an encoder-deco...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2019-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/8747422/ |
_version_ | 1818737280090636288 |
---|---|
author | Shanqing Zhang Pengcheng Li Yiheng Meng Li Li Qili Zhou Xiaofeng Fu |
author_facet | Shanqing Zhang Pengcheng Li Yiheng Meng Li Li Qili Zhou Xiaofeng Fu |
author_sort | Shanqing Zhang |
collection | DOAJ |
description | Camera shakes cause video motion blur. Video deblurring has been studied for years, and however, there are still unresolved problems, such as video frame alignment, frame selection, and frame ambiguity evaluation. We propose a video deblurring algorithm based on the motion vector and an encoder-decoder network. Our algorithm consists of four steps: first, the blurry image blocks in a video frame are located using a blurred image quality evaluation algorithm based on a response function of singular values. Second, the corresponding candidates of the blurry image block in the consecutive frames are searched using the motion vector, and the optimal candidate blocks are obtained using an objective function. Third, the blurry image block and the optimal candidate blocks are served as samples, which are inputted to an encoder-decoder network, so that the blurry image block is repaired. Finally, all blurry image blocks are replaced with the repaired ones, the boundary artifacts are eliminated, and the entire video frame is repaired. The experiments show that our algorithm yields sharper repair results, and the overall performance of our algorithm is better than other related algorithms. |
first_indexed | 2024-12-18T00:50:32Z |
format | Article |
id | doaj.art-fcc1d91c2fe448ec8a750d5104fd1f08 |
institution | Directory Open Access Journal |
issn | 2169-3536 |
language | English |
last_indexed | 2024-12-18T00:50:32Z |
publishDate | 2019-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj.art-fcc1d91c2fe448ec8a750d5104fd1f082022-12-21T21:26:42ZengIEEEIEEE Access2169-35362019-01-017867788678810.1109/ACCESS.2019.29237598747422A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder NetworkShanqing Zhang0Pengcheng Li1Yiheng Meng2https://orcid.org/0000-0002-6072-935XLi Li3Qili Zhou4Xiaofeng Fu5School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, ChinaSchool of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, ChinaSchool of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, ChinaSchool of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, ChinaSchool of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, ChinaSchool of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, ChinaCamera shakes cause video motion blur. Video deblurring has been studied for years, and however, there are still unresolved problems, such as video frame alignment, frame selection, and frame ambiguity evaluation. We propose a video deblurring algorithm based on the motion vector and an encoder-decoder network. Our algorithm consists of four steps: first, the blurry image blocks in a video frame are located using a blurred image quality evaluation algorithm based on a response function of singular values. Second, the corresponding candidates of the blurry image block in the consecutive frames are searched using the motion vector, and the optimal candidate blocks are obtained using an objective function. Third, the blurry image block and the optimal candidate blocks are served as samples, which are inputted to an encoder-decoder network, so that the blurry image block is repaired. Finally, all blurry image blocks are replaced with the repaired ones, the boundary artifacts are eliminated, and the entire video frame is repaired. The experiments show that our algorithm yields sharper repair results, and the overall performance of our algorithm is better than other related algorithms.https://ieeexplore.ieee.org/document/8747422/Video deblurringblur quality evaluationmotion vectorencoder-decoder network |
spellingShingle | Shanqing Zhang Pengcheng Li Yiheng Meng Li Li Qili Zhou Xiaofeng Fu A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder Network IEEE Access Video deblurring blur quality evaluation motion vector encoder-decoder network |
title | A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder Network |
title_full | A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder Network |
title_fullStr | A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder Network |
title_full_unstemmed | A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder Network |
title_short | A Video Deblurring Algorithm Based on Motion Vector and An Encorder-Decoder Network |
title_sort | video deblurring algorithm based on motion vector and an encorder decoder network |
topic | Video deblurring blur quality evaluation motion vector encoder-decoder network |
url | https://ieeexplore.ieee.org/document/8747422/ |
work_keys_str_mv | AT shanqingzhang avideodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork AT pengchengli avideodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork AT yihengmeng avideodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork AT lili avideodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork AT qilizhou avideodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork AT xiaofengfu avideodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork AT shanqingzhang videodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork AT pengchengli videodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork AT yihengmeng videodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork AT lili videodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork AT qilizhou videodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork AT xiaofengfu videodeblurringalgorithmbasedonmotionvectorandanencorderdecodernetwork |