Semantic Information Supplementary Pyramid Network for Dynamic Scene Deblurring

The algorithm in this paper is called semantic information supplementary pyramid network(SIS-net). We choose Generative Adversarial Network (GAN) as its fundamental model. SIS-net's generator imitates the feature pyramid network (FPN) structure to recycle features spanning across multiple recep...

Full description

Bibliographic Details
Main Authors: Yiming Liu, Yifei Luo, Wenzhuo Huang, Ying Qiao, Junhui Li, Dahong Xu, Duqiang Luo
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9214402/
Description
Summary:The algorithm in this paper is called semantic information supplementary pyramid network(SIS-net). We choose Generative Adversarial Network (GAN) as its fundamental model. SIS-net's generator imitates the feature pyramid network (FPN) structure to recycle features spanning across multiple receptive scales to restore a sharp image. However, to solve the problem caused by the phenomenon of semantic dilution in the FPN network, we have innovatively designed a semantic information supplement (SIS) mechanism. SIS mechanism contains two essential components: semantic information storage box (info-box) and feature fusion expanding. In the process of feature fusion expanding, the semantic information features coming from the info-box is supplemented to make greater use of detailed clues. In addition, SIS-net uses the intermediate layer path to extract image features in a single time to obtain a multi-scale effect. The running speed of SIS-net has obvious advantages over other algorithms, and can basically complete real-time deblurring tasks. Extensive experiments show that our SIS-net achieves both qualitative and quantitative improvements against state-of-the-art methods. The code is available at https://github.com/yimingliu123/SIS-NET.
ISSN:2169-3536