A deep learning method for fog removal in image

Fog removal has always been a vital issue in image and video processing. With the development of various vision-based applications (e.g. photography, video surveillance and autonomous driving), images and videos are of essential importance to extract useful scene information. However, real-world sce...

Full description

Bibliographic Details
Main Author: Guo, Dongfang
Other Authors: Chau Lap Pui
Format: Thesis
Language:English
Published: 2019
Subjects:
Online Access:http://hdl.handle.net/10356/78419
_version_ 1811696908469534720
author Guo, Dongfang
author2 Chau Lap Pui
author_facet Chau Lap Pui
Guo, Dongfang
author_sort Guo, Dongfang
collection NTU
description Fog removal has always been a vital issue in image and video processing. With the development of various vision-based applications (e.g. photography, video surveillance and autonomous driving), images and videos are of essential importance to extract useful scene information. However, real-world scenes are sometimes obscured by fog, suffering from degraded visibility, color distortion and low contrast. Therefore, fog removal is significant mean in real-world image pre-processing for many vision tasks. Inspired by the considerable improvement in vision tasks brought by deep learning, we propose a deep learning method for fog removal in image. The method is a novel end-to-end model of convolutional neural networks. We use a densely connected network with pyramid pooling and a U-net to predict the transmission map and atmospheric light respectively, and do fog removal via the atmospheric scattering model. Moreover, we design a jointly-refining module based on generative adversarial network to further strengthen the mutual structural correlation between the fog-removed images and their responding predicted transmission maps. Both quantitative evaluation on synthetic dataset and qualitative evaluation on synthetic and real-life dataset are conducted to evaluate the results. To better demonstrate the effectiveness, results of several previous methods and ours are displayed together for comparison. The evaluations show our advancement in performance, with better visibility, less distortion and more true-to-nature restoration results.
first_indexed 2024-10-01T07:46:50Z
format Thesis
id ntu-10356/78419
institution Nanyang Technological University
language English
last_indexed 2024-10-01T07:46:50Z
publishDate 2019
record_format dspace
spelling ntu-10356/784192023-07-04T16:23:02Z A deep learning method for fog removal in image Guo, Dongfang Chau Lap Pui School of Electrical and Electronic Engineering DRNTU::Engineering::Electrical and electronic engineering Fog removal has always been a vital issue in image and video processing. With the development of various vision-based applications (e.g. photography, video surveillance and autonomous driving), images and videos are of essential importance to extract useful scene information. However, real-world scenes are sometimes obscured by fog, suffering from degraded visibility, color distortion and low contrast. Therefore, fog removal is significant mean in real-world image pre-processing for many vision tasks. Inspired by the considerable improvement in vision tasks brought by deep learning, we propose a deep learning method for fog removal in image. The method is a novel end-to-end model of convolutional neural networks. We use a densely connected network with pyramid pooling and a U-net to predict the transmission map and atmospheric light respectively, and do fog removal via the atmospheric scattering model. Moreover, we design a jointly-refining module based on generative adversarial network to further strengthen the mutual structural correlation between the fog-removed images and their responding predicted transmission maps. Both quantitative evaluation on synthetic dataset and qualitative evaluation on synthetic and real-life dataset are conducted to evaluate the results. To better demonstrate the effectiveness, results of several previous methods and ours are displayed together for comparison. The evaluations show our advancement in performance, with better visibility, less distortion and more true-to-nature restoration results. Master of Science (Communications Engineering) 2019-06-19T14:06:38Z 2019-06-19T14:06:38Z 2019 Thesis http://hdl.handle.net/10356/78419 en 64 p. application/pdf
spellingShingle DRNTU::Engineering::Electrical and electronic engineering
Guo, Dongfang
A deep learning method for fog removal in image
title A deep learning method for fog removal in image
title_full A deep learning method for fog removal in image
title_fullStr A deep learning method for fog removal in image
title_full_unstemmed A deep learning method for fog removal in image
title_short A deep learning method for fog removal in image
title_sort deep learning method for fog removal in image
topic DRNTU::Engineering::Electrical and electronic engineering
url http://hdl.handle.net/10356/78419
work_keys_str_mv AT guodongfang adeeplearningmethodforfogremovalinimage
AT guodongfang deeplearningmethodforfogremovalinimage