Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware Accelerator

In recent years, machine vision algorithms have played an influential role as core technologies in several practical applications, such as surveillance, autonomous driving, and object recognition/localization. However, as almost all such algorithms are applicable to clear weather conditions, their p...

Full description

Bibliographic Details
Main Authors: Dat Ngo, Seungmin Lee, Gi-Dong Lee, Bongsoon Kang
Format: Article
Language:English
Published: MDPI AG 2020-10-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/20/5795
_version_ 1797551060671266816
author Dat Ngo
Seungmin Lee
Gi-Dong Lee
Bongsoon Kang
author_facet Dat Ngo
Seungmin Lee
Gi-Dong Lee
Bongsoon Kang
author_sort Dat Ngo
collection DOAJ
description In recent years, machine vision algorithms have played an influential role as core technologies in several practical applications, such as surveillance, autonomous driving, and object recognition/localization. However, as almost all such algorithms are applicable to clear weather conditions, their performance is severely affected by any atmospheric turbidity. Several image visibility restoration algorithms have been proposed to address this issue, and they have proven to be a highly efficient solution. This paper proposes a novel method to recover clear images from degraded ones. To this end, the proposed algorithm uses a supervised machine learning-based technique to estimate the pixel-wise extinction coefficients of the transmission medium and a novel compensation scheme to rectify the post-dehazing false enlargement of white objects. Also, a corresponding hardware accelerator implemented on a Field Programmable Gate Array chip is in order for facilitating real-time processing, a critical requirement of practical camera-based systems. Experimental results on both synthetic and real image datasets verified the proposed method’s superiority over existing benchmark approaches. Furthermore, the hardware synthesis results revealed that the accelerator exhibits a processing rate of nearly 271.67 Mpixel/s, enabling it to process 4K videos at 30.7 frames per second in real time.
first_indexed 2024-03-10T15:39:23Z
format Article
id doaj.art-5375a47065ff4152a5c0e7a953b0c4e4
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T15:39:23Z
publishDate 2020-10-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-5375a47065ff4152a5c0e7a953b0c4e42023-11-20T16:56:52ZengMDPI AGSensors1424-82202020-10-012020579510.3390/s20205795Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware AcceleratorDat Ngo0Seungmin Lee1Gi-Dong Lee2Bongsoon Kang3Department of Electronics Engineering, Dong-A University, Busan 49315, KoreaDepartment of Electronics Engineering, Dong-A University, Busan 49315, KoreaDepartment of Electronics Engineering, Dong-A University, Busan 49315, KoreaDepartment of Electronics Engineering, Dong-A University, Busan 49315, KoreaIn recent years, machine vision algorithms have played an influential role as core technologies in several practical applications, such as surveillance, autonomous driving, and object recognition/localization. However, as almost all such algorithms are applicable to clear weather conditions, their performance is severely affected by any atmospheric turbidity. Several image visibility restoration algorithms have been proposed to address this issue, and they have proven to be a highly efficient solution. This paper proposes a novel method to recover clear images from degraded ones. To this end, the proposed algorithm uses a supervised machine learning-based technique to estimate the pixel-wise extinction coefficients of the transmission medium and a novel compensation scheme to rectify the post-dehazing false enlargement of white objects. Also, a corresponding hardware accelerator implemented on a Field Programmable Gate Array chip is in order for facilitating real-time processing, a critical requirement of practical camera-based systems. Experimental results on both synthetic and real image datasets verified the proposed method’s superiority over existing benchmark approaches. Furthermore, the hardware synthesis results revealed that the accelerator exhibits a processing rate of nearly 271.67 Mpixel/s, enabling it to process 4K videos at 30.7 frames per second in real time.https://www.mdpi.com/1424-8220/20/20/5795haze removalmachine learningsupervised learninghardware acceleratorfield programmable gate array
spellingShingle Dat Ngo
Seungmin Lee
Gi-Dong Lee
Bongsoon Kang
Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware Accelerator
Sensors
haze removal
machine learning
supervised learning
hardware accelerator
field programmable gate array
title Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware Accelerator
title_full Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware Accelerator
title_fullStr Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware Accelerator
title_full_unstemmed Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware Accelerator
title_short Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware Accelerator
title_sort single image visibility restoration a machine learning approach and its 4k capable hardware accelerator
topic haze removal
machine learning
supervised learning
hardware accelerator
field programmable gate array
url https://www.mdpi.com/1424-8220/20/20/5795
work_keys_str_mv AT datngo singleimagevisibilityrestorationamachinelearningapproachandits4kcapablehardwareaccelerator
AT seungminlee singleimagevisibilityrestorationamachinelearningapproachandits4kcapablehardwareaccelerator
AT gidonglee singleimagevisibilityrestorationamachinelearningapproachandits4kcapablehardwareaccelerator
AT bongsoonkang singleimagevisibilityrestorationamachinelearningapproachandits4kcapablehardwareaccelerator