AP Shadow Net: A Remote Sensing Shadow Removal Network Based on Atmospheric Transport and Poisson’s Equation

Shadow is one of the fundamental indicators of remote sensing image which could cause loss or interference of the target data. As a result, the detection and removal of shadow has already been the hotspot of current study because of the complicated background information. In the following passage, a...

Full description

Bibliographic Details
Main Authors: Fan Li, Zhiyi Wang, Guoliang He
Format: Article
Language:English
Published: MDPI AG 2022-09-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/24/9/1301
_version_ 1827661219036659712
author Fan Li
Zhiyi Wang
Guoliang He
author_facet Fan Li
Zhiyi Wang
Guoliang He
author_sort Fan Li
collection DOAJ
description Shadow is one of the fundamental indicators of remote sensing image which could cause loss or interference of the target data. As a result, the detection and removal of shadow has already been the hotspot of current study because of the complicated background information. In the following passage, a model combining the Atmospheric Transport Model (hereinafter abbreviated as ATM) with the Poisson Equation, AP ShadowNet, is proposed for the shadow detection and removal of remote sensing images by unsupervised learning. This network based on a preprocessing network based on ATM, A Net, and a network based on the Poisson Equation, P Net. Firstly, corresponding mapping between shadow and unshaded area is generated by the ATM. The brightened image will then enter the Confrontation identification in the P Net. Lastly, the reconstructed image is optimized on color consistency and edge transition by Poisson Equation. At present, most shadow removal models based on neural networks are significantly data-driven. Fortunately, by the model in this passage, the unsupervised shadow detection and removal could be released from the data source restrictions from the remote sensing images themselves. By verifying the shadow removal on our model, the result shows a satisfying effect from a both qualitative and quantitative angle. From a qualitative point of view, our results have a prominent effect on tone consistency and removal of detailed shadows. From the quantitative point of view, we adopt the non-reference evaluation indicators: gradient structure similarity (NRSS) and Natural Image Quality Evaluator (NIQE). Combining various evaluation factors such as reasoning speed and memory occupation, it shows that it is outstanding among other current algorithms.
first_indexed 2024-03-10T00:05:24Z
format Article
id doaj.art-88aa80ab98f1462985d06a644e2b0887
institution Directory Open Access Journal
issn 1099-4300
language English
last_indexed 2024-03-10T00:05:24Z
publishDate 2022-09-01
publisher MDPI AG
record_format Article
series Entropy
spelling doaj.art-88aa80ab98f1462985d06a644e2b08872023-11-23T16:09:22ZengMDPI AGEntropy1099-43002022-09-01249130110.3390/e24091301AP Shadow Net: A Remote Sensing Shadow Removal Network Based on Atmospheric Transport and Poisson’s EquationFan Li0Zhiyi Wang1Guoliang He2School of Mathematical Sciences, University of Electronic Science and Technology of China, Chengdu 611731, ChinaUoG-UESTC Joint School, University of Electronic Science and Technology of China, Chengdu 611731, ChinaSchool of Mathematical Sciences, University of Electronic Science and Technology of China, Chengdu 611731, ChinaShadow is one of the fundamental indicators of remote sensing image which could cause loss or interference of the target data. As a result, the detection and removal of shadow has already been the hotspot of current study because of the complicated background information. In the following passage, a model combining the Atmospheric Transport Model (hereinafter abbreviated as ATM) with the Poisson Equation, AP ShadowNet, is proposed for the shadow detection and removal of remote sensing images by unsupervised learning. This network based on a preprocessing network based on ATM, A Net, and a network based on the Poisson Equation, P Net. Firstly, corresponding mapping between shadow and unshaded area is generated by the ATM. The brightened image will then enter the Confrontation identification in the P Net. Lastly, the reconstructed image is optimized on color consistency and edge transition by Poisson Equation. At present, most shadow removal models based on neural networks are significantly data-driven. Fortunately, by the model in this passage, the unsupervised shadow detection and removal could be released from the data source restrictions from the remote sensing images themselves. By verifying the shadow removal on our model, the result shows a satisfying effect from a both qualitative and quantitative angle. From a qualitative point of view, our results have a prominent effect on tone consistency and removal of detailed shadows. From the quantitative point of view, we adopt the non-reference evaluation indicators: gradient structure similarity (NRSS) and Natural Image Quality Evaluator (NIQE). Combining various evaluation factors such as reasoning speed and memory occupation, it shows that it is outstanding among other current algorithms.https://www.mdpi.com/1099-4300/24/9/1301remote sensing imageshadow detection and removalatmospheric transport modelPoisson equationdeep learning
spellingShingle Fan Li
Zhiyi Wang
Guoliang He
AP Shadow Net: A Remote Sensing Shadow Removal Network Based on Atmospheric Transport and Poisson’s Equation
Entropy
remote sensing image
shadow detection and removal
atmospheric transport model
Poisson equation
deep learning
title AP Shadow Net: A Remote Sensing Shadow Removal Network Based on Atmospheric Transport and Poisson’s Equation
title_full AP Shadow Net: A Remote Sensing Shadow Removal Network Based on Atmospheric Transport and Poisson’s Equation
title_fullStr AP Shadow Net: A Remote Sensing Shadow Removal Network Based on Atmospheric Transport and Poisson’s Equation
title_full_unstemmed AP Shadow Net: A Remote Sensing Shadow Removal Network Based on Atmospheric Transport and Poisson’s Equation
title_short AP Shadow Net: A Remote Sensing Shadow Removal Network Based on Atmospheric Transport and Poisson’s Equation
title_sort ap shadow net a remote sensing shadow removal network based on atmospheric transport and poisson s equation
topic remote sensing image
shadow detection and removal
atmospheric transport model
Poisson equation
deep learning
url https://www.mdpi.com/1099-4300/24/9/1301
work_keys_str_mv AT fanli apshadownetaremotesensingshadowremovalnetworkbasedonatmospherictransportandpoissonsequation
AT zhiyiwang apshadownetaremotesensingshadowremovalnetworkbasedonatmospherictransportandpoissonsequation
AT guolianghe apshadownetaremotesensingshadowremovalnetworkbasedonatmospherictransportandpoissonsequation