Layer Decomposition Learning Based on Gaussian Convolution Model and Residual Deblurring for Inverse Halftoning
Layer decomposition to separate an input image into base and detail layers has been steadily used for image restoration. Existing residual networks based on an additive model require residual layers with a small output range for fast convergence and visual quality improvement. However, in inverse ha...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-07-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/11/15/7006 |
| _version_ | 1797525820470722560 |
|---|---|
| author | Chang-Hwan Son |
| author_facet | Chang-Hwan Son |
| author_sort | Chang-Hwan Son |
| collection | DOAJ |
| description | Layer decomposition to separate an input image into base and detail layers has been steadily used for image restoration. Existing residual networks based on an additive model require residual layers with a small output range for fast convergence and visual quality improvement. However, in inverse halftoning, homogenous dot patterns hinder a small output range from the residual layers. Therefore, a new layer decomposition network based on the Gaussian convolution model (GCM) and a structure-aware deblurring strategy is presented to achieve residual learning for both the base and detail layers. For the base layer, a new GCM-based residual subnetwork is presented. The GCM utilizes a statistical distribution, in which the image difference between a blurred continuous-tone image and a blurred halftoned image with a Gaussian filter can result in a narrow output range. Subsequently, the GCM-based residual subnetwork uses a Gaussian-filtered halftoned image as the input, and outputs the image difference as a residual, thereby generating the base layer, i.e., the Gaussian-blurred continuous-tone image. For the detail layer, a new structure-aware residual deblurring subnetwork (SARDS) is presented. To remove the Gaussian blurring of the base layer, the SARDS uses the predicted base layer as the input, and outputs the deblurred version. To more effectively restore image structures such as lines and text, a new image structure map predictor is incorporated into the deblurring network to induce structure-adaptive learning. This paper provides a method to realize the residual learning of both the base and detail layers based on the GCM and SARDS. In addition, it is verified that the proposed method surpasses state-of-the-art methods based on U-Net, direct deblurring networks, and progressively residual networks. |
| first_indexed | 2024-03-10T09:19:23Z |
| format | Article |
| id | doaj.art-fbccc804807c4ae598eb0e515ac6da9e |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-10T09:19:23Z |
| publishDate | 2021-07-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-fbccc804807c4ae598eb0e515ac6da9e2023-11-22T05:22:58ZengMDPI AGApplied Sciences2076-34172021-07-011115700610.3390/app11157006Layer Decomposition Learning Based on Gaussian Convolution Model and Residual Deblurring for Inverse HalftoningChang-Hwan Son0Department of Software Convergence Engineering, Kunsan National University, Gunsan-si 54150, KoreaLayer decomposition to separate an input image into base and detail layers has been steadily used for image restoration. Existing residual networks based on an additive model require residual layers with a small output range for fast convergence and visual quality improvement. However, in inverse halftoning, homogenous dot patterns hinder a small output range from the residual layers. Therefore, a new layer decomposition network based on the Gaussian convolution model (GCM) and a structure-aware deblurring strategy is presented to achieve residual learning for both the base and detail layers. For the base layer, a new GCM-based residual subnetwork is presented. The GCM utilizes a statistical distribution, in which the image difference between a blurred continuous-tone image and a blurred halftoned image with a Gaussian filter can result in a narrow output range. Subsequently, the GCM-based residual subnetwork uses a Gaussian-filtered halftoned image as the input, and outputs the image difference as a residual, thereby generating the base layer, i.e., the Gaussian-blurred continuous-tone image. For the detail layer, a new structure-aware residual deblurring subnetwork (SARDS) is presented. To remove the Gaussian blurring of the base layer, the SARDS uses the predicted base layer as the input, and outputs the deblurred version. To more effectively restore image structures such as lines and text, a new image structure map predictor is incorporated into the deblurring network to induce structure-adaptive learning. This paper provides a method to realize the residual learning of both the base and detail layers based on the GCM and SARDS. In addition, it is verified that the proposed method surpasses state-of-the-art methods based on U-Net, direct deblurring networks, and progressively residual networks.https://www.mdpi.com/2076-3417/11/15/7006inverse halftoningimage decompositionresidual learningmultiresolution |
| spellingShingle | Chang-Hwan Son Layer Decomposition Learning Based on Gaussian Convolution Model and Residual Deblurring for Inverse Halftoning Applied Sciences inverse halftoning image decomposition residual learning multiresolution |
| title | Layer Decomposition Learning Based on Gaussian Convolution Model and Residual Deblurring for Inverse Halftoning |
| title_full | Layer Decomposition Learning Based on Gaussian Convolution Model and Residual Deblurring for Inverse Halftoning |
| title_fullStr | Layer Decomposition Learning Based on Gaussian Convolution Model and Residual Deblurring for Inverse Halftoning |
| title_full_unstemmed | Layer Decomposition Learning Based on Gaussian Convolution Model and Residual Deblurring for Inverse Halftoning |
| title_short | Layer Decomposition Learning Based on Gaussian Convolution Model and Residual Deblurring for Inverse Halftoning |
| title_sort | layer decomposition learning based on gaussian convolution model and residual deblurring for inverse halftoning |
| topic | inverse halftoning image decomposition residual learning multiresolution |
| url | https://www.mdpi.com/2076-3417/11/15/7006 |
| work_keys_str_mv | AT changhwanson layerdecompositionlearningbasedongaussianconvolutionmodelandresidualdeblurringforinversehalftoning |