Symmetric Enhancement of Visual Clarity through a Multi-Scale Dilated Residual Recurrent Network Approach for Image Deraining
Images captured during rainy days present the challenge of maintaining a symmetrical balance between foreground elements (like rain streaks) and the background scenery. The interplay between these rain-obscured images is reminiscent of the principle of symmetry, where one element, the rain streak, o...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-08-01
|
| Series: | Symmetry |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2073-8994/15/8/1571 |
| _version_ | 1797583115302993920 |
|---|---|
| author | Jameel Ahmed Bhutto Ruihong Zhang Ziaur Rahman |
| author_facet | Jameel Ahmed Bhutto Ruihong Zhang Ziaur Rahman |
| author_sort | Jameel Ahmed Bhutto |
| collection | DOAJ |
| description | Images captured during rainy days present the challenge of maintaining a symmetrical balance between foreground elements (like rain streaks) and the background scenery. The interplay between these rain-obscured images is reminiscent of the principle of symmetry, where one element, the rain streak, overshadows or disrupts the visual quality of the entire image. The challenge lies not just in eradicating the rain streaks but in ensuring the background is symmetrically restored to its original clarity. Recently, numerous deraining algorithms that employ deep learning techniques have been proposed, demonstrating promising results. Yet, achieving a perfect symmetrical balance by effectively removing rain streaks from a diverse set of images, while also symmetrically restoring the background details, is a monumental task. To address this issue, we introduce an image-deraining algorithm that leverages multi-scale dilated residual recurrent networks. The algorithm begins by utilizing convolutional activation layers to symmetrically process both the foreground and background features. Then, to ensure the symmetrical dissemination of the characteristics of rain streaks and the background, it employs long short-term memory networks in conjunction with gated recurrent units across various stages. The algorithm then incorporates dilated residual blocks (DRB), composed of dilated convolutions with three distinct dilation factors. This integration expands the receptive field, facilitating the extraction of deep, multi-scale features of both the rain streaks and background information. Furthermore, considering the complex and diverse nature of rain streaks, a channel attention (CA) mechanism is incorporated to capture richer image features and enhance the model’s performance. Ultimately, convolutional layers are employed to fuse the image features, resulting in a derained image. An evaluation encompassing seven benchmark datasets, assessed using five quality metrics against various conventional and modern algorithms, confirms the robustness and flexibility of our approach. |
| first_indexed | 2024-03-10T23:32:17Z |
| format | Article |
| id | doaj.art-108a8a0ae33f46daa7b7e4812cc8b1b7 |
| institution | Directory Open Access Journal |
| issn | 2073-8994 |
| language | English |
| last_indexed | 2024-03-10T23:32:17Z |
| publishDate | 2023-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Symmetry |
| spelling | doaj.art-108a8a0ae33f46daa7b7e4812cc8b1b72023-11-19T03:11:39ZengMDPI AGSymmetry2073-89942023-08-01158157110.3390/sym15081571Symmetric Enhancement of Visual Clarity through a Multi-Scale Dilated Residual Recurrent Network Approach for Image DerainingJameel Ahmed Bhutto0Ruihong Zhang1Ziaur Rahman2School of Computer, Huanggang Normal University, Huanggang 438000, ChinaSchool of Computer, Huanggang Normal University, Huanggang 438000, ChinaSchool of Computer, Huanggang Normal University, Huanggang 438000, ChinaImages captured during rainy days present the challenge of maintaining a symmetrical balance between foreground elements (like rain streaks) and the background scenery. The interplay between these rain-obscured images is reminiscent of the principle of symmetry, where one element, the rain streak, overshadows or disrupts the visual quality of the entire image. The challenge lies not just in eradicating the rain streaks but in ensuring the background is symmetrically restored to its original clarity. Recently, numerous deraining algorithms that employ deep learning techniques have been proposed, demonstrating promising results. Yet, achieving a perfect symmetrical balance by effectively removing rain streaks from a diverse set of images, while also symmetrically restoring the background details, is a monumental task. To address this issue, we introduce an image-deraining algorithm that leverages multi-scale dilated residual recurrent networks. The algorithm begins by utilizing convolutional activation layers to symmetrically process both the foreground and background features. Then, to ensure the symmetrical dissemination of the characteristics of rain streaks and the background, it employs long short-term memory networks in conjunction with gated recurrent units across various stages. The algorithm then incorporates dilated residual blocks (DRB), composed of dilated convolutions with three distinct dilation factors. This integration expands the receptive field, facilitating the extraction of deep, multi-scale features of both the rain streaks and background information. Furthermore, considering the complex and diverse nature of rain streaks, a channel attention (CA) mechanism is incorporated to capture richer image features and enhance the model’s performance. Ultimately, convolutional layers are employed to fuse the image features, resulting in a derained image. An evaluation encompassing seven benchmark datasets, assessed using five quality metrics against various conventional and modern algorithms, confirms the robustness and flexibility of our approach.https://www.mdpi.com/2073-8994/15/8/1571image derainingimage restorationdeep learningcomputer visionimage processing |
| spellingShingle | Jameel Ahmed Bhutto Ruihong Zhang Ziaur Rahman Symmetric Enhancement of Visual Clarity through a Multi-Scale Dilated Residual Recurrent Network Approach for Image Deraining Symmetry image deraining image restoration deep learning computer vision image processing |
| title | Symmetric Enhancement of Visual Clarity through a Multi-Scale Dilated Residual Recurrent Network Approach for Image Deraining |
| title_full | Symmetric Enhancement of Visual Clarity through a Multi-Scale Dilated Residual Recurrent Network Approach for Image Deraining |
| title_fullStr | Symmetric Enhancement of Visual Clarity through a Multi-Scale Dilated Residual Recurrent Network Approach for Image Deraining |
| title_full_unstemmed | Symmetric Enhancement of Visual Clarity through a Multi-Scale Dilated Residual Recurrent Network Approach for Image Deraining |
| title_short | Symmetric Enhancement of Visual Clarity through a Multi-Scale Dilated Residual Recurrent Network Approach for Image Deraining |
| title_sort | symmetric enhancement of visual clarity through a multi scale dilated residual recurrent network approach for image deraining |
| topic | image deraining image restoration deep learning computer vision image processing |
| url | https://www.mdpi.com/2073-8994/15/8/1571 |
| work_keys_str_mv | AT jameelahmedbhutto symmetricenhancementofvisualclaritythroughamultiscaledilatedresidualrecurrentnetworkapproachforimagederaining AT ruihongzhang symmetricenhancementofvisualclaritythroughamultiscaledilatedresidualrecurrentnetworkapproachforimagederaining AT ziaurrahman symmetricenhancementofvisualclaritythroughamultiscaledilatedresidualrecurrentnetworkapproachforimagederaining |