Residual dense U‐Net for abnormal exposure restoration from single images
Abstract Digital imaging devices sometimes capture images with abnormal exposure because of the complex lighting conditions and limited dynamic range of luminance. In this work, a new residual dense U‐Net is proposed to predict the information that has been lost in saturated image areas, to enable a...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2021-01-01
|
| Series: | IET Image Processing |
| Online Access: | https://doi.org/10.1049/ipr2.12011 |
| _version_ | 1811251918464352256 |
|---|---|
| author | Yue Que Hyo Jong Lee |
| author_facet | Yue Que Hyo Jong Lee |
| author_sort | Yue Que |
| collection | DOAJ |
| description | Abstract Digital imaging devices sometimes capture images with abnormal exposure because of the complex lighting conditions and limited dynamic range of luminance. In this work, a new residual dense U‐Net is proposed to predict the information that has been lost in saturated image areas, to enable abnormal exposure restoration from a single image. Full advantage of the multi‐level features is taken from all the convolution layers in the restoration process. Specifically, the densely connected convolutional layers are used in a contracting encoder net to extract abundant local features. The transition layer and local residual learning after each dense block is then applied to adaptively learn more effectively from prior with present local features. Further, an expanding decoder net with dense layers is used and added with skip connections to preserve low‐level information and existing details. Finally, multiple global residual learning is used to adaptively extract hierarchical features and help train the network. It is shown that such a network can be trained end‐to‐end from abnormal exposure images and outperform the prior best method on image enhancement. Experimental results show that the proposed model can greatly enhance the dynamic range of an abnormal exposure image. |
| first_indexed | 2024-04-12T16:27:07Z |
| format | Article |
| id | doaj.art-238861b61b6a40ff8d2ff6e8e9214e9a |
| institution | Directory Open Access Journal |
| issn | 1751-9659 1751-9667 |
| language | English |
| last_indexed | 2024-04-12T16:27:07Z |
| publishDate | 2021-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | IET Image Processing |
| spelling | doaj.art-238861b61b6a40ff8d2ff6e8e9214e9a2022-12-22T03:25:19ZengWileyIET Image Processing1751-96591751-96672021-01-0115111512610.1049/ipr2.12011Residual dense U‐Net for abnormal exposure restoration from single imagesYue Que0Hyo Jong Lee1Division of Computer Science and Engineering Jeonbuk National University Jeonju South KoreaDivision of Computer Science and Engineering Jeonbuk National University Jeonju South KoreaAbstract Digital imaging devices sometimes capture images with abnormal exposure because of the complex lighting conditions and limited dynamic range of luminance. In this work, a new residual dense U‐Net is proposed to predict the information that has been lost in saturated image areas, to enable abnormal exposure restoration from a single image. Full advantage of the multi‐level features is taken from all the convolution layers in the restoration process. Specifically, the densely connected convolutional layers are used in a contracting encoder net to extract abundant local features. The transition layer and local residual learning after each dense block is then applied to adaptively learn more effectively from prior with present local features. Further, an expanding decoder net with dense layers is used and added with skip connections to preserve low‐level information and existing details. Finally, multiple global residual learning is used to adaptively extract hierarchical features and help train the network. It is shown that such a network can be trained end‐to‐end from abnormal exposure images and outperform the prior best method on image enhancement. Experimental results show that the proposed model can greatly enhance the dynamic range of an abnormal exposure image.https://doi.org/10.1049/ipr2.12011 |
| spellingShingle | Yue Que Hyo Jong Lee Residual dense U‐Net for abnormal exposure restoration from single images IET Image Processing |
| title | Residual dense U‐Net for abnormal exposure restoration from single images |
| title_full | Residual dense U‐Net for abnormal exposure restoration from single images |
| title_fullStr | Residual dense U‐Net for abnormal exposure restoration from single images |
| title_full_unstemmed | Residual dense U‐Net for abnormal exposure restoration from single images |
| title_short | Residual dense U‐Net for abnormal exposure restoration from single images |
| title_sort | residual dense u net for abnormal exposure restoration from single images |
| url | https://doi.org/10.1049/ipr2.12011 |
| work_keys_str_mv | AT yueque residualdenseunetforabnormalexposurerestorationfromsingleimages AT hyojonglee residualdenseunetforabnormalexposurerestorationfromsingleimages |