Texture and exposure awareness based refill for HDRI reconstruction of saturated and occluded areas
Abstract High‐dynamic‐range image (HDRI) displays scenes as vivid as the real scenes. HDRI can be reconstructed by fusing a set of bracketed‐exposure low‐dynamic‐range images (LDRI). For the reconstruction, many works succeed in removing the ghost artefacts caused by moving objects. The critical iss...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2021-09-01
|
| Series: | IET Image Processing |
| Subjects: | |
| Online Access: | https://doi.org/10.1049/ipr2.12257 |
| _version_ | 1811266453511340032 |
|---|---|
| author | Jianming Zhou Yipeng Deng Qin Liu Takeshi Ikenaga |
| author_facet | Jianming Zhou Yipeng Deng Qin Liu Takeshi Ikenaga |
| author_sort | Jianming Zhou |
| collection | DOAJ |
| description | Abstract High‐dynamic‐range image (HDRI) displays scenes as vivid as the real scenes. HDRI can be reconstructed by fusing a set of bracketed‐exposure low‐dynamic‐range images (LDRI). For the reconstruction, many works succeed in removing the ghost artefacts caused by moving objects. The critical issue is reconstructing the areas which are saturated due to bad exposure and occluded due to motion with no ghost artefacts. To overcome this issue, this paper proposes texture and exposure awareness based refill. The proposed work first locates the saturated and occluded areas existing in input image set, then refills background textures or patches containing rough exposure and colour information into located areas. Proposed work can be integrated with multiple existing ghost removal works to improve the reconstruction result. Experimental results show that proposed work removes the ghost artefacts caused by saturated and occluded areas in subjective evaluation. For the objective evaluation, the proposed work improves the HDR‐VDP‐2 evaluation result for multiple conventional works by 1.33% on average. |
| first_indexed | 2024-04-12T20:43:32Z |
| format | Article |
| id | doaj.art-33891653a6f64b0e9f0798a9ee97217b |
| institution | Directory Open Access Journal |
| issn | 1751-9659 1751-9667 |
| language | English |
| last_indexed | 2024-04-12T20:43:32Z |
| publishDate | 2021-09-01 |
| publisher | Wiley |
| record_format | Article |
| series | IET Image Processing |
| spelling | doaj.art-33891653a6f64b0e9f0798a9ee97217b2022-12-22T03:17:21ZengWileyIET Image Processing1751-96591751-96672021-09-0115112705271610.1049/ipr2.12257Texture and exposure awareness based refill for HDRI reconstruction of saturated and occluded areasJianming Zhou0Yipeng Deng1Qin Liu2Takeshi Ikenaga3Graduate School of Information, Production, and Systems Waseda University Kitakyushu‐shi JapanGraduate School of Information, Production, and Systems Waseda University Kitakyushu‐shi JapanSoftware Institute Nanjing University Nanjing Jiangsu P. R. ChinaGraduate School of Information, Production, and Systems Waseda University Kitakyushu‐shi JapanAbstract High‐dynamic‐range image (HDRI) displays scenes as vivid as the real scenes. HDRI can be reconstructed by fusing a set of bracketed‐exposure low‐dynamic‐range images (LDRI). For the reconstruction, many works succeed in removing the ghost artefacts caused by moving objects. The critical issue is reconstructing the areas which are saturated due to bad exposure and occluded due to motion with no ghost artefacts. To overcome this issue, this paper proposes texture and exposure awareness based refill. The proposed work first locates the saturated and occluded areas existing in input image set, then refills background textures or patches containing rough exposure and colour information into located areas. Proposed work can be integrated with multiple existing ghost removal works to improve the reconstruction result. Experimental results show that proposed work removes the ghost artefacts caused by saturated and occluded areas in subjective evaluation. For the objective evaluation, the proposed work improves the HDR‐VDP‐2 evaluation result for multiple conventional works by 1.33% on average.https://doi.org/10.1049/ipr2.12257Optical, image and video signal processingImage and video codingImage sensorsComputer vision and image processing techniquesVideo signal processingPatient diagnostic methods and instrumentation |
| spellingShingle | Jianming Zhou Yipeng Deng Qin Liu Takeshi Ikenaga Texture and exposure awareness based refill for HDRI reconstruction of saturated and occluded areas IET Image Processing Optical, image and video signal processing Image and video coding Image sensors Computer vision and image processing techniques Video signal processing Patient diagnostic methods and instrumentation |
| title | Texture and exposure awareness based refill for HDRI reconstruction of saturated and occluded areas |
| title_full | Texture and exposure awareness based refill for HDRI reconstruction of saturated and occluded areas |
| title_fullStr | Texture and exposure awareness based refill for HDRI reconstruction of saturated and occluded areas |
| title_full_unstemmed | Texture and exposure awareness based refill for HDRI reconstruction of saturated and occluded areas |
| title_short | Texture and exposure awareness based refill for HDRI reconstruction of saturated and occluded areas |
| title_sort | texture and exposure awareness based refill for hdri reconstruction of saturated and occluded areas |
| topic | Optical, image and video signal processing Image and video coding Image sensors Computer vision and image processing techniques Video signal processing Patient diagnostic methods and instrumentation |
| url | https://doi.org/10.1049/ipr2.12257 |
| work_keys_str_mv | AT jianmingzhou textureandexposureawarenessbasedrefillforhdrireconstructionofsaturatedandoccludedareas AT yipengdeng textureandexposureawarenessbasedrefillforhdrireconstructionofsaturatedandoccludedareas AT qinliu textureandexposureawarenessbasedrefillforhdrireconstructionofsaturatedandoccludedareas AT takeshiikenaga textureandexposureawarenessbasedrefillforhdrireconstructionofsaturatedandoccludedareas |