Example-based image relighting
Synthesizing photo-realistic images under different illumination conditions remains an important but challenging problem in both computer vision and graphics communities. Over the past few years, many researchers in both communities have tried inventing new methods to capture the complex light inter...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | English |
| Published: |
2014
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/55404 |
| _version_ | 1811686155503009792 |
|---|---|
| author | Teng, Xiao |
| author2 | Cham Tat Jen |
| author_facet | Cham Tat Jen Teng, Xiao |
| author_sort | Teng, Xiao |
| collection | NTU |
| description | Synthesizing photo-realistic images under different illumination conditions remains an important but challenging problem in both computer vision and graphics communities. Over the past few years, many researchers in both communities have tried inventing new methods to capture the complex light interactions existing in nature. However, most of them either rely on expensive custom-built equipment, or only focus on a class of objects, such as faces, to make the problem tractable with their approaches. Our research focuses on an example-based relighting framework for general objects. In this thesis, a review of the representative existing works on image relighting is provided. To avoid explicit 3D model acquisition as required in geometry-based methods and tedious laboratory setups as required for existing image-based methods, an example-based framework is proposed and analyzed. In this framework, we use a database of reference objects captured under different illumination conditions. Given one or several input image(s) of a new object captured under illumination conditions present in the reference database, new images can be synthesized for the input object under novel illumination conditions. We start from a single image approach with spherical surface and Lambertian model assumptions. The analysis is extended to non-spherical surface and more general BRDF models. Finally, a multiple image approach is introduced. Given limited sample images of the input object, the example-based relighting method can synthesize realistic images under different lighting conditions. It is a general and purely data-driven method which does not require an analytical model of the surface geometry or reflectance. The framework is demonstrated on standard real image databases and our own collected data, with comparisons showing that it outperforms image-based model fitting methods. This thesis concludes with a discussion of future work for example-based relighting. These include applying the framework to more complex images using sophisticated similarity estimation methods. Besides exploring physically correct solutions, we may also consider research methods for achieving perceptually appropriate relighting. |
| first_indexed | 2024-10-01T04:55:55Z |
| format | Thesis |
| id | ntu-10356/55404 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T04:55:55Z |
| publishDate | 2014 |
| record_format | dspace |
| spelling | ntu-10356/554042023-03-04T00:45:48Z Example-based image relighting Teng, Xiao Cham Tat Jen School of Computer Engineering Centre for Multimedia and Network Technology DRNTU::Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Synthesizing photo-realistic images under different illumination conditions remains an important but challenging problem in both computer vision and graphics communities. Over the past few years, many researchers in both communities have tried inventing new methods to capture the complex light interactions existing in nature. However, most of them either rely on expensive custom-built equipment, or only focus on a class of objects, such as faces, to make the problem tractable with their approaches. Our research focuses on an example-based relighting framework for general objects. In this thesis, a review of the representative existing works on image relighting is provided. To avoid explicit 3D model acquisition as required in geometry-based methods and tedious laboratory setups as required for existing image-based methods, an example-based framework is proposed and analyzed. In this framework, we use a database of reference objects captured under different illumination conditions. Given one or several input image(s) of a new object captured under illumination conditions present in the reference database, new images can be synthesized for the input object under novel illumination conditions. We start from a single image approach with spherical surface and Lambertian model assumptions. The analysis is extended to non-spherical surface and more general BRDF models. Finally, a multiple image approach is introduced. Given limited sample images of the input object, the example-based relighting method can synthesize realistic images under different lighting conditions. It is a general and purely data-driven method which does not require an analytical model of the surface geometry or reflectance. The framework is demonstrated on standard real image databases and our own collected data, with comparisons showing that it outperforms image-based model fitting methods. This thesis concludes with a discussion of future work for example-based relighting. These include applying the framework to more complex images using sophisticated similarity estimation methods. Besides exploring physically correct solutions, we may also consider research methods for achieving perceptually appropriate relighting. DOCTOR OF PHILOSOPHY (SCE) 2014-02-28T00:53:33Z 2014-02-28T00:53:33Z 2014 2014 Thesis Teng, X. (2014). Example-based image relighting. Doctoral thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/55404 10.32657/10356/55404 en 184 p. application/pdf |
| spellingShingle | DRNTU::Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Teng, Xiao Example-based image relighting |
| title | Example-based image relighting |
| title_full | Example-based image relighting |
| title_fullStr | Example-based image relighting |
| title_full_unstemmed | Example-based image relighting |
| title_short | Example-based image relighting |
| title_sort | example based image relighting |
| topic | DRNTU::Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision |
| url | https://hdl.handle.net/10356/55404 |
| work_keys_str_mv | AT tengxiao examplebasedimagerelighting |