Single image reflection removal with camera calibration
With the rapid development of deep learning algorithms and powerful computing hardware, some classic ill-posed computer vision problems could be better solved in a data-driven manner. For single image reflection removal, researchers use different prior knowledge to make the loss design more reasonab...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis-Master by Research |
| Language: | English |
| Published: |
Nanyang Technological University
2021
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/150528 |
| _version_ | 1811680827624390656 |
|---|---|
| author | Chen, Jinnan |
| author2 | Jiang Xudong |
| author_facet | Jiang Xudong Chen, Jinnan |
| author_sort | Chen, Jinnan |
| collection | NTU |
| description | With the rapid development of deep learning algorithms and powerful computing hardware, some classic ill-posed computer vision problems could be better solved in a data-driven manner. For single image reflection removal, researchers use different prior knowledge to make the loss design more reasonable. My research on this topic is based on the prior knowledge of physical modeling of the reflection formation.
I integrated my research work in NTU as a master by research student into this final thesis, with the title of Stationary Single Image Reflection Removal: Physical Rule to Robustness.
This thesis mainly aims to analyze and give a reliable answer to ‘how to encode the physical information into the designed network thus making it easily generalized in the real world and robust to some input perturbations’, before which, some new ideas and in-depth investigation about the robustness of CNN-based model in terms of adversarial perturbations are introduced.
The main part of the thesis consists of two specific physical-rule-based models to simulate the reflection formation process. The first one focuses on how to use the pixel-wise reflection coefficient map to guide the reflection removal process as well as calibrate the camera parameters while the second one focuses on how to add constraints to stabilize the output in terms of the perturbations from some physical parameters of the glass which have a great effect to the reflection part. Substantial experimental results and analysis show the effectiveness and the superiority of the proposed methods in the different real scenarios and this research could have a broad impact on other computer vision problems. |
| first_indexed | 2024-10-01T03:31:14Z |
| format | Thesis-Master by Research |
| id | ntu-10356/150528 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T03:31:14Z |
| publishDate | 2021 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1505282023-07-04T16:50:09Z Single image reflection removal with camera calibration Chen, Jinnan Jiang Xudong School of Electrical and Electronic Engineering Rapid-Rich Object Search (ROSE) Lab EXDJiang@ntu.edu.sg Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Engineering::Electrical and electronic engineering With the rapid development of deep learning algorithms and powerful computing hardware, some classic ill-posed computer vision problems could be better solved in a data-driven manner. For single image reflection removal, researchers use different prior knowledge to make the loss design more reasonable. My research on this topic is based on the prior knowledge of physical modeling of the reflection formation. I integrated my research work in NTU as a master by research student into this final thesis, with the title of Stationary Single Image Reflection Removal: Physical Rule to Robustness. This thesis mainly aims to analyze and give a reliable answer to ‘how to encode the physical information into the designed network thus making it easily generalized in the real world and robust to some input perturbations’, before which, some new ideas and in-depth investigation about the robustness of CNN-based model in terms of adversarial perturbations are introduced. The main part of the thesis consists of two specific physical-rule-based models to simulate the reflection formation process. The first one focuses on how to use the pixel-wise reflection coefficient map to guide the reflection removal process as well as calibrate the camera parameters while the second one focuses on how to add constraints to stabilize the output in terms of the perturbations from some physical parameters of the glass which have a great effect to the reflection part. Substantial experimental results and analysis show the effectiveness and the superiority of the proposed methods in the different real scenarios and this research could have a broad impact on other computer vision problems. Master of Engineering 2021-06-22T12:41:52Z 2021-06-22T12:41:52Z 2021 Thesis-Master by Research Chen, J. (2021). Single image reflection removal with camera calibration. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/150528 https://hdl.handle.net/10356/150528 10.32657/10356/150528 en This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0). application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Engineering::Electrical and electronic engineering Chen, Jinnan Single image reflection removal with camera calibration |
| title | Single image reflection removal with camera calibration |
| title_full | Single image reflection removal with camera calibration |
| title_fullStr | Single image reflection removal with camera calibration |
| title_full_unstemmed | Single image reflection removal with camera calibration |
| title_short | Single image reflection removal with camera calibration |
| title_sort | single image reflection removal with camera calibration |
| topic | Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Engineering::Electrical and electronic engineering |
| url | https://hdl.handle.net/10356/150528 |
| work_keys_str_mv | AT chenjinnan singleimagereflectionremovalwithcameracalibration |