Depth Recovery With Large-Area Data Loss Guided by Polarization Cues for Time-of-Flight Imaging
Time-of-Flight imaging is one of the quintessential techniques in three-dimensional reconstruction. However, depth missing is a common problem in Time-of-Flight imaging, which can be classified into structure-based depth loss and large-area one according to various reasons. Large-area depth loss gen...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10103609/ |
| _version_ | 1797840058011615232 |
|---|---|
| author | Yuwei Zhao Xia Wang Yujie Fang Chao Xu |
| author_facet | Yuwei Zhao Xia Wang Yujie Fang Chao Xu |
| author_sort | Yuwei Zhao |
| collection | DOAJ |
| description | Time-of-Flight imaging is one of the quintessential techniques in three-dimensional reconstruction. However, depth missing is a common problem in Time-of-Flight imaging, which can be classified into structure-based depth loss and large-area one according to various reasons. Large-area depth loss generally occurs due to close-range overexposure resulting in limited dynamic range in depth sensing. Compared to structure-based depth loss, the recovery of large-area depth missing is more challenging and has been rarely studied. In this paper, a large-area depth recovery framework guided by polarization cues is proposed stemmed from a solid physical basic concerning depth and polarization, to realize high dynamic range in applications. Inspired by RGB-D system and shape-from-polarization technique, a dual camera system is utilized including infrared Time-of-Flight camera and visible polarized camera. A physical model between depth map and polarization cues, specifically depth-gradient and degree-of-polarization, is investigated and established. Based on the physical basics, a corresponding polarization-guided depth recovery algorithm with statistical analysis and image processing approach is introduced. Experimental results towards different targets demonstrate the effectiveness of the proposed method qualitatively and quantitatively, accompanied with outcome analysis and detailed discussions about strengths and future works, which indicates a great potential for the applications of high-quality three-dimensional reconstruction and depth sensing. |
| first_indexed | 2024-04-09T16:08:19Z |
| format | Article |
| id | doaj.art-1fcc8135570e4754b3a4aea1291149c8 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-09T16:08:19Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-1fcc8135570e4754b3a4aea1291149c82023-04-24T23:00:33ZengIEEEIEEE Access2169-35362023-01-0111388403884910.1109/ACCESS.2023.326781410103609Depth Recovery With Large-Area Data Loss Guided by Polarization Cues for Time-of-Flight ImagingYuwei Zhao0https://orcid.org/0000-0003-2518-5016Xia Wang1https://orcid.org/0000-0003-0951-4844Yujie Fang2Chao Xu3https://orcid.org/0000-0002-5696-6301Key Laboratory of Photoelectronic Imaging Technology and System, Ministry of Education of China, School of Optics and Photons, Beijing Institute of Technology, Beijing, ChinaKey Laboratory of Photoelectronic Imaging Technology and System, Ministry of Education of China, School of Optics and Photons, Beijing Institute of Technology, Beijing, ChinaBeijing Institute of Technology, Zhuhai, ChinaKey Laboratory of Photoelectronic Imaging Technology and System, Ministry of Education of China, School of Optics and Photons, Beijing Institute of Technology, Beijing, ChinaTime-of-Flight imaging is one of the quintessential techniques in three-dimensional reconstruction. However, depth missing is a common problem in Time-of-Flight imaging, which can be classified into structure-based depth loss and large-area one according to various reasons. Large-area depth loss generally occurs due to close-range overexposure resulting in limited dynamic range in depth sensing. Compared to structure-based depth loss, the recovery of large-area depth missing is more challenging and has been rarely studied. In this paper, a large-area depth recovery framework guided by polarization cues is proposed stemmed from a solid physical basic concerning depth and polarization, to realize high dynamic range in applications. Inspired by RGB-D system and shape-from-polarization technique, a dual camera system is utilized including infrared Time-of-Flight camera and visible polarized camera. A physical model between depth map and polarization cues, specifically depth-gradient and degree-of-polarization, is investigated and established. Based on the physical basics, a corresponding polarization-guided depth recovery algorithm with statistical analysis and image processing approach is introduced. Experimental results towards different targets demonstrate the effectiveness of the proposed method qualitatively and quantitatively, accompanied with outcome analysis and detailed discussions about strengths and future works, which indicates a great potential for the applications of high-quality three-dimensional reconstruction and depth sensing.https://ieeexplore.ieee.org/document/10103609/Depth recoverytime-of-flight imagingpolarization cues |
| spellingShingle | Yuwei Zhao Xia Wang Yujie Fang Chao Xu Depth Recovery With Large-Area Data Loss Guided by Polarization Cues for Time-of-Flight Imaging IEEE Access Depth recovery time-of-flight imaging polarization cues |
| title | Depth Recovery With Large-Area Data Loss Guided by Polarization Cues for Time-of-Flight Imaging |
| title_full | Depth Recovery With Large-Area Data Loss Guided by Polarization Cues for Time-of-Flight Imaging |
| title_fullStr | Depth Recovery With Large-Area Data Loss Guided by Polarization Cues for Time-of-Flight Imaging |
| title_full_unstemmed | Depth Recovery With Large-Area Data Loss Guided by Polarization Cues for Time-of-Flight Imaging |
| title_short | Depth Recovery With Large-Area Data Loss Guided by Polarization Cues for Time-of-Flight Imaging |
| title_sort | depth recovery with large area data loss guided by polarization cues for time of flight imaging |
| topic | Depth recovery time-of-flight imaging polarization cues |
| url | https://ieeexplore.ieee.org/document/10103609/ |
| work_keys_str_mv | AT yuweizhao depthrecoverywithlargeareadatalossguidedbypolarizationcuesfortimeofflightimaging AT xiawang depthrecoverywithlargeareadatalossguidedbypolarizationcuesfortimeofflightimaging AT yujiefang depthrecoverywithlargeareadatalossguidedbypolarizationcuesfortimeofflightimaging AT chaoxu depthrecoverywithlargeareadatalossguidedbypolarizationcuesfortimeofflightimaging |