Distance Error Correction in Time-of-Flight Cameras Using Asynchronous Integration Time

A distance map captured using a time-of-flight (ToF) depth sensor has fundamental problems, such as ambiguous depth information in shiny or dark surfaces, optical noise, and mismatched boundaries. Severe depth errors exist in shiny and dark surfaces owing to excess reflection and excess absorption o...

Full description

Bibliographic Details
Main Authors: Eu-Tteum Baek, Hyung-Jeong Yang, Soo-Hyung Kim, Gueesang Lee, Hieyong Jeong
Format: Article
Language:English
Published: MDPI AG 2020-02-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/4/1156
_version_ 1798043686058065920
author Eu-Tteum Baek
Hyung-Jeong Yang
Soo-Hyung Kim
Gueesang Lee
Hieyong Jeong
author_facet Eu-Tteum Baek
Hyung-Jeong Yang
Soo-Hyung Kim
Gueesang Lee
Hieyong Jeong
author_sort Eu-Tteum Baek
collection DOAJ
description A distance map captured using a time-of-flight (ToF) depth sensor has fundamental problems, such as ambiguous depth information in shiny or dark surfaces, optical noise, and mismatched boundaries. Severe depth errors exist in shiny and dark surfaces owing to excess reflection and excess absorption of light, respectively. Dealing with this problem has been a challenge due to the inherent hardware limitations of ToF, which measures the distance using the number of reflected photons. This study proposes a distance error correction method using three ToF sensors, set to different integration times to address the ambiguity in depth information. First, the three ToF depth sensors are installed horizontally at different integration times to capture distance maps at different integration times. Given the amplitude maps and error regions are estimated based on the amount of light, the estimated error regions are refined by exploiting the accurate depth information from the neighboring depth sensors that use different integration times. Moreover, we propose a new optical noise reduction filter that considers the distribution of the depth information biased toward one side. Experimental results verified that the proposed method overcomes the drawbacks of ToF cameras and provides enhanced distance maps.
first_indexed 2024-04-11T22:52:34Z
format Article
id doaj.art-3fa1a35cfc93475281f4bcac7ba38737
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-04-11T22:52:34Z
publishDate 2020-02-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-3fa1a35cfc93475281f4bcac7ba387372022-12-22T03:58:32ZengMDPI AGSensors1424-82202020-02-01204115610.3390/s20041156s20041156Distance Error Correction in Time-of-Flight Cameras Using Asynchronous Integration TimeEu-Tteum Baek0Hyung-Jeong Yang1Soo-Hyung Kim2Gueesang Lee3Hieyong Jeong4Department of Electronics and Computer Engineering, Chonnam National University, 77 Yongbong-ro, Gwangju 61186, KoreaDepartment of Electronics and Computer Engineering, Chonnam National University, 77 Yongbong-ro, Gwangju 61186, KoreaDepartment of Electronics and Computer Engineering, Chonnam National University, 77 Yongbong-ro, Gwangju 61186, KoreaDepartment of Electronics and Computer Engineering, Chonnam National University, 77 Yongbong-ro, Gwangju 61186, KoreaDepartment of Electronics and Computer Engineering, Chonnam National University, 77 Yongbong-ro, Gwangju 61186, KoreaA distance map captured using a time-of-flight (ToF) depth sensor has fundamental problems, such as ambiguous depth information in shiny or dark surfaces, optical noise, and mismatched boundaries. Severe depth errors exist in shiny and dark surfaces owing to excess reflection and excess absorption of light, respectively. Dealing with this problem has been a challenge due to the inherent hardware limitations of ToF, which measures the distance using the number of reflected photons. This study proposes a distance error correction method using three ToF sensors, set to different integration times to address the ambiguity in depth information. First, the three ToF depth sensors are installed horizontally at different integration times to capture distance maps at different integration times. Given the amplitude maps and error regions are estimated based on the amount of light, the estimated error regions are refined by exploiting the accurate depth information from the neighboring depth sensors that use different integration times. Moreover, we propose a new optical noise reduction filter that considers the distribution of the depth information biased toward one side. Experimental results verified that the proposed method overcomes the drawbacks of ToF cameras and provides enhanced distance maps.https://www.mdpi.com/1424-8220/20/4/1156time-of-flightoptical noise reduction filterasynchronous integration time3d warping
spellingShingle Eu-Tteum Baek
Hyung-Jeong Yang
Soo-Hyung Kim
Gueesang Lee
Hieyong Jeong
Distance Error Correction in Time-of-Flight Cameras Using Asynchronous Integration Time
Sensors
time-of-flight
optical noise reduction filter
asynchronous integration time
3d warping
title Distance Error Correction in Time-of-Flight Cameras Using Asynchronous Integration Time
title_full Distance Error Correction in Time-of-Flight Cameras Using Asynchronous Integration Time
title_fullStr Distance Error Correction in Time-of-Flight Cameras Using Asynchronous Integration Time
title_full_unstemmed Distance Error Correction in Time-of-Flight Cameras Using Asynchronous Integration Time
title_short Distance Error Correction in Time-of-Flight Cameras Using Asynchronous Integration Time
title_sort distance error correction in time of flight cameras using asynchronous integration time
topic time-of-flight
optical noise reduction filter
asynchronous integration time
3d warping
url https://www.mdpi.com/1424-8220/20/4/1156
work_keys_str_mv AT eutteumbaek distanceerrorcorrectionintimeofflightcamerasusingasynchronousintegrationtime
AT hyungjeongyang distanceerrorcorrectionintimeofflightcamerasusingasynchronousintegrationtime
AT soohyungkim distanceerrorcorrectionintimeofflightcamerasusingasynchronousintegrationtime
AT gueesanglee distanceerrorcorrectionintimeofflightcamerasusingasynchronousintegrationtime
AT hieyongjeong distanceerrorcorrectionintimeofflightcamerasusingasynchronousintegrationtime