Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth Estimation

This paper proposes a method to extend a sensing range of a short-baseline stereo camera (SBSC). The proposed method combines a stereo depth and a monocular depth estimated by a convolutional neural network-based monocular depth estimation (MDE). To combine a stereo depth and a monocular depth, the...

Full description

Bibliographic Details
Main Authors: Beom-Su Seo, Byungjae Park, Hoon Choi
Format: Article
Language:English
Published: MDPI AG 2022-06-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/22/12/4605
_version_ 1797482330500104192
author Beom-Su Seo
Byungjae Park
Hoon Choi
author_facet Beom-Su Seo
Byungjae Park
Hoon Choi
author_sort Beom-Su Seo
collection DOAJ
description This paper proposes a method to extend a sensing range of a short-baseline stereo camera (SBSC). The proposed method combines a stereo depth and a monocular depth estimated by a convolutional neural network-based monocular depth estimation (MDE). To combine a stereo depth and a monocular depth, the proposed method estimates a scale factor of a monocular depth using stereo depth–mono depth pairs and then combines the two depths. Another advantage of the proposed method is that the trained MDE model may be utilized for different environments without retraining. The performance of the proposed method is verified qualitatively and quantitatively using the directly collected and open datasets.
first_indexed 2024-03-09T22:30:46Z
format Article
id doaj.art-4004d46a60cf486382d40476a03f0f16
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-09T22:30:46Z
publishDate 2022-06-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-4004d46a60cf486382d40476a03f0f162023-11-23T18:56:02ZengMDPI AGSensors1424-82202022-06-012212460510.3390/s22124605Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth EstimationBeom-Su Seo0Byungjae Park1Hoon Choi2Intelligent Robotics Research Division, AI Research Laboratory, Electronics and Telecommunication Research Institute (ETRI), Daejeon 34129, KoreaSchool of Mechanical Engineering, Korea University of Technology and Education, Cheonan 31253, KoreaDepartment of Artificial Intelligence, Chungnam National University, Daejeon 34134, KoreaThis paper proposes a method to extend a sensing range of a short-baseline stereo camera (SBSC). The proposed method combines a stereo depth and a monocular depth estimated by a convolutional neural network-based monocular depth estimation (MDE). To combine a stereo depth and a monocular depth, the proposed method estimates a scale factor of a monocular depth using stereo depth–mono depth pairs and then combines the two depths. Another advantage of the proposed method is that the trained MDE model may be utilized for different environments without retraining. The performance of the proposed method is verified qualitatively and quantitatively using the directly collected and open datasets.https://www.mdpi.com/1424-8220/22/12/4605stereo cameradepth estimationconvolution neural network
spellingShingle Beom-Su Seo
Byungjae Park
Hoon Choi
Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth Estimation
Sensors
stereo camera
depth estimation
convolution neural network
title Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth Estimation
title_full Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth Estimation
title_fullStr Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth Estimation
title_full_unstemmed Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth Estimation
title_short Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth Estimation
title_sort sensing range extension for short baseline stereo camera using monocular depth estimation
topic stereo camera
depth estimation
convolution neural network
url https://www.mdpi.com/1424-8220/22/12/4605
work_keys_str_mv AT beomsuseo sensingrangeextensionforshortbaselinestereocamerausingmonoculardepthestimation
AT byungjaepark sensingrangeextensionforshortbaselinestereocamerausingmonoculardepthestimation
AT hoonchoi sensingrangeextensionforshortbaselinestereocamerausingmonoculardepthestimation