Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth Estimation
This paper proposes a method to extend a sensing range of a short-baseline stereo camera (SBSC). The proposed method combines a stereo depth and a monocular depth estimated by a convolutional neural network-based monocular depth estimation (MDE). To combine a stereo depth and a monocular depth, the...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2022-06-01
|
Series: | Sensors |
Subjects: | |
Online Access: | https://www.mdpi.com/1424-8220/22/12/4605 |
_version_ | 1797482330500104192 |
---|---|
author | Beom-Su Seo Byungjae Park Hoon Choi |
author_facet | Beom-Su Seo Byungjae Park Hoon Choi |
author_sort | Beom-Su Seo |
collection | DOAJ |
description | This paper proposes a method to extend a sensing range of a short-baseline stereo camera (SBSC). The proposed method combines a stereo depth and a monocular depth estimated by a convolutional neural network-based monocular depth estimation (MDE). To combine a stereo depth and a monocular depth, the proposed method estimates a scale factor of a monocular depth using stereo depth–mono depth pairs and then combines the two depths. Another advantage of the proposed method is that the trained MDE model may be utilized for different environments without retraining. The performance of the proposed method is verified qualitatively and quantitatively using the directly collected and open datasets. |
first_indexed | 2024-03-09T22:30:46Z |
format | Article |
id | doaj.art-4004d46a60cf486382d40476a03f0f16 |
institution | Directory Open Access Journal |
issn | 1424-8220 |
language | English |
last_indexed | 2024-03-09T22:30:46Z |
publishDate | 2022-06-01 |
publisher | MDPI AG |
record_format | Article |
series | Sensors |
spelling | doaj.art-4004d46a60cf486382d40476a03f0f162023-11-23T18:56:02ZengMDPI AGSensors1424-82202022-06-012212460510.3390/s22124605Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth EstimationBeom-Su Seo0Byungjae Park1Hoon Choi2Intelligent Robotics Research Division, AI Research Laboratory, Electronics and Telecommunication Research Institute (ETRI), Daejeon 34129, KoreaSchool of Mechanical Engineering, Korea University of Technology and Education, Cheonan 31253, KoreaDepartment of Artificial Intelligence, Chungnam National University, Daejeon 34134, KoreaThis paper proposes a method to extend a sensing range of a short-baseline stereo camera (SBSC). The proposed method combines a stereo depth and a monocular depth estimated by a convolutional neural network-based monocular depth estimation (MDE). To combine a stereo depth and a monocular depth, the proposed method estimates a scale factor of a monocular depth using stereo depth–mono depth pairs and then combines the two depths. Another advantage of the proposed method is that the trained MDE model may be utilized for different environments without retraining. The performance of the proposed method is verified qualitatively and quantitatively using the directly collected and open datasets.https://www.mdpi.com/1424-8220/22/12/4605stereo cameradepth estimationconvolution neural network |
spellingShingle | Beom-Su Seo Byungjae Park Hoon Choi Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth Estimation Sensors stereo camera depth estimation convolution neural network |
title | Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth Estimation |
title_full | Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth Estimation |
title_fullStr | Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth Estimation |
title_full_unstemmed | Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth Estimation |
title_short | Sensing Range Extension for Short-Baseline Stereo Camera Using Monocular Depth Estimation |
title_sort | sensing range extension for short baseline stereo camera using monocular depth estimation |
topic | stereo camera depth estimation convolution neural network |
url | https://www.mdpi.com/1424-8220/22/12/4605 |
work_keys_str_mv | AT beomsuseo sensingrangeextensionforshortbaselinestereocamerausingmonoculardepthestimation AT byungjaepark sensingrangeextensionforshortbaselinestereocamerausingmonoculardepthestimation AT hoonchoi sensingrangeextensionforshortbaselinestereocamerausingmonoculardepthestimation |