MULTI-VIEW STEREO WITH SEMANTIC PRIORS

<p>Patch-based stereo is nowadays a commonly used image-based technique for dense 3D reconstruction in large scale multi-view applications. The typical steps of such a pipeline can be summarized in stereo pair selection, depth map computation, depth map refinement and, finally, fusion in ord...

Full description

Bibliographic Details
Main Authors: E.-K. Stathopoulou, F. Remondino
Format: Article
Language:English
Published: Copernicus Publications 2019-08-01
Series:The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2-W15/1135/2019/isprs-archives-XLII-2-W15-1135-2019.pdf
_version_ 1811206440399929344
author E.-K. Stathopoulou
F. Remondino
author_facet E.-K. Stathopoulou
F. Remondino
author_sort E.-K. Stathopoulou
collection DOAJ
description <p>Patch-based stereo is nowadays a commonly used image-based technique for dense 3D reconstruction in large scale multi-view applications. The typical steps of such a pipeline can be summarized in stereo pair selection, depth map computation, depth map refinement and, finally, fusion in order to generate a complete and accurate representation of the scene in 3D. In this study, we aim to support the standard dense 3D reconstruction of scenes as implemented in the open source library OpenMVS by using semantic priors. To this end, during the depth map fusion step, along with the depth consistency check between depth maps of neighbouring views referring to the same part of the 3D scene, we impose extra semantic constraints in order to remove possible errors and selectively obtain segmented point clouds per label, boosting automation towards this direction. In order to reassure semantic coherence between neighbouring views, additional semantic criterions can be considered, aiming to eliminate mismatches of pixels belonging in different classes.</p>
first_indexed 2024-04-12T03:47:46Z
format Article
id doaj.art-8fd43c3ea8cc42d2bd4ed884f124308d
institution Directory Open Access Journal
issn 1682-1750
2194-9034
language English
last_indexed 2024-04-12T03:47:46Z
publishDate 2019-08-01
publisher Copernicus Publications
record_format Article
series The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
spelling doaj.art-8fd43c3ea8cc42d2bd4ed884f124308d2022-12-22T03:49:04ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342019-08-01XLII-2-W151135114010.5194/isprs-archives-XLII-2-W15-1135-2019MULTI-VIEW STEREO WITH SEMANTIC PRIORSE.-K. Stathopoulou0F. Remondino13D Optical Metrology (3DOM) unit, Bruno Kessler Foundation (FBK), Trento, Italy3D Optical Metrology (3DOM) unit, Bruno Kessler Foundation (FBK), Trento, Italy<p>Patch-based stereo is nowadays a commonly used image-based technique for dense 3D reconstruction in large scale multi-view applications. The typical steps of such a pipeline can be summarized in stereo pair selection, depth map computation, depth map refinement and, finally, fusion in order to generate a complete and accurate representation of the scene in 3D. In this study, we aim to support the standard dense 3D reconstruction of scenes as implemented in the open source library OpenMVS by using semantic priors. To this end, during the depth map fusion step, along with the depth consistency check between depth maps of neighbouring views referring to the same part of the 3D scene, we impose extra semantic constraints in order to remove possible errors and selectively obtain segmented point clouds per label, boosting automation towards this direction. In order to reassure semantic coherence between neighbouring views, additional semantic criterions can be considered, aiming to eliminate mismatches of pixels belonging in different classes.</p>https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2-W15/1135/2019/isprs-archives-XLII-2-W15-1135-2019.pdf
spellingShingle E.-K. Stathopoulou
F. Remondino
MULTI-VIEW STEREO WITH SEMANTIC PRIORS
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
title MULTI-VIEW STEREO WITH SEMANTIC PRIORS
title_full MULTI-VIEW STEREO WITH SEMANTIC PRIORS
title_fullStr MULTI-VIEW STEREO WITH SEMANTIC PRIORS
title_full_unstemmed MULTI-VIEW STEREO WITH SEMANTIC PRIORS
title_short MULTI-VIEW STEREO WITH SEMANTIC PRIORS
title_sort multi view stereo with semantic priors
url https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2-W15/1135/2019/isprs-archives-XLII-2-W15-1135-2019.pdf
work_keys_str_mv AT ekstathopoulou multiviewstereowithsemanticpriors
AT fremondino multiviewstereowithsemanticpriors