Improving Monocular Camera Localization for Video-Based Three-Dimensional Outer Ear Reconstruction Tasks

This work addresses challenges related to camera 3D localization while reconstructing a 3D model of an ear. This work explores the potential solution of using a cap, specifically designed not to obstruct the ear, and its efficiency in enhancing the camera localization for structure-from-motion (SfM)...

Full description

Bibliographic Details
Main Authors: Mantas Tamulionis, Artūras Serackis, Kęstutis Bartnykas, Darius Miniotas, Šarūnas Mikučionis, Raimond Laptik, Andrius Ušinskas, Dalius Matuzevičius
Format: Article
Language:English
Published: MDPI AG 2023-07-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/13/15/8712
_version_ 1797587088392060928
author Mantas Tamulionis
Artūras Serackis
Kęstutis Bartnykas
Darius Miniotas
Šarūnas Mikučionis
Raimond Laptik
Andrius Ušinskas
Dalius Matuzevičius
author_facet Mantas Tamulionis
Artūras Serackis
Kęstutis Bartnykas
Darius Miniotas
Šarūnas Mikučionis
Raimond Laptik
Andrius Ušinskas
Dalius Matuzevičius
author_sort Mantas Tamulionis
collection DOAJ
description This work addresses challenges related to camera 3D localization while reconstructing a 3D model of an ear. This work explores the potential solution of using a cap, specifically designed not to obstruct the ear, and its efficiency in enhancing the camera localization for structure-from-motion (SfM)-based object reconstruction. The proposed solution is described, and an elaboration of the experimental scenarios used to investigate the background textures is provided; data collection and software tools used in the research are reported. The results show that the proposed method is effective, and using the cap with texture leads to a reduction in the camera localization error. Errors in the 3D location reconstruction of the camera were calculated by comparing cameras localized within typical ear reconstruction situations to those of higher-accuracy reconstructions. The findings also show that caps with sparse dot patterns and a regular knitted patterned winter hat are the preferred patterns. The study provides a contribution to the field of 3D modeling, particularly in the context of creating 3D models of the human ear, and offers a step towards more accurate, reliable, and feasible 3D ear modeling and reconstruction.
first_indexed 2024-03-11T00:32:15Z
format Article
id doaj.art-5cf252db633745a9b70e2fe10740f333
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-11T00:32:15Z
publishDate 2023-07-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-5cf252db633745a9b70e2fe10740f3332023-11-18T22:36:31ZengMDPI AGApplied Sciences2076-34172023-07-011315871210.3390/app13158712Improving Monocular Camera Localization for Video-Based Three-Dimensional Outer Ear Reconstruction TasksMantas Tamulionis0Artūras Serackis1Kęstutis Bartnykas2Darius Miniotas3Šarūnas Mikučionis4Raimond Laptik5Andrius Ušinskas6Dalius Matuzevičius7Department of Electronic Systems, Vilnius Gediminas Technical University (VILNIUS TECH), 10223 Vilnius, LithuaniaDepartment of Electronic Systems, Vilnius Gediminas Technical University (VILNIUS TECH), 10223 Vilnius, LithuaniaDepartment of Electronic Systems, Vilnius Gediminas Technical University (VILNIUS TECH), 10223 Vilnius, LithuaniaDepartment of Electronic Systems, Vilnius Gediminas Technical University (VILNIUS TECH), 10223 Vilnius, LithuaniaDepartment of Electronic Systems, Vilnius Gediminas Technical University (VILNIUS TECH), 10223 Vilnius, LithuaniaDepartment of Electronic Systems, Vilnius Gediminas Technical University (VILNIUS TECH), 10223 Vilnius, LithuaniaDepartment of Electronic Systems, Vilnius Gediminas Technical University (VILNIUS TECH), 10223 Vilnius, LithuaniaDepartment of Electronic Systems, Vilnius Gediminas Technical University (VILNIUS TECH), 10223 Vilnius, LithuaniaThis work addresses challenges related to camera 3D localization while reconstructing a 3D model of an ear. This work explores the potential solution of using a cap, specifically designed not to obstruct the ear, and its efficiency in enhancing the camera localization for structure-from-motion (SfM)-based object reconstruction. The proposed solution is described, and an elaboration of the experimental scenarios used to investigate the background textures is provided; data collection and software tools used in the research are reported. The results show that the proposed method is effective, and using the cap with texture leads to a reduction in the camera localization error. Errors in the 3D location reconstruction of the camera were calculated by comparing cameras localized within typical ear reconstruction situations to those of higher-accuracy reconstructions. The findings also show that caps with sparse dot patterns and a regular knitted patterned winter hat are the preferred patterns. The study provides a contribution to the field of 3D modeling, particularly in the context of creating 3D models of the human ear, and offers a step towards more accurate, reliable, and feasible 3D ear modeling and reconstruction.https://www.mdpi.com/2076-3417/13/15/87123D ear (pinna) reconstructionmonocular camera localizationclose-range photogrammetryvideogrammetrysmartphone-based photogrammetrystructure from motion
spellingShingle Mantas Tamulionis
Artūras Serackis
Kęstutis Bartnykas
Darius Miniotas
Šarūnas Mikučionis
Raimond Laptik
Andrius Ušinskas
Dalius Matuzevičius
Improving Monocular Camera Localization for Video-Based Three-Dimensional Outer Ear Reconstruction Tasks
Applied Sciences
3D ear (pinna) reconstruction
monocular camera localization
close-range photogrammetry
videogrammetry
smartphone-based photogrammetry
structure from motion
title Improving Monocular Camera Localization for Video-Based Three-Dimensional Outer Ear Reconstruction Tasks
title_full Improving Monocular Camera Localization for Video-Based Three-Dimensional Outer Ear Reconstruction Tasks
title_fullStr Improving Monocular Camera Localization for Video-Based Three-Dimensional Outer Ear Reconstruction Tasks
title_full_unstemmed Improving Monocular Camera Localization for Video-Based Three-Dimensional Outer Ear Reconstruction Tasks
title_short Improving Monocular Camera Localization for Video-Based Three-Dimensional Outer Ear Reconstruction Tasks
title_sort improving monocular camera localization for video based three dimensional outer ear reconstruction tasks
topic 3D ear (pinna) reconstruction
monocular camera localization
close-range photogrammetry
videogrammetry
smartphone-based photogrammetry
structure from motion
url https://www.mdpi.com/2076-3417/13/15/8712
work_keys_str_mv AT mantastamulionis improvingmonocularcameralocalizationforvideobasedthreedimensionalouterearreconstructiontasks
AT arturasserackis improvingmonocularcameralocalizationforvideobasedthreedimensionalouterearreconstructiontasks
AT kestutisbartnykas improvingmonocularcameralocalizationforvideobasedthreedimensionalouterearreconstructiontasks
AT dariusminiotas improvingmonocularcameralocalizationforvideobasedthreedimensionalouterearreconstructiontasks
AT sarunasmikucionis improvingmonocularcameralocalizationforvideobasedthreedimensionalouterearreconstructiontasks
AT raimondlaptik improvingmonocularcameralocalizationforvideobasedthreedimensionalouterearreconstructiontasks
AT andriususinskas improvingmonocularcameralocalizationforvideobasedthreedimensionalouterearreconstructiontasks
AT daliusmatuzevicius improvingmonocularcameralocalizationforvideobasedthreedimensionalouterearreconstructiontasks