UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVAL

In this paper, main challenges of underwater photogrammetry in shallow waters are described and analysed. The very short camera to object distance in such cases, as well as buoyancy issues, wave effects and turbidity of the waters are challenges to be resolved. Additionally, the major challenge of a...

Full description

Bibliographic Details
Main Authors: P. Agrafiotis, D. Skarlatos, T. Forbes, C. Poullis, M. Skamantzari, A. Georgopoulos
Format: Article
Language:English
Published: Copernicus Publications 2018-05-01
Series:The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2/15/2018/isprs-archives-XLII-2-15-2018.pdf
_version_ 1819146039512268800
author P. Agrafiotis
P. Agrafiotis
D. Skarlatos
T. Forbes
C. Poullis
M. Skamantzari
A. Georgopoulos
author_facet P. Agrafiotis
P. Agrafiotis
D. Skarlatos
T. Forbes
C. Poullis
M. Skamantzari
A. Georgopoulos
author_sort P. Agrafiotis
collection DOAJ
description In this paper, main challenges of underwater photogrammetry in shallow waters are described and analysed. The very short camera to object distance in such cases, as well as buoyancy issues, wave effects and turbidity of the waters are challenges to be resolved. Additionally, the major challenge of all, caustics, is addressed by a new approach for caustics removal (Forbes et al., 2018) which is applied in order to investigate its performance in terms of SfM-MVS and 3D reconstruction results. In the proposed approach the complex problem of removing caustics effects is addressed by classifying and then removing them from the images. We propose and test a novel solution based on two small and easily trainable Convolutional Neural Networks (CNNs). Real ground truth for caustics is not easily available. We show how a small set of synthetic data can be used to train the network and later transfer the learning to real data with robustness to intra-class variation. The proposed solution results in caustic-free images which can be further used for other tasks as may be needed.
first_indexed 2024-12-22T13:07:35Z
format Article
id doaj.art-60ab2f07dbe44a629951fb2b638574b6
institution Directory Open Access Journal
issn 1682-1750
2194-9034
language English
last_indexed 2024-12-22T13:07:35Z
publishDate 2018-05-01
publisher Copernicus Publications
record_format Article
series The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
spelling doaj.art-60ab2f07dbe44a629951fb2b638574b62022-12-21T18:24:50ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342018-05-01XLII-2152210.5194/isprs-archives-XLII-2-15-2018UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVALP. Agrafiotis0P. Agrafiotis1D. Skarlatos2T. Forbes3C. Poullis4M. Skamantzari5A. Georgopoulos6Cyprus University of Technology, Civil Engineering and Geomatics Dept., Lab of Photogrammetric Vision, 2-8 Saripolou str., 3036, Limassol, CyprusNational Technical University of Athens, School of Rural and Surveying Engineering, Lab. of Photogrammetry Zografou Campus, 9 Heroon Polytechniou str., 15780, Zografou, Athens, GreeceNational Technical University of Athens, School of Rural and Surveying Engineering, Lab. of Photogrammetry Zografou Campus, 9 Heroon Polytechniou str., 15780, Zografou, Athens, GreeceImmersive and Creative Technologies Lab, Department of Computer Science and Software Engineering, Concordia University, Quebec H3G 1M8 , CanadaImmersive and Creative Technologies Lab, Department of Computer Science and Software Engineering, Concordia University, Quebec H3G 1M8 , CanadaNational Technical University of Athens, School of Rural and Surveying Engineering, Lab. of Photogrammetry Zografou Campus, 9 Heroon Polytechniou str., 15780, Zografou, Athens, GreeceNational Technical University of Athens, School of Rural and Surveying Engineering, Lab. of Photogrammetry Zografou Campus, 9 Heroon Polytechniou str., 15780, Zografou, Athens, GreeceIn this paper, main challenges of underwater photogrammetry in shallow waters are described and analysed. The very short camera to object distance in such cases, as well as buoyancy issues, wave effects and turbidity of the waters are challenges to be resolved. Additionally, the major challenge of all, caustics, is addressed by a new approach for caustics removal (Forbes et al., 2018) which is applied in order to investigate its performance in terms of SfM-MVS and 3D reconstruction results. In the proposed approach the complex problem of removing caustics effects is addressed by classifying and then removing them from the images. We propose and test a novel solution based on two small and easily trainable Convolutional Neural Networks (CNNs). Real ground truth for caustics is not easily available. We show how a small set of synthetic data can be used to train the network and later transfer the learning to real data with robustness to intra-class variation. The proposed solution results in caustic-free images which can be further used for other tasks as may be needed.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2/15/2018/isprs-archives-XLII-2-15-2018.pdf
spellingShingle P. Agrafiotis
P. Agrafiotis
D. Skarlatos
T. Forbes
C. Poullis
M. Skamantzari
A. Georgopoulos
UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVAL
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
title UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVAL
title_full UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVAL
title_fullStr UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVAL
title_full_unstemmed UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVAL
title_short UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVAL
title_sort underwater photogrammetry in very shallow waters main challenges and caustics effect removal
url https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2/15/2018/isprs-archives-XLII-2-15-2018.pdf
work_keys_str_mv AT pagrafiotis underwaterphotogrammetryinveryshallowwatersmainchallengesandcausticseffectremoval
AT pagrafiotis underwaterphotogrammetryinveryshallowwatersmainchallengesandcausticseffectremoval
AT dskarlatos underwaterphotogrammetryinveryshallowwatersmainchallengesandcausticseffectremoval
AT tforbes underwaterphotogrammetryinveryshallowwatersmainchallengesandcausticseffectremoval
AT cpoullis underwaterphotogrammetryinveryshallowwatersmainchallengesandcausticseffectremoval
AT mskamantzari underwaterphotogrammetryinveryshallowwatersmainchallengesandcausticseffectremoval
AT ageorgopoulos underwaterphotogrammetryinveryshallowwatersmainchallengesandcausticseffectremoval