UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVAL
In this paper, main challenges of underwater photogrammetry in shallow waters are described and analysed. The very short camera to object distance in such cases, as well as buoyancy issues, wave effects and turbidity of the waters are challenges to be resolved. Additionally, the major challenge of a...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Copernicus Publications
2018-05-01
|
Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
Online Access: | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2/15/2018/isprs-archives-XLII-2-15-2018.pdf |
_version_ | 1819146039512268800 |
---|---|
author | P. Agrafiotis P. Agrafiotis D. Skarlatos T. Forbes C. Poullis M. Skamantzari A. Georgopoulos |
author_facet | P. Agrafiotis P. Agrafiotis D. Skarlatos T. Forbes C. Poullis M. Skamantzari A. Georgopoulos |
author_sort | P. Agrafiotis |
collection | DOAJ |
description | In this paper, main challenges of underwater photogrammetry in shallow waters are described and analysed. The very short camera to object distance in such cases, as well as buoyancy issues, wave effects and turbidity of the waters are challenges to be resolved. Additionally, the major challenge of all, caustics, is addressed by a new approach for caustics removal (Forbes et al., 2018) which is applied in order to investigate its performance in terms of SfM-MVS and 3D reconstruction results. In the proposed approach the complex problem of removing caustics effects is addressed by classifying and then removing them from the images. We propose and test a novel solution based on two small and easily trainable Convolutional Neural Networks (CNNs). Real ground truth for caustics is not easily available. We show how a small set of synthetic data can be used to train the network and later transfer the learning to real data with robustness to intra-class variation. The proposed solution results in caustic-free images which can be further used for other tasks as may be needed. |
first_indexed | 2024-12-22T13:07:35Z |
format | Article |
id | doaj.art-60ab2f07dbe44a629951fb2b638574b6 |
institution | Directory Open Access Journal |
issn | 1682-1750 2194-9034 |
language | English |
last_indexed | 2024-12-22T13:07:35Z |
publishDate | 2018-05-01 |
publisher | Copernicus Publications |
record_format | Article |
series | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
spelling | doaj.art-60ab2f07dbe44a629951fb2b638574b62022-12-21T18:24:50ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342018-05-01XLII-2152210.5194/isprs-archives-XLII-2-15-2018UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVALP. Agrafiotis0P. Agrafiotis1D. Skarlatos2T. Forbes3C. Poullis4M. Skamantzari5A. Georgopoulos6Cyprus University of Technology, Civil Engineering and Geomatics Dept., Lab of Photogrammetric Vision, 2-8 Saripolou str., 3036, Limassol, CyprusNational Technical University of Athens, School of Rural and Surveying Engineering, Lab. of Photogrammetry Zografou Campus, 9 Heroon Polytechniou str., 15780, Zografou, Athens, GreeceNational Technical University of Athens, School of Rural and Surveying Engineering, Lab. of Photogrammetry Zografou Campus, 9 Heroon Polytechniou str., 15780, Zografou, Athens, GreeceImmersive and Creative Technologies Lab, Department of Computer Science and Software Engineering, Concordia University, Quebec H3G 1M8 , CanadaImmersive and Creative Technologies Lab, Department of Computer Science and Software Engineering, Concordia University, Quebec H3G 1M8 , CanadaNational Technical University of Athens, School of Rural and Surveying Engineering, Lab. of Photogrammetry Zografou Campus, 9 Heroon Polytechniou str., 15780, Zografou, Athens, GreeceNational Technical University of Athens, School of Rural and Surveying Engineering, Lab. of Photogrammetry Zografou Campus, 9 Heroon Polytechniou str., 15780, Zografou, Athens, GreeceIn this paper, main challenges of underwater photogrammetry in shallow waters are described and analysed. The very short camera to object distance in such cases, as well as buoyancy issues, wave effects and turbidity of the waters are challenges to be resolved. Additionally, the major challenge of all, caustics, is addressed by a new approach for caustics removal (Forbes et al., 2018) which is applied in order to investigate its performance in terms of SfM-MVS and 3D reconstruction results. In the proposed approach the complex problem of removing caustics effects is addressed by classifying and then removing them from the images. We propose and test a novel solution based on two small and easily trainable Convolutional Neural Networks (CNNs). Real ground truth for caustics is not easily available. We show how a small set of synthetic data can be used to train the network and later transfer the learning to real data with robustness to intra-class variation. The proposed solution results in caustic-free images which can be further used for other tasks as may be needed.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2/15/2018/isprs-archives-XLII-2-15-2018.pdf |
spellingShingle | P. Agrafiotis P. Agrafiotis D. Skarlatos T. Forbes C. Poullis M. Skamantzari A. Georgopoulos UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVAL The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
title | UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVAL |
title_full | UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVAL |
title_fullStr | UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVAL |
title_full_unstemmed | UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVAL |
title_short | UNDERWATER PHOTOGRAMMETRY IN VERY SHALLOW WATERS: MAIN CHALLENGES AND CAUSTICS EFFECT REMOVAL |
title_sort | underwater photogrammetry in very shallow waters main challenges and caustics effect removal |
url | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2/15/2018/isprs-archives-XLII-2-15-2018.pdf |
work_keys_str_mv | AT pagrafiotis underwaterphotogrammetryinveryshallowwatersmainchallengesandcausticseffectremoval AT pagrafiotis underwaterphotogrammetryinveryshallowwatersmainchallengesandcausticseffectremoval AT dskarlatos underwaterphotogrammetryinveryshallowwatersmainchallengesandcausticseffectremoval AT tforbes underwaterphotogrammetryinveryshallowwatersmainchallengesandcausticseffectremoval AT cpoullis underwaterphotogrammetryinveryshallowwatersmainchallengesandcausticseffectremoval AT mskamantzari underwaterphotogrammetryinveryshallowwatersmainchallengesandcausticseffectremoval AT ageorgopoulos underwaterphotogrammetryinveryshallowwatersmainchallengesandcausticseffectremoval |