DIGITAL TWINNING IN THE OCEAN – CHALLENGES IN MULTIMODAL SENSING AND MULTISCALE FUSION BASED ON FAITHFUL VISUAL MODELS
In engineering, machines are typically built after a careful conception and design process: All components of a system, their roles and the interaction between them is well understood, and often even digital models of the system exist before the actual hardware is built. This enables simulations and...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2022-05-01
|
| Series: | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/V-4-2022/345/2022/isprs-annals-V-4-2022-345-2022.pdf |
| _version_ | 1811248891585101824 |
|---|---|
| author | V. Grossmann D. Nakath M. Urlaub N. Oppelt R. Koch K. Köser |
| author_facet | V. Grossmann D. Nakath M. Urlaub N. Oppelt R. Koch K. Köser |
| author_sort | V. Grossmann |
| collection | DOAJ |
| description | In engineering, machines are typically built after a careful conception and design process: All components of a system, their roles and the interaction between them is well understood, and often even digital models of the system exist before the actual hardware is built. This enables simulations and even feedback loops between the real-world system and a digital model, leading to a digital twin that allows better testing, prediction and understanding of complex effects. On the contrary, in Earth sciences, and particularly in ocean sciences, models exist only for certain aspects of the real world, of certain processes and of some interactions and dependencies between different “components” of the ocean. These individual models cover large temporal (seconds to millions of years) and spatial (millimetres to thousands of kilometres) scales, a variety of field data underpin them, and their results are represented in many different ways. A key to enabling digital twins in the oceans is fusion at different levels, in particular, fusion of data sources and modalities, fusion over different scales and fusion of differing representations. We outline these challenges and exemplify different envisioned digital twins employed in the oceans involving remote sensing, underwater photogrammetry and computer vision, focusing on optical aspects of the digital twinning process. In particular, we look at the holistic sensing scenarios of optical properties in coastal waters as well as seafloor dynamics at volcanic slopes and discuss road blockers for digital twins as well as potential solutions to increase and widen the use of digital twins. |
| first_indexed | 2024-04-12T15:35:50Z |
| format | Article |
| id | doaj.art-a2fcdce94d4446cc8ed0c5a6058ab65f |
| institution | Directory Open Access Journal |
| issn | 2194-9042 2194-9050 |
| language | English |
| last_indexed | 2024-04-12T15:35:50Z |
| publishDate | 2022-05-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj.art-a2fcdce94d4446cc8ed0c5a6058ab65f2022-12-22T03:26:57ZengCopernicus PublicationsISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences2194-90422194-90502022-05-01V-4-202234535210.5194/isprs-annals-V-4-2022-345-2022DIGITAL TWINNING IN THE OCEAN – CHALLENGES IN MULTIMODAL SENSING AND MULTISCALE FUSION BASED ON FAITHFUL VISUAL MODELSV. Grossmann0D. Nakath1M. Urlaub2N. Oppelt3R. Koch4K. Köser5Dept. of Computer Science, University of Kiel, 24118 Kiel, GermanyGEOMAR Helmholtz Centre for Ocean Research Kiel, 24148 Kiel, GermanyGEOMAR Helmholtz Centre for Ocean Research Kiel, 24148 Kiel, GermanyDept. of Geography, University of Kiel, 24118 Kiel, GermanyDept. of Computer Science, University of Kiel, 24118 Kiel, GermanyGEOMAR Helmholtz Centre for Ocean Research Kiel, 24148 Kiel, GermanyIn engineering, machines are typically built after a careful conception and design process: All components of a system, their roles and the interaction between them is well understood, and often even digital models of the system exist before the actual hardware is built. This enables simulations and even feedback loops between the real-world system and a digital model, leading to a digital twin that allows better testing, prediction and understanding of complex effects. On the contrary, in Earth sciences, and particularly in ocean sciences, models exist only for certain aspects of the real world, of certain processes and of some interactions and dependencies between different “components” of the ocean. These individual models cover large temporal (seconds to millions of years) and spatial (millimetres to thousands of kilometres) scales, a variety of field data underpin them, and their results are represented in many different ways. A key to enabling digital twins in the oceans is fusion at different levels, in particular, fusion of data sources and modalities, fusion over different scales and fusion of differing representations. We outline these challenges and exemplify different envisioned digital twins employed in the oceans involving remote sensing, underwater photogrammetry and computer vision, focusing on optical aspects of the digital twinning process. In particular, we look at the holistic sensing scenarios of optical properties in coastal waters as well as seafloor dynamics at volcanic slopes and discuss road blockers for digital twins as well as potential solutions to increase and widen the use of digital twins.https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/V-4-2022/345/2022/isprs-annals-V-4-2022-345-2022.pdf |
| spellingShingle | V. Grossmann D. Nakath M. Urlaub N. Oppelt R. Koch K. Köser DIGITAL TWINNING IN THE OCEAN – CHALLENGES IN MULTIMODAL SENSING AND MULTISCALE FUSION BASED ON FAITHFUL VISUAL MODELS ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | DIGITAL TWINNING IN THE OCEAN – CHALLENGES IN MULTIMODAL SENSING AND MULTISCALE FUSION BASED ON FAITHFUL VISUAL MODELS |
| title_full | DIGITAL TWINNING IN THE OCEAN – CHALLENGES IN MULTIMODAL SENSING AND MULTISCALE FUSION BASED ON FAITHFUL VISUAL MODELS |
| title_fullStr | DIGITAL TWINNING IN THE OCEAN – CHALLENGES IN MULTIMODAL SENSING AND MULTISCALE FUSION BASED ON FAITHFUL VISUAL MODELS |
| title_full_unstemmed | DIGITAL TWINNING IN THE OCEAN – CHALLENGES IN MULTIMODAL SENSING AND MULTISCALE FUSION BASED ON FAITHFUL VISUAL MODELS |
| title_short | DIGITAL TWINNING IN THE OCEAN – CHALLENGES IN MULTIMODAL SENSING AND MULTISCALE FUSION BASED ON FAITHFUL VISUAL MODELS |
| title_sort | digital twinning in the ocean challenges in multimodal sensing and multiscale fusion based on faithful visual models |
| url | https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/V-4-2022/345/2022/isprs-annals-V-4-2022-345-2022.pdf |
| work_keys_str_mv | AT vgrossmann digitaltwinningintheoceanchallengesinmultimodalsensingandmultiscalefusionbasedonfaithfulvisualmodels AT dnakath digitaltwinningintheoceanchallengesinmultimodalsensingandmultiscalefusionbasedonfaithfulvisualmodels AT murlaub digitaltwinningintheoceanchallengesinmultimodalsensingandmultiscalefusionbasedonfaithfulvisualmodels AT noppelt digitaltwinningintheoceanchallengesinmultimodalsensingandmultiscalefusionbasedonfaithfulvisualmodels AT rkoch digitaltwinningintheoceanchallengesinmultimodalsensingandmultiscalefusionbasedonfaithfulvisualmodels AT kkoser digitaltwinningintheoceanchallengesinmultimodalsensingandmultiscalefusionbasedonfaithfulvisualmodels |