A diagnostic interface for the ICOsahedral Non-hydrostatic (ICON) modelling framework based on the Modular Earth Submodel System (MESSy v2.50)
Numerical climate and weather models have advanced to finer scales, accompanied by large amounts of output data. The model systems hit the input and output (I/O) bottleneck of modern high-performance computing (HPC) systems. We aim to apply diagnostic methods online during the model simulation inste...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
Copernicus Publications
2016-10-01
|
Series: | Geoscientific Model Development |
Online Access: | http://www.geosci-model-dev.net/9/3639/2016/gmd-9-3639-2016.pdf |
_version_ | 1819194964046774272 |
---|---|
author | B. Kern P. Jöckel |
author_facet | B. Kern P. Jöckel |
author_sort | B. Kern |
collection | DOAJ |
description | Numerical climate and weather models have advanced to finer scales, accompanied by large amounts of output data. The model systems hit the input and output
(I/O) bottleneck of modern high-performance computing (HPC) systems. We aim
to apply diagnostic methods online during the model simulation instead of
applying them as a post-processing step to written output data, to reduce the
amount of I/O. To include diagnostic tools into the model system, we
implemented a standardised, easy-to-use interface based on the Modular Earth
Submodel System (MESSy) into the ICOsahedral Non-hydrostatic (ICON) modelling
framework. The integration of the diagnostic interface into the model system
is briefly described.
<br><br>
Furthermore, we present a prototype implementation of an advanced online
diagnostic tool for the aggregation of model data onto a user-defined regular
coarse grid. This diagnostic tool will be used to reduce the amount of model
output in future simulations.
<br><br>
Performance tests of the interface and of two different diagnostic tools
show, that the interface itself introduces no overhead in form of additional
runtime to the model system. The diagnostic tools, however, have significant
impact on the model system's runtime. This overhead strongly depends on the
characteristics and implementation of the diagnostic tool. A diagnostic
tool with high inter-process communication introduces large overhead, whereas
the additional runtime of a diagnostic tool without inter-process
communication is low. We briefly describe our efforts to reduce the
additional runtime from the diagnostic tools, and present a brief analysis of
memory consumption. Future work will focus on optimisation of the memory
footprint and the I/O operations of the diagnostic interface. |
first_indexed | 2024-12-23T02:05:13Z |
format | Article |
id | doaj.art-9fe8d1e6e1c34723b870b5fa0f6dcd2a |
institution | Directory Open Access Journal |
issn | 1991-959X 1991-9603 |
language | English |
last_indexed | 2024-12-23T02:05:13Z |
publishDate | 2016-10-01 |
publisher | Copernicus Publications |
record_format | Article |
series | Geoscientific Model Development |
spelling | doaj.art-9fe8d1e6e1c34723b870b5fa0f6dcd2a2022-12-21T18:03:54ZengCopernicus PublicationsGeoscientific Model Development1991-959X1991-96032016-10-019103639365410.5194/gmd-9-3639-2016A diagnostic interface for the ICOsahedral Non-hydrostatic (ICON) modelling framework based on the Modular Earth Submodel System (MESSy v2.50)B. Kern0P. Jöckel1Deutsches Zentrum für Luft- und Raumfahrt e.V. (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, GermanyDeutsches Zentrum für Luft- und Raumfahrt e.V. (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, GermanyNumerical climate and weather models have advanced to finer scales, accompanied by large amounts of output data. The model systems hit the input and output (I/O) bottleneck of modern high-performance computing (HPC) systems. We aim to apply diagnostic methods online during the model simulation instead of applying them as a post-processing step to written output data, to reduce the amount of I/O. To include diagnostic tools into the model system, we implemented a standardised, easy-to-use interface based on the Modular Earth Submodel System (MESSy) into the ICOsahedral Non-hydrostatic (ICON) modelling framework. The integration of the diagnostic interface into the model system is briefly described. <br><br> Furthermore, we present a prototype implementation of an advanced online diagnostic tool for the aggregation of model data onto a user-defined regular coarse grid. This diagnostic tool will be used to reduce the amount of model output in future simulations. <br><br> Performance tests of the interface and of two different diagnostic tools show, that the interface itself introduces no overhead in form of additional runtime to the model system. The diagnostic tools, however, have significant impact on the model system's runtime. This overhead strongly depends on the characteristics and implementation of the diagnostic tool. A diagnostic tool with high inter-process communication introduces large overhead, whereas the additional runtime of a diagnostic tool without inter-process communication is low. We briefly describe our efforts to reduce the additional runtime from the diagnostic tools, and present a brief analysis of memory consumption. Future work will focus on optimisation of the memory footprint and the I/O operations of the diagnostic interface.http://www.geosci-model-dev.net/9/3639/2016/gmd-9-3639-2016.pdf |
spellingShingle | B. Kern P. Jöckel A diagnostic interface for the ICOsahedral Non-hydrostatic (ICON) modelling framework based on the Modular Earth Submodel System (MESSy v2.50) Geoscientific Model Development |
title | A diagnostic interface for the ICOsahedral Non-hydrostatic (ICON) modelling framework based on the Modular Earth Submodel System (MESSy v2.50) |
title_full | A diagnostic interface for the ICOsahedral Non-hydrostatic (ICON) modelling framework based on the Modular Earth Submodel System (MESSy v2.50) |
title_fullStr | A diagnostic interface for the ICOsahedral Non-hydrostatic (ICON) modelling framework based on the Modular Earth Submodel System (MESSy v2.50) |
title_full_unstemmed | A diagnostic interface for the ICOsahedral Non-hydrostatic (ICON) modelling framework based on the Modular Earth Submodel System (MESSy v2.50) |
title_short | A diagnostic interface for the ICOsahedral Non-hydrostatic (ICON) modelling framework based on the Modular Earth Submodel System (MESSy v2.50) |
title_sort | diagnostic interface for the icosahedral non hydrostatic icon modelling framework based on the modular earth submodel system messy v2 50 |
url | http://www.geosci-model-dev.net/9/3639/2016/gmd-9-3639-2016.pdf |
work_keys_str_mv | AT bkern adiagnosticinterfacefortheicosahedralnonhydrostaticiconmodellingframeworkbasedonthemodularearthsubmodelsystemmessyv250 AT pjockel adiagnosticinterfacefortheicosahedralnonhydrostaticiconmodellingframeworkbasedonthemodularearthsubmodelsystemmessyv250 AT bkern diagnosticinterfacefortheicosahedralnonhydrostaticiconmodellingframeworkbasedonthemodularearthsubmodelsystemmessyv250 AT pjockel diagnosticinterfacefortheicosahedralnonhydrostaticiconmodellingframeworkbasedonthemodularearthsubmodelsystemmessyv250 |