Balancing EC‐Earth3 Improving the Performance of EC‐Earth CMIP6 Configurations by Minimizing the Coupling Cost
Abstract Earth System Models (ESMs) are complex systems used in weather and climate studies generally built from different independent components responsible for simulating a specific realm (ocean, atmosphere, biosphere, etc.). To replicate the interactions between these processes, ESMs typically us...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
American Geophysical Union (AGU)
2023-08-01
|
| Series: | Earth and Space Science |
| Subjects: | |
| Online Access: | https://doi.org/10.1029/2023EA002912 |
| _version_ | 1797658123622678528 |
|---|---|
| author | M. C. Acosta S. Palomas E. Tourigny |
| author_facet | M. C. Acosta S. Palomas E. Tourigny |
| author_sort | M. C. Acosta |
| collection | DOAJ |
| description | Abstract Earth System Models (ESMs) are complex systems used in weather and climate studies generally built from different independent components responsible for simulating a specific realm (ocean, atmosphere, biosphere, etc.). To replicate the interactions between these processes, ESMs typically use coupling libraries that manage the synchronization and field exchanges between the individual components, which run in parallel as a Multi‐Program, Multiple‐Data application. As ESMs get more complex (increase in resolution, number of components, configurations, etc.), achieving the best performance when running in High‐performance Computing platforms has become increasingly challenging and of major concern. One of the critical bottlenecks is the load‐imbalance, where the fastest components will have to wait for the slower ones. Finding the optimal number of processing elements to assign to each of the multiple independent constituents to minimize the performance loss due to synchronizations and maximize the overall parallel efficiency is impossible without the right performance metrics, methodology, and tools. This paper presents the results of balancing multiple Coupled Model Intercomparison Project phase 6 configurations for the EC‐Earth3 ESM. We will show that intuitive approaches can lead to suboptimal resource allocations and propose new setups up to 25% fasters while reducing the computational cost by 72%. We prove that new methods are needed to deal with the load‐balance of ESMs and hope that our study will serve as a guide to optimize any other coupled system. |
| first_indexed | 2024-03-11T17:54:33Z |
| format | Article |
| id | doaj.art-d89bcc0c7e954d77818a8970b6717a48 |
| institution | Directory Open Access Journal |
| issn | 2333-5084 |
| language | English |
| last_indexed | 2024-03-11T17:54:33Z |
| publishDate | 2023-08-01 |
| publisher | American Geophysical Union (AGU) |
| record_format | Article |
| series | Earth and Space Science |
| spelling | doaj.art-d89bcc0c7e954d77818a8970b6717a482023-10-17T21:16:18ZengAmerican Geophysical Union (AGU)Earth and Space Science2333-50842023-08-01108n/an/a10.1029/2023EA002912Balancing EC‐Earth3 Improving the Performance of EC‐Earth CMIP6 Configurations by Minimizing the Coupling CostM. C. Acosta0S. Palomas1E. Tourigny2Barcelona Supercomputing Center Barcelona SpainBarcelona Supercomputing Center Barcelona SpainBarcelona Supercomputing Center Barcelona SpainAbstract Earth System Models (ESMs) are complex systems used in weather and climate studies generally built from different independent components responsible for simulating a specific realm (ocean, atmosphere, biosphere, etc.). To replicate the interactions between these processes, ESMs typically use coupling libraries that manage the synchronization and field exchanges between the individual components, which run in parallel as a Multi‐Program, Multiple‐Data application. As ESMs get more complex (increase in resolution, number of components, configurations, etc.), achieving the best performance when running in High‐performance Computing platforms has become increasingly challenging and of major concern. One of the critical bottlenecks is the load‐imbalance, where the fastest components will have to wait for the slower ones. Finding the optimal number of processing elements to assign to each of the multiple independent constituents to minimize the performance loss due to synchronizations and maximize the overall parallel efficiency is impossible without the right performance metrics, methodology, and tools. This paper presents the results of balancing multiple Coupled Model Intercomparison Project phase 6 configurations for the EC‐Earth3 ESM. We will show that intuitive approaches can lead to suboptimal resource allocations and propose new setups up to 25% fasters while reducing the computational cost by 72%. We prove that new methods are needed to deal with the load‐balance of ESMs and hope that our study will serve as a guide to optimize any other coupled system.https://doi.org/10.1029/2023EA002912HPCperformanceESMsEC‐EarthCMIP6 |
| spellingShingle | M. C. Acosta S. Palomas E. Tourigny Balancing EC‐Earth3 Improving the Performance of EC‐Earth CMIP6 Configurations by Minimizing the Coupling Cost Earth and Space Science HPC performance ESMs EC‐Earth CMIP6 |
| title | Balancing EC‐Earth3 Improving the Performance of EC‐Earth CMIP6 Configurations by Minimizing the Coupling Cost |
| title_full | Balancing EC‐Earth3 Improving the Performance of EC‐Earth CMIP6 Configurations by Minimizing the Coupling Cost |
| title_fullStr | Balancing EC‐Earth3 Improving the Performance of EC‐Earth CMIP6 Configurations by Minimizing the Coupling Cost |
| title_full_unstemmed | Balancing EC‐Earth3 Improving the Performance of EC‐Earth CMIP6 Configurations by Minimizing the Coupling Cost |
| title_short | Balancing EC‐Earth3 Improving the Performance of EC‐Earth CMIP6 Configurations by Minimizing the Coupling Cost |
| title_sort | balancing ec earth3 improving the performance of ec earth cmip6 configurations by minimizing the coupling cost |
| topic | HPC performance ESMs EC‐Earth CMIP6 |
| url | https://doi.org/10.1029/2023EA002912 |
| work_keys_str_mv | AT mcacosta balancingecearth3improvingtheperformanceofecearthcmip6configurationsbyminimizingthecouplingcost AT spalomas balancingecearth3improvingtheperformanceofecearthcmip6configurationsbyminimizingthecouplingcost AT etourigny balancingecearth3improvingtheperformanceofecearthcmip6configurationsbyminimizingthecouplingcost |