Twelve Times Faster yet Accurate: A New State‐Of‐The‐Art in Radiation Schemes via Performance and Spectral Optimization
Abstract Radiation schemes are critical components of Earth system models that need to be both efficient and accurate. Despite the use of approximations such as 1D radiative transfer, radiation can account for a large share of the runtime of expensive climate simulations. Here we seek a new state‐of...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
American Geophysical Union (AGU)
2024-01-01
|
| Series: | Journal of Advances in Modeling Earth Systems |
| Subjects: | |
| Online Access: | https://doi.org/10.1029/2023MS003932 |
| _version_ | 1797299883720310784 |
|---|---|
| author | Peter Ukkonen Robin J. Hogan |
| author_facet | Peter Ukkonen Robin J. Hogan |
| author_sort | Peter Ukkonen |
| collection | DOAJ |
| description | Abstract Radiation schemes are critical components of Earth system models that need to be both efficient and accurate. Despite the use of approximations such as 1D radiative transfer, radiation can account for a large share of the runtime of expensive climate simulations. Here we seek a new state‐of‐the‐art in speed and accuracy by combining code optimization with improved algorithms. To fully benefit from new spectrally reduced gas optics schemes, we restructure code to avoid short vectorized loops where possible by collapsing the spectral and vertical dimensions. Our main focus is the ecRad radiation scheme, where this requires batching of adjacent cloudy layers, trading some simplicity for improved vectorization and instruction‐level parallelism. When combined with common optimization techniques for serial code and porting widely used two‐stream kernels fully to single precision, we find that ecRad with the TripleClouds solver becomes 12 times faster than the operational radiation scheme in ECMWF's Integrated Forecast System (IFS) cycle 47r3, which uses a less accurate gas optics model (RRMTG) and a more noisy solver (McICA). After applying the spectral reduction and extensive optimizations to the more sophisticated SPARTACUS solver, we find that it’s 2.5 times faster than IFS cy47r3 radiation, making cloud 3D radiative effects affordable to compute in large‐scale models. The code optimization itself gave a threefold speedup for both solvers. While SPARTACUS is still under development, preliminary experiments show slightly improved medium‐range forecasts of 2‐m temperature in the tropics, and in year‐long coupled atmosphere‐ocean simulations the 3D effects warm the surface substantially. |
| first_indexed | 2024-03-07T22:58:08Z |
| format | Article |
| id | doaj.art-48f34b484d9c42b79939cfa4a60fbdcb |
| institution | Directory Open Access Journal |
| issn | 1942-2466 |
| language | English |
| last_indexed | 2024-03-07T22:58:08Z |
| publishDate | 2024-01-01 |
| publisher | American Geophysical Union (AGU) |
| record_format | Article |
| series | Journal of Advances in Modeling Earth Systems |
| spelling | doaj.art-48f34b484d9c42b79939cfa4a60fbdcb2024-02-22T16:54:50ZengAmerican Geophysical Union (AGU)Journal of Advances in Modeling Earth Systems1942-24662024-01-01161n/an/a10.1029/2023MS003932Twelve Times Faster yet Accurate: A New State‐Of‐The‐Art in Radiation Schemes via Performance and Spectral OptimizationPeter Ukkonen0Robin J. Hogan1Danish Meteorological Institute Copenhagen DenmarkEuropean Centre for Medium‐Range Weather Forecasts Reading UKAbstract Radiation schemes are critical components of Earth system models that need to be both efficient and accurate. Despite the use of approximations such as 1D radiative transfer, radiation can account for a large share of the runtime of expensive climate simulations. Here we seek a new state‐of‐the‐art in speed and accuracy by combining code optimization with improved algorithms. To fully benefit from new spectrally reduced gas optics schemes, we restructure code to avoid short vectorized loops where possible by collapsing the spectral and vertical dimensions. Our main focus is the ecRad radiation scheme, where this requires batching of adjacent cloudy layers, trading some simplicity for improved vectorization and instruction‐level parallelism. When combined with common optimization techniques for serial code and porting widely used two‐stream kernels fully to single precision, we find that ecRad with the TripleClouds solver becomes 12 times faster than the operational radiation scheme in ECMWF's Integrated Forecast System (IFS) cycle 47r3, which uses a less accurate gas optics model (RRMTG) and a more noisy solver (McICA). After applying the spectral reduction and extensive optimizations to the more sophisticated SPARTACUS solver, we find that it’s 2.5 times faster than IFS cy47r3 radiation, making cloud 3D radiative effects affordable to compute in large‐scale models. The code optimization itself gave a threefold speedup for both solvers. While SPARTACUS is still under development, preliminary experiments show slightly improved medium‐range forecasts of 2‐m temperature in the tropics, and in year‐long coupled atmosphere‐ocean simulations the 3D effects warm the surface substantially.https://doi.org/10.1029/2023MS003932radiation schemeoptimization |
| spellingShingle | Peter Ukkonen Robin J. Hogan Twelve Times Faster yet Accurate: A New State‐Of‐The‐Art in Radiation Schemes via Performance and Spectral Optimization Journal of Advances in Modeling Earth Systems radiation scheme optimization |
| title | Twelve Times Faster yet Accurate: A New State‐Of‐The‐Art in Radiation Schemes via Performance and Spectral Optimization |
| title_full | Twelve Times Faster yet Accurate: A New State‐Of‐The‐Art in Radiation Schemes via Performance and Spectral Optimization |
| title_fullStr | Twelve Times Faster yet Accurate: A New State‐Of‐The‐Art in Radiation Schemes via Performance and Spectral Optimization |
| title_full_unstemmed | Twelve Times Faster yet Accurate: A New State‐Of‐The‐Art in Radiation Schemes via Performance and Spectral Optimization |
| title_short | Twelve Times Faster yet Accurate: A New State‐Of‐The‐Art in Radiation Schemes via Performance and Spectral Optimization |
| title_sort | twelve times faster yet accurate a new state of the art in radiation schemes via performance and spectral optimization |
| topic | radiation scheme optimization |
| url | https://doi.org/10.1029/2023MS003932 |
| work_keys_str_mv | AT peterukkonen twelvetimesfasteryetaccurateanewstateoftheartinradiationschemesviaperformanceandspectraloptimization AT robinjhogan twelvetimesfasteryetaccurateanewstateoftheartinradiationschemesviaperformanceandspectraloptimization |