Reduced-precision arithmetic in numerical weather prediction with an emphasis on data assimilation
<p>The skill of weather forecasts has improved dramatically over the past 30 years. This improvement has depended to a large degree on developments in supercomputing, which have allowed models to increase in complexity and resolution with minimal technical effort. However, the nature of superc...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | English |
| Published: |
2019
|
| Subjects: |
| _version_ | 1797072189109829632 |
|---|---|
| author | Hatfield, S |
| author2 | Palmer, T |
| author_facet | Palmer, T Hatfield, S |
| author_sort | Hatfield, S |
| collection | OXFORD |
| description | <p>The skill of weather forecasts has improved dramatically over the past 30 years. This improvement has depended to a large degree on developments in supercomputing, which have allowed models to increase in complexity and resolution with minimal technical effort. However, the nature of supercomputing is undergoing a significant change, with the advent of extremely parallel and heterogeneous architectures. This paradigm shift threatens the continual increase of forecast skill and prompts a reevaluation of how Earth-System models are developed. In this thesis we explore the notion of reduced-precision arithmetic to accelerate Earth-System models, specifically those used in data assimilation and in numerical weather prediction.</p> <p>We first conduct data assimilation experiments with the Lorenz '96 toy atmospheric system, using the ensemble Kalman filter to perform assimilation. We reduce precision in the forecast and analysis steps of the ensemble Kalman filter and measure how this affects the quality of the data assimilation product, the analysis. We find that the optimal choice of precision is intimately linked with the degree of uncertainty from noisy observations and infrequent assimilation. We also find that precision can be traded for more ensemble members, and that this trade-off delivers a more accurate analysis than otherwise.</p> <p>We then consider the SPEEDY intermediate complexity atmospheric general circulation model, again with the ensemble Kalman filter. In this case we find that, in a perfect model setting, reducing precision in the forecast model gives an unacceptable degradation in the data assimilation product. However, we then show that even a modest degree of model error can mask the errors introduced by reducing precision.</p> <p>We consider also a precision reduction in the 4D-Var data assimilation scheme. We find that reducing precision increases the asymmetry between the tangent-linear and adjoint models, and that this retards the convergence of the minimisation scheme. However, with a standard reorthogonalisation procedure we are able to use single-precision, and even lower levels of precision, successfully.</p> <p>Finally, we consider the use of reduced-precision arithmetic to accelerate the Legendre transforms of an operational global weather forecasting model. We find that, with a few considerations of the algorithmic structure of the transforms and the physical meaning of the different components, we are able to use even half-precision without affecting the forecast skill of the model.</p> <p>In conclusion, we find that the errors introduced by reducing precision are negligible with respect to inherent errors in the forecasting system. In order to make optimal use of future supercomputers, reduced-precision arithmetic will be key.</p> |
| first_indexed | 2024-03-06T23:04:06Z |
| format | Thesis |
| id | oxford-uuid:633244e2-0a6a-47e1-aa4f-dcb656583c83 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-06T23:04:06Z |
| publishDate | 2019 |
| record_format | dspace |
| spelling | oxford-uuid:633244e2-0a6a-47e1-aa4f-dcb656583c832022-03-26T18:11:17ZReduced-precision arithmetic in numerical weather prediction with an emphasis on data assimilationThesishttp://purl.org/coar/resource_type/c_db06uuid:633244e2-0a6a-47e1-aa4f-dcb656583c83data assimilationhigh-performance computingNumerical weather forecastingEnglishORA Deposit2019Hatfield, SPalmer, TDueben, P<p>The skill of weather forecasts has improved dramatically over the past 30 years. This improvement has depended to a large degree on developments in supercomputing, which have allowed models to increase in complexity and resolution with minimal technical effort. However, the nature of supercomputing is undergoing a significant change, with the advent of extremely parallel and heterogeneous architectures. This paradigm shift threatens the continual increase of forecast skill and prompts a reevaluation of how Earth-System models are developed. In this thesis we explore the notion of reduced-precision arithmetic to accelerate Earth-System models, specifically those used in data assimilation and in numerical weather prediction.</p> <p>We first conduct data assimilation experiments with the Lorenz '96 toy atmospheric system, using the ensemble Kalman filter to perform assimilation. We reduce precision in the forecast and analysis steps of the ensemble Kalman filter and measure how this affects the quality of the data assimilation product, the analysis. We find that the optimal choice of precision is intimately linked with the degree of uncertainty from noisy observations and infrequent assimilation. We also find that precision can be traded for more ensemble members, and that this trade-off delivers a more accurate analysis than otherwise.</p> <p>We then consider the SPEEDY intermediate complexity atmospheric general circulation model, again with the ensemble Kalman filter. In this case we find that, in a perfect model setting, reducing precision in the forecast model gives an unacceptable degradation in the data assimilation product. However, we then show that even a modest degree of model error can mask the errors introduced by reducing precision.</p> <p>We consider also a precision reduction in the 4D-Var data assimilation scheme. We find that reducing precision increases the asymmetry between the tangent-linear and adjoint models, and that this retards the convergence of the minimisation scheme. However, with a standard reorthogonalisation procedure we are able to use single-precision, and even lower levels of precision, successfully.</p> <p>Finally, we consider the use of reduced-precision arithmetic to accelerate the Legendre transforms of an operational global weather forecasting model. We find that, with a few considerations of the algorithmic structure of the transforms and the physical meaning of the different components, we are able to use even half-precision without affecting the forecast skill of the model.</p> <p>In conclusion, we find that the errors introduced by reducing precision are negligible with respect to inherent errors in the forecasting system. In order to make optimal use of future supercomputers, reduced-precision arithmetic will be key.</p> |
| spellingShingle | data assimilation high-performance computing Numerical weather forecasting Hatfield, S Reduced-precision arithmetic in numerical weather prediction with an emphasis on data assimilation |
| title | Reduced-precision arithmetic in numerical weather prediction with an emphasis on data assimilation |
| title_full | Reduced-precision arithmetic in numerical weather prediction with an emphasis on data assimilation |
| title_fullStr | Reduced-precision arithmetic in numerical weather prediction with an emphasis on data assimilation |
| title_full_unstemmed | Reduced-precision arithmetic in numerical weather prediction with an emphasis on data assimilation |
| title_short | Reduced-precision arithmetic in numerical weather prediction with an emphasis on data assimilation |
| title_sort | reduced precision arithmetic in numerical weather prediction with an emphasis on data assimilation |
| topic | data assimilation high-performance computing Numerical weather forecasting |
| work_keys_str_mv | AT hatfields reducedprecisionarithmeticinnumericalweatherpredictionwithanemphasisondataassimilation |