Neural Closure Models for Chaotic Dynamical Systems
An important challenge in the problem of producing accurate forecasts of multiscale dynamics, including but not limited to weather prediction and ocean modeling, is that these dynamical systems are chaotic in nature. A hallmark of chaotic dynamical systems is that they are highly sensitive to small...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2023
|
| Online Access: | https://hdl.handle.net/1721.1/150084 |
| _version_ | 1826200815714435072 |
|---|---|
| author | Jalan, Aman |
| author2 | Lermusiaux, Pierre F.J. |
| author_facet | Lermusiaux, Pierre F.J. Jalan, Aman |
| author_sort | Jalan, Aman |
| collection | MIT |
| description | An important challenge in the problem of producing accurate forecasts of multiscale dynamics, including but not limited to weather prediction and ocean modeling, is that these dynamical systems are chaotic in nature. A hallmark of chaotic dynamical systems is that they are highly sensitive to small perturbations in the initial conditions and parameter values. As a result, even the best physics-based computational models, often derived from first principles but limited by varied sources of errors, have limited predictive capabilities for both shorter-term state forecasts and for important longer-term global characteristics of the true system. Observational data, however, provide an avenue to increase predictive capabilities by learning the physics missing from lower-fidelity computational models and reducing their various errors. Recent advances in machine learning, and specifically data-driven knowledge-based prediction, have made this a possibility but even state-of-the-art techniques in this area have not been able to produce short-term forecasts beyond a small multiple of the Lyapunov time of the system, even for simple chaotic systems such as the Lorenz 63 model. In this work, we develop a training framework to apply neural ordinary differential equation-based (nODE) closure models to correct errors in the equations of such dynamical systems. We first identify the key training parameters that have an outsize effect on the learning ability of the neural closure models. We then develop a novel learning algorithm, broadly consisting of adaptive tuning of these parameters, designing dynamic multi-loss objective functions, and an error-targeting batching process. We evaluate and showcase our methodology to the chaotic Balance Equations in an array of increasingly difficult learning settings: first, only the coefficient of one missing term in one perturbed equation; second, one entire missing term in on perturbed equation; third, two missing terms in two perturbed equations; and finally the previous but with a perturbation being two orders of magnitude larger than the state, thereby resulting in a completely different attractor. In each of these cases, our new multi-faceted training approach drastically increases both state-of-the-art state predictability (upto 15 Lyapunov times) and attractor-reproducibility. Finally, we validate our results by comparing them with the predictability limit of the chaotic BE system under different magnitudes of perturbations. |
| first_indexed | 2024-09-23T11:42:14Z |
| format | Thesis |
| id | mit-1721.1/150084 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T11:42:14Z |
| publishDate | 2023 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1500842023-04-01T03:37:25Z Neural Closure Models for Chaotic Dynamical Systems Jalan, Aman Lermusiaux, Pierre F.J. Massachusetts Institute of Technology. Department of Mechanical Engineering An important challenge in the problem of producing accurate forecasts of multiscale dynamics, including but not limited to weather prediction and ocean modeling, is that these dynamical systems are chaotic in nature. A hallmark of chaotic dynamical systems is that they are highly sensitive to small perturbations in the initial conditions and parameter values. As a result, even the best physics-based computational models, often derived from first principles but limited by varied sources of errors, have limited predictive capabilities for both shorter-term state forecasts and for important longer-term global characteristics of the true system. Observational data, however, provide an avenue to increase predictive capabilities by learning the physics missing from lower-fidelity computational models and reducing their various errors. Recent advances in machine learning, and specifically data-driven knowledge-based prediction, have made this a possibility but even state-of-the-art techniques in this area have not been able to produce short-term forecasts beyond a small multiple of the Lyapunov time of the system, even for simple chaotic systems such as the Lorenz 63 model. In this work, we develop a training framework to apply neural ordinary differential equation-based (nODE) closure models to correct errors in the equations of such dynamical systems. We first identify the key training parameters that have an outsize effect on the learning ability of the neural closure models. We then develop a novel learning algorithm, broadly consisting of adaptive tuning of these parameters, designing dynamic multi-loss objective functions, and an error-targeting batching process. We evaluate and showcase our methodology to the chaotic Balance Equations in an array of increasingly difficult learning settings: first, only the coefficient of one missing term in one perturbed equation; second, one entire missing term in on perturbed equation; third, two missing terms in two perturbed equations; and finally the previous but with a perturbation being two orders of magnitude larger than the state, thereby resulting in a completely different attractor. In each of these cases, our new multi-faceted training approach drastically increases both state-of-the-art state predictability (upto 15 Lyapunov times) and attractor-reproducibility. Finally, we validate our results by comparing them with the predictability limit of the chaotic BE system under different magnitudes of perturbations. S.M. 2023-03-31T14:30:45Z 2023-03-31T14:30:45Z 2023-02 2023-03-01T20:01:54.952Z Thesis https://hdl.handle.net/1721.1/150084 In Copyright - Educational Use Permitted Copyright MIT http://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Jalan, Aman Neural Closure Models for Chaotic Dynamical Systems |
| title | Neural Closure Models for Chaotic Dynamical Systems |
| title_full | Neural Closure Models for Chaotic Dynamical Systems |
| title_fullStr | Neural Closure Models for Chaotic Dynamical Systems |
| title_full_unstemmed | Neural Closure Models for Chaotic Dynamical Systems |
| title_short | Neural Closure Models for Chaotic Dynamical Systems |
| title_sort | neural closure models for chaotic dynamical systems |
| url | https://hdl.handle.net/1721.1/150084 |
| work_keys_str_mv | AT jalanaman neuralclosuremodelsforchaoticdynamicalsystems |