Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks

We introduce a data-driven forecasting method for high-dimensional chaotic systems using long shortterm memory (LSTM) recurrent neural networks. The proposed LSTM neural networks perform inference of high-dimensional dynamical systems in their reduced order space and are shown to be an effective set...

Full description

Bibliographic Details
Main Authors: Vlachas, Pantelis R., Byeon, Wonmin, Koumoutsakos, Petros, Wan, Zhong Yi, Sapsis, Themistoklis P.
Other Authors: Massachusetts Institute of Technology. Department of Mechanical Engineering
Format: Article
Published: The Royal Society 2019
Online Access:http://hdl.handle.net/1721.1/120011
https://orcid.org/0000-0001-7264-3628
https://orcid.org/0000-0003-0302-0691
Description
Summary:We introduce a data-driven forecasting method for high-dimensional chaotic systems using long shortterm memory (LSTM) recurrent neural networks. The proposed LSTM neural networks perform inference of high-dimensional dynamical systems in their reduced order space and are shown to be an effective set of nonlinear approximators of their attractor. We demonstrate the forecasting performance of the LSTM and compare it with Gaussian processes (GPS) in time series obtained from the Lorenz 96 system, the Kuramoto-Sivashinsky equation and a prototype climate model. The LSTM networks outperform the GPS in short-Term forecasting accuracy in all applications considered. A hybrid architecture, extending the LSTM with a mean stochastic model (MSM-LSTM), is proposed to ensure convergence to the invariant measure. This novel hybrid method is fully data-driven and extends the forecasting capabilities of LSTM networks.