Machine Learning Predictors of Extreme Events Occurring in Complex Dynamical Systems
The ability to characterize and predict extreme events is a vital topic in fields ranging from finance to ocean engineering. Typically, the most-extreme events are also the most-rare, and it is this property that makes data collection and direct simulation challenging. We consider the problem of der...
Main Authors: | , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
MDPI AG
2020
|
Online Access: | https://hdl.handle.net/1721.1/125399 |
_version_ | 1826201240947654656 |
---|---|
author | Guth, Stephen Carrol Sapsis, Themistoklis Panagiotis |
author2 | Massachusetts Institute of Technology. Department of Mechanical Engineering |
author_facet | Massachusetts Institute of Technology. Department of Mechanical Engineering Guth, Stephen Carrol Sapsis, Themistoklis Panagiotis |
author_sort | Guth, Stephen Carrol |
collection | MIT |
description | The ability to characterize and predict extreme events is a vital topic in fields ranging from finance to ocean engineering. Typically, the most-extreme events are also the most-rare, and it is this property that makes data collection and direct simulation challenging. We consider the problem of deriving optimal predictors of extremes directly from data characterizing a complex system, by formulating the problem in the context of binary classification. Specifically, we assume that a training dataset consists of: (i) indicator time series specifying on whether or not an extreme event occurs; and (ii) observables time series, which are employed to formulate efficient predictors. We employ and assess standard binary classification criteria for the selection of optimal predictors, such as total and balanced error and area under the curve, in the context of extreme event prediction. For physical systems for which there is sufficient separation between the extreme and regular events, i.e., extremes are distinguishably larger compared with regular events, we prove the existence of optimal extreme event thresholds that lead to efficient predictors. Moreover, motivated by the special character of extreme events, i.e., the very low rate of occurrence, we formulate a new objective function for the selection of predictors. This objective is constructed from the same principles as receiver operating characteristic curves, and exhibits a geometric connection to the regime separation property. We demonstrate the application of the new selection criterion to the advance prediction of intermittent extreme events in two challenging complex systems: the Majda-McLaughlin-Tabak model, a 1D nonlinear, dispersive wave model, and the 2D Kolmogorov flow model, which exhibits extreme dissipation events. Keywords: optimal predictors; binary classification; rare extreme events; chaotic systems; data-driven methods |
first_indexed | 2024-09-23T11:48:29Z |
format | Article |
id | mit-1721.1/125399 |
institution | Massachusetts Institute of Technology |
language | English |
last_indexed | 2024-09-23T11:48:29Z |
publishDate | 2020 |
publisher | MDPI AG |
record_format | dspace |
spelling | mit-1721.1/1253992022-10-01T06:12:16Z Machine Learning Predictors of Extreme Events Occurring in Complex Dynamical Systems Guth, Stephen Carrol Sapsis, Themistoklis Panagiotis Massachusetts Institute of Technology. Department of Mechanical Engineering The ability to characterize and predict extreme events is a vital topic in fields ranging from finance to ocean engineering. Typically, the most-extreme events are also the most-rare, and it is this property that makes data collection and direct simulation challenging. We consider the problem of deriving optimal predictors of extremes directly from data characterizing a complex system, by formulating the problem in the context of binary classification. Specifically, we assume that a training dataset consists of: (i) indicator time series specifying on whether or not an extreme event occurs; and (ii) observables time series, which are employed to formulate efficient predictors. We employ and assess standard binary classification criteria for the selection of optimal predictors, such as total and balanced error and area under the curve, in the context of extreme event prediction. For physical systems for which there is sufficient separation between the extreme and regular events, i.e., extremes are distinguishably larger compared with regular events, we prove the existence of optimal extreme event thresholds that lead to efficient predictors. Moreover, motivated by the special character of extreme events, i.e., the very low rate of occurrence, we formulate a new objective function for the selection of predictors. This objective is constructed from the same principles as receiver operating characteristic curves, and exhibits a geometric connection to the regime separation property. We demonstrate the application of the new selection criterion to the advance prediction of intermittent extreme events in two challenging complex systems: the Majda-McLaughlin-Tabak model, a 1D nonlinear, dispersive wave model, and the 2D Kolmogorov flow model, which exhibits extreme dissipation events. Keywords: optimal predictors; binary classification; rare extreme events; chaotic systems; data-driven methods 2020-05-21T20:40:12Z 2020-05-21T20:40:12Z 2019-09 2019-09 2019-11-20T16:57:12Z Article http://purl.org/eprint/type/JournalArticle 1099-4300 https://hdl.handle.net/1721.1/125399 Guth, Stephen and Sapsis, Themistoklis P., "Machine Learning Predictors of Extreme Events Occurring in Complex Dynamical Systems." Entropy 21, 10 (September 2019): 925 © 2019 The Author(s). en http://dx.doi.org/10.3390/e21100925 Entropy Creative Commons Attribution 4.0 International license https://creativecommons.org/licenses/by/4.0/ application/pdf MDPI AG MDPI |
spellingShingle | Guth, Stephen Carrol Sapsis, Themistoklis Panagiotis Machine Learning Predictors of Extreme Events Occurring in Complex Dynamical Systems |
title | Machine Learning Predictors of Extreme Events Occurring in Complex Dynamical Systems |
title_full | Machine Learning Predictors of Extreme Events Occurring in Complex Dynamical Systems |
title_fullStr | Machine Learning Predictors of Extreme Events Occurring in Complex Dynamical Systems |
title_full_unstemmed | Machine Learning Predictors of Extreme Events Occurring in Complex Dynamical Systems |
title_short | Machine Learning Predictors of Extreme Events Occurring in Complex Dynamical Systems |
title_sort | machine learning predictors of extreme events occurring in complex dynamical systems |
url | https://hdl.handle.net/1721.1/125399 |
work_keys_str_mv | AT guthstephencarrol machinelearningpredictorsofextremeeventsoccurringincomplexdynamicalsystems AT sapsisthemistoklispanagiotis machinelearningpredictorsofextremeeventsoccurringincomplexdynamicalsystems |