Optimization based methods for partially observed chaotic systems

In this paper we consider filtering and smoothing of partially observed chaotic dynamical systems that are discretely observed, with an additive Gaussian noise in the observation. These models are found in a wide variety of real applications and include the Lorenz 96’ model. In the context of a fixe...

Full description

Bibliographic Details
Main Authors: Paulin, D, Jasra, A, Crisan, D, Beskos, A
Format: Journal article
Published: Springer US 2018
_version_ 1797075460436262912
author Paulin, D
Jasra, A
Crisan, D
Beskos, A
author_facet Paulin, D
Jasra, A
Crisan, D
Beskos, A
author_sort Paulin, D
collection OXFORD
description In this paper we consider filtering and smoothing of partially observed chaotic dynamical systems that are discretely observed, with an additive Gaussian noise in the observation. These models are found in a wide variety of real applications and include the Lorenz 96’ model. In the context of a fixed observation interval T , observation time step h and Gaussian observation variance σ2 Z , we show under assumptions that the filter and smoother are well approximated by a Gaussian with high probability when h and σ2 Z h are sufficiently small. Based on this result we show that the maximum a posteriori (MAP) estimators are asymptotically optimal in mean square error as σ2 Z h tends to 0. Given these results, we provide a batch algorithm for the smoother and filter, based on Newton’s method, to obtain the MAP. In particular, we show that if the initial point is close enough to the MAP, then Newton’s method converges to it at a fast rate. We also provide a method for computing such an initial point. These results contribute to the theoretical understanding of widely used 4D-Var data assimilation method. Our approach is illustrated numerically on the Lorenz 96’ model with state vector up to 1 million dimensions, with code running in the order of minutes. To our knowledge the results in this paper are the first of their type for this class of models.
first_indexed 2024-03-06T23:50:42Z
format Journal article
id oxford-uuid:727d47a7-97e1-4910-b727-ce8cbbe42b00
institution University of Oxford
last_indexed 2024-03-06T23:50:42Z
publishDate 2018
publisher Springer US
record_format dspace
spelling oxford-uuid:727d47a7-97e1-4910-b727-ce8cbbe42b002022-03-26T19:50:26ZOptimization based methods for partially observed chaotic systemsJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:727d47a7-97e1-4910-b727-ce8cbbe42b00Symplectic Elements at OxfordSpringer US2018Paulin, DJasra, ACrisan, DBeskos, AIn this paper we consider filtering and smoothing of partially observed chaotic dynamical systems that are discretely observed, with an additive Gaussian noise in the observation. These models are found in a wide variety of real applications and include the Lorenz 96’ model. In the context of a fixed observation interval T , observation time step h and Gaussian observation variance σ2 Z , we show under assumptions that the filter and smoother are well approximated by a Gaussian with high probability when h and σ2 Z h are sufficiently small. Based on this result we show that the maximum a posteriori (MAP) estimators are asymptotically optimal in mean square error as σ2 Z h tends to 0. Given these results, we provide a batch algorithm for the smoother and filter, based on Newton’s method, to obtain the MAP. In particular, we show that if the initial point is close enough to the MAP, then Newton’s method converges to it at a fast rate. We also provide a method for computing such an initial point. These results contribute to the theoretical understanding of widely used 4D-Var data assimilation method. Our approach is illustrated numerically on the Lorenz 96’ model with state vector up to 1 million dimensions, with code running in the order of minutes. To our knowledge the results in this paper are the first of their type for this class of models.
spellingShingle Paulin, D
Jasra, A
Crisan, D
Beskos, A
Optimization based methods for partially observed chaotic systems
title Optimization based methods for partially observed chaotic systems
title_full Optimization based methods for partially observed chaotic systems
title_fullStr Optimization based methods for partially observed chaotic systems
title_full_unstemmed Optimization based methods for partially observed chaotic systems
title_short Optimization based methods for partially observed chaotic systems
title_sort optimization based methods for partially observed chaotic systems
work_keys_str_mv AT paulind optimizationbasedmethodsforpartiallyobservedchaoticsystems
AT jasraa optimizationbasedmethodsforpartiallyobservedchaoticsystems
AT crisand optimizationbasedmethodsforpartiallyobservedchaoticsystems
AT beskosa optimizationbasedmethodsforpartiallyobservedchaoticsystems