Contraction theory analysis of echo state networks

Nowadays, the more and more intelligent and inter-disciplinary industrial tasks impose an increasingly strict requirement on the control system design, and thus, a more intensive research in the field of dynamic computation, control stability and robustness, as well as a deeper exploitation of im...

Full description

Bibliographic Details
Main Author: Yang, Taozheng
Other Authors: Pham Quang Cuong
Format: Final Year Project (FYP)
Language:English
Published: 2017
Subjects:
Online Access:http://hdl.handle.net/10356/70570
_version_ 1826115168962084864
author Yang, Taozheng
author2 Pham Quang Cuong
author_facet Pham Quang Cuong
Yang, Taozheng
author_sort Yang, Taozheng
collection NTU
description Nowadays, the more and more intelligent and inter-disciplinary industrial tasks impose an increasingly strict requirement on the control system design, and thus, a more intensive research in the field of dynamic computation, control stability and robustness, as well as a deeper exploitation of implementing the ar- tificial intelligence methodology, for instance, recurrent neural networks (RNNs); such as precise control, motion planning and events detection for industry robots; stochastic events prediction in natural language processing. This report discusses the relationship between a nonlinear contraction control theory and echo state network (a specific type of neural network belonging to RNN), various proper- ties of echo state network (ESN), and applications of echo state network (ESN). Specifically, various sufficient conditions for a system to have echo state property (ESP) are investigated and compared, a sufficient condition for nonlinear con- traction theory was derived mathematically, the connections as well as nuances between these two properties are explored, and the short-term memory capacity of an echo state network is studied. It is discovered that with the contracting property, an echo state network is faster and easier to be trained to tackle com- plicated practical tasks, especially the nonlinear dynamical system.
first_indexed 2024-10-01T03:51:08Z
format Final Year Project (FYP)
id ntu-10356/70570
institution Nanyang Technological University
language English
last_indexed 2024-10-01T03:51:08Z
publishDate 2017
record_format dspace
spelling ntu-10356/705702023-03-04T19:05:03Z Contraction theory analysis of echo state networks Yang, Taozheng Pham Quang Cuong School of Mechanical and Aerospace Engineering Robotics Research Centre DRNTU::Engineering::Mechanical engineering Nowadays, the more and more intelligent and inter-disciplinary industrial tasks impose an increasingly strict requirement on the control system design, and thus, a more intensive research in the field of dynamic computation, control stability and robustness, as well as a deeper exploitation of implementing the ar- tificial intelligence methodology, for instance, recurrent neural networks (RNNs); such as precise control, motion planning and events detection for industry robots; stochastic events prediction in natural language processing. This report discusses the relationship between a nonlinear contraction control theory and echo state network (a specific type of neural network belonging to RNN), various proper- ties of echo state network (ESN), and applications of echo state network (ESN). Specifically, various sufficient conditions for a system to have echo state property (ESP) are investigated and compared, a sufficient condition for nonlinear con- traction theory was derived mathematically, the connections as well as nuances between these two properties are explored, and the short-term memory capacity of an echo state network is studied. It is discovered that with the contracting property, an echo state network is faster and easier to be trained to tackle com- plicated practical tasks, especially the nonlinear dynamical system. Bachelor of Engineering (Mechanical Engineering) 2017-05-02T02:33:30Z 2017-05-02T02:33:30Z 2017 Final Year Project (FYP) http://hdl.handle.net/10356/70570 en Nanyang Technological University 42 p. application/pdf
spellingShingle DRNTU::Engineering::Mechanical engineering
Yang, Taozheng
Contraction theory analysis of echo state networks
title Contraction theory analysis of echo state networks
title_full Contraction theory analysis of echo state networks
title_fullStr Contraction theory analysis of echo state networks
title_full_unstemmed Contraction theory analysis of echo state networks
title_short Contraction theory analysis of echo state networks
title_sort contraction theory analysis of echo state networks
topic DRNTU::Engineering::Mechanical engineering
url http://hdl.handle.net/10356/70570
work_keys_str_mv AT yangtaozheng contractiontheoryanalysisofechostatenetworks