Stabilization of Stochastic Iterative Methods for Singular and Nearly Singular Linear Systems

We consider linear systems of equations, Ax = b, with an emphasis on the case where A is singular. Under certain conditions, necessary as well as sufficient, linear deterministic iterative methods generate sequences {x[subscript k]} that converge to a solution as long as there exists at least one so...

Full description

Bibliographic Details
Main Authors: Wang, Mengdi, Bertsekas, Dimitri P.
Other Authors: Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Format: Article
Language:en_US
Published: Institute for Operations Research and the Management Sciences (INFORMS) 2015
Online Access:http://hdl.handle.net/1721.1/99752
https://orcid.org/0000-0001-6909-7208
Description
Summary:We consider linear systems of equations, Ax = b, with an emphasis on the case where A is singular. Under certain conditions, necessary as well as sufficient, linear deterministic iterative methods generate sequences {x[subscript k]} that converge to a solution as long as there exists at least one solution. This convergence property can be impaired when these methods are implemented with stochastic simulation, as is often done in important classes of large-scale problems. We introduce additional conditions and novel algorithmic stabilization schemes under which {x[subscript k]} converges to a solution when A is singular and may also be used with substantial benefit when A is nearly singular.