Stochastic Forward–Backward Splitting for Monotone Inclusions

We propose and analyze the convergence of a novel stochastic algorithm for monotone inclusions that are sum of a maximal monotone operator and a single-valued cocoercive operator. The algorithm we propose is a natural stochastic extension of the classical forward–backward method. We provide a non-as...

Full description

Bibliographic Details
Main Authors: Villa, Silvia, Vũ, Bang Công, Rosasco, Lorenzo Andrea
Other Authors: Massachusetts Institute of Technology. Laboratory for Computational and Statistical Learning
Format: Article
Language:English
Published: Springer US 2016
Online Access:http://hdl.handle.net/1721.1/103419
https://orcid.org/0000-0001-6376-4786
Description
Summary:We propose and analyze the convergence of a novel stochastic algorithm for monotone inclusions that are sum of a maximal monotone operator and a single-valued cocoercive operator. The algorithm we propose is a natural stochastic extension of the classical forward–backward method. We provide a non-asymptotic error analysis in expectation for the strongly monotone case, as well as almost sure convergence under weaker assumptions. For minimization problems, we recover rates matching those obtained by stochastic extensions of the so-called accelerated methods. Stochastic quasi-Fejér’s sequences are a key technical tool to prove almost sure convergence.