CoolMomentum: a method for stochastic optimization by Langevin dynamics with simulated annealing

Abstract Deep learning applications require global optimization of non-convex objective functions, which have multiple local minima. The same problem is often found in physical simulations and may be resolved by the methods of Langevin dynamics with Simulated Annealing, which is a well-established a...

Full description

Bibliographic Details
Main Authors: Oleksandr Borysenko, Maksym Byshkin
Format: Article
Language:English
Published: Nature Portfolio 2021-05-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-021-90144-3