Direct optimization through arg max for discrete variational auto-encoder

Reparameterization of variational auto-encoders with continuous random variables is an effective method for reducing the variance of their gradient estimates. In the discrete case, one can perform reparametrization using the Gumbel-Max trick, but the resulting objective relies on an arg max operatio...

Full description

Bibliographic Details
Main Authors: Gane, Andreea, Jaakkola, Tommi S
Other Authors: Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Format: Article
Language:English
Published: Morgan Kaufmann Publishers 2021
Online Access:https://hdl.handle.net/1721.1/129438