Tighter variational bounds are not necessarily better

We provide theoretical and empirical evidence that using tighter evidence lower bounds (ELBOs) can be detrimental to the process of learning an inference network by reducing the signal-to-noise ratio of the gradient estimator. Our results call into question common implicit assumptions that tighter E...

全面介绍

书目详细资料
Main Authors: Rainforth, T, Kosiorek, A, Le, T, Maddison, C, Igl, M, Wood, F, Teh, Y
格式: Conference item
语言:English
出版: Proceedings of Machine Learning Research 2018