Skip to Main content Skip to Navigation
Conference papers

Adaptive Density Estimation for Generative Models

Thomas Lucas 1 Konstantin Shmelkov 1 Cordelia Schmid 1 Karteek Alahari 1 Jakob Verbeek 1 
1 Thoth - Apprentissage de modèles à partir de données massives
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann
Abstract : Unsupervised learning of generative models has seen tremendous progress over recent years, in particular due to generative adversarial networks (GANs), variational autoencoders, and flow-based models. GANs have dramatically improved sample quality, but suffer from two drawbacks: (i) they mode-drop, i.e., do not cover the full support of the train data, and (ii) they do not allow for likelihood evaluations on held-out data. In contrast likelihood-based training encourages models to cover the full support of the train data, but yields poorer samples. These mutual short comings can in principle be addressed by training generative latent variable models in a hybrid adversarial-likelihood manner. However, we show that commonly made parametric assumptions create a conflict between them, making successful hybrid models non trivial. As a solution, we propose to use deep invertible transformations in the latent variable decoder. This approach allows for likelihood computations in image space, is more efficient than fully invertible models, and can take full advantage of adversarial training. We show that our model significantly improves over existing hybrid models: offering GAN-like samples, IS and FID scores thatare competitive with fully adversarial models, and improved likelihood scores.
Document type :
Conference papers
Complete list of metadata

Cited literature [54 references]  Display  Hide  Download
Contributor : Jakob Verbeek Connect in order to contact the contributor
Submitted on : Friday, February 14, 2020 - 9:49:48 AM
Last modification on : Wednesday, May 4, 2022 - 12:18:03 PM
Long-term archiving on: : Friday, May 15, 2020 - 12:30:48 PM


Files produced by the author(s)


  • HAL Id : hal-01886285, version 5



Thomas Lucas, Konstantin Shmelkov, Cordelia Schmid, Karteek Alahari, Jakob Verbeek. Adaptive Density Estimation for Generative Models. NeurIPS 2019 - Thirty-third Conference on Neural Information Processing Systems, Dec 2019, Vancouver, Canada. pp.11993-12003. ⟨hal-01886285v5⟩



Record views


Files downloads