HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Stochastic Latent Residual Video Prediction

Abstract : Designing video prediction models that account for the inherent uncertainty of the future is challenging. Most works in the literature are based on stochastic image-autoregressive recurrent networks, which raises several performance and applicability issues. An alternative is to use fully latent temporal models which untie frame synthesis and temporal dynamics. However, no such model for stochastic video prediction has been proposed in the literature yet, due to design and training difficulties. In this paper, we overcome these difficulties by introducing a novel stochastic temporal model whose dynamics are governed in a latent space by a residual update rule. This first-order scheme is motivated by discretization schemes of differential equations. It naturally models video dynamics as it allows our simpler, more interpretable, latent model to outperform prior state-of-the-art methods on challenging datasets.
Complete list of metadata

Cited literature [15 references]  Display  Hide  Download

Contributor : Jean-Yves Franceschi Connect in order to contact the contributor
Submitted on : Saturday, August 1, 2020 - 8:34:48 PM
Last modification on : Wednesday, March 16, 2022 - 3:44:11 AM


Files produced by the author(s)


Distributed under a Creative Commons Attribution 4.0 International License


  • HAL Id : hal-02484182, version 4
  • ARXIV : 2002.09219


Jean-Yves Franceschi, Edouard Delasalles, Mickaël Chen, Sylvain Lamprier, Patrick Gallinari. Stochastic Latent Residual Video Prediction. Thirty-seventh International Conference on Machine Learning, International Machine Learning Society, Jul 2020, Vienne, Austria. pp.3233--3246. ⟨hal-02484182v4⟩



Record views


Files downloads