Towards fast, generic video inpainting

Alasdair Newson (1) , Matthieu Fradet (2) , Patrick Pérez (1) , Andrés Almansa (3) , Yann Gousseau (3, 4)

1 Technicolor R & I [Cesson Sévigné]
2 Technicolor Imaging Science Lab
3 LTCI - Laboratoire Traitement et Communication de l'Information
4 Télécom ParisTech

Achieving globally coherent video inpainting results in reasonable time and in an automated manner is still an open problem. In this paper, we build on the seminal work by Wexler et al. to propose an automatic video inpainting algorithm yielding convincing results in greatly reduced computational times. We extend the PatchMatch algorithm to the spatio-temporal case in order to accelerate the search for approximate nearest neighbours in the patch space. We also provide a simple and fast solution to the well known over-smoothing problem resulting from the averaging of patches. Furthermore, we show that results similar to those of a supervised state-of-the-art method may be obtained on high resolution videos without any manual intervention. Our results indicate that globally coherent patch-based algorithms are feasible and an attractive solution to the difficult problem of video inpainting.

Mots clés: exemplar-based; PatchMatch; Video inpainting; patches; spacetime occlusion

Domaines: Traitement des images [eess.IV]

Alasdair Newson, Matthieu Fradet, Patrick Pérez, Andrés Almansa, Yann Gousseau. Towards fast, generic video inpainting. Proceedings of the 10th European Conference on Visual Media Production - CVMP ’13, ACM SIGGRAPH, Nov 2013, London, United Kingdom. ⟨10.1145/2534008.2534019⟩. ⟨hal-00838927⟩