Dense and Accurate Spatio-Temporal Multi-View Stereovision IMAGINE Research Report 09-43

Jérôme Courchay 1 Jean-Philippe Pons 2 Renaud Keriven 1 Pascal Monasse 1
1 IMAGINE [Marne-la-Vallée]
LIGM - Laboratoire d'Informatique Gaspard-Monge, CSTB - Centre Scientifique et Technique du Bâtiment, ENPC - École des Ponts ParisTech
Abstract : In this report, we describe a novel method to simultaneously and accurately estimate the 3D shape and 3D motion of a dynamic scene from multiple-viewpoint calibrated videos. We follow a variational approach in the vein of previous work on stereo reconstruction and scene flow estimation. We adopt a representation of a dynamic scene by an animated mesh, i.e. a polygonal mesh with fixed connectivity whose time-varying vertex positions sample the trajectories of material points. Interestingly, this representation ensures a consistent coding of shape and motion by construction. Our method accurately recovers 3D shape and 3D motion by optimizing the positions of the vertices of the animated mesh. This optimization is driven by an energy function which incorporates multi-view and inter-frame photo-consistency, smoothness of the spatio-temporal surface and of the velocity field. Central to our work is an image-based photo-consistency score which can be efficiently computed and which fully handles projective distortion and partial occlusions. We demonstrate the effectiveness of our method on several challenging real-world dynamic scenes.
Type de document :
Autre publication
RR-0943. In this report, we describe a novel method to simultaneously and accurately estimate the 3D shape.. 2009
Liste complète des métadonnées

Littérature citée [29 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-00404929
Contributeur : Jérôme Courchay <>
Soumis le : vendredi 17 juillet 2009 - 16:42:32
Dernière modification le : mardi 19 février 2019 - 16:58:06
Document(s) archivé(s) le : mercredi 22 septembre 2010 - 13:01:16

Identifiants

  • HAL Id : hal-00404929, version 2

Collections

Citation

Jérôme Courchay, Jean-Philippe Pons, Renaud Keriven, Pascal Monasse. Dense and Accurate Spatio-Temporal Multi-View Stereovision IMAGINE Research Report 09-43. RR-0943. In this report, we describe a novel method to simultaneously and accurately estimate the 3D shape.. 2009. 〈hal-00404929v2〉

Partager

Métriques

Consultations de la notice

329

Téléchargements de fichiers

135