Articulated Motion Capture from 3-D Points and Normals

Matti Niskanen (1) , Edmond Boyer (2) , Radu Horaud (2)

1 MVG - Machine Vision Group
2 PERCEPTION - Interpretation and Modelling of Images and Videos

In this paper we address the problem of tracking the motion of articulated objects from their 2-D silhouettes gathered with several cameras. The vast majority of existing approaches relies on a single camera or on stereo. We describe a new method which requires at least two cameras. The method relies on (i) building 3-D observations (points and normals) from image silhouettes and on (ii) fitting an articulated object model to these observations by minimizing their discrepancies. The objective function sums up these discrepancies while it takes into account both the scaled algebraic distance from data points to the model surface and the offset in orientation between observed normals and model normals. The combination of a feed-forward reconstruction technique with a robust model-tracking method results in a reliable and efficient method for articulated motion capture.

Domaines: Synthèse d'image et réalité virtuelle [cs.GR]

Matti Niskanen, Edmond Boyer, Radu Horaud. Articulated Motion Capture from 3-D Points and Normals. British Machine Vision Conference (BMVC '05), Sep 2005, Oxford, United Kingdom. pp.439--448. ⟨inria-00590195⟩