Non-Local Manifold Tangent Learning

Yoshua Bengio (1) , Martin Monperrus (1)

1 DIRO - Département d'Informatique et de Recherche Opérationnelle [Montreal]

We claim and present arguments to the effect that a large class of manifold learning algorithms that are essentially local and can be framed as kernel learning algorithms will suffer from the curse of dimensionality, at the dimension of the true underlying manifold. This observation suggests to explore non-local manifold learning algorithms which attempt to discover shared structure in the tangent planes at different positions. A criterion for such an algorithm is proposed and experiments estimating a tangent plane prediction function are presented, showing its advantages with respect to local manifold learning algorithms: it is able to generalize very far from training data (on learning handwritten character image rotations), where a local non-parametric method fails.

Domaines: Génie logiciel [cs.SE]

Yoshua Bengio, Martin Monperrus. Non-Local Manifold Tangent Learning. Advances in Neural Information Processing Systems, 2004, Vancouver, Canada. pp.129-136. ⟨hal-01575349⟩