Perceptual principles for video classification with Slow Feature Analysis

Abstract : At the core of vision research is the notion of perceptual invariance. The question of how the visual system is able to develop stable or invariant states through the ever transforming environment is central to understanding the brain's recognition process. The coined term slowness principle used in slow feature analysis is a reference to the brain's ability to generate slow changing and thus stable percepts in response to the fast varying visual stimulations in the environment. Based on this principle this paper deals with categorization of video sequences composed of dynamic natural scenes. Unlike models relying on supervised learning or handcrafted descriptors, we represent videos using unsupervised learning of motion features. Our method is based on: 1) Slow feature analysis principle from which motion features representing the principal and more stable motion components of training videos are learned. 2) Integration of the local motion feature into a global classification architecture. Classification experiments produce 11% and 19% improvements compared to state-of-the-art methods on two dynamic natural scenes data sets. A quantitative and qualitative analysis illustrates how the learned slow features untangle the input manifolds and remain stable under various parameters settings.
Document type :
Journal articles
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01185462
Contributor : Lip6 Publications <>
Submitted on : Thursday, August 20, 2015 - 11:32:14 AM
Last modification on : Thursday, November 22, 2018 - 2:51:30 PM

Identifiers

Collections

Citation

Christian Theriault, Nicolas Thome, Matthieu Cord, Patrick Pérez. Perceptual principles for video classification with Slow Feature Analysis. IEEE Journal of Selected Topics in Signal Processing, IEEE, 2014, 8 (3), pp.428-437. ⟨10.1109/JSTSP.2014.2315742⟩. ⟨hal-01185462⟩

Share

Metrics

Record views

121