A Motion-Based Feature for Event-Based Pattern Recognition

Xavier Clady (1) , Jean-Matthieu Maro (1) , Sébastien B Barré (1) , Ryad B. Benosman (1)

1 Institut de la Vision

This paper introduces an event-based luminance-free feature from the output of asynchronous event-based neuromorphic retinas. The feature consists in mapping the distribution of the optical flow along the contours of the moving objects in the visual scene into a matrix. Asynchronous event-based neuromorphic retinas are composed of autonomous pixels, each of them asynchronously generating " spiking " events that encode relative changes in pixels' illumination at high temporal resolutions. The optical flow is computed at each event, and is integrated locally or globally in a speed and direction coordinate frame based grid, using speed-tuned temporal kernels. The latter ensures that the resulting feature equitably represents the distribution of the normal motion along the current moving edges, whatever their respective dynamics. The usefulness and the generality of the proposed feature are demonstrated in pattern recognition applications: local corner detection and global gesture recognition.

Mots clés: neuromorphic sensor; event-driven vision; pattern recognition; motion-based feature; speed-tuned integration time; histogram of oriented optical flow; corner detection; gesture recognition

Domaines: Neurosciences [q-bio.NC]

Xavier Clady, Jean-Matthieu Maro, Sébastien B Barré, Ryad B. Benosman. A Motion-Based Feature for Event-Based Pattern Recognition. Frontiers in Neuroscience, 2017, 10, pp.594. ⟨10.3389/fnins.2016.00594⟩. ⟨hal-01449343⟩