Unsupervised Online Learning of Visual Focus of Attention

Stefan Duffner (1) , Christophe Garcia (1)

1 imagine - Extraction de Caractéristiques et Identification

In this paper, we propose a novel approach for estimating visual focus of attention in video streams. The method is based on an unsupervised algorithm that incrementally learns the different appearance clusters from low-level visual features extracted from face patches provided by a face tracker. The clusters learnt in that way can then be used to classify the different visual attention targets of a given person during a tracking run, without any prior knowledge on the environment and the configuration of the room or the present persons. Experiments on public datasets containing almost two hours of annotated videos from meetings and video-conferencing show that the proposed algorithm produces state-of-the-art results and even outperforms a traditional supervised method that is based on head orientation estimation and that classifies visual focus of attention using Gaussian Mixture Models.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Stefan Duffner, Christophe Garcia. Unsupervised Online Learning of Visual Focus of Attention. 10-th IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS 2013), Aug 2013, Krakow, Poland. pp.25-30. ⟨hal-00976391⟩