Visual-Based Eye Contact Detection in Multi-Person Interactions

Mahmoud Qodseya (1) , Franck Jeveme Panta (1) , Florence Sèdes (1)

1 IRIT-SIG - Systèmes d’Informations Généralisées

Visual non-verbal behavior analysis (VNBA) methods mainly depend on extracting an important and essential social cue, called eye contact, for performing a wide range of analysis such as dominant person detection. Besides the major need for an automated eye-contact detection method, existing state-of-the-art methods require intrusive devices for detecting any contacts at the eye-level. Also, such methods are completely dependent on supervised learning approaches to produce eye-contact classification models, raising the need for ground truth datasets. To overcome the limitations of existing techniques, we propose a novel geometrical method to detect eye contact in natural multi-person interactions without the need for any intrusive eye-tracking device. We have experimented our method on 10 social videos, each 20 minutes long. Experiments demonstrate highly competitive efficiency with regards to classification performance, compared to the classical existing supervised eye contact detection methods.

Mots clés: Eye contact detection; Visual nonverbal behavior analysis; Social interaction

Domaines: Recherche d'information [cs.IR]

Mahmoud Qodseya, Franck Jeveme Panta, Florence Sèdes. Visual-Based Eye Contact Detection in Multi-Person Interactions. International Conference on Content-Based Multimedia Indexing (CBMI 2019), Sep 2019, Dublin, Ireland. pp.1-6, ⟨10.1109/CBMI.2019.8877471⟩. ⟨hal-02930110⟩