Robust detection of conversational groups using a voting scheme and a memory process

Victor Fortier (1) , Isabelle Bloch (1) , Catherine Pelachaud (2)

1 LFI - Learning, Fuzzy and Intelligent systems
2 ISIR - Institut des Systèmes Intelligents et de Robotique

Studies in human-human interaction have introduced the concept of F-formation to describe the spatial organization of participants during social interaction. This paper aims at detecting such Fformations in images of video sequences. The proposed approach combines a voting scheme in the visual field of each participant and a memory process to make the detection in each frame robust to small, irrelevant changes of participant's behavior. Results on the MatchNMingle data set demonstrate the good performances of this approach.

Keywords: F-formation; Clustering; Temporal regularity

Domains: Human-Computer Interaction [cs.HC]

Victor Fortier, Isabelle Bloch, Catherine Pelachaud. Robust detection of conversational groups using a voting scheme and a memory process. 3rd International Conference on Pattern Recognition and Artificial Intelligence, Jun 2022, Paris, France. pp.162-173, ⟨10.1007/978-3-031-09282-4_14⟩. ⟨hal-03845965⟩