Modeling Perception-Action Loops: Comparing Sequential Models with Frame-Based Classifiers

Alaeddine Mihoub 1, 2, * Gérard Bailly 2 Christian Wolf 1
* Corresponding author
1 imagine - Extraction de Caractéristiques et Identification
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
2 GIPSA-MAGIC - MAGIC
GIPSA-DPC - Département Parole et Cognition
Abstract : Modeling multimodal perception-action loops in face-to-face interactions is a crucial step in the process of building sensory-motor behaviors for social robots or users-aware Embodied Conversational Agents (ECA). In this paper, we compare trainable behavioral models based on sequential models (HMMs) and classifiers (SVMs and Decision Trees) inherently inappropriate to model sequential aspects. These models aim at giving pertinent perception/action skills for robots in order to generate optimal actions given the perceived actions of others and joint goals. We applied these models to parallel speech and gaze data collected from interacting dyads. The challenge was to predict the gaze of one subject given the gaze of the interlocutor and the voice activity of both. We show that Incremental Discrete HMM (IDHMM) generally outperforms classifiers and that injecting input context in the modeling process significantly improves the performances of all algorithms.
Complete list of metadatas

Cited literature [29 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01061454
Contributor : Alaeddine Mihoub <>
Submitted on : Friday, September 5, 2014 - 7:13:16 PM
Last modification on : Tuesday, February 26, 2019 - 4:35:37 PM
Long-term archiving on : Saturday, December 6, 2014 - 11:47:00 AM

File

HAI_2014.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01061454, version 1

Citation

Alaeddine Mihoub, Gérard Bailly, Christian Wolf. Modeling Perception-Action Loops: Comparing Sequential Models with Frame-Based Classifiers. The Second International Conference on Human-Agent Interaction (HAI 2014), Oct 2014, Tsukuba, Japan. pp.309-314. ⟨hal-01061454⟩

Share

Metrics

Record views

669

Files downloads

263