Agents Behavior Semi-automatic Analysis through Their Comparison to Human Behavior Clustering

Kévin Darty (1) , Julien Saunier (2) , Nicolas Sabouret (3)

1 IFSTTAR/COSYS/LEPSIS - Laboratoire Exploitation, Perception, Simulateurs et Simulations
2 LITIS - Laboratoire d'Informatique, de Traitement de l'Information et des Systèmes
3 LIMSI - Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur

This paper presents a generic method to evaluate virtual agents that aim at reproducing humans behaviors in an immersive virtual environment. We first use automated clustering of simulation logs to extract humans behaviors. We then propose an aggregation of the agents logs into those clusters to analyze the credibility of agents behaviors in terms of capacities, lacks, and errors by comparing them to humans ones. We complete this analysis with a subjective evaluation based on a questionnaire filled by human annotators to draw categories of users, making their behaviors explicit. We illustrate this method in the context of immersive driving simulation.

Mots clés: Virtual autonomous agent; virtual environment; behavior analysis; clustering and aggregation; logs explicitation

Domaines: Intelligence artificielle [cs.AI]

Kévin Darty, Julien Saunier, Nicolas Sabouret. Agents Behavior Semi-automatic Analysis through Their Comparison to Human Behavior Clustering. 14th International Conference on Intelligent Virtual Agents (IVA 2014), Aug 2014, Boston, MA, United States. pp 154-163, ⟨10.1007/978-3-319-09767-1_18⟩. ⟨hal-01062385v2⟩