From Automatic Sound Analysis of Gameplay Footage [Echos] to the Understanding of Player Experience [Ethos]: an Interdisciplinary Approach to Feedback- Based Gameplay Metrics

Raphael Marczak (1) , Pierre Hanna (2) , Jean-Luc Rouas (2) , Jasper van Vught (1) , Gareth Schott (1)

1 University of waikato
2 LaBRI - Laboratoire Bordelais de Recherche en Informatique

In line with the ICMC|SMC|2014 conference theme "from digital echos to virtual ethos", and the conference interdisciplinary main objective; the present paper is seeking to demonstrate that the sound feedback stream produced by videogames when activated by players (echos) can be automatically analyzed in order to study how sound can, not only, describe a gameplay perfor-mance, but also help to understand player experience and emotions (ethos). To do so, the present paper illustrates how sound processing algorithms can be applied in the game studies discipline in order to assess and understand better how players engage with videogames. The present paper proposes to adapt the Feedback-based Gameplay Metrics method, successfully applied to the analysis of gameplay footage video stream [17], to the sound stream, via the automatic detection of musical sequences and speech segment.

Domaines: Traitement du signal et de l'image [eess.SP]

Raphael Marczak, Pierre Hanna, Jean-Luc Rouas, Jasper van Vught, Gareth Schott. From Automatic Sound Analysis of Gameplay Footage [Echos] to the Understanding of Player Experience [Ethos]: an Interdisciplinary Approach to Feedback- Based Gameplay Metrics. 40th International Computer Music Conference (ICMC) joint with the 11th Sound & Music Computing conference (SMC), Sep 2014, athens, Greece. ⟨hal-01080041⟩