SoundGuides: Adapting Continuous Auditory Feedback to Users

Jules Françoise 1 Olivier Chapuis 2, 3 Sylvain Hanneton 4 Frédéric Bevilacqua 1
1 Interactions Son Musique Mouvement
STMS - Sciences et Technologies de la Musique et du Son
2 ILDA - Interacting with Large Data
LRI - Laboratoire de Recherche en Informatique, Inria Saclay - Ile de France
3 LRI - Laboratoire de Recherche en Informatique
4 LPP - UMR 8242 - Laboratoire Psychologie de la Perception
Abstract : We introduce SoundGuides, a user adaptable tool for auditory feedback on movement. The system is based on a interactive machine learning approach, where both gestures and sounds are first conjointly designed and conjointly learned by the system. The system can then automatically adapt the auditory feedback to any new user, taking into account the particular way each user performs a given gesture. SoundGuides is suitable for the design of continuous auditory feedback aimed at guiding users' movements and helping them to perform a specific movement consistently over time. Applications span from movement-based interaction techniques to auditory-guided rehabilitation. We first describe our system and report a study that demonstrates a 'stabilizing effect' of our adaptive auditory feedback method.
Keywords : Sound and Music Computing Movement Sound 3D Gestures Auditory feedback User Interfaces
Document type :
Conference papers
Complete list of metadatas

Cited literature [23 references]  Display  Hide  Download

soudguides.jpg
soudguides.jpg
https://hal.archives-ouvertes.fr/hal-01317069
Contributor : Olivier Chapuis <>
Submitted on : Wednesday, May 18, 2016 - 3:29:27 PM
Last modification on : Tuesday, May 14, 2019 - 11:06:46 AM
Long-term archiving on : Thursday, November 17, 2016 - 10:45:04 AM

Files

soundguides-final.pdf
Files produced by the author(s)

Identifiers

Collections

CNRS | IRCAM | UPMC | UMR8623 | STMS | UNIV-PARIS5 | LRI-HCC | INRIA | USPC | CENTRALESUPELEC | UNIV-PARIS-SACLAY | SORBONNE-UNIVERSITE | SU-SCIENCES

Citation

Jules Françoise, Olivier Chapuis, Sylvain Hanneton, Frédéric Bevilacqua. SoundGuides: Adapting Continuous Auditory Feedback to Users. Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, May 2016, San Jose, United States. pp.2829--2836, ⟨10.1145/2851581.2892420⟩. ⟨hal-01317069⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

935

Files downloads

508

Contact

CCSD