Haptic techniques for browsing sound maps organized by similarity

Christian Frisson (1, 2) , Colin Gallacher (3) , Marcelo M. Wanderley (1, 2)

1 McGill University = Université McGill [Montréal, Canada]
2 IDMIL - Input Devices and Music Interaction Laboratory
3 Haply Robotics

This demo paper showcases haptic techniques for browsing sound maps organized by content-based similarity. Our system Freesound Tracker forks the Freesound Explorer application inside a web browser augmented with haptic capabilities using the Chai3d library that we modified to support Haply haptic devices, ours configured with a 2-DOF pantograph mechanism. A first technique enhances the exploratory navigation of sound maps by adding physical effects, such as: magnetizing the pointer to its closest sound item, rendering viscosity when hovering items. A second technique assists loop-based musical creation by having user-defined sound paths followed by the force-feedback pointing device.

Domaines: Son [cs.SD]; Interface homme-machine [cs.HC]; Modélisation et simulation; Acoustique [physics.class-ph]; Biomécanique [physics.med-ph]

Christian Frisson, Colin Gallacher, Marcelo M. Wanderley. Haptic techniques for browsing sound maps organized by similarity. International Workshop on Haptic and Audio Interaction Design - HAID2019, Mar 2019, Lille, France. ⟨hal-02050235⟩