Live Orchestral Piano, a system for real-time orchestral music generation

Léopold Crestel 1 Philippe Esling 1
1 Repmus - Représentations musicales
STMS - Sciences et Technologies de la Musique et du Son
Abstract : This paper introduces the first system performing automatic orchestration from a real-time piano input. We cast this problem as a case of projective orchestration, where the goal is to learn the underlying regularities existing between piano scores and their orchestrations by well-known composers, in order to later perform this task automatically on novel piano inputs. To that end, we investigate a class of statistical inference models based on the Restricted Boltzmann Machine (RBM). We introduce an evaluation framework specific to the projective orchestral generation task that provides a quantitative analysis of different models. We also show that the frame-level accuracy currently used by most music prediction and generation system is highly biased towards models that simply repeat their last input. As prediction and creation are two widely different endeavors, we discuss other potential biases in evaluating temporal generative models through prediction tasks and their impact on a creative system. Finally, we provide an implementation of the proposed models called Live Orchestral Piano (LOP), which allows for anyone to play the orchestra in real-time by simply playing on a MIDI keyboard. To evaluate the quality of the system, orchestrations generated by the different models we investigated can be found on a companion website.
Type de document :
Direction d'ouvrage, Proceedings, Dossier
14th Sound and Music Computing Conference 2017, Jul 2017, Espoo, Finland. pp.434, 2017, Proceedings of the 14th Sound and Music Computing Conference 2017, 978-952-60-3729-5
Liste complète des métadonnées

Littérature citée [34 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01577463
Contributeur : Léopold Crestel <>
Soumis le : vendredi 25 août 2017 - 18:07:23
Dernière modification le : jeudi 11 janvier 2018 - 06:27:23

Fichier

live-orchestral-piano.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01577463, version 1

Collections

Citation

Léopold Crestel, Philippe Esling. Live Orchestral Piano, a system for real-time orchestral music generation. 14th Sound and Music Computing Conference 2017, Jul 2017, Espoo, Finland. pp.434, 2017, Proceedings of the 14th Sound and Music Computing Conference 2017, 978-952-60-3729-5. 〈hal-01577463〉

Partager

Métriques

Consultations de la notice

71

Téléchargements de fichiers

42