Score Following Using Spectral Analysis and Hidden Markov Models

Nicola Orio (1) , François Déchelle (1)

1 Equipe Systèmes temps-réel

This paper presents an approach to score following. The real-time alignment of a performance with a score is obtained through the use of a hidden Markov model. The model works on two levels. The lower level compares the features of the incoming signal with the expected ones. Groups of states of the lower level are embedded in states at the higher level, which are used to model the performance by taking into account the possible errors a performer may make. The performer's position on the score is computed through a decoding technique alternative to classic Viterbi decoding. A novel technique for the training of hidden Markov models is proposed.

Mots clés: NA; Informatique musicale

Domaines: Son [cs.SD]; Interface homme-machine [cs.HC]; Musique, musicologie et arts de la scène; Traitement du signal et de l'image [eess.SP]; Apprentissage [cs.LG]; Intelligence artificielle [cs.AI]; Ingénierie assistée par ordinateur; Multimédia [cs.MM]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Autre [cs.OH]; Traitement du signal et de l'image [eess.SP]

Nicola Orio, François Déchelle. Score Following Using Spectral Analysis and Hidden Markov Models. ICMC: International Computer Music Conference, 2001, La Havane, Cuba. pp.1-1. ⟨hal-01161055⟩