Foundations for Reliable and Flexible Interactive Multimedia Scores

Jaime Arias 1, 2 Myriam Desainte-Catherine 2, 1 Carlos Olarte 3 Camilo Rueda 4
1 PoSET - Models for a Structured Programming of Space and Time
LaBRI - Laboratoire Bordelais de Recherche en Informatique, SCRIME - Studio de Création et de Recherche en Informatique et Musique Électroacoustique, Inria Bordeaux - Sud-Ouest
Abstract : Interactive Scores (IS) is a formalism for composing and performing interactive multimedia scores with several applications in video games, live performance installations, and virtual museums. The composer defines the temporal organization of the score by asserting temporal relations (TRs) between temporal objects (TOs). At execution time, the performer may modify the start/stop times of the TOs by triggering interaction points and the system guarantees that all the TRs are satisfied. Implementations of IS and formal models of their behavior have already been proposed, but these do not provide usable means to reason about their properties. In this paper we introduce ReactiveIS, a programming language that fully captures the temporal structure of IS during both composition and execution. For that, we propose a semantics based on tree-like structures representing the execution state of the score at each point in time. The semantics captures the hierarchical aspects of IS and provides an intuitive representation of their execution. We also endow ReactiveIS with a logical semantics based on linear logic, thus widening the reasoning techniques available for IS. We show that ReactiveIS is general enough to capture the full behavior of IS and that it provides declarative ways to increase IS expressivity with, for instance, conditional statements and loops.
Liste complète des métadonnées

Cited literature [13 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01129394
Contributor : Arias Jaime <>
Submitted on : Tuesday, September 22, 2015 - 2:58:05 PM
Last modification on : Tuesday, May 29, 2018 - 9:14:04 AM
Document(s) archivé(s) le : Tuesday, December 29, 2015 - 9:11:08 AM

File

mcm15.pdf
Files produced by the author(s)

Identifiers

Citation

Jaime Arias, Myriam Desainte-Catherine, Carlos Olarte, Camilo Rueda. Foundations for Reliable and Flexible Interactive Multimedia Scores. Fifth Biennial International Conference on Mathematics and Computation in Music, Jun 2015, London, United Kingdom. pp.29-41, ⟨10.1007/978-3-319-20603-5_3⟩. ⟨hal-01129394⟩

Share

Metrics

Record views

502

Files downloads

175