A deep reinforcement learning approach for early classification of time series

Abstract : —In many real-world applications, ranging from pre-dictive maintenance to personalized medicine, early classification of time series data is of paramount importance for supporting decision makers. In this article, we address this challenging task with a novel approach based on reinforcement learning. We introduce an early classifier agent, an end-to-end reinforcement learning agent (deep Q-network, DQN) [1] able to perform early classification in an efficient way. We formulate the early classification problem in a reinforcement learning framework: we introduce a suitable set of states and actions but we also define a specific reward function which aims at finding a compromise between earliness and classification accuracy. While most of the existing solutions do not explicitly take time into account in the final decision, this solution allows the user to set this trade-off in a more flexible way. In particular, we show experimentally on datasets from the UCR time series archive [2] that this agent is able to continually adapt its behavior without human intervention and progressively learn to compromise between accurate and fast predictions.
Type de document :
Communication dans un congrès
EUSIPCO 2018, Sep 2018, Rome, Italy
Liste complète des métadonnées

Littérature citée [10 références]  Voir  Masquer  Télécharger

Contributeur : Michele Rombaut <>
Soumis le : jeudi 28 juin 2018 - 12:51:25
Dernière modification le : mardi 10 juillet 2018 - 01:18:46


Fichiers produits par l'(les) auteur(s)


  • HAL Id : hal-01825472, version 1



Martinez Coralie, Guillaume Perrin, E Ramasso, Michèle Rombaut. A deep reinforcement learning approach for early classification of time series. EUSIPCO 2018, Sep 2018, Rome, Italy. 〈hal-01825472〉



Consultations de la notice


Téléchargements de fichiers