Variational Sequence Labeling

Rémi Flamary (1) , Stephane Canu (1) , Alain Rakotomamonjy (1) , Rose Jean-Loïc (2)

1 LITIS - Laboratoire d'Informatique, de Traitement de l'Information et des Systèmes
2 CREATIS - Centre de Recherche et d'Application en Traitement de l'Image et du Signal

Sequence labeling is concerned with processing an input data sequence and producing an output sequence of discrete labels which characterize it. Common applications includes speech recognition, language processing (tagging, chunk- ing) and bioinformatics. Many solutions have been pro- posed to partially cope with this problem. These include probabilistic models (HMMs, CRFs) and machine learning algorithm (SVM, Neural nets). In practice, the best results have been obtained by combining several of these methods. However, fusing different signal segmentation methods is not straightforward, particularly when integrating prior in- formation. In this paper the sequence labeling problem is viewed as a multi objective optimization task. Each objec- tive targets a different aspect of sequence labelling such as good classification, temporal stability and change detection. The resulting optimization problem turns out to be non con- vex and plagued with numerous local minima. A region growing algorithm is proposed as a method for finding a solution to this multi functional optimization task. The pro- posed algorithm is evaluated on both synthetic and real data (BCI dataset). Results are encouraging and better than those previously reported on these datasets.

Mots clés: sequence labeling; SVM; prior information

Domaines: Apprentissage [cs.LG]

Rémi Flamary, Stephane Canu, Alain Rakotomamonjy, Rose Jean-Loïc. Variational Sequence Labeling. http://mlsp2009.conwiz.dk/, Sep 2009, Grenoble, France. pp.1-6, ⟨10.1109/MLSP.2009.5306238⟩. ⟨hal-00493553⟩