Weakly supervised discriminative training of linear models for Natural Language Processing

Lina Maria Rojas Barahona 1, * Christophe Cerisara 1, *
* Auteur correspondant
1 SYNALP - Natural Language Processing : representations, inference and semantics
LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : This work explores weakly supervised training of discrimi-native linear classifiers. Such features-rich classifiers have been widely adopted by the Natural Language processing (NLP) community because of their powerful modeling capacity and their support for correlated features , which allow separating the expert task of designing features from the core learning method. However, unsupervised training of discrim-inative models is more challenging than with generative models. We adapt a recently proposed approximation of the classifier risk and derive a closed-form solution that greatly speeds-up its convergence time. This method is appealing because it provably converges towards the minimum risk without any labeled corpus, thanks to only two reasonable assumptions about the rank of class marginal and Gaussianity of class-conditional linear scores. We also show that the method is a viable , interesting alternative to achieve weakly supervised training of linear classifiers in two NLP tasks: predicate and entity recognition.
Type de document :
Communication dans un congrès
3rd International Conference on Statistical Language and Speech Processing (SLSP), Nov 2015, Budapest, Hungary
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01184849
Contributeur : Christophe Cerisara <>
Soumis le : mardi 18 août 2015 - 09:14:41
Dernière modification le : mardi 24 avril 2018 - 13:29:44

Identifiants

  • HAL Id : hal-01184849, version 1

Collections

Citation

Lina Maria Rojas Barahona, Christophe Cerisara. Weakly supervised discriminative training of linear models for Natural Language Processing. 3rd International Conference on Statistical Language and Speech Processing (SLSP), Nov 2015, Budapest, Hungary. 〈hal-01184849〉

Partager

Métriques

Consultations de la notice

204