Skip to Main content Skip to Navigation
Conference papers

Weakly supervised discriminative training of linear models for Natural Language Processing

Lina Maria Rojas Barahona 1, * Christophe Cerisara 1, * 
* Corresponding author
1 SYNALP - Natural Language Processing : representations, inference and semantics
LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : This work explores weakly supervised training of discrimi-native linear classifiers. Such features-rich classifiers have been widely adopted by the Natural Language processing (NLP) community because of their powerful modeling capacity and their support for correlated features , which allow separating the expert task of designing features from the core learning method. However, unsupervised training of discrim-inative models is more challenging than with generative models. We adapt a recently proposed approximation of the classifier risk and derive a closed-form solution that greatly speeds-up its convergence time. This method is appealing because it provably converges towards the minimum risk without any labeled corpus, thanks to only two reasonable assumptions about the rank of class marginal and Gaussianity of class-conditional linear scores. We also show that the method is a viable , interesting alternative to achieve weakly supervised training of linear classifiers in two NLP tasks: predicate and entity recognition.
Document type :
Conference papers
Complete list of metadata

Cited literature [15 references]  Display  Hide  Download
Contributor : Christophe Cerisara Connect in order to contact the contributor
Submitted on : Sunday, February 24, 2019 - 8:24:15 AM
Last modification on : Saturday, October 16, 2021 - 11:26:06 AM
Long-term archiving on: : Saturday, May 25, 2019 - 12:40:09 PM


Files produced by the author(s)


  • HAL Id : hal-01184849, version 1



Lina Maria Rojas Barahona, Christophe Cerisara. Weakly supervised discriminative training of linear models for Natural Language Processing. 3rd International Conference on Statistical Language and Speech Processing (SLSP), Nov 2015, Budapest, Hungary. ⟨hal-01184849⟩



Record views


Files downloads