Coping with the Document Frequency Bias in Sentiment Classification - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2012

Coping with the Document Frequency Bias in Sentiment Classification

Résumé

In this article, we study the polarity detection problem using linear supervised classifiers. We show the interest of penalizing the document frequencies in the regularization process to increase the accuracy. We propose a systematic comparison of different loss and regularization functions on this particular task using the Amazon dataset. Then, we evaluate our models according to three criteria: accuracy, sparsity and subjectivity. The subjectivity is measured by projecting our dictionary and optimized weight vector on the SentiWordNet lexicon. This original approach highlights a bias in the selection of the relevant terms during the regularization procedure: frequent terms are overweighted compared to their intrinsic subjectivities.We show that this bias appears whatever the chosen loss or regularization and on all datasets: it is closely link to the gradient descent technique. Penalizing the document frequency during the learning step enables us to improve significantly our performances. A lot of sentimental markers appear rarely and thus, are unappreciated by statistical learning algorithms. Explicitly boosting their influences leads to increasing the accuracy in the sentiment classification task.
Fichier principal
Vignette du fichier
4582-21942-1-PB.pdf (184.99 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00878275 , version 1 (29-10-2013)

Identifiants

  • HAL Id : hal-00878275 , version 1

Citer

Abdelhalim Rafrafi, Vincent Guigue, Patrick Gallinari. Coping with the Document Frequency Bias in Sentiment Classification. Sixth International AAAI Conference on Weblogs and Social Media (ICWSM'12), Jun 2012, Dublin, Ireland. pp.314-321. ⟨hal-00878275⟩
144 Consultations
55 Téléchargements

Partager

Gmail Facebook X LinkedIn More