Coping with the Frequency Bias in Sentiment Classification

Abstract : In this article, we study the polarity detection problem using linear supervised classifiers. We show the interest of penalizing the document frequencies in the regularization process to increase the accuracy. We propose a systematic comparison of different loss and regularization functions on this particular task using the Amazon dataset. Then, we evaluate our models according to three criteria: accuracy, sparsity and subjectivity. The subjectivity is measured by projecting our dictionary and optimized weight vector on the SentiWordNet lexicon. This original approach highlights a bias in the selection of the relevant terms during the regularization procedure: frequent terms are overweighted compared to their intrinsic subjectivities.We show that this bias appears whatever the chosen loss or regularization and on all datasets: it is closely link to the gradient descent technique. Penalizing the document frequency during the learning step enables us to improve significantly our performances. A lot of sentimental markers appear rarely and thus, are unappreciated by statistical learning algorithms. Explicitly boosting their influences leads to increasing the accuracy in the sentiment classification task.
Complete list of metadatas

Cited literature [16 references]  Display  Hide  Download
Contributor : Abdelhalim Rafrafi <>
Submitted on : Tuesday, October 29, 2013 - 6:00:40 PM
Last modification on : Thursday, March 21, 2019 - 1:13:45 PM
Long-term archiving on : Thursday, January 30, 2014 - 4:43:08 AM


Files produced by the author(s)


  • HAL Id : hal-00878275, version 1


Abdelhalim Rafrafi, Vincent Guigue, Patrick Gallinari. Coping with the Frequency Bias in Sentiment Classification. Sixth International AAAI Conference on Weblogs and Social Media (ICWSM'12), Jun 2012, Dublin, Ireland. pp.314-321. ⟨hal-00878275⟩



Record views


Files downloads