Topical Coherence in LDA-based Models through Induced Segmentation

Abstract : This paper presents an LDA-based model that generates topically coherent segments within documents by jointly segmenting documents and assigning topics to their words. The coherence between topics is ensured through a copula, binding the topics associated to the words of a segment. In addition, this model relies on both document and segment specific topic distributions so as to capture fine grained differences in topic assignments. We show that the proposed model naturally encompasses other state-of-the-art LDA-based models designed for similar tasks. Furthermore, our experiments, conducted on six different publicly available datasets, show the effectiveness of our model in terms of perplexity, Normalized Pointwise Mutual Information, which captures the coherence between the generated topics, and the Micro F1 measure for text classification.
Type de document :
Communication dans un congrès
55th Annual Meeting of the Association for Computational Linguistics, Jul 2017, Vancouver, Canada. ACL, pp.1799-1809, 〈10.18653/v1/P17-1165〉
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01769776
Contributeur : Massih-Reza Amini <>
Soumis le : mercredi 18 avril 2018 - 13:27:24
Dernière modification le : mercredi 6 février 2019 - 02:01:32

Lien texte intégral

Identifiants

Collections

Citation

Hesam Amoualian, Wei Lu, Gaussier Eric, Georgios Balikas, Massih-Reza Amini, et al.. Topical Coherence in LDA-based Models through Induced Segmentation. 55th Annual Meeting of the Association for Computational Linguistics, Jul 2017, Vancouver, Canada. ACL, pp.1799-1809, 〈10.18653/v1/P17-1165〉. 〈hal-01769776〉

Partager

Métriques

Consultations de la notice

112