Total Variability Space for LDA-based multi-view text categorization

Abstract : Mapping text document into LDA-based topic-space is a classical way to extract high level representation of text documents. Unfortunatly , LDA is higly sensitive to hyper-parameters related to class number or word and topic distribution , and there is not any systematic way to prior estimate optimal configurations. Morover , various hyperparameter configurations offer complementary views on the document. In this paper , we propose a method based on a two-step process that , first , expands representation space by using a set of topic spaces and , second , compacts representation space by removing poorly relevant dimensions. These two steps are based respectivelly on multi-view LDA-based representation spaces and factor-analysis models. This model provides a view-independant representation of documents while extracting complementary information from a massive multi-view representation. Experiments are conducted on the DECODA conversation corpus and Reuters-21578 textual dataset. Results show the effectiveness of the proposed multi-view compact representation paradigm. The proposed categorization system reaches an accuracy of 86. 9% and 86. 5% respectively with manual and automatic transcriptions of conversations , and a macro-F1 of 80% during a classification task of the well-known studied Reuters-21578 corpus , with a significant gain compared to the baseline (best single topic space configuration) , as well as methods and document representations previously studied .
Complete list of metadatas

Cited literature [50 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01322940
Contributor : Georges Linares <>
Submitted on : Thursday, December 20, 2018 - 2:00:00 PM
Last modification on : Friday, March 22, 2019 - 11:34:07 AM
Long-term archiving on : Friday, March 22, 2019 - 10:37:27 AM

File

morchid_Decoda_Ivectors.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Mohamed Morchid, Mohamed Bouallegue, Richard Dufour, Georges Linarès, Renato de Mori. Total Variability Space for LDA-based multi-view text categorization. IEEE/ACM Transactions on Audio, Speech and Language Processing, Institute of Electrical and Electronics Engineers, 2015, ⟨10.1109/TASLP.2015.2431854⟩. ⟨hal-01322940⟩

Share

Metrics

Record views

34

Files downloads

20