Hierarchical topic structuring: from dense segmentation to topically focused fragments via burst analysis

Anca Simon (1) , Pascale Sébillot (1) , Guillaume Gravier (1)

1 LinkMedia - Creating and exploiting explicit links between multimedia fragments

Topic segmentation traditionally relies on lexical cohesion measured through word re-occurrences to output a dense segmen-tation, either linear or hierarchical. In this paper, a novel organization of the topical structure of textual content is proposed. Rather than searching for topic shifts to yield dense segmentation, we propose an algorithm to extract topically focused fragments organized in a hierarchical manner. This is achieved by leveraging the temporal distribution of word re-occurrences, searching for bursts, to skirt the limits imposed by a global counting of lexical re-occurrences within segments. Comparison to a reference dense segmentation on varied datasets indicates that we can achieve a better topic focus while retrieving all of the important aspects of a text.

Domaines: Multimédia [cs.MM]; Traitement du texte et du document; Recherche d'information [cs.IR]; Informatique et langage [cs.CL]

Anca Simon, Pascale Sébillot, Guillaume Gravier. Hierarchical topic structuring: from dense segmentation to topically focused fragments via burst analysis. Recent Advances on Natural Language Processing, 2015, Hissar, Bulgaria. ⟨hal-01186443⟩