A Fuzzy Decision Strategy for Topic Identification and Dynamic Selection of Language Models - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Signal Processing Année : 2000

A Fuzzy Decision Strategy for Topic Identification and Dynamic Selection of Language Models

Brigitte Bigi
Marc El Bèze
  • Fonction : Auteur
  • PersonId : 949557
Spriet Thierry

Résumé

The paper introduces a new effective model for topic recognition. The model follows a multi-expert decision paradigm based on fuzzy relations in which fuzzy variables express degrees of reliability of expert decision. Heterogeneous measures are integrated by the fuzzy relations whose structure and components may evolve in time. Experiments resulted in more than 80% topic classification accuracy on articlesof the French newspaper Le Monde which describe a very large variety of facts with a very large vocabulary (of the order of 500,000 words). Experiments show a significant improvement when the above mentioned integration of multi-expert decision is used. A robust strategy for dynamic Language Model (LM) selection, based on topic recognition and switching between topic models, is proposed. It is effective because it relies on a small set of well trained topic-dependent LMs and on reliable topic recognition. By using perplexity as a performance measure of the LM switching model, a tangible reduction is observed with respect to the use of a single, general, static LM.
Fichier non déposé

Dates et versions

hal-01392257 , version 1 (04-11-2016)

Identifiants

  • HAL Id : hal-01392257 , version 1

Citer

Brigitte Bigi, Renato de Mori, Marc El Bèze, Spriet Thierry. A Fuzzy Decision Strategy for Topic Identification and Dynamic Selection of Language Models. Signal Processing, 2000, Special Issue on Fuzzy Logic in Signal Processing, 80 (6), pp.1085--1097. ⟨hal-01392257⟩

Collections

UNIV-AVIGNON LIA
51 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More