Exploiting Speech for Automatic TV Delinearization: From Streams to Cross-Media Semantic Navigation

Guillaume Gravier 1, * Camille Guinaudeau 1 Gwénolé Lecorvé 1 Pascale Sébillot 1
* Corresponding author
1 TEXMEX - Multimedia content-based indexing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : The gradual migration of television from broadcast diffusion to Internet diffusion offers countless possibilities for the generation of rich navigable contents. However, it also raises numerous scientific issues regarding delinearization of TV streams and content enrichment. In this paper, we study how speech can be used at different levels of the delinearization process, using automatic speech transcription and natural language processing (NLP) for the segmentation and characterization of TV programs and for the generation of semantic hyperlinks in videos. Transcript-based video delinearization requires natural language processing techniques robust to transcription peculiarities, such as transcription errors, and to domain and genre differences. We therefore propose to modify classical NLP techniques, initially designed for regular texts, to improve their robustness in the context of TV delinearization. We demonstrate that the modified NLP techniques can efficiently handle various types of TV material and be exploited for program description, for topic segmentation, and for the generation of semantic hyperlinks between multimedia contents. We illustrate the concept of cross-media semantic navigation with a description of our news navigation demonstrator presented during the NEM Summit 2009.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-00645216
Contributor : Pascale Sébillot <>
Submitted on : Sunday, November 27, 2011 - 4:05:29 PM
Last modification on : Friday, April 12, 2019 - 11:06:11 AM
Long-term archiving on : Tuesday, February 28, 2012 - 2:21:23 AM

File

eurasipFinal.pdf
Files produced by the author(s)

Identifiers

Citation

Guillaume Gravier, Camille Guinaudeau, Gwénolé Lecorvé, Pascale Sébillot. Exploiting Speech for Automatic TV Delinearization: From Streams to Cross-Media Semantic Navigation. EURASIP Journal on Image and Video Processing, Springer, 2011, 2011, 689780, 17 p. 2 columns. ⟨10.1155/2011/689780⟩. ⟨hal-00645216⟩

Share

Metrics

Record views

1117

Files downloads

393