Skip to Main content Skip to Navigation
Conference papers

French Contextualized Word-Embeddings with a sip of CaBeRnet: a New French Balanced Reference Corpus

Abstract : This paper describes and compares the impact of different types and size of training corpora on language models like ELMO. By asking the fundamental question of quality versus quantity we evaluate four French corpora for training on parsing scores, POS-tagging and named-entities recognition downstream tasks. The paper studies the relevance of a new corpus, CaBeRnet, featuring a representative range of language usage, including a balanced variety of genres (oral transcriptions, newspapers, popular magazines, technical reports, fiction, academic texts), in oral and written styles. We hypothesize that a linguistically representative and balanced corpora will allow the language model to be more efficient and representative of a given language and therefore yield better evaluation scores on different evaluation sets and tasks.
Complete list of metadatas

Cited literature [52 references]  Display  Hide  Download

https://hal.inria.fr/hal-02678358
Contributor : Benoît Sagot <>
Submitted on : Sunday, May 31, 2020 - 8:22:43 PM
Last modification on : Friday, June 12, 2020 - 5:38:06 PM

File

LREC_Fabre_Ortiz.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02678358, version 1

Collections

Citation

Murielle Fabre, Pedro Javier Ortiz Suárez, Benoît Sagot, Éric Villemonte de la Clergerie. French Contextualized Word-Embeddings with a sip of CaBeRnet: a New French Balanced Reference Corpus. CMLC-8 - 8th Workshop on the Challenges in the Management of Large Corpora, May 2020, Marseille, France. ⟨hal-02678358⟩

Share

Metrics

Record views

20

Files downloads

154