Skip to Main content Skip to Navigation
New interface
Preprints, Working Papers, ...

Generating artificial texts as substitution or complement of training data

Vincent Claveau 1 Antoine Chaffin 1 Ewa Kijak 1 
1 LinkMedia - Creating and exploiting explicit links between multimedia fragments
Inria Rennes – Bretagne Atlantique , IRISA-D6 - MEDIA ET INTERACTIONS
Abstract : The quality of artificially generated texts has considerably improved with the advent of transformers. The question of using these models to generate learning data for supervised learning tasks naturally arises. In this article, this question is explored under 3 aspects: (i) are artificial data an efficient complement? (ii) can they replace the original data when those are not available or cannot be distributed for confidentiality reasons? (iii) can they improve the explainability of classifiers? Different experiments are carried out on Web-related classification tasks -- namely sentiment analysis on product reviews and Fake News detection -- using artificially generated data by fine-tuned GPT-2 models. The results show that such artificial data can be used in a certain extend but require pre-processing to significantly improve performance. We show that bag-of-word approaches benefit the most from such data augmentation.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03430603
Contributor : Vincent Claveau Connect in order to contact the contributor
Submitted on : Tuesday, November 16, 2021 - 12:19:39 PM
Last modification on : Friday, August 5, 2022 - 2:54:52 PM

Links full text

Identifiers

  • HAL Id : hal-03430603, version 1
  • ARXIV : 2110.13016

Citation

Vincent Claveau, Antoine Chaffin, Ewa Kijak. Generating artificial texts as substitution or complement of training data. 2021. ⟨hal-03430603⟩

Share

Metrics

Record views

38