Skip to Main content Skip to Navigation
Conference papers

NLP Community Perspectives on Replicability.

Abstract : With recent efforts in drawing attention to the task of replicating and/or reproducing1 results, for example in the context of COLING 2018 and various LREC workshops, the question arises how the NLP community views the topic of replicability in general. Using a survey, in which we involve members of the NLP community, we investigate how our community perceives this topic, its relevance and options for improvement. Based on over two hundred participants, the survey results confirm earlier observations, that successful reproducibility requires more than having access to code and data. Additionally, the results show that the topic has to be tackled from the authors, reviewers and community 's side.
Complete list of metadatas

Cited literature [20 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02282794
Contributor : Limsi Publications <>
Submitted on : Friday, January 3, 2020 - 11:29:31 PM
Last modification on : Wednesday, October 14, 2020 - 3:41:33 AM
Long-term archiving on: : Monday, April 6, 2020 - 4:51:31 PM

File

MieskesRANLP2019.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02282794, version 1

Citation

Margot Mieskes, Karën Fort, Aurélie Névéol, Cyril Grouin, Kevin B Cohen. NLP Community Perspectives on Replicability.. Recent Advances in Natural Language Processing, Sep 2019, Varna, Bulgaria. ⟨hal-02282794⟩

Share

Metrics

Record views

119

Files downloads

103