L. De, Cet article est une version traduite et raccourcie de l, 2019.

, Une liste de modèles, en constante évolution

A. M. Schwenk-h, Massively multilingual sentence embeddings for zero-shot cross-lingual transfer and beyond, Transactions of the Association for Computational Linguistics, vol.7, pp.597-610, 2019.

J. Blitzer, . &. Mcdonald-r, and . Pereira-f, Domain adaptation with structural correspondence learning, Proceedings of the 2006 conference on empirical methods in natural language processing, pp.120-128, 2006.

C. Q. Zhu, X. Ling-z.-h, . Wei-s, and . Jiang-h.-&-inkpen-d, Enhanced lstm for natural language inference, Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, vol.1, pp.1657-1668, 2017.

. Conneau-a, K. Khandelwal, . Goyal-n, . Chaudhary-v, G. Wenzek et al., Unsupervised cross-lingual representation learning at scale, 2019.

. Conneau-a, . Rinott-r, G. Lample, . Williams-a, . Bowman-s et al., Xnli : Evaluating cross-lingual sentence representations, Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp.2475-2485, 2018.

M. Constant, M. &. Candito, and . Seddah-d, The ligm-alpage architecture for the spmrl 2013 shared task : Multiword expression analysis and dependency parsing, Proceedings of the EMNLP Workshop on Statistical Parsing of Morphologically Rich Languages, 2013.
URL : https://hal.archives-ouvertes.fr/hal-00932372

. M. Dai-a and . V. Le-q, Semi-supervised sequence learning, Advances in neural information processing systems, pp.3079-3087, 2015.

J. Devlin, . Chang-m.-w, and . Lee-k.-&-toutanova-k, Bert : Pre-training of deep bidirectional transformers for language understanding, Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics : Human Language Technologies, vol.1, pp.4171-4186, 2019.

. Dozat-t and . D. Manning-c, Deep biaffine attention for neural dependency parsing, 5th International Conference on Learning Representations, 2017.

J. Eisenschlos, S. Ruder, P. Czapla, M. Kardas, . Gugger-s et al., , 2019.

, Multifit : Efficient multi-lingual language model fine-tuning, Proceedings of the 2019 conference on empirical methods in natural language processing, pp.1532-1543

M. Hadj, Arabic word sense disambiguation for and by machine translation. Theses, Faculté des Sciences économiques et de gestion. HAL : tel-02139438, 2018.
URL : https://hal.archives-ouvertes.fr/tel-02139438

H. J. Ruder-s, Universal language model fine-tuning for text classification, Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, vol.1, pp.328-339, 2018.

. P. Kingma-d and . Ba-j, Adam : A method for stochastic optimization, 2014.

. Kitaev-n, . &. Cao-s, and . Klein-d, Multilingual constituency parsing with self-attention and pre-training, Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp.3499-3505, 2019.

. Kitaev-n and . Klein-d, Constituency parsing with a self-attentive encoder, Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, vol.1, p.275, 2018.

, Papers, pp.2676-2686

P. Koehn, H. Hoang, . Birch-a, . Callison-burch-c, . Federico-m et al., Moses : Open source toolkit for statistical machine translation, Proceedings of the 45th annual meeting of the association for computational linguistics companion volume proceedings of the demo and poster sessions, pp.177-180, 2007.

. Lample-g.-&-conneau-a, Cross-lingual language model pretraining, Advances in neural information processing systems, 2019.

L. Z. Chen-m, . Goodman-s, K. Gimpel, . Sharma-p.-&-soricut-r, . Le-h et al., Albert : A lite bert for self-supervised learning of language representations, Flaubert : Unsupervised language model pre-training for french, 2019.

L. X. Michel-p, . Anastasopoulos-a, Y. Belinkov, N. Durrani, . Firat-o et al., Findings of the first shared task on machine translation robustness. Fourth Conference on Machine Translation (WMT19), pp.91-102, 2019.

Y. Liu, M. Ott, . Goyal-n, J. Du, M. Joshi et al., Roberta : A robustly optimized bert pretraining approach, 2019.

M. L. Muller-b, . J. Ortiz-suárez-p, Y. Dupont, L. Romary, . Villemonte-de-la et al., CamemBERT : a Tasty French Language Model, 2019.

. Mikolov-t, . Sutskever-i, . Chen-k, G. Corrado, and . Dean-j, Distributed representations of words and phrases and their compositionality, Proceedings of the 26th International Conference on Neural Information Processing Systems, vol.2, pp.3111-3119, 2013.

. A. Miller-g, Wordnet : a lexical database for english, Communications of the ACM, vol.38, issue.11, pp.39-41, 1995.

. Navigli-r, . &. Jurgens-d, and . Vannella-d, SemEval-2013 Task 12 : Multilingual Word Sense Disambiguation, Proceedings of the Seventh International Workshop on Semantic Evaluation, vol.2, pp.222-231, 2013.

. Navigli-r and . P. Ponzetto-s, Babelnet : Building a very large multilingual semantic network, Proceedings of the 48th annual meeting of the association for computational linguistics, pp.216-225, 2010.

J. Pennington, . &. Socher-r, and . D. Manning-c, Glove : Global vectors for word representation, EMNLP, 2014.

. E. Peters-m, M. Neumann, M. Iyyer, . Gardner-m, C. Clark et al., Deep contextualized word representations, Proceedings of NAACL-HLT, pp.2227-2237, 2018.

P. P. Stein-b, Cross-language text classification using structural correspondence learning, Proceedings of the 48th annual meeting of the association for computational linguistics, pp.1118-1127, 2010.

. Radford-a, . Narasimhan-k, and . Salimans-t.-&-sutskever-i, Improving language understanding by generative pre-training, 2018.

C. Raffel, N. Shazeer, . Roberts-a, . Lee-k, S. Narang et al.,

. J. Liu-p, Exploring the limits of transfer learning with a unified text-to-text transformer, 2019.

. Ramachandran-p, . Liu-p, and . Le-q, Unsupervised pretraining for sequence to sequence learning, Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp.383-391, 2017.

. Seddah-d, . Tsarfaty-r, S. Kübler, M. Candito, J. D. Choi et al., Overview of the SPMRL 2013 shared task : A cross-framework evaluation of parsing morphologically rich languages, Proceedings of the Fourth Workshop on Statistical Parsing of Morphologically-Rich Languages, pp.146-182, 2013.

. Segonne-v and . Candito-m.-&-crabbé-b, Using wiktionary as a resource for wsd : the case of french verbs, Proceedings of the 13th International Conference on Computational Semantics-Long Papers, pp.259-270, 2019.

. Sennrich-r, . &. Haddow-b, and . Birch-a, Neural machine translation of rare words with subword units, Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, vol.1, pp.1715-1725, 2016.

K. Tiedemann-j.-;, T. Chou-kri, M. U. Declerck, B. Dogan, J. Maegaard et al., Parallel data, tools and interfaces in opus, Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12), 2012.

. Vaswani-a, N. Shazeer, . Parmar-n, J. Uszkoreit, . Jones-l et al.,

&. Polosukhin-i, Attention is all you need, Advances in neural information processing systems, pp.5998-6008, 2017.

. Vial-l, . &. Lecouteux-b, and . Schwab-d, Compression de vocabulaire de sens grâce aux relations sémantiques pour la désambiguïsation lexicale, Conférence sur le Traitement Automatique des Langues Naturelles (TALN-RECITAL), p.2092559, 2019.

. Vial-l, . &. Lecouteux-b, and . Schwab-d, Sense Vocabulary Compression through the Semantic Knowledge of WordNet for Neural Word Sense Disambiguation, Proceedings of the 10th Global Wordnet Conference, p.2131872, 2019.

W. A. Pruksachatkun, Y. Nangia, N. Singh-a, J. Michael, . Hill-f et al.,

. R. Bowman-s, Superglue : A stickier benchmark for general-purpose language understanding systems, 2019.

W. A. Singh-a, J. Michael, . Hill-f, . &. Levy-o, and . Bowman-s, GLUE : A multitask benchmark and analysis platform for natural language understanding, Proceedings of the 2018 EMNLP Workshop BlackboxNLP : Analyzing and Interpreting Neural Networks for NLP, pp.353-355, 2018.

W. A. Nangia-n and . Bowman-s, A broad-coverage challenge corpus for sentence understanding through inference, Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics : Human Language Technologies, vol.1, pp.1112-1122, 2018.

. Wolf-t, L. Debut, . Sanh-v, J. Chaumond, C. Delangue et al., Huggingface's transformers : State-of-the-art natural language processing, 2019.

Y. Y. Zhang, Y. Tar, and C. &. Baldridge-j, Paws-x : A cross-lingual adversarial dataset for paraphrase identification, 2019.

Y. Z. Dai-z, Y. Yang, J. Carbonell, . Salakhutdinov-r, and . V. Le-q, Xlnet : Generalized autoregressive pretraining for language understanding, Advances in neural information processing systems, 2019.

Y. Zhang, J. &. Baldridge, and . He-l, Paws : Paraphrase adversaries from word scrambling, Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics : Human Language Technologies, vol.1, pp.1298-1308, 2019.