A. J. Villaneau and . Lefeuvre-a, Weighted Krippendorff's alpha is a more reliable metrics for multi-coders ordinal annotations: experimental studies on emotion, opinion and coreference annotation, Proc. 14th Conference of the European Chapter of the Association of Computational Linguistics, EACL'2014, 2014.

B. V. Passonneau-r, . A. Salleb-aouissi, and . Ide-n, Anveshan: a framework for analysis of multiple annotators' labeling behavior, Proc. 4th Linguistic Annotation Workshop (LAW IV), pp.47-55, 2010.

B. U. Bensaude-vincent, La société du risque, Paris : Flammarion, Champs/essais L'opinion publique et la science : à chacun son ignorance, 2001.

B. J. Bimbot-f and B. J. Dupont-p, Des évaluations des systèmes de vérification du locuteur à la mise en cause des expertises vocales en identification juridique, pp.270-288, 1999.

C. , C. Nationale, . Depart, and . Public, Bilan du débat public sur le développement et la régulation des nanotechnologies, 2010.

C. M. Lascoumes-p and . Barthe-y, Agir dans un monde incertain. Essai sur la démocratie technique, 2001.

C. J. Poesio-m and . Kruschwitz-u, Phrase Detectives : a web-based collaborative annotation game, Proc. Int. Conference on Semantic Systems, 2008.

L. A. , A. , C. A. Schang-e, A. L. Savary-a, M. D. Eshkol-taravella et al., Covering various Needs in Temporal Annotation: a Proposal of Extension of ISO TimeML that Preserves Upward Compatibility, Proc. LREC'2016, 2016.

M. M. Bojar-o, Results of the WMT13 Metrics Shared Task, Actes ACL'2013 eigth workshop on statistical machine translation, WMT'2103, 2013.

S. B. Fort-k, A. G. Mariani-j, and L. B. , Un turc mécanique pour les ressources linguistiques : critique de la myriadisation du travail parcellisé, 2011.

W. T. , A. , and D. Poirier-f, SIBYLLE, an assistive communication system adapting to the context and its user, ACM Transactions on Accessible Computing, vol.1, issue.1, pp.1-30, 2008.