Accounting for Chance Agreement in Gesture Elicitation Studies

Theophanis Tsandilas 1, 2, * Pierre Dragicevic 3
* Auteur correspondant
1 EX-SITU - Extreme Interaction
LRI - Laboratoire de Recherche en Informatique, Inria Saclay - Ile de France
3 AVIZ - Analysis and Visualization
Inria Saclay - Ile de France
Abstract : The level of agreement among participants is a key aspect of gesture elicitation studies, and it is typically quantified by means of agreement rates (AR). We show that this measure is problematic, as it does not account for chance agreement. The problem of chance agreement has been extensively discussed in a range of scientific fields in the context of inter-rater reliability studies. We review chance-corrected agreement coefficients that are routinely used in inter-reliability studies and show how to apply them to gesture elicitation studies. We also discuss how to compute interval estimates for these coefficients and how to use them for statistical inference.
Type de document :
Rapport
[Research Report] 1584, LRI - CNRS, University Paris-Sud. 2016, pp.5
Liste complète des métadonnées



https://hal.archives-ouvertes.fr/hal-01267288
Contributeur : Theophanis Tsandilas <>
Soumis le : mardi 29 novembre 2016 - 16:49:14
Dernière modification le : vendredi 17 février 2017 - 16:10:39
Document(s) archivé(s) le : lundi 27 mars 2017 - 09:21:05

Fichiers

main.pdf
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité - Partage selon les Conditions Initiales 4.0 International License

Identifiants

  • HAL Id : hal-01267288, version 1

Citation

Theophanis Tsandilas, Pierre Dragicevic. Accounting for Chance Agreement in Gesture Elicitation Studies. [Research Report] 1584, LRI - CNRS, University Paris-Sud. 2016, pp.5. <hal-01267288>

Partager

Métriques

Consultations de
la notice

249

Téléchargements du document

226