Accounting for Chance Agreement in Gesture Elicitation Studies

Theophanis Tsandilas 1, 2, * Pierre Dragicevic 3
* Corresponding author
1 EX-SITU - Extreme Interaction
LRI - Laboratoire de Recherche en Informatique, Inria Saclay - Ile de France
3 AVIZ - Analysis and Visualization
Inria Saclay - Ile de France
Abstract : The level of agreement among participants is a key aspect of gesture elicitation studies, and it is typically quantified by means of agreement rates (AR). We show that this measure is problematic, as it does not account for chance agreement. The problem of chance agreement has been extensively discussed in a range of scientific fields in the context of inter-rater reliability studies. We review chance-corrected agreement coefficients that are routinely used in inter-reliability studies and show how to apply them to gesture elicitation studies. We also discuss how to compute interval estimates for these coefficients and how to use them for statistical inference.
Document type :
Reports
Liste complète des métadonnées

Cited literature [22 references]  Display  Hide  Download


https://hal.archives-ouvertes.fr/hal-01267288
Contributor : Theophanis Tsandilas <>
Submitted on : Tuesday, November 29, 2016 - 4:49:14 PM
Last modification on : Thursday, April 5, 2018 - 12:30:25 PM
Document(s) archivé(s) le : Monday, March 27, 2017 - 9:21:05 AM

Files

main.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution - ShareAlike 4.0 International License

Identifiers

  • HAL Id : hal-01267288, version 1

Citation

Theophanis Tsandilas, Pierre Dragicevic. Accounting for Chance Agreement in Gesture Elicitation Studies. [Research Report] 1584, LRI - CNRS, University Paris-Sud. 2016, pp.5. ⟨hal-01267288⟩

Share

Metrics

Record views

1685

Files downloads

373