Skip to Main content Skip to Navigation

Accounting for Chance Agreement in Gesture Elicitation Studies

Theophanis Tsandilas 1, 2, * Pierre Dragicevic 3
* Corresponding author
1 EX-SITU - Extreme Interaction
LRI - Laboratoire de Recherche en Informatique, Inria Saclay - Ile de France
3 AVIZ - Analysis and Visualization
Inria Saclay - Ile de France, LRI - Laboratoire de Recherche en Informatique, Université Paris-Saclay
Abstract : The level of agreement among participants is a key aspect of gesture elicitation studies, and it is typically quantified by means of agreement rates (AR). We show that this measure is problematic, as it does not account for chance agreement. The problem of chance agreement has been extensively discussed in a range of scientific fields in the context of inter-rater reliability studies. We review chance-corrected agreement coefficients that are routinely used in inter-reliability studies and show how to apply them to gesture elicitation studies. We also discuss how to compute interval estimates for these coefficients and how to use them for statistical inference.
Complete list of metadatas

Cited literature [22 references]  Display  Hide  Download
Contributor : Theophanis Tsandilas <>
Submitted on : Tuesday, November 29, 2016 - 4:49:14 PM
Last modification on : Tuesday, May 26, 2020 - 3:20:03 PM
Document(s) archivé(s) le : Monday, March 27, 2017 - 9:21:05 AM


Files produced by the author(s)


Distributed under a Creative Commons Attribution - ShareAlike 4.0 International License


  • HAL Id : hal-01267288, version 1


Theophanis Tsandilas, Pierre Dragicevic. Accounting for Chance Agreement in Gesture Elicitation Studies. [Research Report] 1584, LRI - CNRS, University Paris-Sud. 2016, pp.5. ⟨hal-01267288⟩



Record views


Files downloads