Skip to Main content Skip to Navigation
Conference papers

RepliCHI - CHI should be replicating and validating results more: discuss

Max Wilson 1 Wendy E. Mackay 2, 3 Ed Chi 4 Michael Bernstein 5 Dan Russell 6 Harold Thimbleby 1
2 IN-SITU - Situated interaction
LRI - Laboratoire de Recherche en Informatique, UP11 - Université Paris-Sud - Paris 11, Inria Saclay - Ile de France, CNRS - Centre National de la Recherche Scientifique : UMR8623
3 InSitu
LRI - Laboratoire de Recherche en Informatique
Abstract : The replication of research findings is a cornerstone of good science. Replication confirms results, strengthens research, and makes sure progress is based on solid foundations. CHI, however, rewards novelty and is focused on new results. As a community, therefore, we do not value, facilitate, or reward replication in research, and often take the significant results of a single user study on 20 users to be true. This panel will address the issues surrounding replication in our community, and discuss: a) how much of our broad diverse discipline is 'science', b) how, if at all, we currently see replication of research in our community, c) whether we should place more emphasis on replication in some form, and d) how that should look in our community. The aim of the panel is to make a proposal to future CHI organizers (2 are on the panel) for how we should facilitate replication in the future.
Document type :
Conference papers
Complete list of metadata

Cited literature [7 references]  Display  Hide  Download
Contributor : Michel Beaudouin-Lafon Connect in order to contact the contributor
Submitted on : Wednesday, June 4, 2014 - 12:19:23 PM
Last modification on : Thursday, July 8, 2021 - 3:48:20 AM
Long-term archiving on: : Thursday, September 4, 2014 - 11:40:35 AM


Publisher files allowed on an open archive



Max Wilson, Wendy E. Mackay, Ed Chi, Michael Bernstein, Dan Russell, et al.. RepliCHI - CHI should be replicating and validating results more: discuss. CHI EA '11: Proceedings of the 2011 annual conference extended abstracts on Human factors in computing systems, May 2011, Vancouver, Canada. pp.463--466, ⟨10.1145/1979742.1979491⟩. ⟨hal-01000423⟩



Record views


Files downloads