Modeling uncertainty and inaccuracy on data from crowdsourcing platforms: MONITOR

Abstract : Crowdsourcing is characterized by the externaliza-tion of tasks to a crowd of workers. In some platforms the tasks are easy, open access and remunerated by micropayment. The crowd is very diversified due to the simplicity of the tasks, but the payment can attract malicious workers. It is essential to identify these malicious workers in order not to consider their answers. In addition, not all workers have the same qualification for a task, so it might be interesting to give more weight to those with more qualifications. In this paper we propose a new method for characterizing the profile of contributors and aggregating answers using the theory of belief functions to estimate uncertain and imprecise answers. In order to evaluate the contributor profile we consider both his qualification for the task and his behaviour during its achievement thanks to his reflection.
Document type :
Conference papers
Complete list of metadatas

Cited literature [31 references]  Display  Hide  Download
Contributor : Constance Thierry <>
Submitted on : Tuesday, November 12, 2019 - 3:35:49 PM
Last modification on : Sunday, November 17, 2019 - 1:18:38 AM


Files produced by the author(s)


  • HAL Id : hal-02359881, version 1


Constance Thierry, Jean-Christophe Dubois, Yolande Le Gall, Arnaud Martin. Modeling uncertainty and inaccuracy on data from crowdsourcing platforms: MONITOR. IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI'19), Nov 2019, Portland, United States. ⟨hal-02359881⟩



Record views


Files downloads