Eliciting Worker Preference for Task Completion

Abstract : Current crowdsourcing platforms provide little support for worker feedback. Workers are sometimes invited to post free text describing their experience and preferences in completing tasks. They can also use forums such as Turker Nation 1 to exchange preferences on tasks and requesters. In fact, crowdsourcing platforms rely heavily on observing workers and inferring their preferences implicitly. In this work, we believe that asking workers to indicate their preferences explicitly improve their experience in task completion and hence, the quality of their contributions. Explicit elicitation can indeed help to build more accurate worker models for task completion that captures the evolving nature of worker preferences. We design a worker model whose accuracy is improved iteratively by requesting preferences for task factors such as required skills, task payment, and task relevance. We propose a generic framework, develop efficient solutions in realistic scenarios, and run extensive experiments that show the benefit of explicit preference elicitation over implicit ones with statistical significance.
Complete list of metadatas

Cited literature [44 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02002078
Contributor : Sihem Amer-Yahia <>
Submitted on : Thursday, January 31, 2019 - 2:44:12 PM
Last modification on : Friday, March 15, 2019 - 12:56:11 PM
Long-term archiving on : Wednesday, May 1, 2019 - 8:23:57 PM

File

1801.03233.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02002078, version 1

Collections

Citation

Mohammad Esfandiari, Senjuti Basu Roy, Sihem Amer-Yahia. Eliciting Worker Preference for Task Completion. International Conference on Information and Knowledge Management, Oct 2018, Torino, Italy. ⟨hal-02002078⟩

Share

Metrics

Record views

8

Files downloads

10