Crowdsourcing Strategies for Text Creation Tasks

Abstract : We examine deployment strategies for text translation and text summarization tasks. We formalize a deployment strategy along three dimensions: work structure, workforce organization , and work style. Work structure can be either simultaneous or sequential, workforce organization independent or collaborative, and work style either crowd-only or hybrid. We use Amazon Mechanical Turk to evaluate the cost, latency, and quality of various deployment strategies. We asses our strategies for different scenarios: short/long text, presence/absence of an outline, and popular/unpopular topics. Our findings serve as a basis to automate the deployment of text creation tasks.
Document type :
Conference papers
Complete list of metadatas

Cited literature [14 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02000656
Contributor : Sihem Amer-Yahia <>
Submitted on : Thursday, January 31, 2019 - 2:48:46 PM
Last modification on : Friday, October 25, 2019 - 1:30:38 AM
Long-term archiving on : Wednesday, May 1, 2019 - 1:44:07 PM

File

paper-275 (1).pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Ria Borromeo, Maha Alsayasneh, Sihem Amer-Yahia, Vincent Leroy. Crowdsourcing Strategies for Text Creation Tasks. Inter- national Conference on Extending Database Technology (EDBT), Mar 2017, Venise, Italy. ⟨10.5441/002/edbt.2017.42⟩. ⟨hal-02000656⟩

Share

Metrics

Record views

36

Files downloads

30