In crowdsourcing, a range task is a type of creation task where only free answers belonging to the numeric domain are accepted/possible. In this paper, we present the median-on-agreement (ma) techniques based on statistical and consensus-based mechanisms for determining the result of range tasks. The ma techniques are characterized by i) the distinction between the group of workers that agree (i.e., workers in the consensus) on the task result from the group that disagree, and ii) the calculation of the final task answer through a median-based mechanism where only answers of workers in the consensus are considered.
Consensus-based techniques for range-task resolution in crowdsourcing systems / L. Genta, A. Ferrara, S. Montanelli - In: EDBT/ICDT 2017 : Workshops / [a cura di] Y. Ioannidis, J. Stoyanovich,G. Orsi. - [s.l] : CEUR-WS, 2017. - pp. 1-4 (( Intervento presentato al 7. convegno Linked Web Data Management tenutosi a Venezia nel 2017.
Titolo: | Consensus-based techniques for range-task resolution in crowdsourcing systems |
Autori: | |
Parole Chiave: | Consensus evaluation; Crowdsourcing; Range task management |
Settore Scientifico Disciplinare: | Settore INF/01 - Informatica |
Data di pubblicazione: | 2017 |
URL: | http://ceur-ws.org/ |
Tipologia: | Book Part (author) |
Appare nelle tipologie: | 03 - Contributo in volume |
File in questo prodotto:
File | Descrizione | Tipologia | Licenza | |
---|---|---|---|---|
LWDM_paper_03.pdf | Publisher's version/PDF | Administrator Richiedi una copia |