In crowdsourcing, a range task is a type of creation task where only free answers belonging to the numeric domain are accepted/possible. In this paper, we present the median-on-agreement (ma) techniques based on statistical and consensus-based mechanisms for determining the result of range tasks. The ma techniques are characterized by i) the distinction between the group of workers that agree (i.e., workers in the consensus) on the task result from the group that disagree, and ii) the calculation of the final task answer through a median-based mechanism where only answers of workers in the consensus are considered.

Consensus-based techniques for range-task resolution in crowdsourcing systems / L. Genta, A. Ferrara, S. Montanelli - In: EDBT/ICDT 2017 : Workshops / [a cura di] Y. Ioannidis, J. Stoyanovich,G. Orsi. - [s.l] : CEUR-WS, 2017. - pp. 1-4 (( Intervento presentato al 7. convegno Linked Web Data Management tenutosi a Venezia nel 2017.

Consensus-based techniques for range-task resolution in crowdsourcing systems

L. Genta;A. Ferrara;S. Montanelli
2017

Abstract

In crowdsourcing, a range task is a type of creation task where only free answers belonging to the numeric domain are accepted/possible. In this paper, we present the median-on-agreement (ma) techniques based on statistical and consensus-based mechanisms for determining the result of range tasks. The ma techniques are characterized by i) the distinction between the group of workers that agree (i.e., workers in the consensus) on the task result from the group that disagree, and ii) the calculation of the final task answer through a median-based mechanism where only answers of workers in the consensus are considered.
Consensus evaluation; Crowdsourcing; Range task management
Settore INF/01 - Informatica
2017
http://ceur-ws.org/
Book Part (author)
File in questo prodotto:
File Dimensione Formato  
LWDM_paper_03.pdf

accesso riservato

Tipologia: Publisher's version/PDF
Dimensione 297.9 kB
Formato Adobe PDF
297.9 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/500915
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? ND
social impact