In this paper, we present the LiquidCrowd methodological approach based on consensus and trustworthiness techniques for managing the execution of collective tasks. By collective task, we refer to a task in which the result depends on the consensus (i.e., degree of agreement) reached by the group of workers involved in the task execution. The more workers agree on a certain task answer, the more this answer is valid/accepted as a committed result for the task. In the paper, we provide crowdsourcing techniques for managing collective tasks based on the notion of supermajority to verify an expected degree of consensus/agreement required for considering a task as successfully completed. Moreover, we define trustworthiness techniques to measure the worker reliability/expertise in collective task execution in order to tailor the composition of a group by involving workers that are more able to express a sharable answer where needed. A case study of a collective task related to web-resource labeling is illustrated and evaluation results of the LiquidCrowd methodological approach are finally discussed.

Combining crowd consensus and user trustworthiness for managing collective tasks / S. Castano, A. Ferrara, L. Genta, S. Montanelli. - In: FUTURE GENERATION COMPUTER SYSTEMS. - ISSN 0167-739X. - 54(2016), pp. 378-388.

Combining crowd consensus and user trustworthiness for managing collective tasks

S. Castano
Primo
;
A. Ferrara
Secondo
;
L. Genta
Penultimo
;
S. Montanelli
Ultimo
2016

Abstract

In this paper, we present the LiquidCrowd methodological approach based on consensus and trustworthiness techniques for managing the execution of collective tasks. By collective task, we refer to a task in which the result depends on the consensus (i.e., degree of agreement) reached by the group of workers involved in the task execution. The more workers agree on a certain task answer, the more this answer is valid/accepted as a committed result for the task. In the paper, we provide crowdsourcing techniques for managing collective tasks based on the notion of supermajority to verify an expected degree of consensus/agreement required for considering a task as successfully completed. Moreover, we define trustworthiness techniques to measure the worker reliability/expertise in collective task execution in order to tailor the composition of a group by involving workers that are more able to express a sharable answer where needed. A case study of a collective task related to web-resource labeling is illustrated and evaluation results of the LiquidCrowd methodological approach are finally discussed.
Crowdsourcing; Collective task; Consensus negotiation; Worker trustworthiness
Settore INF/01 - Informatica
2016
Article (author)
File in questo prodotto:
File Dimensione Formato  
1-s2.0-S0167739X15001065-main.pdf

accesso riservato

Tipologia: Publisher's version/PDF
Dimensione 1.24 MB
Formato Adobe PDF
1.24 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/277246
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 20
  • ???jsp.display-item.citation.isi??? 12
social impact