This paper presents an agent-based model of peer review that looks at potential con-sequences of reciprocity strategies by scientists on the quality and efficiency of the process. We analyzed scientist strategies in two conditions: (i) when peer review is confidential and anony-mous; (ii) when peer review is open. We built three scenarios through which we manipulated reviewer behavior: reliable (reviewers always cooperate by providing pertinent opinion), unre-liable (reviewers always defect by providing biased opinion) and strategic (reviewers overvalue other’s work when previously published and vice versa) reviewers. Results showed that the effect of reciprocity strategies on the quality of peer review might be detrimental. This is even more dramatic when peer review is open, as scientists could play Tit-for-Tat direct reciprocity against other colleagues, which may dramatically biases their personal judgement.

The shadow of reciprocity on confidential vs. open peer review: An agent-based model / F. Bianchi, F. Squazzoni. ((Intervento presentato al convegno Social Simulation Conference tenutosi a Roma nel 2016.

The shadow of reciprocity on confidential vs. open peer review: An agent-based model

F. Bianchi;F. Squazzoni
2016

Abstract

This paper presents an agent-based model of peer review that looks at potential con-sequences of reciprocity strategies by scientists on the quality and efficiency of the process. We analyzed scientist strategies in two conditions: (i) when peer review is confidential and anony-mous; (ii) when peer review is open. We built three scenarios through which we manipulated reviewer behavior: reliable (reviewers always cooperate by providing pertinent opinion), unre-liable (reviewers always defect by providing biased opinion) and strategic (reviewers overvalue other’s work when previously published and vice versa) reviewers. Results showed that the effect of reciprocity strategies on the quality of peer review might be detrimental. This is even more dramatic when peer review is open, as scientists could play Tit-for-Tat direct reciprocity against other colleagues, which may dramatically biases their personal judgement.
20-set-2016
peer review; sociology of science; evaluation; open peer review; agent-based model; social simulation
Settore SPS/07 - Sociologia Generale
Settore SPS/09 - Sociologia dei Processi economici e del Lavoro
The shadow of reciprocity on confidential vs. open peer review: An agent-based model / F. Bianchi, F. Squazzoni. ((Intervento presentato al convegno Social Simulation Conference tenutosi a Roma nel 2016.
Conference Object
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/478457
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact