This paper examines the impact of strategic behaviour of referees on the quality and efficiency of peer review. We modelled peer review as a process based on knowledge asymmetry and subject to evaluation bias. We built two simulation scenarios to investigate largescale implications of referee behaviour and judgment bias. The first one was inspired by "the luck of the reviewer draw" idea. In this case, we assumed that referees randomly fell into Type I and Type II errors, i.e., recommending submissions of low quality to be published or recommending against the publishing of submissions which should have been published. In the second scenario, we assumed that certain referees tried intentionally to outperform potential competitors by underrating the value of their submissions. We found that when publication selection increased, the presence of a minority of cheaters may dramatically undermine the quality and efficiency of peer review even compared with a scenario purely dominated by "the luck of the reviewer draw". We also found that peer review outcomes are significantly influenced by differences in the way scientists identify potential competitors in the system.
When competition is pushed too hard. An agent-based model of strategic behaviour of referees in peer review / J. Cabotà, F. Grimaldo, F. Squazzoni - In: European Conference on Modelling and Simulation / [a cura di] W. Rekdalsbakken, R.T. Bye, H. Zhang. - Prima edizione. - [s.l] : European Council for Modelling and Simulation, 2013. - ISBN 9780956494467. - pp. 881-887 (( Intervento presentato al 27. convegno ECMS tenutosi a Alesund nel 2013.
Titolo: | When competition is pushed too hard. An agent-based model of strategic behaviour of referees in peer review |
Autori: | SQUAZZONI, FLAMINIO (Corresponding) |
Parole Chiave: | Peer review; referees; competition; rational cheating; fairness; agent-based model |
Settore Scientifico Disciplinare: | Settore SPS/07 - Sociologia Generale |
Data di pubblicazione: | 2013 |
Tipologia: | Book Part (author) |
Appare nelle tipologie: | 03 - Contributo in volume |
File in questo prodotto:
File | Descrizione | Tipologia | Licenza | |
---|---|---|---|---|
Ecms2013.pdf | Publisher's version/PDF | Administrator Richiedi una copia |