This paper presents an agent-based model of peer review that looks at the effect of different editorial policies of referee selection. We tested four author/referee matching scenarios as follows: random selection of referees, selection of referees with a similar status to submission authors, selection of higher-skilled and lower skilled referees. We tested these scenarios against three types of referee behaviour, ie., fair, unreliable and strategic and measured their implications for the quality and efficiency of the process. Results show that in case of randomness of referee judgment, any editorial policy is detrimental for peer review. If referees behave strategically, certain matching policies, such as selecting referees of good quality, might counteract possible bias.
Do editors have a silver bullet? an agent-based model of peer review / J. Cabotà, F. Grimaldo, F. Squazzoni - In: Proceedings - 28th European Conference on Modelling and Simulation, ECMS 2014[s.l] : European Council for Modelling and Simulation, 2014. - ISBN 9780956494481. - pp. 725-731 (( Intervento presentato al 28. convegno European Conference on Modelling and Simulation tenutosi a Brescia nel 2014.
Do editors have a silver bullet? an agent-based model of peer review
F. Squazzoni
2014
Abstract
This paper presents an agent-based model of peer review that looks at the effect of different editorial policies of referee selection. We tested four author/referee matching scenarios as follows: random selection of referees, selection of referees with a similar status to submission authors, selection of higher-skilled and lower skilled referees. We tested these scenarios against three types of referee behaviour, ie., fair, unreliable and strategic and measured their implications for the quality and efficiency of the process. Results show that in case of randomness of referee judgment, any editorial policy is detrimental for peer review. If referees behave strategically, certain matching policies, such as selecting referees of good quality, might counteract possible bias.File | Dimensione | Formato | |
---|---|---|---|
ECMS2014CabotaGrimaldoSquazzoni.pdf
accesso riservato
Tipologia:
Post-print, accepted manuscript ecc. (versione accettata dall'editore)
Dimensione
777.82 kB
Formato
Adobe PDF
|
777.82 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.