This paper presents an agent-based model of peer review that looks at the effect of different editorial policies of referee selection. We tested four author/referee matching scenarios as follows: random selection of referees, selection of referees with a similar status to submission authors, selection of higher-skilled and lower skilled referees. We tested these scenarios against three types of referee behaviour, ie., fair, unreliable and strategic and measured their implications for the quality and efficiency of the process. Results show that in case of randomness of referee judgment, any editorial policy is detrimental for peer review. If referees behave strategically, certain matching policies, such as selecting referees of good quality, might counteract possible bias.

Do editors have a silver bullet? an agent-based model of peer review / J. Cabotà, F. Grimaldo, F. Squazzoni - In: Proceedings - 28th European Conference on Modelling and Simulation, ECMS 2014[s.l] : European Council for Modelling and Simulation, 2014. - ISBN 9780956494481. - pp. 725-731 (( Intervento presentato al 28. convegno European Conference on Modelling and Simulation tenutosi a Brescia nel 2014.

Do editors have a silver bullet? an agent-based model of peer review

F. Squazzoni
2014

Abstract

This paper presents an agent-based model of peer review that looks at the effect of different editorial policies of referee selection. We tested four author/referee matching scenarios as follows: random selection of referees, selection of referees with a similar status to submission authors, selection of higher-skilled and lower skilled referees. We tested these scenarios against three types of referee behaviour, ie., fair, unreliable and strategic and measured their implications for the quality and efficiency of the process. Results show that in case of randomness of referee judgment, any editorial policy is detrimental for peer review. If referees behave strategically, certain matching policies, such as selecting referees of good quality, might counteract possible bias.
Peer review; editor; referee-author matching policy; referee behaviour; agent-based modelling
Settore SPS/07 - Sociologia Generale
Book Part (author)
File in questo prodotto:
File Dimensione Formato  
ECMS2014CabotaGrimaldoSquazzoni.pdf

accesso riservato

Tipologia: Post-print, accepted manuscript ecc. (versione accettata dall'editore)
Dimensione 777.82 kB
Formato Adobe PDF
777.82 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

Caricamento pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/2434/661742
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 6
  • ???jsp.display-item.citation.isi??? ND
social impact