Transparency and accountability are keywords in corporate business, politics, and science. As part of the open science movement, many journals have started to adopt forms of open peer review beyond the closed (single- or double-blind) standard model. However, there is contrasting evidence on the impact of these innovations on the quality of peer review. Furthermore, their long-term consequences on scientists’ cooperation and competition are difficult to assess empirically. This paper aims to fill this gap by presenting an agent-based model that simulates competition and status dynamics between scholars in an artificial academic system. The results would suggest that if referees are sensitive to competition and status, the transparency achieved by open peer review could backfire on the quality of the process. Although only abstract and hypothetical, our findings suggest the importance of multidimensional values of peer review and the anonymity and confidentiality of the process.

Can transparency undermine peer review? A simulation model of scientist behavior under open peer review / F. Bianchi, F. Squazzoni. - In: SCIENCE & PUBLIC POLICY. - ISSN 0302-3427. - 49:5(2022 Oct), pp. scac027.791-scac027.800. [10.1093/scipol/scac027]

Can transparency undermine peer review? A simulation model of scientist behavior under open peer review

F. Bianchi
Primo
;
F. Squazzoni
Ultimo
2022

Abstract

Transparency and accountability are keywords in corporate business, politics, and science. As part of the open science movement, many journals have started to adopt forms of open peer review beyond the closed (single- or double-blind) standard model. However, there is contrasting evidence on the impact of these innovations on the quality of peer review. Furthermore, their long-term consequences on scientists’ cooperation and competition are difficult to assess empirically. This paper aims to fill this gap by presenting an agent-based model that simulates competition and status dynamics between scholars in an artificial academic system. The results would suggest that if referees are sensitive to competition and status, the transparency achieved by open peer review could backfire on the quality of the process. Although only abstract and hypothetical, our findings suggest the importance of multidimensional values of peer review and the anonymity and confidentiality of the process.
peer review; science; reviewer bias; status; agent-based models
Settore SPS/07 - Sociologia Generale
ott-2022
6-giu-2022
Article (author)
File in questo prodotto:
File Dimensione Formato  
scac027(2).pdf

accesso aperto

Descrizione: online first
Tipologia: Publisher's version/PDF
Dimensione 891.71 kB
Formato Adobe PDF
891.71 kB Adobe PDF Visualizza/Apri
scac027(3).pdf

accesso aperto

Tipologia: Publisher's version/PDF
Dimensione 596.6 kB
Formato Adobe PDF
596.6 kB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/930468
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 7
  • ???jsp.display-item.citation.isi??? 7
social impact