Randomized controlled trials (RCTs) are increasingly used in sociology to generate causal evidence. While the uptake of RCTs in sociology has lagged behind other disciplines, recent growth signals a shift toward what some now call “experimental sociology.” However, the methodological promise of RCTs depends not only on random assignment but also on transparent reporting practices that allow readers to assess internal validity, implementation quality, and the generalizability of findings. In this article, we conduct a systematic scoping review of 91 field experiments published since 2000 in high- ranking sociological journals. Using an adapted version of the CONSORT-SPI checklist, we evaluate reporting accuracy across a range of design and implementation indicators. We find substantial variability and frequent omissions in how sociological RCTs are reported, with implications for replicability and the cumulative advancement of causal knowledge. Our findings suggest that sociologists have yet to fully adopt reporting standards developed in other disciplines, and that greater attention to documentation could strengthen the credibility and utility of experimental evidence. We offer concrete recommendations for researchers, reviewers, and journal editors to improve transparency and comparability in sociological field experiments.

Tell me more. Findings from a Scoping Review on the Reporting of Field Experiments in Sociology / G. Argentin, G.M. Abbiati, D. Azzolini, G. Ballarino, D. Cartagini, E. Manzella, M. Pellegrini, L. Vergolini. - (2025 Oct 17). [10.31235/osf.io/85u4w_v1]

Tell me more. Findings from a Scoping Review on the Reporting of Field Experiments in Sociology

G.M. Abbiati;G. Ballarino;D. Cartagini;
2025

Abstract

Randomized controlled trials (RCTs) are increasingly used in sociology to generate causal evidence. While the uptake of RCTs in sociology has lagged behind other disciplines, recent growth signals a shift toward what some now call “experimental sociology.” However, the methodological promise of RCTs depends not only on random assignment but also on transparent reporting practices that allow readers to assess internal validity, implementation quality, and the generalizability of findings. In this article, we conduct a systematic scoping review of 91 field experiments published since 2000 in high- ranking sociological journals. Using an adapted version of the CONSORT-SPI checklist, we evaluate reporting accuracy across a range of design and implementation indicators. We find substantial variability and frequent omissions in how sociological RCTs are reported, with implications for replicability and the cumulative advancement of causal knowledge. Our findings suggest that sociologists have yet to fully adopt reporting standards developed in other disciplines, and that greater attention to documentation could strengthen the credibility and utility of experimental evidence. We offer concrete recommendations for researchers, reviewers, and journal editors to improve transparency and comparability in sociological field experiments.
Settore GSPS-08/A - Sociologia dei processi economici e del lavoro
Settore GSPS-05/A - Sociologia generale
17-ott-2025
https://www.openicpsr.org/openicpsr/project/238993/version/V2/view
File in questo prodotto:
File Dimensione Formato  
WP_Tell_me_more.pdf

accesso aperto

Tipologia: Pre-print (manoscritto inviato all'editore)
Licenza: Creative commons
Dimensione 1.7 MB
Formato Adobe PDF
1.7 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/1244571
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact