Background: Italy is a country showing low math achievement, especially in the Southern regions. Moreover, national student assessments are recent and rigorous policy evaluation is lacking. This study presents the results of one of the first randomized controlled trials implemented in Italian schools in order to measure the effects of a professional development (PD) program for teachers on student math achievement. The program was already at scale when it was being evaluated. Objective: Assessing the effects of a PD program for math teachers on their students' achievement and making suggestions for future policy evaluations. Design: A large-scale clustered randomized control trial has been conducted. It involves 175 lower secondary schools (sixth - eighth grade) in four among the Italian lowest performing regions. Alongside national standard math assessments, the project collected a wide amount of information. Subjects: Math in lower secondary schools. Measures: Math achievement as measured by standardized tests provided by the National Education Assessment Institute (Istituto Nazionale per la Valutazione del Sistema di Istruzione e Formazione); teacher and student practices and attitudes collected through questionnaires. Results: Findings suggest that the program had no significant impact on math scores during the first year (when the program was held). Nonetheless some heterogeneity was detected, as the treatment does seem "to work" with middle-aged teachers. Moreover, effects on teaching practice and student attitudes appear. Conclusion: Some effects attributable to the intervention have been detected. Moreover, this project shows that a rigorous approach to evaluation is feasible also in a context lacking attention towards evidence-based policies, such the Italian school system.

Trying to Raise (Low) Math Achievement and to Promote (Rigorous) Policy Evaluation in Italy: Evidence From a Large-Scale Randomized Trial / G. Argentin, A. Pennisi, D. Vidoni, G. Abbiati, A. Caputo. - In: EVALUATION REVIEW. - ISSN 0193-841X. - 38:2(2014), pp. 99-132.

Trying to Raise (Low) Math Achievement and to Promote (Rigorous) Policy Evaluation in Italy: Evidence From a Large-Scale Randomized Trial

G. Abbiati;
2014

Abstract

Background: Italy is a country showing low math achievement, especially in the Southern regions. Moreover, national student assessments are recent and rigorous policy evaluation is lacking. This study presents the results of one of the first randomized controlled trials implemented in Italian schools in order to measure the effects of a professional development (PD) program for teachers on student math achievement. The program was already at scale when it was being evaluated. Objective: Assessing the effects of a PD program for math teachers on their students' achievement and making suggestions for future policy evaluations. Design: A large-scale clustered randomized control trial has been conducted. It involves 175 lower secondary schools (sixth - eighth grade) in four among the Italian lowest performing regions. Alongside national standard math assessments, the project collected a wide amount of information. Subjects: Math in lower secondary schools. Measures: Math achievement as measured by standardized tests provided by the National Education Assessment Institute (Istituto Nazionale per la Valutazione del Sistema di Istruzione e Formazione); teacher and student practices and attitudes collected through questionnaires. Results: Findings suggest that the program had no significant impact on math scores during the first year (when the program was held). Nonetheless some heterogeneity was detected, as the treatment does seem "to work" with middle-aged teachers. Moreover, effects on teaching practice and student attitudes appear. Conclusion: Some effects attributable to the intervention have been detected. Moreover, this project shows that a rigorous approach to evaluation is feasible also in a context lacking attention towards evidence-based policies, such the Italian school system.
teacher professional development; randomized experiment; math achievement
Settore SPS/07 - Sociologia Generale
Settore SPS/08 - Sociologia dei Processi Culturali e Comunicativi
Settore SPS/09 - Sociologia dei Processi economici e del Lavoro
Settore SECS-S/03 - Statistica Economica
EVALUATION REVIEW
Article (author)
File in questo prodotto:
File Dimensione Formato  
2014 Evaluation review.pdf

non disponibili

Tipologia: Publisher's version/PDF
Dimensione 274.5 kB
Formato Adobe PDF
274.5 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

Caricamento pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/2434/767777
Citazioni
  • ???jsp.display-item.citation.pmc??? 1
  • Scopus 11
  • ???jsp.display-item.citation.isi??? 13
social impact