The chapter illustrates the English systems for research evaluation (the Research Excellence Framework - REF) and teaching evaluation (Teaching Excellence and Student Outcomes Framework – TEF) as NPM-driven mechanisms aimed at increasing public accountability and efficiency. Particular attention is given to the methodology of assessment, the incentives provided through the evaluation mechanism and the actual/potential effects that have been generating on both academics and universities. These two experiences are analyzed through the lens of the Management Control Theory (MCT), which argues that each evaluation system must be designed according to the nature of the activity/task under evaluation in order to be effective. Two dimensions are particularly relevant to this regard: the degree of the measurability and a¬ttributability of the output (i) and the knowledge of the cause-effect relation or transformation process producing the output (ii). Different configurations of these two dimensions lead indeed to different types of evaluation (input, process, output evaluation). Regarding the REF, it is highlighted how peer-review reflects both a process-based and an output-based evaluation since the quality of the research outputs under assessment should be judged according to the consistency of theoretical arguments and research methodologies employed to develop that specific research output. However, when this process shifts towards increasing attention to just quantifiable indicators of research outputs, some unintended consequences may arise. Concerning the TEF, the dominant focus of the metrics-based system towards measurable dimensions of teaching outputs, may not be able to grasp more qualitative and not directly measurable aspects that are still crucial in discriminating between satisfactory or partial performances.

An Analysis of Methodologies, Incentives, and Effects of Performance Evaluation in Higher Education: The English Experience / G. Barbato, M. Turri (SIDREA SERIES IN ACCOUNTING AND BUSINESS ADMINISTRATION). - In: Governance and Performance Management in Public Universities : Current Research and Practice / [a cura di] E. Caperchione, C. Bianchi. - [s.l] : Springer, 2022. - ISBN 978-3-030-85697-7. - pp. 49-68 [10.1007/978-3-030-85698-4_3]

An Analysis of Methodologies, Incentives, and Effects of Performance Evaluation in Higher Education: The English Experience

G. Barbato
Primo
;
M. Turri
Ultimo
2022

Abstract

The chapter illustrates the English systems for research evaluation (the Research Excellence Framework - REF) and teaching evaluation (Teaching Excellence and Student Outcomes Framework – TEF) as NPM-driven mechanisms aimed at increasing public accountability and efficiency. Particular attention is given to the methodology of assessment, the incentives provided through the evaluation mechanism and the actual/potential effects that have been generating on both academics and universities. These two experiences are analyzed through the lens of the Management Control Theory (MCT), which argues that each evaluation system must be designed according to the nature of the activity/task under evaluation in order to be effective. Two dimensions are particularly relevant to this regard: the degree of the measurability and a¬ttributability of the output (i) and the knowledge of the cause-effect relation or transformation process producing the output (ii). Different configurations of these two dimensions lead indeed to different types of evaluation (input, process, output evaluation). Regarding the REF, it is highlighted how peer-review reflects both a process-based and an output-based evaluation since the quality of the research outputs under assessment should be judged according to the consistency of theoretical arguments and research methodologies employed to develop that specific research output. However, when this process shifts towards increasing attention to just quantifiable indicators of research outputs, some unintended consequences may arise. Concerning the TEF, the dominant focus of the metrics-based system towards measurable dimensions of teaching outputs, may not be able to grasp more qualitative and not directly measurable aspects that are still crucial in discriminating between satisfactory or partial performances.
Research evaluation; Teaching evaluation; Teaching excellence framework; Management control theory
Settore SECS-P/07 - Economia Aziendale
2022
Book Part (author)
File in questo prodotto:
File Dimensione Formato  
Barbato_Turri_2022_An+Analysis+of+Methodologies.pdf

accesso aperto

Tipologia: Pre-print (manoscritto inviato all'editore)
Dimensione 298.47 kB
Formato Adobe PDF
298.47 kB Adobe PDF Visualizza/Apri
978-3-030-85698-4_3.pdf

accesso riservato

Tipologia: Publisher's version/PDF
Dimensione 293.19 kB
Formato Adobe PDF
293.19 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/901299
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? ND
social impact