The chapter illustrates the English systems for research evaluation (the Research Excellence Framework - REF) and teaching evaluation (Teaching Excellence and Student Outcomes Framework – TEF) as NPM-driven mechanisms aimed at increasing public accountability and efficiency. Particular attention is given to the methodology of assessment, the incentives provided through the evaluation mechanism and the actual/potential effects that have been generating on both academics and universities. These two experiences are analyzed through the lens of the Management Control Theory (MCT), which argues that each evaluation system must be designed according to the nature of the activity/task under evaluation in order to be effective. Two dimensions are particularly relevant to this regard: the degree of the measurability and a¬ttributability of the output (i) and the knowledge of the cause-effect relation or transformation process producing the output (ii). Different configurations of these two dimensions lead indeed to different types of evaluation (input, process, output evaluation). Regarding the REF, it is highlighted how peer-review reflects both a process-based and an output-based evaluation since the quality of the research outputs under assessment should be judged according to the consistency of theoretical arguments and research methodologies employed to develop that specific research output. However, when this process shifts towards increasing attention to just quantifiable indicators of research outputs, some unintended consequences may arise. Concerning the TEF, the dominant focus of the metrics-based system towards measurable dimensions of teaching outputs, may not be able to grasp more qualitative and not directly measurable aspects that are still crucial in discriminating between satisfactory or partial performances.
An Analysis of Methodologies, Incentives, and Effects of Performance Evaluation in Higher Education: The English Experience / G. Barbato, M. Turri (SIDREA SERIES IN ACCOUNTING AND BUSINESS ADMINISTRATION). - In: Governance and Performance Management in Public Universities : Current Research and Practice / [a cura di] E. Caperchione, C. Bianchi. - [s.l] : Springer, 2022. - ISBN 978-3-030-85697-7. - pp. 49-68 [10.1007/978-3-030-85698-4_3]
An Analysis of Methodologies, Incentives, and Effects of Performance Evaluation in Higher Education: The English Experience
G. Barbato
Primo
;M. TurriUltimo
2022
Abstract
The chapter illustrates the English systems for research evaluation (the Research Excellence Framework - REF) and teaching evaluation (Teaching Excellence and Student Outcomes Framework – TEF) as NPM-driven mechanisms aimed at increasing public accountability and efficiency. Particular attention is given to the methodology of assessment, the incentives provided through the evaluation mechanism and the actual/potential effects that have been generating on both academics and universities. These two experiences are analyzed through the lens of the Management Control Theory (MCT), which argues that each evaluation system must be designed according to the nature of the activity/task under evaluation in order to be effective. Two dimensions are particularly relevant to this regard: the degree of the measurability and a¬ttributability of the output (i) and the knowledge of the cause-effect relation or transformation process producing the output (ii). Different configurations of these two dimensions lead indeed to different types of evaluation (input, process, output evaluation). Regarding the REF, it is highlighted how peer-review reflects both a process-based and an output-based evaluation since the quality of the research outputs under assessment should be judged according to the consistency of theoretical arguments and research methodologies employed to develop that specific research output. However, when this process shifts towards increasing attention to just quantifiable indicators of research outputs, some unintended consequences may arise. Concerning the TEF, the dominant focus of the metrics-based system towards measurable dimensions of teaching outputs, may not be able to grasp more qualitative and not directly measurable aspects that are still crucial in discriminating between satisfactory or partial performances.File | Dimensione | Formato | |
---|---|---|---|
Barbato_Turri_2022_An+Analysis+of+Methodologies.pdf
accesso aperto
Tipologia:
Pre-print (manoscritto inviato all'editore)
Dimensione
298.47 kB
Formato
Adobe PDF
|
298.47 kB | Adobe PDF | Visualizza/Apri |
978-3-030-85698-4_3.pdf
accesso riservato
Tipologia:
Publisher's version/PDF
Dimensione
293.19 kB
Formato
Adobe PDF
|
293.19 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.