The use of a variety of metrics is advocated to assess model performance but correlated metrics may convey the same information, thus leading to redundancy. Starting from this assumption, a method was developed for selecting, from among a collection of performance indicators, one or more subsets providing the same information as the entire set. The method, based on the definition of "stable correlation", was applied to 23 performance indicators of agrometeorological models, calculated on large sets of simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Two subsets were determined: Squared Bias, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index, Modified Modelling Efficiency, Persistence Model Efficiency, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index. The method needs corroboration but is statistically founded and can support the implementation of standardized evaluation tools.

A new method for analysing the interrelationship between performance indicators with an application to agrometeorological models / M. Sanna, G. Bellocchi, M. Fumagalli, M. Acutis. - In: ENVIRONMENTAL MODELLING & SOFTWARE. - ISSN 1364-8152. - 73(2015), pp. 3511.286-3511.304.

A new method for analysing the interrelationship between performance indicators with an application to agrometeorological models

M. Sanna;M. Acutis
2015

Abstract

The use of a variety of metrics is advocated to assess model performance but correlated metrics may convey the same information, thus leading to redundancy. Starting from this assumption, a method was developed for selecting, from among a collection of performance indicators, one or more subsets providing the same information as the entire set. The method, based on the definition of "stable correlation", was applied to 23 performance indicators of agrometeorological models, calculated on large sets of simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Two subsets were determined: Squared Bias, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index, Modified Modelling Efficiency, Persistence Model Efficiency, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index. The method needs corroboration but is statistically founded and can support the implementation of standardized evaluation tools.
English
model evaluation; performance indicators; stable correlation; ecological modeling; environmental engineering; software
Settore AGR/02 - Agronomia e Coltivazioni Erbacee
Articolo
Comitato scientifico
Ricerca applicata
Pubblicazione scientifica
2015
Elsevier Ltd
73
3511
286
304
19
Pubblicato
Periodico con rilevanza internazionale
scopus
crossref
Aderisco
info:eu-repo/semantics/article
A new method for analysing the interrelationship between performance indicators with an application to agrometeorological models / M. Sanna, G. Bellocchi, M. Fumagalli, M. Acutis. - In: ENVIRONMENTAL MODELLING & SOFTWARE. - ISSN 1364-8152. - 73(2015), pp. 3511.286-3511.304.
reserved
Prodotti della ricerca::01 - Articolo su periodico
4
262
Article (author)
si
M. Sanna, G. Bellocchi, M. Fumagalli, M. Acutis
File in questo prodotto:
File Dimensione Formato  
SannaAcutis_EnvinrModellSoftware_NewMethodAnalysing_2015.pdf

accesso riservato

Tipologia: Publisher's version/PDF
Dimensione 10.46 MB
Formato Adobe PDF
10.46 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/349548
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
  • ???jsp.display-item.citation.isi??? 5
social impact