Predicting the future state of a system has always been a natural motivation for science and practical applications. Such a topic, beyond its obvious technical and societal relevance, is also interesting from a conceptual point of view. This owes to the fact that forecasting lends itself to two equally radical, yet opposite methodologies. A reductionist one, based on first principles, and the naïve-inductivist one, based only on data. This latter view has recently gained some attention in response to the availability of unprecedented amounts of data and increasingly sophisticated algorithmic analytic techniques. The purpose of this note is to assess critically the role of big data in reshaping the key aspects of forecasting and in particular the claim that bigger data leads to better predictions. Drawing on the representative example of weather forecasts we argue that this is not generally the case. We conclude by suggesting that a clever and context-dependent compromise between modelling and quantitative analysis stands out as the best forecasting strategy, as anticipated nearly a century ago by Richardson and von Neumann.

Forecasting in light of Big Data / H. Hosni, A. Vulpiani. - In: PHILOSOPHY & TECHNOLOGY. - ISSN 2210-5433. - 31:4(2018 Dec 01), pp. 557-569. [10.1007/s13347-017-0265-3]

Forecasting in light of Big Data

H. Hosni;
2018

Abstract

Predicting the future state of a system has always been a natural motivation for science and practical applications. Such a topic, beyond its obvious technical and societal relevance, is also interesting from a conceptual point of view. This owes to the fact that forecasting lends itself to two equally radical, yet opposite methodologies. A reductionist one, based on first principles, and the naïve-inductivist one, based only on data. This latter view has recently gained some attention in response to the availability of unprecedented amounts of data and increasingly sophisticated algorithmic analytic techniques. The purpose of this note is to assess critically the role of big data in reshaping the key aspects of forecasting and in particular the claim that bigger data leads to better predictions. Drawing on the representative example of weather forecasts we argue that this is not generally the case. We conclude by suggesting that a clever and context-dependent compromise between modelling and quantitative analysis stands out as the best forecasting strategy, as anticipated nearly a century ago by Richardson and von Neumann.
forecasting; Big data; epistemology
Settore M-FIL/02 - Logica e Filosofia della Scienza
1-dic-2018
26-mag-2017
Article (author)
File in questo prodotto:
File Dimensione Formato  
HH-AV-big-data-arxiv.pdf

Open Access dal 20/09/2018

Tipologia: Post-print, accepted manuscript ecc. (versione accettata dall'editore)
Dimensione 273.67 kB
Formato Adobe PDF
273.67 kB Adobe PDF Visualizza/Apri
HosniVolpiani_ForecastingLightBigData_PhilosTechnol.pdf

accesso riservato

Tipologia: Publisher's version/PDF
Dimensione 229.09 kB
Formato Adobe PDF
229.09 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/504513
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 25
  • ???jsp.display-item.citation.isi??? ND
social impact