ETL (Extraction-Transform-Load) tools, traditionally developed to operate offline on historical data for feeding Data-warehouses, need to be enhanced to deal with big and fresh data and be executed at network level during data streams acquisition. In this paper, we present StreamLoader, a Web application for the specification of conceptual ETL dataflows on heterogeneous sensor data that leverages the peculiarities of network configuration, data stream management, and specification and deployment of ETL operations in a programmable network. It can be used for feeding traditional/ real-time data-warehouses or visual analytic tools.
StreamLoader: an event-driven ETL system for the on-line processing of heterogeneous sensor data / M. Mesiti, L. Ferrari, S. Valtolina, G. Licari, G.L. Galliani, M.S. Dao, K. Zettsu - In: Advances in database technology : EDBT 2016 : proceedings / [a cura di] E. Pitoura, S. Maabout, G. Koutrika, A. Marian, L. Tanca, I. Manolescu, K. Stefanidis. - Konstanz : OpenProceedings, 2016 Mar 15. - ISBN 9783893180707. - pp. 628-631 (( Intervento presentato al 19. convegno Extending Database Technology tenutosi a Bordeaux nel 2016 [10.5441/002/edbt.2016.65].
StreamLoader: an event-driven ETL system for the on-line processing of heterogeneous sensor data
M. Mesiti;L. Ferrari;S. Valtolina;
2016
Abstract
ETL (Extraction-Transform-Load) tools, traditionally developed to operate offline on historical data for feeding Data-warehouses, need to be enhanced to deal with big and fresh data and be executed at network level during data streams acquisition. In this paper, we present StreamLoader, a Web application for the specification of conceptual ETL dataflows on heterogeneous sensor data that leverages the peculiarities of network configuration, data stream management, and specification and deployment of ETL operations in a programmable network. It can be used for feeding traditional/ real-time data-warehouses or visual analytic tools.File | Dimensione | Formato | |
---|---|---|---|
paper-271.pdf
accesso aperto
Tipologia:
Publisher's version/PDF
Dimensione
856.16 kB
Formato
Adobe PDF
|
856.16 kB | Adobe PDF | Visualizza/Apri |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.