streamLoader: An Event-Driven ETL System for the On-line Processing of Heterogeneous Sensor Data
Marco Mesiti, Luca Ferrari, Stefano Valtolina, Giacomo Licari, Gian Luca Galliani, Dao, Minh-San, Koji Zettsu · Archivio Istituzionale della Ricerca (Universita Degli Studi Di Milano) · 2016
ETL (Extraction-Transform-Load) tools, traditionally developed to operate offline on historical data for feeding Datawarehouses, need to be enhanced to deal with big and fresh data and be executed at network level during data streams acquisition.In this paper, we present StreamLoader, a Web application for the specification of conceptual ETL dataflows on heterogeneous sensor data that leverages the peculiarities of network configuration, data stream management, and specification and deployment of ETL operations in a programmable network.It can be used for feeding traditional/ real-time data-warehouses or visual analytic tools.