A Triggering and Scheduling Approach for ETL in a Real-time Data Warehouse
Jie Song, Yubin Bao, Jingang Shi · 2010
In a real-time data warehouses, ETL is no longer executed periodically during the idle time of data warehouses, but continuously ongoing. Thus the triggering of ETL task, and In a real-time data warehouses, ETL is no longer executed periodically during the idle time of data warehouses, but continuously ongoing. Thus the triggering of ETL task, and the scheduling of updates and queries become the key issues. This paper proposes an IBSA (Integration Based Scheduling Approach), including the triggering rule and algorithm for staring an ETL task, and a scheduling algorithm for balancing the queries and updates by threads controlling. We also proposed the framework of implementations. A series of experiments show that IBSA can adjust the running order of tasks reasonably and use the system resources effectively to provide the faster query response and higher real-time capability of ETL.