Efficient data streams processing in the real time data warehouse
Fiaz Majeed, Muhammad Sohaib Mahm Muhammad Sohaib Mahmood, Mujahid Iqbal Mujahid Iqbal · 2010
Today many business applications are generating fast, multiple, continuous and time varying data streams [2] which are not manageable from available ETL (Extraction, Transformation and Loading) technology. This work gives architecture to extend the real time data warehouse for efficient handling of data streams while keeping traditional functionalities. The paper focuses on the data stream processing part of the architecture. The data stream processor constructed with the combination of mature techniques performs data stream processing reliably. It ensures synchronization of the data streams processing with the pace of the incoming data streams from source applications.