Design and Implementation of Lightweight Architecture of ETL System
Luming Yang · Computer Technology and Development · 2008
ETL system is a key component responsible for constructing data warehouse.It processes large volumes of data and builds data warehouse through data extraction,transformation and loading.How to efficiently shorten the execution time and enhance system stability is a big challenge.According the application of practical background of telecommunication resources analysis system,gives a lightweight architecture of ETL system.The framework adopted the piecemeal thinking,the original core of the extraction tasks assign to the various parts of the subsystem to do preliminary processing,with the advantages of this application is to reduce the core ETL engine burden,separate tasks from each other,and improve extraction efficiency.The specific operation proves it to be efficient.