ETL Processes Modeling and Realization towards Data Quality
Youping Huang · Acta Simulata Systematica Sinica · 2004
To help data warehouse getting high-quality data, data preprocess is needed. Extraction-Transformation-Loading(ETL)tools can finish this work. Complexity and usability are the primary problems concerning the ETL tools. To deal with these problems we provide a uniform architecture design for ETL processes which covers the aspects of metadata pertinent to ETL modeling, ETL transformation function design, modeling of ETL tasks, and the description language of ETL task model (XTDL). According to this idea of design, we developed an ETL tool named MSETL, aiming to provide the high-quality data for our multi-strategy data mining platform (MSMiner), which provides the friendly interface to manage the metadata of ETL processes, including login and deleting of ETL transformation functions, constructing and deleting the tasks, and browsing the result of execution of task.