The Implementation of a Special ETL Program
Bai Hong-tao, Jigui Sun, Mo Xu, Yang Feng-jie · Jisuanji gongcheng · 2004
A ETL (Extract-Transform-Load) program for DW (Data Warehouse) of grain is designed and developed, which supports two kinds of data source, Relational Database data source and text data source. Five increment update methods are compared and analyzed including the timestamp, scanning the increment files, scanning daily logs, modifying the application code and distinguishing before image with after, and the increment of datum update is designed and realized according to the primary key comparison of records. This ETL supports the splitting and combination of tables, which remedies the deficiency of Data Warehouse modeling tools. This program has been applied with MIS(Management Information System)and DSS(Decision Support System)in trade of grain, already.