Research and implementation of data process platform
Zou Zhi-qiang · Jisuanji gongcheng yu sheji · 2008
At present,data process work has been one of the mainly problems faced in application development.And now there exist a lot of common ETL tools,they can help to improve system development and execute efficiency,but lacks of exception restore ability.An architecture of data process platform,technologies like log management,exception handle,directory service are given and rule management are used,concept like Data Processing Set,Influence Domain,and models like single job state transfer model,multi-job DAG model,data processing set based log management model,influence domain based exception handling and restore model are used in this platform,the problem of exception restore is solved,and the flexibility and development efficiency from reality are improved.