DataTurbo:pluggable tool for data exchange and integration
Deyu Qi · Jisuanji yingyong yanjiu · 2009
This paper introduced a novel pluggable tool,DataTurbo,developed by the authors for data exchange and integration which was based on a unified data model and extended data flow model.It utilized an example-driven user interface to help build configurable and flexible data flow models quickly out of composeable functional plug-ins,to implement automatic,robust and efficient materialized data integration.The unified data model alleviated the problem of complex data flow definitions caused by differences in data formats and semantics,and also improved the extensibility of the plug-ins and tools.The extended data flow model supported flow transactions and asynchronous event handling based on shared states.The former extension added understandable control information to a flow through model transformation and the latter enabled quick responses to exceptional events.DataTurbo had been deployed and serving in Panyu and Nansha data centers in Guangzhou successfully.