Data Integration with XML ETL Processing
G. Jayashree, C. Priya · 2020 International Conference on Computer Science, Engineering and Applications (ICCSEA) · 2020
Data forms the key success enabler for any business organization. Structured collection and organized data along with this analytical enablement will provide more insights to the organization's existing operations and ways for better improvement. In order to do efficient data collection, integration of data from various sources forms the vital role. Many of the vital business initiatives for an organization requires the data to integrate. Such initiatives performed by creating a customized solution across every data source. In such given architecture, the complexity to integrate data source is proportionate to the increase in data sources. Use of eXtensible Markup Language (XML) for standardizing the information exchange across several sources is an industry standard implementation. It is the technology used to implement and deliver an enterprise-level data integration solution using heterogeneous data sources. The transformation capability of XML is capable of handling very complex and big documents and can do processing of ~thousands of real-time transactions using message bus or Web Services methods. The XML provided solutions are flexible and easily adaptable, thus enabling them to incorporate into a broader range of organizational solutions. This paper discusses in detail, the data integration methods and their challenges and processing of XML data using Extraction, Transformation and Load method. The paper also provides the several ways to parse the XML data as part of the data processing with the case study for an On Line Transaction Process (OLTP) system of a manufacturing company.