SODIM: Service Oriented Data Integration based on MapReduce

Ghada ElSheikh, Mustafa Y. ElNainay, Saleh ElShehaby, Mohamed S. Abougabal · Alexandria Engineering Journal · 2013

Data integration has become a backbone for many essential and widely used services. These services depend on integrating data from multiple sources in a fast and efficient way to be able to provide the accepted level of service performance it is committed to. As the size of data available on different environments increases, and systems are heterogeneous and autonomous, data integration becomes a crucial part of most modern systems. Data integration systems can benefit from innovative dynamic infrastructure solutions such as Clouds, with its more agility, lower cost, device independency, location independency, and scalability. This study consolidates the data integration system, Service Orientation, and distributed processing to develop a new data integration system called Service Oriented Data Integration based on MapReduce (SODIM) that improves the system performance, especially with large number of data sources, and that can efficiently be hosted on modern dynamic infrastructures as Clouds.

Read the paper · More papers on PaperTik