A Near Metal Platform for Intensive Big Data Processing Using A Novel Approach
Noussair Fikri, Mohamed Rida, Noreddine Abghour, Khalid Moussaid, Amina El Omri · 2020
In this paper we present a new Golang based framework for distributed intensive data processing and also micro batching. It uses a novel approach, the persistent distributed channels, based on the concept of Share memory by communicating, and inspired from Resilient distributed datasets of Apache Spark. The architecture of our proposed system is considered as near-metal platform for Big Data operations in order to enhance the speed of massive data processing.