An Overview of Apache Spark for Structured Big Data and Simulation of Enhancing Security Using Asymmetric Cryptosystems
Abu Zafar Md. Nuruzzaman Abir, Kazi Md. Rokibul Alam, Nahid Hasan Kakon, Yasuhiko Morimoto · 2018 International Conference on Computer, Communication, Chemical, Material and Electronic Engineering (IC4ME2) · 2018
Big data is an emerging and a hotly debated issue of research and business and inconceivably utilized as a part of organizations. The concept of security and privacy has always been concerned concurrently. Still, there is a logical inconsistency between big data usage and utilization in the variable information. There are various types of assaults and hazards to the security and safety of the cyber landscape. In this paper, initially big data aspects, associated technologies and tools like Apache spark are reviewed, after that scope and enormous benefits are explained. Description of features, installation and dealing procedures of Spark, deployment to cluster and the whole distributed processing engine architecture is elaborated. After that traditional and some variants of renowned asymmetric cryptography methodologies are tested and simulated to enhance security and privacy in the context of the structured dataset with Spark. Finally, comparisons among them are presented on the basis of the time required to posit how fast they are processing.