Security for Big Data
Jawwad Ahmed Shamsi, Muhammad Ali Khojaye · 2021
Security is fundamental to big data systems. There are several requirements of ensuring security in big data systems. These include Availability, Integrity, Confidentiality, and Protection from Intrusion and Data Theft. A big data system can encounter various types of threats and attacks such as espionage, data theft, denial of service, and fabricated message. Attacks can be launched through various means such as flooding, malware, DNS attack, SQL Injection, Data Breach, Cross-site scripting, and Prefix hijacking attack. Virtual Private Network (VPN) servers and Firewalls can be used to provide end-to-end security. Access control mechanisms and single sign on (SSO) techniques are useful in providing the security measures and processes by regularizing access using authentication, authorization, encryption, and auditing. Antivirus solutions are used for protection against malware. Blockchain is used to enhance availability and provide immutability to big data systems. DDoS attacks can be detected through Machine Learning based log analysis. Software Defined Networks can be incorporated to avert DDoS attacks in real-time. This chapter explores these security requirements, identifies challenges, and elucidates security-based solutions for storage and processing of big data systems.