SCALABLE EVENT-DRIVEN ARCHITECTURES FOR REAL-TIME DATA PROCESSING: A FRAMEWORK FOR DISTRIBUTED SYSTEMS
Mohanraj Varatharaj · INTERNATIONAL JOURNAL OF COMPUTER ENGINEERING & TECHNOLOGY · 2024
A significant challenge in modern data-driven organizations is the development of scalable architectures capable of processing real-time data streams efficiently.This article presents a comprehensive framework for building and optimizing real-time data processing systems, focusing on integrating contemporary technologies such as Apache Kafka, Apache Flink, and Spark Streaming.The article systematically analyzes microservices architectures and event-driven design patterns, and it examines various approaches to data ingestion, state management, and dynamic load balancing in distributed environments.The methodology combines an extensive literature review Mohanraj Varatharaj