Real-Time Network Monitoring: A Big Data Approach
Kunisetty Jaswanth, S Sruthi, Pranav Ramachandrula, S. Saravanan · 2023
Real-time network monitoring is a critical requirement for tracking user activities and ensuring optimal network performance. In this paper, we propose a big data approach to real-time network monitoring that leverages the capabilities of Apache Spark, MongoDB, and Apache Kafka with Python. Our approach utilizes distributed stream processing of network data, enabling real-time analytics for user activity monitoring and network performance optimization. Our approach demonstrates the effectiveness of our system through experiments with real network traffic data, showing how it can identify and track user activities in real-time. Our system can be used by network administrators and IT professionals to optimize network performance, improve user experience, and enhance security through real-time monitoring and analysis of user activity data. This approach can also be opted as a feature in SDNs.