A Bird's-Eye View of Complex Streaming Data Analytics
Minos Garofalakis · 2025
Massive continuous data streams arise naturally in several dynamic big data analytics applications, such as enabling observability for complex distributed systems, network-operations monitoring in large ISPs, or incremental federated learning over dynamic distributed data.In such settings, usage information from numerous devices needs to be continuously collected and analyzed for interesting trends and real-time reaction to different conditions (e.g., anomalies/hotspots, DDoS attacks, or concept drifts).Streaming data raises important memory-, time-, and communication-efficiency issues, making it critical to carefully optimize the use of available computation and communication resources.We give a (biased) overview of some key algorithmic tools in the space of streaming data analytics, along with relevant applications and challenges.