Scaling issues in network monitoring
Theodore J. Johnson · 2008
Monitoring a Tier-1 ISP's extremely large and diverse network places extreme scaling demands on a Data Stream Management System (DSMS). A typical application involves a large number stream queries executing on high volume streams, replicated at a large number of monitoring points, with the results fed to a stream warehouse supporting a large number of users. I will describe some of these challenges and how a DSMS and other tools have evolved to meet them.