Popularity framework for monitoring user workload
Angelos Molfetas, M. Lassnig, V. Garonne, Graeme Andrew Stewart, M-S. Barisits, T. A. Beermann, Gancho Dimitrov · Journal of Physics Conference Series · 2012
This paper describes a monitoring framework for large scale data management systems with frequent data access. This framework allows large data management systems to generate meaningful information from collected tracing data and to be queried on demand for specific user usage patterns in respect to source and destination locations, period intervals, and other searchable parameters. The feasibility of such a system at the petabyte scale is demonstrated by describing the implementation and operational experience of a real world management information system for the ATLAS experiment employing the proposed framework. Our observations suggest that the proposed user monitoring framework is capable of scaling to meet the needs of very large data management systems.