GATES: a grid-based middleware for processing distributed data streams
Liang Chen, K. S. N. Reddy, Gagan Agrawal · 2004
Increasingly, a number of applications rely on, or can potentially benefit from, analysis and monitoring of data streams. Moreover, many of these applica-tions involve high volume data streams and require dis-tributed processing of data arising from a distributed set of sources. Thus, we believe that a grid environ-ment is well suited for flexible and adaptive analysis of these streams. This paper reports the design and initial evaluation of a middleware for processing distributed data streams. Our system is referred to as GATES (Grid-based Adap-Tive Execution on Streams). This system is designed to use the existing grid standards and tools to the ex-tent possible. It flexibly achieves the best accuracy that is possible while maintaining the real-time constraint on the analysis. We have developed a self-adaptation algorithm for this purpose. Results from a detailed evaluation of this system demonstrate the benefits of distributed processing, and the effectiveness of our self-adaptation algorithm. 1