A Benchmark Suite for Distributed Publish/Subscribe Systems
Antonio Carzaniga, Alexander L. Wolf · 2002
Building a distributed publish/subscribe infrastructure amounts to defining a service model (or interface) and providing an implementation for it. A typical distributed implementation is architected as a network of dispatcher components, each one implementing appropriate protocols and algorithms, that collectively realize the chosen service model. The service model should provide a value-added service for a wide variety of applications, while the implementation should gracefully scale up to handle an intense traffic of publications and subscriptions. We believe that the design of such service models and implementations must be guided by a systematic evaluation method, which in turns must be based on a carefully chosen benchmark suite. In this paper, we lay out a set of requirements for a benchmark suite for distributed publish/subscribe services, and we outline its primary components. The ideas proposed in this paper are based on our own experience in building and studying publish/subscribe infrastructures, and on existing evaluation frameworks. 1 Evaluating a Distributed Publish/Subscribe Service Within a publish/subscribe service, information flows from publishers to subscribers according to the specific selection criteria expressed by individual subscribers. Subscribers express their interests by means of subscriptions, while publishers simply publish information. The service accepts subscriptions and publications,