Magnet: Practical Subscription Clustering for Internet-Scale Publish/Subscribe

Sarunas Girdzijauskas, Gregory Chockler, Ymir Vigfusson, Roie Melamed, Yoav Tock

Research output: Chapter in Book/Report/Conference proceedingConference contribution

56 Downloads (Pure)


An effective means for building Internet-scale distributed applications, and in particular those involving group-based information sharing, is to deploy peer-to-peer overlay networks. The key pre-requisite for supporting these types of applications on top of the overlays is efficient distribution of messages to multiple subscribers dispersed across numerous multicast groups. In this paper, we introduce Magnet: a peer-to-peer publish/subscribe system which achieves efficient message distribution by dynamically organizing peers with similar subscriptions into dissemination structures which preserve locality in the subscription space. Magnet is able to significantly reduce the message propagation costs by taking advantage of subscription correlations present in many large-scale group-based applications. We evaluate Magnet by comparing its performance against a strawman pub/sub system which does not cluster similar subscriptions by simulation. We find that Magnet outperforms the strawman by a substantial margin on clustered subscription workloads produced using both generative models and real application traces.
Original languageEnglish
Title of host publicationProceedings of the Fourth ACM International Conference on Distributed Event-Based Systems (DEBS '10)
Place of PublicationCambridge, UK
Number of pages12
ISBN (Print)978-1-60558-927-5
Publication statusPublished - Jul 2010
EventFourth ACM International Conference on Distributed Event-Based Systems - Cambridge, United Kingdom
Duration: 12 Jul 201015 Jul 2010


ConferenceFourth ACM International Conference on Distributed Event-Based Systems
Country/TerritoryUnited Kingdom


  • Data communications
  • Distributed Systems
  • Clustering

Cite this