NUPastry and NUScribe

Thu, 01 Sep 2005 00:00:00 +0000

Context

The work was motivated by delivering high-quality streaming media to an effectively unlimited number of peers over a purely cooperative model. Multicast suits that class of application because it decouples the size of the receiver set from the state kept at any single node, and avoids redundant transmission. Application-level approaches put all the multicast functionality in end systems configured into an overlay, keeping most of the benefit of network-layer multicast while avoiding IP multicast’s deployment and scalability problems.

Trees are the natural structure for timely delivery, and they scale well in link stress, overhead and latency. But pushed onto autonomous, unpredictable end systems they suffer three specific problems:

Transiency. End systems leave far more readily than routers, and trees depend on their interior nodes.
Bandwidth constraints near the root. Available bandwidth decreases as one ascends from the leaves, so high-level paths become the bottleneck under load.
Unfair load distribution. A small fraction of interior nodes do all the replication and forwarding while leaves contribute nothing — awkward in a system premised on every peer contributing in exchange for the service.

We proposed three generic techniques against these: co-leaders, alternative leaders that remove single-node dependencies and provide alternative forwarding paths; fat-trees, imported from parallel computing to relieve the bandwidth constraint near the root; and multiple performance-centric balanced trees, which allow fair resource contribution without sacrificing performance.

Those became three reference implementations: Nemo, a structurally resilient overlay; FatNemo, a fat-tree overlay for high-bandwidth multicast; and Magellan, a performance-centric multi-tree overlay maximizing fair load distribution against stated performance expectations.

What Was Released

NUPastry — reference implementation of a resilient distributed hash table
NUScribe — DHT-based multicast, with a work-in-progress NUSplitStream providing many of the proposed SplitStream features

They came with documentation for the supporting pieces: a DHT API, the Heimdall network library, a multicast API, and a common API layer.

Software was distributed to users who registered on the lab site, on the condition that any paper using it cite the corresponding publication and that a copy be sent to us on publication. It is no longer available. Wide-area experiments were run with the Nixes tool set.

Papers

Resilient Peer-to-Peer Multicast from the Ground Up — NCA 2004
FatNemo: Building a Resilient Multi-Source Multicast Fat-Tree — WCW 2004
Nemo: Resilient Peer-to-Peer Multicast without the Cost — MMCN 2005
FatNemo: Multisource Multicast Overlay Fat-Trees — NSDI 2005 (poster)
Magellan: Performance-based, Cooperative Multicast — WCW 2005
The Feasibility of DHT-based Streaming Multicast — MASCOTS 2005
Resilience in Overlay Multicast Protocols — MASCOTS 2006

People

Lead & PI

Fabián E. Bustamante (Northwestern University)

Students

Collaborators

Peter Dinda (Northwestern University)
Dong Lu (Northwestern University)

Resilient Overlays and Multicast — the project these implementations belong to

Distributed Hash Tables | Aqualab - Northwestern University

NUPastry and NUScribe

Context

What Was Released

Papers

People

Related Links