FatNemo -- FatTrees for bandwidth intensive applications
Motivation and Approach
For streaming oriented applications, where timely data delivery is a key requirement, trees are generally considered the preferred overlay structure. However, when employed for bandwidth-demanding applications, such as video conferencing and multi-party games, basic trees are likely to be bandwidth constrained. Because bandwidth availability monotonically decreases as one ascends from the leaves, under high load, paths near the root tend to become the bottleneck and dominate delivery latencies. Once these links become heavily loaded or overloaded, packets start to be buffered or dropped.
We import the concept of fat-trees from parallel architectures into the realm of overlay networks to address the bandwidth constraints of conventional trees. We have implemented two novel protocols, FatNemo and FatScribe, that adopt the fat-tree approach for performance-centric and DHT-based overlay multicast systems. Through simulation and wide-area experimentation with these two and some alternative protocols, we have show that the proposed fat-tree approach for overlay multicast (i) lowers the forwarding responsibility of nodes, thus increasing system scalability to match the demands of high-bandwidth multicast applications; (ii) reduces the height of the forwarding tree, hence significantly shortening delivery latencies; and (iii) improves the system's robustness to node transiency by increasing path diversity in the overlay.
- Stefan Birrer and Fabián E. Bustamante. The Feasibility of DHT-based Streaming Multicast. In Proc. of the 13th IEEE/ACM International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS 2005), September 2005.
- Stefan Birrer, Fabián E. Bustamante, Dong Lu, Peter Dinda and Yi Qiao. FatNemo: Multi-Source Multicast Overlay Fat-Tree. Poster in Proc. of the Second Symposium on Networked Systems Design & Implementation (NSDI), May 2005.
- Stefan Birrer, Dong Lu, Fabián E. Bustamante, Yi Qiao and Peter Dinda. FatNemo: Building a Resilient Multi-Source Multicast Fat-Tree, In Proc. of the Ninth International Workshop on Web Content Caching and Distribution, October 2004.
- The Nixes Tool Set - A set of bash scripts to install, maintain, control and monitor applications on PlanetLab.