Spinning Relations: High-Speed Networks for Distributed Join Processing
Publication Details
Title
Spinning Relations: High-Speed Networks for Distributed Join Processing
Authors
Philip W. Frey, Romulo Gonçalves, Martin Kersten, and Jens Teubner
Published
Proceedings 5th Int'l Workshop on Data Management on New Hardware (DaMoN), Providence, RI, USA, June 2009.
Download
paper (PDF), presentation slides (PDF)
Abstract
By leveraging modern networking hardware (RDMA-enabled network cards), we can shift priorities in distributed database processing significantly. Complex and sophisticated mechanisms to avoid network traffic can be replaced by a scheme that takes advantage of the bandwidth and low latency offered by such interconnects.
We illustrate this phenomenon with cyclo-join, an efficient join algorithm based on continuously pumping data through a ring-structured network. Our approach is capable of exploiting the resources of all CPUs and distributed main-memory available in the network for processing queries of arbitrary shape and datasets of arbitrary size.
Publication Log
May 2009
camera-ready for DaMoN 2009
April 2009
submission to DaMoN 2009 (accepted)
- submission (PDF)
- reviews (results: weak accept, accept, weak accept)