Accelerating Foreign-Key Joins using Asymmetric Memory Channels

Publication Date: 
01/09/2011
Authors: 
Holger Pirk, Stefan Manegold and Martin Kersten

This paper was published in Proceedings of the Second International Workshop on Accelerating Data Management Systems Using Modern Processor and Storage Architectures (ADMS 2011) in conjunction with VLDB 2011, Seattle, WA on September 2, 2011.

Abstract: 

Indexed Foreign-Key Joins expose a very asymmetric ac- cess pattern: the Foreign-Key Index is sequentially scanned whilst the Primary-Key table is target of many quasi-random lookups which is the dominant cost factor. To reduce the costs of the random lookups the fact-table can be (re-) partitioned at runtime to increase access locality on the dimen- sion table, and thus limit the random memory access to inside the CPU's cache. However, this is very hard to opti- mize and the performance impact on recent architectures is limited because the partitioning costs consume most of the achievable join improvement.

GPGPUs on the other hand have an architecture that is well suited for this operation: a relatively slow connection to the large system memory and a very fast connection to the smaller internal device memory. We show how to accelerate Foreign-Key Joins by executing the random table lookups on the GPU's VRAM while sequentially streaming the Foreign- Key-Index through the PCI-E Bus. We also experimentally study the memory access costs on GPU and CPU to provide estimations of the benefit of this technique.

AttachmentSize
CWI_ADMS2011.pdf416.65 KB

Partners

People

Alexander Marchuk
A.P. Ershov Institute of Informatics Systems
Alice Carpentier
Semantic Technology Institute, University of Innsbruck
Alina Dia Miron
Recognos Romania
Andreas Harth
AIFB Institute, Karlsruhe Institute of Technology
Anna Fensel
Semantic Technology Institute, University of Innsbruck
Barry Norton
AIFB Institute, Karlsruhe Institute of Technology
Benedikt Kämpgen
AIFB Institute, Karlsruhe Institute of Technology
Carlos Juiz
Universitat de les Illes Balears
Carolina Fortuna
Jozef Stefan Institute
Chris Bizer
Freie Universität Berlin
Daniel Fuleki
StrateGO Hungary - Creative Media Innovation Cluster
Daniele DellAglio
CEFRIEL
David Norheim
Computas
Dieter Fensel
Semantic Technology Institute, University of Innsbruck
Dumitru Roman
Stiftelsen SINTEF
Elena Simperl
AIFB Institute, Karlsruhe Institute of Technology
Francois Scharffe
University of Montpellier
Frank van Harmelen
Vrije Universiteit Amsterdam
Freddy Priyatna
Universidad Politécnica de Madrid
Giorgos Flouris
Foundation for Research and Technology Hellas
Graham Hench
Semantic Technology Institute International
Grigoris Antoniou
Foundation for Research and Technology Hellas
Ioana Ciuciu
Semantics Technology and Applications Research Laboratory
Irini Fundulaki
Foundation for Research and Technology Hellas
John Domingue
The Open University
Karl Aberer
Ecole Polytechnique Fédérale de Lausanne
Leonel Ruiz Miyares
Centre for Applied Linguistics
Lyndon Nixon
Semantic Technology Institute International
Marko Grobelnik
Jozef Stefan Institute
Marta Corubolo
CEFRIEL
Martin Kersten
Centrum Wiskunde & Informatica
Neil Chue Hong, EPPC
University of Edinburgh
Oscar Corcho
Universidad Politécnica de Madrid
Pablo Mendes
Freie Universität Berlin
Paolo Bouquet
Università degli Studi di Trento
Peter Mika
Yahoo Research Barcelona
Rajendra Akerkar
Western Norway Research Institute
Roberto García
Universitat de Lleida
Simeona Pellkvist
Semantic Technology Institute International
Simone Contessa
CEFRIEL
Snorri Gudmundsson
IceStat
Stefano Fumeo
CEFRIEL
Steffen Stadtmuller
AIFB Institute, Karlsruhe Institute of Technology
Thomas Bauereiss
Semantic Technology Institute, University of Innsbruck
Ying Zhang
Centrum Wiskunde & Informatica
York Sure
Leibniz Institute for the Social Sciences
Zoltan Miklos
Ecole Polytechnique Fédérale de Lausanne