Scalable producer-consumer pools based on elimination-diffraction trees

Yehuda Afek*, Guy Korland, Maria Natanzon, Nir Shavit

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


Producer-consumer pools, that is, collections of unordered objects or tasks, are a fundamental element of modern multiprocessor software and a target of extensive research and development. For example, there are three common ways to implement such pools in the Java JDK6.0: the SynchronousQueue, the LinkedBlockingQueue, and the ConcurrentLinkedQueue. Unfortunately, most pool implementations, including the ones in the JDK, are based on centralized structures like a queue or a stack, and thus are limited in their scalability. This paper presents the ED-Tree, a distributed pool structure based on a combination of the elimination-tree and diffracting-tree paradigms, allowing high degrees of parallelism with reduced contention. We use the ED-Tree to provide new pool implementations that compete with those of the JDK. In experiments on a 128 way Sun Maramba multicore machine, we show that ED-Tree based pools scale well, outperforming the corresponding algorithms in the JDK6.0 by a factor of 10 or more at high concurrency levels, while providing similar performance at low levels.

Original languageEnglish
Title of host publicationEuro-Par 2010 Parallel Processing - 16th International Euro-Par Conference, Proceedings
Number of pages12
EditionPART 2
StatePublished - 2010
Event16th International Euro-Par Conference on Parallel Processing, Euro-Par 2010 - Ischia, Italy
Duration: 31 Aug 20103 Sep 2010

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 2
Volume6272 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference16th International Euro-Par Conference on Parallel Processing, Euro-Par 2010


Dive into the research topics of 'Scalable producer-consumer pools based on elimination-diffraction trees'. Together they form a unique fingerprint.

Cite this