Trade-offs between communication throughput and parallel time

Yishay Mansour, Noam Nisan, Uzi Vishkin

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

18 Scopus citations

Abstract

We study the effect of limited communication throughput on parallel computation in a setting where the number of processors is much smaller than the length of the input. Our model haa p processors that communicate through a shared memory of size m. The input haa size n, and can be read directly by all the processors. We will be primarily interested in studying cases where n >> p >> m. As a test case we study the list reversal problem. For this problem we prove a time lower bound of Ω(√n/mp). (A similar lower bound holds also for the problems of sorting, finding all unique elements, convolution, and universal hashing.) This result shows that limiting the communication (i.e., small m) has significant effect on parallel computation. We show an almost matching upper bound of O(n /√logmplog(l)n). The upper bound requires the development of a few interesting techniques which can alleviate the limited communication in some general settings. Specifically, we show how to emulate a large shared memory on a limited shared memory efficiently. We also argue that some standard methodology for designing parallel algorithms appears to require a relatively high level of communication throughput. Our results suggest that new alternative methodologies that need a lower such level must be invented for parallel machines that enable a low level of communication throughput, since otherwise those machines will be severly handicapped as general purpose parallel machines. We cannot offer any encouraging evidence to suggest that such new methodologies are likely to be found.

Original languageAmerican English
Title of host publicationProceedings of the 26th Annual ACM Symposium on Theory of Computing, STOC 1994
PublisherAssociation for Computing Machinery
Pages372-381
Number of pages10
ISBN (Electronic)0897916638
DOIs
StatePublished - 23 May 1994
Event26th Annual ACM Symposium on Theory of Computing, STOC 1994 - Montreal, Canada
Duration: 23 May 199425 May 1994

Publication series

NameProceedings of the Annual ACM Symposium on Theory of Computing
VolumePart F129502
ISSN (Print)0737-8017

Conference

Conference26th Annual ACM Symposium on Theory of Computing, STOC 1994
Country/TerritoryCanada
CityMontreal
Period23/05/9425/05/94

Bibliographical note

Publisher Copyright:
© 1994 ACM.

Fingerprint

Dive into the research topics of 'Trade-offs between communication throughput and parallel time'. Together they form a unique fingerprint.

Cite this