Communication Lower Bounds for Distributed-Memory Computations

Michele Scquizzato, Francesco Silvestri

Research output: Conference Article in Proceeding or Book/Report chapterArticle in proceedingsResearchpeer-review

Abstract

In this paper we propose a new approach to the study of the communication requirements of distributed computations, which advocates for the removal of the restrictive assumptions under which earlier results were derived. We illustrate our approach by giving tight lower bounds on the communication complexity required to solve several computational problems in a distributed-memory parallel machine, namely standard matrix multiplication, stencil computations, comparison sorting, and the Fast Fourier Transform. Our bounds rely only on a mild assumption on work distribution, and significantly strengthen previous results which require either the computation to be balanced among the processors, or specific initial distributions of the input data, or an upper bound on the size of processors' local memories.
Original languageEnglish
Title of host publicationProceedings of the 31st International Symposium on Theoretical Aspects of Computer Science (STACS)
Volume25
PublisherSchloss Dagstuhl - Leibniz-Zentrum fuer Informatik GmbH
Publication date2014
Pages627-638
ISBN (Print)978-3-939897-65-1
DOIs
Publication statusPublished - 2014
Externally publishedYes
EventInternational Symposium on Theoretical Aspects of Computer Science - ENS Lyon, Lyon, France
Duration: 5 Mar 20148 Mar 2014
Conference number: 31st
http://stacs2014.sciencesconf.org/resource/page/id/5

Conference

ConferenceInternational Symposium on Theoretical Aspects of Computer Science
Number31st
LocationENS Lyon
Country/TerritoryFrance
CityLyon
Period05/03/201408/03/2014
Internet address
SeriesLeibniz International Proceedings in Informatics (LIPIcs)
ISSN1868-8969

Keywords

  • Communication
  • lower bounds
  • distributed memory
  • parallel algorithms
  • BSP

Fingerprint

Dive into the research topics of 'Communication Lower Bounds for Distributed-Memory Computations'. Together they form a unique fingerprint.

Cite this