Reducing communication costs

Typically, on distributed memory machines the communication latency and message startup costs have to be taken into account. The most common techniques used to reduce the impact of communication on performance are:

• software caching that involves storing non-local data in a local memory buffer instead of performing communication each time data are needed.
• communication coalescing that aggregates all the needed data and sends them together in one message.

Created by Katarzyna Zając