Skip to main content
Publication

Implementing Directive-Based Deferred Execution for Effective Network Aggregation

by Donald A Welch, Oscar R Hernandez Mendoza, Stephen Poole, Wendy Poole
Publication Type
Conference Paper
Book Title
2025 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)
Publication Date
Page Numbers
178 to 186
Publisher Location
New Jersey, United States of America
Conference Name
High-Level Parallel Programming Models and Supportive Environments (HIPS 2025)
Conference Location
Milan, Italy
Conference Sponsor
IEEE
Conference Date
-

Remote direct memory access technology provides an efficient mechanism for one-sided communication that can be leveraged to implement a distributed shared memory programming model. However, when applications generate large numbers of small, irregular messages, network congestion often arises. Existing solutions address this small message problem by facilitating message aggregation but typically require disruptive code transformations that detract from the algorithmic intent of applications, or can be limited by dependent operations on aggregated data between synchronisation points. A solution is to use a directive-assisted approach that enables compilers to transform code dependent on aggregated communication for deferred execution. This paper presents an algorithm that a compiler can use to implement and optimise deferred execution for code dependent on aggregated data, based on an "aggregation context" extension for the OpenSHMEM partitioned global address space library. This new capability addresses a key challenge of message aggregation, allowing its full potential to reduce network congestion and enhance programmability to be realised.