Publication details

Polynomial-time Construction of Optimal MPI Derived Datatype Trees

Authors

GANIAN Robert KALANY Martin SZEIDER Stefan TRAFF Jesper Larsson

Type Article in Proceedings
Conference 2016 IEEE 30TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS 2016)
MU Faculty or unit

Faculty of Informatics

Citation
Doi http://dx.doi.org/10.1109/IPDPS.2016.13
Field Informatics
Keywords MPI; derived datatypes; type reconstruction; dynamic programming
Description The derived datatype mechanism is a powerful, integral feature of the Message-Passing Interface (MPI) for communicating arbitrarily structured, possibly non-consecutive and non-homogeneous application data. MPI defines a set of derived datatype constructors of increasing generality, which allows to describe arbitrary data layouts in a reasonably compact fashion. The constructors may be applied recursively, leading to tree-like representations of the application data layouts. Efficient derived datatype representations are required for MPI implementations to efficiently access and process structured application data. We study the problem of finding tree-like representations of MPI derived datatypes that are optimal in terms of space and processing cost. More precisely, we consider the so-called MPI TYPE TREE RECONSTRUCTION PROBLEM of determining a least-cost treelike representation of a given data layout for a given set of constructors. In an additive cost model that accounts for the space consumption of the constructors and lower-bounds the processing costs, we show that the problem can be solved in polynomial time for the full set of MPI datatype constructors. Our algorithm uses dynamic programming and requires the solution of a series of shortest path problems on an incrementally built, directed, acyclic graph.

You are running an old browser version. We recommend updating your browser to its latest version.

More info