Topology-aware strategy for MPI-IO operations in clusters
type: Item
instance of: scholarly article
title: Topology-aware strategy for MPI-IO operations in clusters
zbMATH Open document ID: 1460.90214
DOI: 10.1155/2018/2068490
author: Weifeng Liu
author: Jie Zhou
author: Meng Guo
published in: Journal of Optimization
publication date: 2019-02-18T00:00:00Z
review text: Summary: This paper presents the topology-aware two-phase I/O (TATP), which optimizes the most popular collective MPI-IO implementation of ROMIO. In order to improve the hop-bytes metric during the file access, topology-aware two-phase I/O employs the Linear Assignment Problem (LAP) for finding an optimal assignment of file domain to aggregators, an aspect which is not considered in most two-phase I/O implementations. The distribution is based on the local data stored by each process, and its main purpose is to reduce the total hop-bytes of the I/O collective operation. Therefore, the global execution time can be improved. In most of the considered scenarios, topology-aware two-phase I/O obtains important improvements when compared with the original two-phase I/O implementations.
Mathematics Subject Classification ID: 90C90
zbMATH DE Number: 7024759
describes a project that uses: NAS Parallel Benchmarks
describes a project that uses: hwloc
MaRDI profile type: Publication
full work available at URL: https://doi.org/10.1155/2018/2068490
OpenAlex ID: W2901628484
cites work: Optimizing noncontiguous accesses in MPI--IO
cites work: A shortest augmenting path algorithm for dense and sparse linear assignment problems
description: scientific article; zbMATH DE number 7024759