Portal de Periódicos da CAPES

An Adaptive, Scalable, and Portable Technique for Speeding Up MPI-Based Applications

2012; Springer Science+Business Media; Linguagem: Inglês

10.1007/978-3-642-32820-6_72

1611-3349

Rosa Filgueira, Malcolm Atkinson, Alberto Núñez, Javier Fernández,

Distributed and Parallel Computing Systems

This paper presents a portable optimization for MPI communications, called PRAcTICaL-MPI (Portable Adaptive Compression Library- MPI). PRAcTICaL-MPI reduces the data volume exchanged among processes by using lossless compression and offers two main advantages. Firstly, it is independent of the MPI implementation and the application used. Secondly, it allows for turning the compression on and off and selecting the most appropriate compression algorithm at run-time, depending on the characteristics of each message and on network performance.We have validated PRAcTICaL-MPI in different MPI implementations and HPC clusters. The evaluation shows that compressing MPI messages with the best algorithm and only when it is worthwhile, we obtain a great reduction in the overall execution time for many of the scenarios considered.