article · 2004
Design and Implementation of MPICH2 over InfiniBand with RDMA Support
Jiuxing Liu, Weihang Jiang, Pete Wyckoff, Dhabaleswar K. Panda, David Ashton, Darius Buntinas, William Gropp, Brian Toonen
Cited by 87Abstract and details only
Abstract
Summary form only given. For several years, MPI has been the de facto standard for writing parallel applications. One of the most popular MPI implementations is MPICH. Its successor, MPICH2, features a completely new design that provides more performance and flexibility. To ensure portability, it has a hierarchical structure based on which porting can be done at different levels. In this paper, we present our experiences in designing and implementing MPICH2 over InfiniBand. Because of its high performance and open standard, InfiniBand is gaining popularity in the area of high-performance computing. Our study focuses on optimizing the performance of MPl-1 functions in MPICH2. One of our objectives is to exploit remote direct memory access (RDMA) in InfiniBand to achieve high performance. We have based our design on the RDMA channel interface provided by MP1CH2, which encapsulates architecture-dependent communication functionalities into a very small set of functions. Starting with a basic design, we apply different optimizations and also propose a zero-copy-based design. We characterize the impact of our optimizations and designs using microbenchmarks. We have also performed an application-level evaluation using the NAS parallel benchmarks. Our optimized MPICH2 implementation achieves 7.6/spl mu/s latency and 857 MB/s bandwidth, which are close to the raw performance of the underlying InfiniBand layer. Our study shows that the RDMA channel interface in MPICH2 provides a simple, yet powerful, abstraction that enables implementations with high performance by exploiting RDMA operations in InfiniBand. To the best of our knowledge, this is the first high-performance design and implementation ofMPICH2 on InfiniBand using RDMA support.
Cite this paper
Liu, J., Jiang, W., Wyckoff, P., Panda, D. K., Ashton, D., Buntinas, D., Gropp, W., & Toonen, B. (2004). Design and Implementation of MPICH2 over InfiniBand with RDMA Support. https://doi.org/10.1109/ipdps.2004.1302922
Liu, Jiuxing, et al. “Design and Implementation of MPICH2 over InfiniBand with RDMA Support.” 2004, pp. 16–25, https://doi.org/10.1109/ipdps.2004.1302922.
Liu, Jiuxing, Weihang Jiang, Pete Wyckoff, Dhabaleswar K. Panda, David Ashton, Darius Buntinas, William Gropp, and Brian Toonen. 2004. “Design and Implementation of MPICH2 over InfiniBand with RDMA Support.” https://doi.org/10.1109/ipdps.2004.1302922.
Liu, J. et al. (2004) ‘Design and Implementation of MPICH2 over InfiniBand with RDMA Support’. Available at: https://doi.org/10.1109/ipdps.2004.1302922.
@article{liu2004design,
title = {{Design and Implementation of MPICH2 over InfiniBand with RDMA Support}},
author = {Liu, Jiuxing and Jiang, Weihang and Wyckoff, Pete and Panda, Dhabaleswar K. and Ashton, David and Buntinas, Darius and Gropp, William and Toonen, Brian},
pages = {16--25},
year = {2004},
doi = {10.1109/ipdps.2004.1302922}
}Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.