preprint · arXiv (Cornell University) · 2023
Compiler Optimization for Irregular Memory Access Patterns in PGAS Programs
Thomas B. Rolinger, Christopher D. Krieger, Alan Sussman
Cited by 0Open access
Abstract
Irregular memory access patterns pose performance and user productivity challenges on distributed-memory systems. They can lead to fine-grained remote communication and the data access patterns are often not known until runtime. The Partitioned Global Address Space (PGAS) programming model addresses these challenges by providing users with a view of a distributed-memory system that resembles a single shared address space. However, this view often leads programmers to write code that causes fine-grained remote communication, which can result in poor performance. Prior work has shown that the performance of irregular applications written in Chapel, a high-level PGAS language, can be improved by manually applying optimizations. However, applying such optimizations by hand reduces the productivity advantages provided by Chapel and the PGAS model. We present an inspector-executor based compiler optimization for Chapel programs that automatically performs remote data replication. While there have been similar compiler optimizations implemented for other PGAS languages, high-level features in Chapel such as implicit processor affinity lead to new challenges for compiler optimization. We evaluate the performance of our optimization across two irregular applications. Our results show that the total runtime can be improved by as much as 52x on a Cray XC system with a low-latency interconnect and 364x on a standard Linux cluster with an Infiniband interconnect, demonstrating that significant performance gains can be achieved without sacrificing user productivity.
Cite this paper
Rolinger, T. B., Krieger, C. D., & Sussman, A. (2023). Compiler Optimization for Irregular Memory Access Patterns in PGAS Programs. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2303.13954
Rolinger, Thomas B., et al. “Compiler Optimization for Irregular Memory Access Patterns in PGAS Programs.” arXiv (Cornell University), 2023, https://doi.org/10.48550/arxiv.2303.13954.
Rolinger, Thomas B., Christopher D. Krieger, and Alan Sussman. 2023. “Compiler Optimization for Irregular Memory Access Patterns in PGAS Programs.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2303.13954.
Rolinger, T.B., Krieger, C.D. and Sussman, A. (2023) ‘Compiler Optimization for Irregular Memory Access Patterns in PGAS Programs’, arXiv (Cornell University). Available at: https://doi.org/10.48550/arxiv.2303.13954.
@misc{rolinger2023compiler,
title = {{Compiler Optimization for Irregular Memory Access Patterns in PGAS Programs}},
author = {Rolinger, Thomas B. and Krieger, Christopher D. and Sussman, Alan},
journal = {arXiv (Cornell University)},
year = {2023},
doi = {10.48550/arxiv.2303.13954}
}Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.
Related papers
Transparent system-level migration of PGAS applications using Xen on InfiniBand
Daniele Paolo Scarpazza, P. Mullaney, Oreste Villa et al. · IEEE International Conference on Cluster Computing (CLUSTER) · 2007
Cited by 16
Toward a Comprehensive Benchmark Suite for Evaluating GASPI in HPC Environments
Sarah Neuwirth · IEEE International Conference on Cluster Computing (CLUSTER) · 2021
Cited by 1
XcalableACC: Extension of XcalableMP PGAS Language Using OpenACC for Accelerator Clusters
Masahiro Nakao, Hitoshi Murai, Takenori Shimosaka et al. · Workshop on Accelerator Programming Using Directives (WACCPD) · 2014
Cited by 39
Dynamic Time-Variant Connection Management for PGAS Models on InfiniBand
Abhinav Vishnu, Manoj Krishnan, Pavan Balaji · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · 2011
Cited by 2
Efficient On-Demand Connection Management Mechanisms with PGAS Models over InfiniBand
Abhinav Vishnu, Manoj Krishnan · IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) · 2010
Cited by 10
Impact of the Columbia Supercomputer on NASA Science and Engineering Applications
Walter F. Brooks, Michael J. Aftosmis, Bryan A. Biegel et al. · Lecture notes in computer science · 2005
Cited by 4
A Programming Model Performance Study Using the NAS Parallel Benchmarks
Hongzhang Shan, Filip Blagojević, Seung-Jai Min et al. · Scientific Programming · 2010
Cited by 27Open access
Scalable MiniMD Design with Hybrid MPI and OpenSHMEM
Mingzhe Li, Jian Lin, Xiaoyi Lu et al. · International Conference on Partitioned Global Address Space Programming Models (PGAS) · 2014
Cited by 13