Skip to content
Free planNo credit card requiredStart writing

preprint · arXiv (Cornell University) · 2023

Compiler Optimization for Irregular Memory Access Patterns in PGAS Programs

Thomas B. Rolinger, Christopher D. Krieger, Alan Sussman

Cited by 0Open access

Abstract

Irregular memory access patterns pose performance and user productivity challenges on distributed-memory systems. They can lead to fine-grained remote communication and the data access patterns are often not known until runtime. The Partitioned Global Address Space (PGAS) programming model addresses these challenges by providing users with a view of a distributed-memory system that resembles a single shared address space. However, this view often leads programmers to write code that causes fine-grained remote communication, which can result in poor performance. Prior work has shown that the performance of irregular applications written in Chapel, a high-level PGAS language, can be improved by manually applying optimizations. However, applying such optimizations by hand reduces the productivity advantages provided by Chapel and the PGAS model. We present an inspector-executor based compiler optimization for Chapel programs that automatically performs remote data replication. While there have been similar compiler optimizations implemented for other PGAS languages, high-level features in Chapel such as implicit processor affinity lead to new challenges for compiler optimization. We evaluate the performance of our optimization across two irregular applications. Our results show that the total runtime can be improved by as much as 52x on a Cray XC system with a low-latency interconnect and 364x on a standard Linux cluster with an Infiniband interconnect, demonstrating that significant performance gains can be achieved without sacrificing user productivity.

Cite this paper

APA 7

Rolinger, T. B., Krieger, C. D., & Sussman, A. (2023). Compiler Optimization for Irregular Memory Access Patterns in PGAS Programs. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2303.13954

MLA 9

Rolinger, Thomas B., et al. “Compiler Optimization for Irregular Memory Access Patterns in PGAS Programs.” arXiv (Cornell University), 2023, https://doi.org/10.48550/arxiv.2303.13954.

Chicago

Rolinger, Thomas B., Christopher D. Krieger, and Alan Sussman. 2023. “Compiler Optimization for Irregular Memory Access Patterns in PGAS Programs.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2303.13954.

Harvard

Rolinger, T.B., Krieger, C.D. and Sussman, A. (2023) ‘Compiler Optimization for Irregular Memory Access Patterns in PGAS Programs’, arXiv (Cornell University). Available at: https://doi.org/10.48550/arxiv.2303.13954.

BibTeX
@misc{rolinger2023compiler,
  title = {{Compiler Optimization for Irregular Memory Access Patterns in PGAS Programs}},
  author = {Rolinger, Thomas B. and Krieger, Christopher D. and Sussman, Alan},
  journal = {arXiv (Cornell University)},
  year = {2023},
  doi = {10.48550/arxiv.2303.13954}
}

Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.