Skip to content
Free planNo credit card requiredStart writing
AI for Research home
AI for Research home
Dashboard
Sign inGet started

preprint · ArXiv.org · 2003

Fast Parallel I/O on Cluster Computers

Thomas Duessel, N. Eicker, Florin Isailă, Thomas Lippert, Thomas Moschny, Hartmut Neff, Klaus Schilling, Walter F. Tichy

Cited by 0Open access

Abstract

Today's cluster computers suffer from slow I/O, which slows down I/O-intensive applications. We show that fast disk I/O can be achieved by operating a parallel file system over fast networks such as Myrinet or Gigabit Ethernet. In this paper, we demonstrate how the ParaStation3 communication system helps speed-up the performance of parallel I/O on clusters using the open source parallel virtual file system (PVFS) as testbed and production system. We will describe the set-up of PVFS on the Alpha-Linux-Cluster-Engine (ALiCE) located at Wuppertal University, Germany. Benchmarks on ALiCE achieve write-performances of up to 1 GB/s from a 32-processor compute-partition to a 32-processor PVFS I/O-partition, outperforming known benchmark results for PVFS on the same network by more than a factor of 2. Read-performance from buffer-cache reaches up to 2.2 GB/s. Our benchmarks are giant, I/O-intensive eigenmode problems from lattice quantum chromodynamics, demonstrating stability and performance of PVFS over Parastation in large-scale production runs.

Cite this paper

APA 7

Duessel, T., Eicker, N., Isailă, F., Lippert, T., Moschny, T., Neff, H., Schilling, K., & Tichy, W. F. (2003). Fast Parallel I/O on Cluster Computers. ArXiv.org. https://doi.org/10.48550/arxiv.cs/0303016

MLA 9

Duessel, Thomas, et al. “Fast Parallel I/O on Cluster Computers.” ArXiv.org, 2003, https://doi.org/10.48550/arxiv.cs/0303016.

Chicago

Duessel, Thomas, N. Eicker, Florin Isailă, Thomas Lippert, Thomas Moschny, Hartmut Neff, Klaus Schilling, and Walter F. Tichy. 2003. “Fast Parallel I/O on Cluster Computers.” ArXiv.org. https://doi.org/10.48550/arxiv.cs/0303016.

Harvard

Duessel, T. et al. (2003) ‘Fast Parallel I/O on Cluster Computers’, ArXiv.org. Available at: https://doi.org/10.48550/arxiv.cs/0303016.

BibTeX
@misc{duessel2003fast,
  title = {{Fast Parallel I/O on Cluster Computers}},
  author = {Duessel, Thomas and Eicker, N. and Isailă, Florin and Lippert, Thomas and Moschny, Thomas and Neff, Hartmut and Schilling, Klaus and Tichy, Walter F.},
  journal = {ArXiv.org},
  year = {2003},
  doi = {10.48550/arxiv.cs/0303016}
}

Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.

Related papers