article · 2021
MulConn: User-Transparent I/O Subsystem for High-Performance Parallel File Systems
Hwa Jung Kim, Jiwoo Bang, Dong Kyu Sung, Hyeonsang Eom, Heon Y. Yeom, Hanul Sung
Cited by 0Abstract and details only
Abstract
Parallel file systems (PFS) are used to distribute data processing and establish shared access to large-scale data. Despite being able to provide high I/O bandwidth on each node, PFS has difficulty utilizing the I/O bandwidth due to a single connection between the client and server nodes. To mitigate the performance bottleneck, users increase the number of connections between the nodes by modifying PFS or applications. However, it is difficult to modify PFS itself due to its complicated internal structure. Thus, PFS users manually increase the number of connections between the nodes by employing several methods. In this paper, we propose a user-transparent I/O subsystem, MulConn, to make users exploit high I/O bandwidth between nodes. To avoid the modifications of PFS and user applications, we have developed a horizontal mount procedure and two I/O scheduling policies, TtoS and TtoM, in the virtual file system (VFS) layer. We expose a single mount point that has multiple connections by modifying the mount path of VFS from vertical hierarchy to horizontal hierarchy. We also introduce two I/O scheduling policies to distribute I/O requests evenly to multiple connections. The experimental results show that MulConn improves write and read performance by up to 2.6x and 2.8x, respectively, compared with those of PFS using the existing kernel. In addition, we provide the best I/O performance that PFS can provide in the given experimental environments.
Cite this paper
Kim, H. J., Bang, J., Sung, D. K., Eom, H., Yeom, H. Y., & Sung, H. (2021). MulConn: User-Transparent I/O Subsystem for High-Performance Parallel File Systems. https://doi.org/10.1109/hipc53243.2021.00019
Kim, Hwa Jung, et al. “MulConn: User-Transparent I/O Subsystem for High-Performance Parallel File Systems.” vol. 235, 2021, pp. 53–62, https://doi.org/10.1109/hipc53243.2021.00019.
Kim, Hwa Jung, Jiwoo Bang, Dong Kyu Sung, Hyeonsang Eom, Heon Y. Yeom, and Hanul Sung. 2021. “MulConn: User-Transparent I/O Subsystem for High-Performance Parallel File Systems.” https://doi.org/10.1109/hipc53243.2021.00019.
Kim, H.J. et al. (2021) ‘MulConn: User-Transparent I/O Subsystem for High-Performance Parallel File Systems’. Available at: https://doi.org/10.1109/hipc53243.2021.00019.
@article{kim2021mulconn,
title = {{MulConn: User-Transparent I/O Subsystem for High-Performance Parallel File Systems}},
author = {Kim, Hwa Jung and Bang, Jiwoo and Sung, Dong Kyu and Eom, Hyeonsang and Yeom, Heon Y. and Sung, Hanul},
volume = {235},
pages = {53--62},
year = {2021},
doi = {10.1109/hipc53243.2021.00019}
}Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.