article · 2020

A High-Performance Distributed File System for Mass Data

Shuaiyu Jin, Qing Yan, Yue Zhang, Jie Yang

Cited by 1Abstract and details only

Abstract

With the rapid development of the mobile Internet and cloud computing, storage sub system's pressure increasing fast as the critical process needs more powerful engines. The paper realizes a high-performance distributed file system based on raft protocol. Our file system guarantees the reliability of data through replication. Write-Ahead Logging (WAL) and raft consensus algorithm provide atomicity, durability and file distribution. In order to solve the problem of data fragmentation in distributed systems, we design an automatic fragmentation and load balancing mechanism based on consistent hashing. Each file goes through the raft state machine so that a few machines crash without I/O error. We also implement the FUSE interface for the users to mount and work on files. Performance measurements under some typical workloads show that our file system has excellent I/O performance.

Cite this paper

APA 7

Jin, S., Yan, Q., Zhang, Y., & Yang, J. (2020). A High-Performance Distributed File System for Mass Data. https://doi.org/10.1109/iccc51575.2020.9344887

MLA 9

Jin, Shuaiyu, et al. “A High-Performance Distributed File System for Mass Data.” 2020, pp. 1804–09, https://doi.org/10.1109/iccc51575.2020.9344887.

Chicago

Jin, Shuaiyu, Qing Yan, Yue Zhang, and Jie Yang. 2020. “A High-Performance Distributed File System for Mass Data.” https://doi.org/10.1109/iccc51575.2020.9344887.

Harvard

Jin, S. et al. (2020) ‘A High-Performance Distributed File System for Mass Data’. Available at: https://doi.org/10.1109/iccc51575.2020.9344887.

BibTeX

@article{jin2020high,
  title = {{A High-Performance Distributed File System for Mass Data}},
  author = {Jin, Shuaiyu and Yan, Qing and Zhang, Yue and Yang, Jie},
  pages = {1804--1809},
  year = {2020},
  doi = {10.1109/iccc51575.2020.9344887}
}

Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.