article · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · 2010
Efficient Distributed File System (EDFS)
Debessay Fesehaye Kassa, Rahul Malik, Klara Nahrstedt
Cited by 3Open access
Abstract
Large scale distributed systems such as cloud computing \napplications are becoming very common. These applications \ncome with increasing challenges on how to transfer \nand where to store and compute data. The most prevalent \ndistributed file systems to deal with these challenges is the \nHadoop File System (HDFS) which is a variant of the Google \nFile System (GFS). However HDFS has two potential problems. \nThe first one is that it depends on a single name node \nto manage almost all operations of every data block in the \nfile system. As a result it can be a bottleneck resource and \na single point of failure. The second potential problem with \nHDFS is that it depends on TCP to transfer data. As has \nbeen cited in many studies TCP takes many rounds before \nit can send at the full capacity of the links in the cloud. This \nresults in low link utilization and longer download times. \nTo overcome these problems of HDFS we present a new distributed \nfile system. Our scheme uses a light weight front \nend server to connect all requests with many name nodes. \nThis helps distribute load of a single name node to many \nname nodes. Our second contribution is to use an efficient \nprotocol to send and route data. Our protocol can achieve \nfull link utilization and hence decreased download times. \nBased on simulation our protocol can outperform HDFS and \nhence GFS.
Cite this paper
Kassa, D. F., Malik, R., & Nahrstedt, K. (2010). Efficient Distributed File System (EDFS). Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign).
Kassa, Debessay Fesehaye, et al. “Efficient Distributed File System (EDFS).” Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign), 2010.
Kassa, Debessay Fesehaye, Rahul Malik, and Klara Nahrstedt. 2010. “Efficient Distributed File System (EDFS).” Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign).
Kassa, D.F., Malik, R. and Nahrstedt, K. (2010) ‘Efficient Distributed File System (EDFS)’, Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign).
@article{kassa2010efficient,
title = {{Efficient Distributed File System (EDFS)}},
author = {Kassa, Debessay Fesehaye and Malik, Rahul and Nahrstedt, Klara},
journal = {Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)},
year = {2010}
}Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.