article · 2017 International Conference on Inventive Computing and Informatics (ICICI) · 2017

HDFS memory usage analysis

B. Purnachandra Rao, N. Naga Malleswara Rao

Cited by 1Abstract and details only

Abstract

Due to high use of online activities, there will be lot of data which is getting generated. To handle this data there should be an efficient system which can process the data effectively. One such system is Hadoop Distributed File System. HDFS consists of number of nodes, and one is the master among them while all others are slave nodes. Master node is called as NameNode and slave nodes are called as DataNodes. System will record the activities in the log file. Whatever the transactions are happening at the front end everything will get recorded at backend. We can capture this data and analyze to find out the system behavior in the failure situation. Since we are using the system for large transactions we need to have an idea on usage of the resources in the HDFS such as memory usage. Analyzers can get the stats of the operating system and the other devices separately i.e, for each service we need to have one analyzer to collect the stats. This paper presents the analyzer or shipper for collecting the metrics from operating system, memory and the other installed services.

Cite this paper

APA 7

Rao, B. P., & Rao, N. N. M. (2017). HDFS memory usage analysis. 2017 International Conference on Inventive Computing and Informatics (ICICI), 44, 1041–1046. https://doi.org/10.1109/icici.2017.8365298

MLA 9

Rao, B. Purnachandra, and N. Naga Malleswara Rao. “HDFS memory usage analysis.” 2017 International Conference on Inventive Computing and Informatics (ICICI), vol. 44, 2017, pp. 1041–46, https://doi.org/10.1109/icici.2017.8365298.

Chicago

Rao, B. Purnachandra, and N. Naga Malleswara Rao. 2017. “HDFS memory usage analysis.” 2017 International Conference on Inventive Computing and Informatics (ICICI) 44: 1041–46. https://doi.org/10.1109/icici.2017.8365298.

Harvard

Rao, B.P. and Rao, N.N.M. (2017) ‘HDFS memory usage analysis’, 2017 International Conference on Inventive Computing and Informatics (ICICI), 44, pp. 1041–1046. Available at: https://doi.org/10.1109/icici.2017.8365298.

BibTeX

@article{rao2017hdfs,
  title = {{HDFS memory usage analysis}},
  author = {Rao, B. Purnachandra and Rao, N. Naga Malleswara},
  journal = {2017 International Conference on Inventive Computing and Informatics (ICICI)},
  volume = {44},
  pages = {1041--1046},
  year = {2017},
  doi = {10.1109/icici.2017.8365298}
}

Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.