article · Proceedings of the Conference on Research Data Infrastructure · 2023
Aruna Object Storage
Marius Alfred Dieckmann, Sebastian Beyvers, Jannis Hochmuth, Anna Rehm, Frank Förster, Alexander Goesmann
Cited by 1Open access
Abstract
The exponential growth of scientific data has led to an increasing demand for effective data management and storage solutions. Academic computing infrastructures are often fragmented, which can make it challenging for researchers to leverage cloud-native principles and modern data analysis tools. To address this challenge, a new distributed storage platform called Aruna Object Storage (AOS) was developed. AOS is a cloud-native, scalable, and domain-agnostic object storage system that provides an S3-compatible interface for a variety of data analysis tools like Apache Spark, TensorFlow, and Pandas. The system uses an underlying distributed NewSQL database to manage detailed information about its resources and can be deployed across multiple data centers for geo-redundancy. AOS is designed to support modern DataOps practices, including the adoption of FAIR principles. Resources in AOS are organized into Objects, Datasets, Collections and Projects, which represent relations of data objects. Additionally, these can be further annotated with key-value pairs called Labels and Hooks to provide additional information about the data. The system's event-driven architecture makes it easy to automate actions and enforce data validation checks, significantly improving accessibility and reproducibility of scientific results. AOS is open source and freely available via https://aruna-storage.org.
Cite this paper
Dieckmann, M. A., Beyvers, S., Hochmuth, J., Rehm, A., Förster, F., & Goesmann, A. (2023). Aruna Object Storage. Proceedings of the Conference on Research Data Infrastructure, 1. https://doi.org/10.52825/cordi.v1i.404
Dieckmann, Marius Alfred, et al. “Aruna Object Storage.” Proceedings of the Conference on Research Data Infrastructure, vol. 1, 2023, https://doi.org/10.52825/cordi.v1i.404.
Dieckmann, Marius Alfred, Sebastian Beyvers, Jannis Hochmuth, Anna Rehm, Frank Förster, and Alexander Goesmann. 2023. “Aruna Object Storage.” Proceedings of the Conference on Research Data Infrastructure 1. https://doi.org/10.52825/cordi.v1i.404.
Dieckmann, M.A. et al. (2023) ‘Aruna Object Storage’, Proceedings of the Conference on Research Data Infrastructure, 1. Available at: https://doi.org/10.52825/cordi.v1i.404.
@article{dieckmann2023aruna,
title = {{Aruna Object Storage}},
author = {Dieckmann, Marius Alfred and Beyvers, Sebastian and Hochmuth, Jannis and Rehm, Anna and Förster, Frank and Goesmann, Alexander},
journal = {Proceedings of the Conference on Research Data Infrastructure},
volume = {1},
year = {2023},
doi = {10.52825/cordi.v1i.404}
}Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.