article · Zenodo (CERN European Organization for Nuclear Research) · 2025

Automated Data Cleaning and Preprocessing System

Aman Rawat, Mr.Ritesh Kumar

Cited by 0Open access

Abstract

Data preprocessing is a fundamental step in any machine learning pipeline, as the quality of input data directly influences the reliability and accuracy of predictive models. Real-world datasets often contain missing values, duplicate entries, inconsistent formats, outliers, and non-standardized features, making manual preprocessing time-consuming, error-prone, and difficult to reproduce. To address these challenges, this research presents an Automated Data Cleaning and Preprocessing System designed to streamline the transformation of raw data into structured, analysis-ready form with minimal user intervention. The system integrates automated detection of missingness, statistical and algorithmic imputation, outlier identification, categorical encoding, normalization, and comprehensive summary reporting through a modular pipeline architecture. Experiments conducted on diverse datasets from multiple domains demonstrate improvements in data consistency, distributional stability, and downstream machine learning performance. The results highlight that automated preprocessing not only reduces human effort but also ensures reproducibility, scalability, and enhanced model accuracy, making it suitable for academic research, industrial applications, and production-level data workflows.

Cite this paper

APA 7

Aman Rawat, M. K. (2025). Automated Data Cleaning and Preprocessing System. Zenodo (CERN European Organization for Nuclear Research). https://doi.org/10.5281/zenodo.17697111

MLA 9

Aman Rawat, Mr.Ritesh Kumar. “Automated Data Cleaning and Preprocessing System.” Zenodo (CERN European Organization for Nuclear Research), 2025, https://doi.org/10.5281/zenodo.17697111.

Chicago

Aman Rawat, Mr.Ritesh Kumar. 2025. “Automated Data Cleaning and Preprocessing System.” Zenodo (CERN European Organization for Nuclear Research). https://doi.org/10.5281/zenodo.17697111.

Harvard

Aman Rawat, M.K. (2025) ‘Automated Data Cleaning and Preprocessing System’, Zenodo (CERN European Organization for Nuclear Research). Available at: https://doi.org/10.5281/zenodo.17697111.

BibTeX

@article{amanrawat2025automated,
  title = {{Automated Data Cleaning and Preprocessing System}},
  author = {Aman Rawat, Mr.Ritesh Kumar},
  journal = {Zenodo (CERN European Organization for Nuclear Research)},
  year = {2025},
  doi = {10.5281/zenodo.17697111}
}

Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.