article · Greater South Information System · 2021

Instance Reduction for Avoiding Overfitting in Decision Trees

Asma' Amro, Mousa Al-Akhras, Khalil El Hindi, Mohamed Habib, Bayan Abu Shawar

Cited by 0Open access

Abstract

Abstract Decision trees learning is one of the most practical classification methods in machine learning, which is used for approximating discrete-valued target functions. However, they may overfit the training data, which limits their ability to generalize to unseen instances. In this study, we investigated the use of instance reduction techniques to smooth the decision boundaries before training the decision trees. Noise filters such as ENN, RENN, and ALLKNN remove noisy instances while DROP3 and DROP5 may remove genuine instances. Extensive empirical experiments were conducted on 13 benchmark datasets from UCI machine learning repository with and without intentionally introduced noise. Empirical results show that eliminating border instances improves the classification accuracy of decision trees and reduces the tree size, which reduces the training and classification times. In datasets without intentionally added noise, applying noise filters without the use of the built-in Reduced Error Pruning gave the best classification accuracy. ENN, RENN, and ALLKNN outperformed decision trees learning without pruning in 9, 9, and 8 out of 13 datasets, respectively. The datasets reduced using ENN and RENN without built-in pruning were more effective when noise was intentionally introduced in different ratios.

Cite this paper

APA 7

Amro, A., Al-Akhras, M., Hindi, K. E., Habib, M., & Shawar, B. A. (2021). Instance Reduction for Avoiding Overfitting in Decision Trees. Greater South Information System. https://doi.org/10.60692/4nk1t-nm246

MLA 9

Amro, Asma', et al. “Instance Reduction for Avoiding Overfitting in Decision Trees.” Greater South Information System, 2021, https://doi.org/10.60692/4nk1t-nm246.

Chicago

Amro, Asma', Mousa Al-Akhras, Khalil El Hindi, Mohamed Habib, and Bayan Abu Shawar. 2021. “Instance Reduction for Avoiding Overfitting in Decision Trees.” Greater South Information System. https://doi.org/10.60692/4nk1t-nm246.

Harvard

Amro, A. et al. (2021) ‘Instance Reduction for Avoiding Overfitting in Decision Trees’, Greater South Information System. Available at: https://doi.org/10.60692/4nk1t-nm246.

BibTeX

@article{amro2021instance,
  title = {{Instance Reduction for Avoiding Overfitting in Decision Trees}},
  author = {Amro, Asma' and Al-Akhras, Mousa and Hindi, Khalil El and Habib, Mohamed and Shawar, Bayan Abu},
  journal = {Greater South Information System},
  year = {2021},
  doi = {10.60692/4nk1t-nm246}
}

Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.