preprint · IEEE Access · 2020

Inverse Feature Learning: Feature Learning Based on Representation Learning of Error

Behzad Ghazanfari, Fatemeh Afghah, MohammadTaghi Hajiaghayi

Cited by 0Open access

Abstract

This paper proposes <i>inverse feature learning</i> (IFL) as a novel supervised feature learning technique that learns a set of high-level features for classification based on an <i>error representation</i> approach. The key contribution of this method is to learn the representation of error as high-level features, while current representation learning methods interpret error by loss functions which are obtained as a function of differences between the true labels and the predicted ones. One advantage of this error representation is that the learned features for each class can be obtained independently of learned features for other classes; therefore, IFL can learn simultaneously meaning that it can learn new classes' features without retraining. Error representation learning can also help with generalization and reduce the chance of over-fitting by adding a set of impactful features to the original data set which capture the relationships between each instance and different classes through an error generation and analysis process. This method can be particularly effective in data sets, where the instances of each class have diverse feature representations or the ones with imbalanced classes. The experimental results show that the proposed IFL results in better performance compared to the state-of-the-art classification techniques for several popular data sets. We hope this paper can open a new path to utilize the proposed perspective of error representation learning in different feature learning domains.

Cite this paper

APA 7

Ghazanfari, B., Afghah, F., & Hajiaghayi, M. (2020). Inverse Feature Learning: Feature Learning Based on Representation Learning of Error. IEEE Access, 8, 132937–132949. https://doi.org/10.1109/access.2020.3009902

MLA 9

Ghazanfari, Behzad, et al. “Inverse Feature Learning: Feature Learning Based on Representation Learning of Error.” IEEE Access, vol. 8, 2020, pp. 132937–49, https://doi.org/10.1109/access.2020.3009902.

Chicago

Ghazanfari, Behzad, Fatemeh Afghah, and MohammadTaghi Hajiaghayi. 2020. “Inverse Feature Learning: Feature Learning Based on Representation Learning of Error.” IEEE Access 8: 132937–49. https://doi.org/10.1109/access.2020.3009902.

Harvard

Ghazanfari, B., Afghah, F. and Hajiaghayi, M. (2020) ‘Inverse Feature Learning: Feature Learning Based on Representation Learning of Error’, IEEE Access, 8, pp. 132937–132949. Available at: https://doi.org/10.1109/access.2020.3009902.

BibTeX

@misc{ghazanfari2020inverse,
  title = {{Inverse Feature Learning: Feature Learning Based on Representation Learning of Error}},
  author = {Ghazanfari, Behzad and Afghah, Fatemeh and Hajiaghayi, MohammadTaghi},
  journal = {IEEE Access},
  volume = {8},
  pages = {132937--132949},
  year = {2020},
  doi = {10.1109/access.2020.3009902}
}

Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.