article · 2011

Kernel Methods for Minimum Entropy Encoding

Cited by 1Abstract and details only

Abstract

Following the basic principles of Information-Theoretic Learning (ITL), in this paper we propose Minimum Entropy Encoders (MEEs), a novel approach to data clustering. We consider a set of functions that project each input point onto a minimum entropy configuration (code). The encoding functions are modeled by kernel machines and the resulting code collects the cluster membership probabilities. Two regularizers are included to balance the distribution of the output features and favor smooth solutions, respectively, thus leading to an unconstrained optimization problem that can be efficiently solved by conjugate gradient or concave-convex procedures. The relationships with Maximum Margin Clustering algorithms are investigated, which show that MEEs overcomes some of the critical issues, such as the lack of a multi-class extension and the need to face problems with a large number of constraints. A massive evaluation on several benchmarks of the proposed approach shows improvements over state-of-the-art techniques, both in terms of accuracy and computational complexity.

Cite this paper

APA 7

Melacci, S., & Gori, M. (2011). Kernel Methods for Minimum Entropy Encoding. https://doi.org/10.1109/icmla.2011.83

MLA 9

Melacci, Stefano, and Marco Gori. “Kernel Methods for Minimum Entropy Encoding.” vol. 13, 2011, pp. 352–57, https://doi.org/10.1109/icmla.2011.83.

Chicago

Melacci, Stefano, and Marco Gori. 2011. “Kernel Methods for Minimum Entropy Encoding.” https://doi.org/10.1109/icmla.2011.83.

Harvard

Melacci, S. and Gori, M. (2011) ‘Kernel Methods for Minimum Entropy Encoding’. Available at: https://doi.org/10.1109/icmla.2011.83.

BibTeX

@article{melacci2011kernel,
  title = {{Kernel Methods for Minimum Entropy Encoding}},
  author = {Melacci, Stefano and Gori, Marco},
  volume = {13},
  pages = {352--357},
  year = {2011},
  doi = {10.1109/icmla.2011.83}
}

Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.