other · UC Berkeley

Non-Sparse Regularization with Multiple Kernels

Kloft, Marius, Author, Brefeld, Ulf, Author, Sonnenburg, Soeren, Author, Zien, Alexander, Author

Cited by 0Abstract and details only

Abstract

Learning linear combinations of multiple kernels is an appealing strategy when the right choice of features is unknown. Previous approaches to multiple kernel learning (MKL) promote sparse kernel combinations to support interpretability and scalability. Unfortunately, this lp-norm MKL is rarely observed to outperform trivial baselines in practical applications. To allow for robust kernel mixtures, we generalize MKL to arbitrary norms. We devise new insights on the connection between several existing MKL formulations and develop two efficient interleaved optimization strategies for arbitrary norms, like lp-norms with p>1. Empirically, we demonstrate that the interleaved optimization strategies are much faster compared to the commonly used wrapper approaches. An experiment on controlled artificial data experiment sheds light on the appropriateness of sparse, non-sparse and uniform MKL in various scenarios. Application of lp-norm MKL to three hard real-world problems from computational biology show that non-sparse MKL achieves accuracies that go beyond the state-of-the-art. We conclude that our improvements finally made MKL fit for deployment to practical applications: MKL now has a good chance of improving the accuracy (over a plain sum kernel) at an affordable computational cost.

Cite this paper

APA 7

Kloft, M. A., Brefeld, U. A., Sonnenburg, S. A., & Zien, A. A. (n.d.). Non-Sparse Regularization with Multiple Kernels. UC Berkeley.

MLA 9

Kloft, Marius, Author, et al. “Non-Sparse Regularization with Multiple Kernels.” UC Berkeley.

Chicago

Kloft, Marius, Author, Ulf, Author Brefeld, Soeren, Author Sonnenburg, and Alexander, Author Zien. n.d.. “Non-Sparse Regularization with Multiple Kernels.” UC Berkeley.

Harvard

Kloft, M.A. et al. (n.d.) ‘Non-Sparse Regularization with Multiple Kernels’, UC Berkeley.

BibTeX

@misc{kloftsparse,
  title = {{Non-Sparse Regularization with Multiple Kernels}},
  author = {Kloft, Marius, Author and Brefeld, Ulf, Author and Sonnenburg, Soeren, Author and Zien, Alexander, Author},
  journal = {UC Berkeley}
}

Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.