Maximum likelihood model selection for 1-norm soft margin SVMs with multiple parameters

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningfagfællebedømt

T. Glasmachers, Christian Igel

Adapting the hyperparameters of support vector machines (SVMs) is a challenging model selection problem, especially when flexible kernels are to be adapted and data are scarce. We present a coherent framework for regularized model selection of 1-norm soft margin SVMs for binary classification. It is proposed to use gradient-ascent on a likelihood function of the hyperparameters. The likelihood function is based on logistic regression for robustly estimating the class conditional probabilities and can be computed efficiently. Overfitting is an important issue in SVM model selection and can be addressed in our framework by incorporating suitable prior distributions over the hyperparameters. We show empirically that gradient-based optimization of the likelihood function is able to adapt multiple kernel parameters and leads to better models than four concurrent state-of-the-art methods.

OriginalsprogEngelsk
TidsskriftIEEE Transactions on Pattern Analysis and Machine Intelligence
Vol/bind32
Udgave nummer8
Sider (fra-til)1522-1528
Antal sider7
DOI
StatusUdgivet - 2010
Eksternt udgivetJa

ID: 32089209