Max-margin stacking with group sparse regularization for classifier combination

Şen, Mehmet Umut (2011) Max-margin stacking with group sparse regularization for classifier combination. [Thesis]

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader

Official URL: (Table of Contents)


Multiple classifier systems are shown to be effective in terms of accuracy for multiclass classification problems with the expense of increased complexity. Classifier combination studies deal with the methods of combining the outputs of base classifiers of an ensemble. Stacked generalization, or stacking, is shown to be a strong combination scheme among combination algorithms; and in this thesis, we improve stacking's performance further in terms of both accuracy and complexity. We investigate four main issues for this purpose. First, we show that margin maximizing combiners outperform the conventional least-squares estimation of the weights. Second we incorporate the idea of group sparsity into regularization to facilitate classifier selection. Third, we develop non-linear versions of class-conscious linear combination types by transforming datasets into binary classification datasets; then applying the kernel trick. And finally, we derive a new optimization algorithm based on the majorization-minimization framework for a particular linear combination type, which we show is the most preferable one.

Item Type:Thesis
Uncontrolled Keywords:Classification. -- Classifier systems. -- Stacked generalization. -- Classifier combination. -- Hinge loss. -- Group sparsity. -- Kernel trick. -- SInıflandırma. -- Sınıflandırıcı sistemler. -- Yığıtlı genelleme. -- Sınıflandırıcı birleştirme. -- Menteşe kaybı. -- Grup seyrekliği. -- Kernel hilesi.
Subjects:T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800-8360 Electronics
ID Code:24622
Deposited By:IC-Cataloging
Deposited On:29 Sep 2014 16:16
Last Modified:25 Mar 2019 17:10

Repository Staff Only: item control page