title   
  

A unifying framework for learning the linear combiners for classifier ensembles

Erdoğan, Hakan and Şen, Mehmet Umut (2010) A unifying framework for learning the linear combiners for classifier ensembles. In: 20th International Conference on Pattern Recognition (ICPR 2010), Istanbul, Turkey

[img]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
418Kb

Official URL: http://dx.doi.org/10.1109/ICPR.2010.731

Abstract

For classifier ensembles, an effective combination method is to combine the outputs of each classifier using a linearly weighted combination rule. There are multiple ways to linearly combine classifier outputs and it is beneficial to analyze them as a whole. We present a unifying framework for multiple linear combination types in this paper. This unification enables using the same learning algorithms for different types of linear combiners. We present various ways to train the weights using regularized empirical loss minimization. We propose using the hinge loss for better performance as compared to the conventional least-squares loss. We analyze the effects of using hinge loss for various types of linear weight training by running experiments on three different databases. We show that, in certain problems, linear combiners with fewer parameters may perform as well as the ones with much larger number of parameters even in the presence of regularization.

Item Type:Papers in Conference Proceedings
Uncontrolled Keywords:classifier fusion , linear classifier learning , linear combiners , stacked generalization
Subjects:T Technology > TK Electrical engineering. Electronics Nuclear engineering
Q Science > QA Mathematics > QA075 Electronic computers. Computer science
ID Code:15904
Deposited By:Hakan Erdoğan
Deposited On:10 Dec 2010 14:56
Last Modified:10 Dec 2010 14:56

Repository Staff Only: item control page