A unifying framework for learning the linear combiners for classifier ensembles

Erdoğan, Hakan and Şen, Mehmet Umut (2010) A unifying framework for learning the linear combiners for classifier ensembles. In: 20th International Conference on Pattern Recognition (ICPR 2010), Istanbul, Turkey

[thumbnail of erdogan10auf.pdf] PDF

Download (428kB)


For classifier ensembles, an effective combination method is to combine the outputs of each classifier using a linearly weighted combination rule. There are multiple ways to linearly combine classifier outputs and it is beneficial to analyze them as a whole. We present a unifying framework for multiple linear combination types in this paper. This unification enables using the same learning algorithms for different types of linear combiners. We present various ways to train the weights using regularized empirical loss minimization. We propose using the hinge loss for better performance as compared to the conventional least-squares loss. We analyze the effects of using hinge loss for various types of linear weight training by running experiments on three different databases. We show that, in certain problems, linear combiners with fewer parameters may perform as well as the ones with much larger number of parameters even in the presence of regularization.
Item Type: Papers in Conference Proceedings
Uncontrolled Keywords: classifier fusion , linear classifier learning , linear combiners , stacked generalization
Subjects: T Technology > TK Electrical engineering. Electronics Nuclear engineering
Q Science > QA Mathematics > QA075 Electronic computers. Computer science
Divisions: Faculty of Engineering and Natural Sciences > Academic programs > Electronics
Faculty of Engineering and Natural Sciences
Depositing User: Hakan Erdoğan
Date Deposited: 10 Dec 2010 14:56
Last Modified: 26 Apr 2022 08:59
URI: https://research.sabanciuniv.edu/id/eprint/15904

Actions (login required)

View Item
View Item