Optimising ECOC matrices in multi-class classification problems

Merdivan, Erinç (2013) Optimising ECOC matrices in multi-class classification problems. [Thesis]

[thumbnail of ErincMerdivan_10015476.pdf] PDF

Download (1MB)


Error Correcting Output Coding (ECOC) is a multi-class classiffication technique in which multiple binary classiffiers are trained according to a preset code matrix, such that each one learns a separate dichotomy of the classes. While ECOC is one of the best solutions to multi-class problems, it is suboptimal since the code matrix and the base classiffiers are not learned simultaneously. In this thesis, we present three different algorithms that iteratively updates the ECOC code matrix to improve the performance of the ensemble by reducing the decoupling. Firstly, we applied the previously developed FlipECOC+ update algorithm. Second method is applying simulated annealing method on updating ECOC matrix by flipping proposed entries according to ascending order. Last method is applying beam search to find updated ECOC matrix which has highest validation accuracy. We applied all three algorithms on UCI (University of California Irvine) data sets. Beam search algorithm gives the best result on UCI data sets. All of the proposed update algorithms does not involve further training of the classiffiers and can be applied to any ECOC ensemble.
Item Type: Thesis
Uncontrolled Keywords: ECOC. -- Error correcting output codes. -- Ensemble learning. -- Multi-class classiffication. -- HDÇK. -- Hata düzelten çıktı kodlaması. -- Toplu öğrenme. -- Çok sınıflı sınıflandırma.
Subjects: T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800-8360 Electronics > TK7885-7895 Computer engineering. Computer hardware
Divisions: Faculty of Engineering and Natural Sciences > Academic programs > Computer Science & Eng.
Faculty of Engineering and Natural Sciences
Depositing User: IC-Cataloging
Date Deposited: 05 Apr 2017 16:22
Last Modified: 26 Apr 2022 10:08
URI: https://research.sabanciuniv.edu/id/eprint/31173

Actions (login required)

View Item
View Item