Nonlinear regression via incremental decision trees

Vanlı, Nuri Denizcan and Sayın, Muhammed Ömer and Mohaghegh, Mohammadreza N. and Özkan, Hüseyin and Kozat, Süleyman Serdar (2019) Nonlinear regression via incremental decision trees. Pattern Recognition, 86 . pp. 1-13. ISSN 0031-3203 (Print) 1873-5142 (Online)

Full text not available from this repository. (Request a copy)

Abstract

We study sequential nonlinear regression and introduce an online algorithm that elegantly mitigates, via an adaptively incremental hierarchical structure, convergence and undertraining issues of conventional nonlinear regression methods. Particularly, we present a piecewise linear (or nonlinear) regression algorithm that partitions the regressor space and learns a linear model at each region to combine. Unlike the conventional approaches, our algorithm effectively learns the optimal regressor space partition with the desired complexity in a completely sequential and data driven manner. Our algorithm sequentially and asymptotically achieves the performance of the optimal twice differentiable regression function for any data sequence without any statistical assumptions. The introduced algorithm can be efficiently implemented with a computational complexity that is only logarithmic in the length of data. In our experiments, we demonstrate significant gains for the well-known benchmark real data sets when compared to the state-of-the-art techniques.
Item Type: Article
Uncontrolled Keywords: Online regression; Sequential learning; Nonlinear models; Incremental decision trees
Divisions: Faculty of Engineering and Natural Sciences > Academic programs > Electronics
Faculty of Engineering and Natural Sciences
Depositing User: Hüseyin Özkan
Date Deposited: 26 Jul 2019 15:55
Last Modified: 26 Apr 2022 10:05
URI: https://research.sabanciuniv.edu/id/eprint/37305

Actions (login required)

View Item
View Item