Parallelized preconditioned model building algorithm for matrix factorization

Kaya, Kamer and Birbil, İlker and Öztürk, Mehmet Kaan and Gohari, Amir (2017) Parallelized preconditioned model building algorithm for matrix factorization. In: The Third International Conference on Machine Learning, Optimization and Big Data (MOD 2017), Volterra, Tuscany, Italy (Accepted/In Press)

[thumbnail of parallelpmb.pdf] PDF
parallelpmb.pdf

Download (978kB)

Abstract

Matrix factorization is a common task underlying several machine learning applications such as recommender systems, topic modeling, or compressed sensing. Given a large and possibly sparse matrix A, we seek two smaller matrices W and H such that their product is as close to A as possible. The objective is minimizing the sum of square errors in the approximation. Typically such problems involve hundreds of thousands of unknowns, so an optimizer must be exceptionally efficient. In this study, a new algorithm, Preconditioned Model Building is adapted to factorize matrices composed of movie ratings in the MovieLens data sets with 1, 10, and 20 million entries. We present experiments that compare the sequential MATLAB implementation of the PMB algorithm with other algorithms in the minFunc package. We also employ a lock-free sparse matrix factorization algorithm and provide a scalable shared-memory parallel implementation. We show that (a) the optimization performance of the PMB algorithm is comparable to the best algorithms in common use, and (b) the computational performance can be significantly increased with parallelization
Item Type: Papers in Conference Proceedings
Subjects: Q Science > QA Mathematics > QA075 Electronic computers. Computer science
Divisions: Faculty of Engineering and Natural Sciences > Academic programs > Computer Science & Eng.
Faculty of Engineering and Natural Sciences
Depositing User: Kamer Kaya
Date Deposited: 20 Aug 2017 16:45
Last Modified: 26 Apr 2022 09:27
URI: https://research.sabanciuniv.edu/id/eprint/33006

Actions (login required)

View Item
View Item