Portal de Periódicos da CAPES

Distributed optimization for multi-task learning via nuclear-norm approximation∗∗The authors are with the Department of Mechanical and Aerospace Engineering, University of California, San Diego, USA.

2015; Elsevier BV; Volume: 48; Issue: 22 Linguagem: Inglês

10.1016/j.ifacol.2015.10.308

2405-8971

David Mateos‐Núñez, Jorge Cortés, David Mateos‐Núñez, Jorge Cortés,

Machine Learning and ELM

We exploit a variational characterization of the nuclear norm to extend the framework of distributed convex optimization to machine learning problems that focus on the sparsity of the aggregate solution. We propose two distributed dynamics that can be used for multi-task feature learning and recommender systems in scenarios with more tasks or users than features. Our first dynamics tackles a convex minimization on local decision variables subject to agreement on a set of local auxiliary matrices. Our second dynamics employs a saddle-point reformulation through Fenchel conjugation of quadratic forms, avoiding the computation of the inverse of the local matrices. We show the correctness of both coordination algorithms using a general analytical framework developed in our previous work that combines distributed optimization and subgradient methods for saddle-point problems.