Please use this identifier to cite or link to this item: https://scholarbank.nus.edu.sg/handle/10635/169192
Title: A Fast Globally Linearly Convergent Algorithm for the Computation of Wasserstein Barycenters
Authors: Yang, Lei 
Li, Jia
Sun Defeng 
Toh, Kim-Chuan 
Keywords: math.OC
math.OC
stat.ML
Issue Date: 2018
Citation: Yang, Lei, Li, Jia, Sun Defeng, Toh, Kim-Chuan (2018). A Fast Globally Linearly Convergent Algorithm for the Computation of Wasserstein Barycenters. ScholarBank@NUS Repository.
Abstract: In this paper, we consider the problem of computing a Wasserstein barycenter for a set of discrete probability distributions with finite supports, which finds many applications in areas such as statistics, machine learning and image processing. When the support points of the barycenter are pre-specified, this problem can be modeled as a linear program (LP) whose problem size can be extremely large. To handle this large-scale LP, we analyse the structure of its dual problem, which is conceivably more tractable and can be reformulated as a well-structured convex problem with 3 kinds of block variables and a coupling linear equality constraint. We then adapt a symmetric Gauss-Seidel based alternating direction method of multipliers (sGS-ADMM) to solve the resulting dual problem and establish its global convergence and global linear convergence rate. As a critical component for efficient computation, we also show how all the subproblems involved can be solved exactly and efficiently. This makes our method suitable for computing a Wasserstein barycenter on a large dataset, without introducing an entropy regularization term as is commonly practiced. In addition, our sGS-ADMM can be used as a subroutine in an alternating minimization method to compute a barycenter when its support points are not pre-specified. Numerical results on synthetic datasets and image datasets demonstrate that our method is highly competitive for solving large-scale problems, in comparison to two existing representative methods and the commercial software Gurobi.
URI: https://scholarbank.nus.edu.sg/handle/10635/169192
Appears in Collections:Staff Publications
Elements

Show full item record
Files in This Item:
File Description SizeFormatAccess SettingsVersion 
1809.04249v4.pdf985.1 kBAdobe PDF

OPEN

Pre-printView/Download

Page view(s)

115
checked on Oct 14, 2021

Download(s)

3
checked on Oct 14, 2021

Google ScholarTM

Check


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.