Please use this identifier to cite or link to this item: http://scholarbank.nus.edu.sg/handle/10635/48693
Title: AUGMENTED LAGRANGIAN BASED ALGORITHMS FOR CONVEX OPTIMIZATION PROBLEMS WITH NON-SEPARABLE L1-REGULARIZATION
Authors: GONG ZHENG
Keywords: Augmented Lagrangian methods, convex programming, non-separable L1-regularization, sparse structure regression, image restoration
Issue Date: 23-Aug-2013
Source: GONG ZHENG (2013-08-23). AUGMENTED LAGRANGIAN BASED ALGORITHMS FOR CONVEX OPTIMIZATION PROBLEMS WITH NON-SEPARABLE L1-REGULARIZATION. ScholarBank@NUS Repository.
Abstract: We consider the problem of minimizing the sum of a convex function and a non-separable L1-regularization term. The motivation for studying such a class of problems comes from recent interests in various high-dimensional sparse feature learning problems in statistics, as well as from problems in image processing. We propose an inexact semi-smooth Newton augmented Lagrangian (SSNAL) algorithm to solve an equivalent reformulation of the problem, and establish comprehensive results on the global convergence and local rate of convergence of the algorithm. For the purpose of exposition and comparison, we also summarize/design three first-order methods to solve the problem under consideration. Numerical experiments show that the SSNAL algorithm performs favourably in comparison to several state-of-the-art first-order algorithms. In addition, we propose an L1+L2 norm fidelity based minimization model for image restoration problems with mixed or unknown noises. Extensive simulations on synthetic data show that this model is effective and robust in restoring images contaminated by various types of additive and multiplicative noises, as well as their mixtures. Numerical results on real data show that it can remove noises without any prior knowledge of the noise distribution.
URI: http://scholarbank.nus.edu.sg/handle/10635/48693
Appears in Collections:Ph.D Theses (Open)

Show full item record
Files in This Item:
File Description SizeFormatAccess SettingsVersion 
Page74_Figure6.6_ noisy_toys.png20.7 MBimage/png

OPEN

NoneThumbnail
View/Download
Page74_Figure6.6_denoised_toys.png8.52 MBimage/png

OPEN

NoneThumbnail
View/Download
GongZ.pdf8.28 MBAdobe PDF

OPEN

NoneView/Download

Page view(s)

308
checked on Dec 11, 2017

Download(s)

125
checked on Dec 11, 2017

Google ScholarTM

Check


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.