Please use this identifier to cite or link to this item:
https://scholarbank.nus.edu.sg/handle/10635/138162
DC Field | Value | |
---|---|---|
dc.title | FAST RATE ANALYSIS OF STOCHASTIC OPTIMIZATION IN STATISTICAL ESTIMATION | |
dc.contributor.author | QU CHAO | |
dc.date.accessioned | 2017-12-31T18:01:02Z | |
dc.date.available | 2017-12-31T18:01:02Z | |
dc.date.issued | 2017-08-03 | |
dc.identifier.citation | QU CHAO (2017-08-03). FAST RATE ANALYSIS OF STOCHASTIC OPTIMIZATION IN STATISTICAL ESTIMATION. ScholarBank@NUS Repository. | |
dc.identifier.uri | http://scholarbank.nus.edu.sg/handle/10635/138162 | |
dc.description.abstract | The interplay of optimization and machine learning becomes an important part of modern artificial intelligence. On one hand, a lot of machine learning problem can be formulated into the optimization problem, and then in the training phase, parameters in these models are tuned using optimization algorithm. Optimization approaches have enjoyed prominence in machine learning because of their wide applicability and attractive theoretical properties. On the other hand, the increasing complexity of machine learning model and big data era push modern optimization algorithms to a higher level. Our study focuses on the stochastic first order method for the high dimensional statistics model. In particular, we investigate the convex stochastic optimization problem and propose the modified regret to relax the strong convexity assumption in some well-known algorithms. We then extend this to solve the large scale robust optimization problem. At last, we study the finite-sum problem, which covers several important formulations such as Lasso, group Lasso, logistic regression, and some non-convex models such as linear regression with SCAD regularization. We show that three variance reduced randomized first order methods enjoy the fast linear convergence even in the non-convex setting under the assumption of restricted strong convexity. | |
dc.language.iso | en | |
dc.subject | machine learning, stochastic optimization, statistical estimation, big data, nonconvex, high dimensional statistics | |
dc.type | Thesis | |
dc.contributor.department | MECHANICAL ENGINEERING | |
dc.contributor.supervisor | XU HUAN | |
dc.contributor.supervisor | ONG CHONG JIN | |
dc.description.degree | Ph.D | |
dc.description.degreeconferred | DOCTOR OF PHILOSOPHY | |
Appears in Collections: | Ph.D Theses (Open) |
Show simple item record
Files in This Item:
File | Description | Size | Format | Access Settings | Version | |
---|---|---|---|---|---|---|
QuC.pdf | 2.95 MB | Adobe PDF | OPEN | None | View/Download |
Page view(s)
179
checked on Jan 26, 2023
Download(s)
192
checked on Jan 26, 2023
Google ScholarTM
Check
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.