Please use this identifier to cite or link to this item:
https://doi.org/10.1080/10618600.2012.679897
DC Field | Value | |
---|---|---|
dc.title | Regression density estimation with variational methods and stochastic approximation | |
dc.contributor.author | Nott, D.J. | |
dc.contributor.author | Tan, S.L. | |
dc.contributor.author | Villan, M. | |
dc.contributor.author | Kohn, R. | |
dc.date.accessioned | 2014-10-28T05:14:39Z | |
dc.date.available | 2014-10-28T05:14:39Z | |
dc.date.issued | 2012 | |
dc.identifier.citation | Nott, D.J., Tan, S.L., Villan, M., Kohn, R. (2012). Regression density estimation with variational methods and stochastic approximation. Journal of Computational and Graphical Statistics 21 (3) : 797-820. ScholarBank@NUS Repository. https://doi.org/10.1080/10618600.2012.679897 | |
dc.identifier.issn | 10618600 | |
dc.identifier.uri | http://scholarbank.nus.edu.sg/handle/10635/105326 | |
dc.description.abstract | Regression density estimation is the problem of flexibly estimating a response distribution as a function of covariates. An important approach to regression density estimation uses finite mixture models and our article considers flexible mixtures of heteroscedastic regression (MHR) models where the response distribution is a normal mixture, with the component means, variances, and mixture weights all varying as a function of covariates. Our article develops fast variational approximation (VA) methods for inference. Our motivation is that alternative computationally intensive Markov chain Monte Carlo (MCMC) methods for fitting mixture models are difficult to apply when it is desired to fit models repeatedly in exploratory analysis and model choice. Our article makes three contributions. First, a VA for MHR models is described where the variational lower bound is in closed form. Second, the basic approximation can be improved by using stochastic approximation (SA) methods to perturb the initial solution to attain higher accuracy. Third, the advantages of our approach for model choice and evaluation compared with MCMC-based approaches are illustrated. These advantages are particularly compelling for time series data where repeated refitting for one-stepahead prediction in model choice and diagnostics and in rolling-window computations is very common. Supplementary materials for the article are available online. 2012 American Statistical Association, Institute of Mathematical Statistics, and Interface Foundation of North America. | |
dc.description.uri | http://libproxy1.nus.edu.sg/login?url=http://dx.doi.org/10.1080/10618600.2012.679897 | |
dc.source | Scopus | |
dc.subject | Bayesian model selection | |
dc.subject | Heteroscedasticity | |
dc.subject | Mixtures of experts | |
dc.subject | Stochastic approximation | |
dc.subject | Variational bayes | |
dc.type | Article | |
dc.contributor.department | STATISTICS & APPLIED PROBABILITY | |
dc.description.doi | 10.1080/10618600.2012.679897 | |
dc.description.sourcetitle | Journal of Computational and Graphical Statistics | |
dc.description.volume | 21 | |
dc.description.issue | 3 | |
dc.description.page | 797-820 | |
dc.identifier.isiut | 000308282000013 | |
Appears in Collections: | Staff Publications |
Show simple item record
Files in This Item:
There are no files associated with this item.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.