Please use this identifier to cite or link to this item: https://doi.org/10.1137/100792007
Title: Characterization of all solutions for undersampled uncorrelated linear discriminant analysis problems
Authors: Chu, D. 
Goh, S.T. 
Hung, Y.S.
Keywords: Data dimensionality reduction
QR factorization
Uncorrelated linear discriminant analysis
Issue Date: 2011
Source: Chu, D., Goh, S.T., Hung, Y.S. (2011). Characterization of all solutions for undersampled uncorrelated linear discriminant analysis problems. SIAM Journal on Matrix Analysis and Applications 32 (3) : 820-844. ScholarBank@NUS Repository. https://doi.org/10.1137/100792007
Abstract: In this paper the uncorrelated linear discriminant analysis (ULDA) for undersampled problems is studied. The main contributions of the present work include the following: (i) all solutions of the optimization problem used for establishing the ULDA are parameterized explicitly; (ii) the optimal solutions among all solutions of the corresponding optimization problem are characterized in terms of both the ratio of between-class distance to within-class distance and the maximum likelihood classification, and it is proved that these optimal solutions are exactly the solutions of the corresponding optimization problem with minimum Frobenius norm, also minimum nuclear norm; these properties provide a good mathematical justification for preferring the minimum-norm transformation over other possible solutions as the optimal transformation in ULDA; (iii) explicit necessary and sufficient conditions are provided to ensure that these minimal solutions lead to a larger ratio of between-class distance to within-class distance, thereby achieving larger discrimination in the reduced subspace than that in the original data space, and our numerical experiments show that these necessary and sufficient conditions hold true generally. Furthermore, a new and fast ULDA algorithm is developed, which is eigendecomposition-free and SVD-free, and its effectiveness is demonstrated by some real-world data sets. © 2011 Society for Industrial and Applied Mathematics.
Source Title: SIAM Journal on Matrix Analysis and Applications
URI: http://scholarbank.nus.edu.sg/handle/10635/52823
ISSN: 08954798
DOI: 10.1137/100792007
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.

SCOPUSTM   
Citations

16
checked on Dec 6, 2017

WEB OF SCIENCETM
Citations

13
checked on Nov 21, 2017

Page view(s)

40
checked on Dec 10, 2017

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.