Please use this identifier to cite or link to this item:
|Title:||Characterization of all solutions for undersampled uncorrelated linear discriminant analysis problems||Authors:||Chu, D.
|Keywords:||Data dimensionality reduction
Uncorrelated linear discriminant analysis
|Issue Date:||2011||Citation:||Chu, D., Goh, S.T., Hung, Y.S. (2011). Characterization of all solutions for undersampled uncorrelated linear discriminant analysis problems. SIAM Journal on Matrix Analysis and Applications 32 (3) : 820-844. ScholarBank@NUS Repository. https://doi.org/10.1137/100792007||Abstract:||In this paper the uncorrelated linear discriminant analysis (ULDA) for undersampled problems is studied. The main contributions of the present work include the following: (i) all solutions of the optimization problem used for establishing the ULDA are parameterized explicitly; (ii) the optimal solutions among all solutions of the corresponding optimization problem are characterized in terms of both the ratio of between-class distance to within-class distance and the maximum likelihood classification, and it is proved that these optimal solutions are exactly the solutions of the corresponding optimization problem with minimum Frobenius norm, also minimum nuclear norm; these properties provide a good mathematical justification for preferring the minimum-norm transformation over other possible solutions as the optimal transformation in ULDA; (iii) explicit necessary and sufficient conditions are provided to ensure that these minimal solutions lead to a larger ratio of between-class distance to within-class distance, thereby achieving larger discrimination in the reduced subspace than that in the original data space, and our numerical experiments show that these necessary and sufficient conditions hold true generally. Furthermore, a new and fast ULDA algorithm is developed, which is eigendecomposition-free and SVD-free, and its effectiveness is demonstrated by some real-world data sets. © 2011 Society for Industrial and Applied Mathematics.||Source Title:||SIAM Journal on Matrix Analysis and Applications||URI:||http://scholarbank.nus.edu.sg/handle/10635/52823||ISSN:||08954798||DOI:||10.1137/100792007|
|Appears in Collections:||Staff Publications|
Show full item record
Files in This Item:
There are no files associated with this item.
checked on Oct 19, 2021
WEB OF SCIENCETM
checked on Oct 12, 2021
checked on Oct 14, 2021
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.