Asymptotic error bounds for kernel-based Nyström low-rank approximation matrices

Abstract

Many kernel-based learning algorithms have the computational load scaled with the sample size n due to the column size of a full kernel Gram matrix K. This article considers the Nyström low-rank approximation. It uses a reduced kernel K̂, which is n × m, consisting of m columns (say columns i1, i2, ⋯ , i m) randomly drawn from K. This approximation takes the form K≈K̂U-1K̂T, where U is the reduced m × m matrix formed by rows i1, i2, ⋯ , i m of K̂. Often m is much smaller than the sample size n resulting in a thin rectangular reduced kernel, and it leads to learning algorithms scaled with the column size m. The quality of matrix approximations can be assessed by the closeness of their eigenvalues and eigenvectors. In this article, asymptotic error bounds on eigenvalues and eigenvectors are derived for the Nyström low-rank approximation matrix. © 2013 Elsevier Inc.