A comparative study of PCA, ICA and class-conditional ICA for naïve bayes classifier

Abstract

The performance of the Naïve Bayes classifier can be improved by appropriate preprocessing procedures. This paper presents a comparative study of three preprocessing procedures, namely Principle Component Analysis (PCA), Independent Component Analysis (ICA) and class-conditional ICA, for Naïve Bayes classifier. It is found that all the three procedures keep improving the performance of the Naïve Bayes classifier with the increase of the number of attributes. Although class-conditional ICA has been found to be superior to PCA and ICA in most cases, it may not be suitable for the case where the sample size for each class is not large enough. © Springer-Verlag Berlin Heidelberg 2007.