Please use this identifier to cite or link to this item:
Title: A new fuzzy rule-based initialization method for K-Nearest neighbor classifier
Authors: Chua, T.
Tan, W. 
Issue Date: 2009
Citation: Chua, T., Tan, W. (2009). A new fuzzy rule-based initialization method for K-Nearest neighbor classifier. IEEE International Conference on Fuzzy Systems : 415-420. ScholarBank@NUS Repository.
Abstract: The performances of conventional crisp and fuzzy K-Nearest neighbor (K-NN) algorithms trained using finite samples tends to be poor [1], [2]. With "holes" in the training data, it is unlikely that the decision area formed can actually represent the underlying data distribution. There is a need to capture more useful information from the limited training samples, therefore we propose a new fuzzy rule-based KNN algorithm. A fuzzy rule-based initialization procedure differentiates our proposed algorithm from the conventional fuzzy K-NN algorithm. The new initialization procedure allows us to handle the imprecise inputs (neighborhood density and distance) through the natural framework of fuzzy logic system. Unlike conventional K-NN algorithms, the ability to fine tune the membership functions can lead to a highly versatile decision boundary. Thus, the new algorithm can be specifically tuned for different problems to achieve better results. The advantage is demonstrated on a synthetic data set in two-dimensional space. In addition, we also adopt weighted Euclidean distance measurement to overcome the curse of dimensionality [3]. The Euclidean distance weights and the parameters of the fuzzy rule-based system are then optimized with Genetic Algorithm (GA) simultaneously. The practical applicability of the proposed algorithm is verified on four UCI data sets (Bupa liver disorders, Glass, Pima Indians diabetes and Wisconsin breast cancer) and Ford automotive data set with an improvement of 3.42% in classification rate on average. ©2009 IEEE.
Source Title: IEEE International Conference on Fuzzy Systems
ISBN: 9781424435975
ISSN: 10987584
DOI: 10.1109/FUZZY.2009.5277215
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.


checked on Feb 13, 2019


checked on Feb 13, 2019

Page view(s)

checked on Feb 9, 2019

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.