Please use this identifier to cite or link to this item: http://scholarbank.nus.edu.sg/handle/10635/55030
Title: An incremental approach to contribution-based feature selection
Authors: Guan, S.-U. 
Liu, J.
Qi, Y.
Keywords: Feature selection
Incremental training
Knock-out
Neural network
Issue Date: 2004
Source: Guan, S.-U.,Liu, J.,Qi, Y. (2004). An incremental approach to contribution-based feature selection. Journal of Intelligent Systems 13 (1) : 15-44. ScholarBank@NUS Repository.
Abstract: This paper presents a novel feature selection approach based on an incremental neural network (NN) training approach. Instead of training input attributes in batch, this incremental approach trains input attributes one by one so that network performance keeps refined when each new attribute comes in. If an incoming attribute is consistent with previous attributes and relevant to output attributes, network performance will be improved, otherwise degraded. The contribution of an input attribute is evaluated through network performance evaluation. Attributes with little or no contribution will be discarded. To have fair feature selection, we evaluate the individual discrimination ability of each attribute before training by using a NN with only one attribute in the input layer. The attribute with the best discrimination ability will be introduced first, followed by those attributes with lower discrimination ability. Two feature-detection methods are discussed based on this incremental training approach. Unlike existing feature selection methods, the proposed feature selection methods are suitable not only for classification problems but also for regression problems. Experimental results show that our methods work well on several benchmark problems, and NN accuracy improved after feature selection.
Source Title: Journal of Intelligent Systems
URI: http://scholarbank.nus.edu.sg/handle/10635/55030
ISSN: 03341860
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.

Page view(s)

82
checked on Dec 8, 2017

Google ScholarTM

Check


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.