Please use this identifier to cite or link to this item:
|Title:||Enhanced random search based incremental extreme learning machine|
Incremental extreme learning machine
Random hidden nodes
|Citation:||Huang, G.-B., Chen, L. (2008). Enhanced random search based incremental extreme learning machine. Neurocomputing 71 (16-18) : 3460-3468. ScholarBank@NUS Repository. https://doi.org/10.1016/j.neucom.2007.10.008|
|Abstract:||Recently an incremental algorithm referred to as incremental extreme learning machine (I-ELM) was proposed by Huang et al. [G.-B. Huang, L. Chen, C.-K. Siew, Universal approximation using incremental constructive feedforward networks with random hidden nodes, IEEE Trans. Neural Networks 17(4) (2006) 879-892], which randomly generates hidden nodes and then analytically determines the output weights. Huang et al. [G.-B. Huang, L. Chen, C.-K. Siew, Universal approximation using incremental constructive feedforward networks with random hidden nodes, IEEE Trans. Neural Networks 17(4) (2006) 879-892] have proved in theory that although additive or RBF hidden nodes are generated randomly the network constructed by I-ELM can work as a universal approximator. During our recent study, it is found that some of the hidden nodes in such networks may play a very minor role in the network output and thus may eventually increase the network complexity. In order to avoid this issue and to obtain a more compact network architecture, this paper proposes an enhanced method for I-ELM (referred to as EI-ELM). At each learning step, several hidden nodes are randomly generated and among them the hidden node leading to the largest residual error decreasing will be added to the existing network and the output weight of the network will be calculated in a same simple way as in the original I-ELM. Generally speaking, the proposed enhanced I-ELM works for the widespread type of piecewise continuous hidden nodes. © 2007 Elsevier B.V. All rights reserved.|
|Appears in Collections:||Staff Publications|
Show full item record
Files in This Item:
There are no files associated with this item.
checked on Sep 12, 2018
WEB OF SCIENCETM
checked on Sep 4, 2018
checked on Sep 14, 2018
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.