Towards minimal network architectures with evolutionary growth perceptrons

Abstract

The purpose of this paper is twofold: First, it will show how the perceptron learning rule can be re-introduced as a local learning technique within the general framework of automatic network construction. Second, it will be pointed out how choosing the right training set during network construction can have profound affects on the quality of the created networks, in terms of number of hidden units and connections. The main vehicle for accomplishing this feat is the use of simple evolutionary processes for automatically determining the correct size of training sets and finding the right examples to train on during the various stages of network construction.