Neural network pruning for function approximation

Abstract

A simple algorithm for pruning feedforward neural networks with a single hidden layer trained for function approximation is presented. The algorithm assumes that the networks have been trained with more then the necessary number of hidden units and it consists of two stages. In the first stage, redundant hidden units are removed and in the second stage, irrelevant input units are removed. Experimental results on seven publicly available data sets show that the proposed algorithm outperforms other methods such as nearest neighbor-, decision tree- and regression-based methods.