MultiLearner based recursive supervised training

Abstract

In supervised learning, most single solution neural networks such as Constructive Backpropagation give good results when used with some datasets but not with others. Others such as Probabilistic Neural Networks (PNN) fit a curve to perfection but need to be manually tuned in the case of noisy data. Recursive Percentage based Hybrid Pattern Training (RPHP) overcomes this problem by recursively training subsets of the data, thereby using several neural networks. MultiLearner based Recursive Training (MLRT) is an extension of this approach, where a combination of existing and new learners are used and subsets are trained using the weak learner which is best suited for this subset. We observed that empirically, MLRT performs considerably well as compared to RPHP and other systems on benchmark data with 11% improvement in accuracy on the spam dataset and comparable performances on the vowel and the two-spiral problems. ©2006 IEEE.