Portal de Periódicos da CAPES

Multilayer Feedforward Ensembles for Classification Problems

2004; Springer Science+Business Media; Linguagem: Inglês

10.1007/978-3-540-30499-9_114

1611-3349

Mercedes Fernández-Redondo, Carlos Hernández-Espinosa, Joaquín Torres-Sospedra,

Text and Document Classification Technologies

As shown in the bibliography, training an ensemble of networks is an interesting way to improve the performance with respect to a single network. However there are several methods to construct the ensemble and there are no complete results showing which one could be the most appropriate. In this paper we present a comparison of eleven different methods. We have trained ensembles of 3, 9, 20 and 40 networks to show results in a wide spectrum of values. The results show that the improvement in performance above 9 networks in the ensemble depends on the method but it is usually marginal. Also, the best method is called "Decorrelated" and uses a penalty term in the usual Backpropagation function to decorrelate the network outputs in the ensemble.