An Extended Approach of a Two-Stage Evolutionary Algorithm in Artificial Neural Networks for Multiclassification Tasks

Áreas de investigación:

• Methodology - Machine learning

Año:

2013

Tipo de publicación:

Parte de libro

Autores:

• Tallón-Ballesteros, Antonio
• Hervás-Martínez, César
• Gutiérrez, Pedro Antonio

Editor:

I. Jordanov and L.C. Jain

Volumen:

442/2013

Capítulo:

9

Páginas:

139-153

Publisher:

Springer

Serie:

Studies in Computational Intelligence Innovations in Intelligent Machines -3 Contemporary Achievements in Intelligent Systems

ISBN:

978-3-642-32177-1

BibTex:

@inbook{ATallonLibro2013, author = "Antonio Tall{\'o}n-Ballesteros and C{\'e}sar Herv{\'a}s-Mart{\'i}nez and Pedro Antonio Guti{\'e}rrez", abstract = "This chapter considers a recent algorithm to add broader diversity at the beginning of the evolutionary process and extends it to sigmoidal neural networks. A simultaneous evolution of architectures and weights is performed with a two-stage evolutionary algorithm. The methodology operates with two initial populations, each one containing individuals with different topologies which are evolved for a small number of generations, selecting the half best individuals from each population and combining them to constitute a single population. At this point, the whole evolutionary cycle is applied to the new population. This idea was previously proposed by us for product unit neural networks, and we now extend to sigmoidal neural networks. The experimentation has been carried out on twelve data sets from the UCI repository and two complex real-world problems which differ in their number of instances, features and classes. The results have been contrasted with nonparametric statistical tests and show that our proposal significantly improves the test accuracy of the models with respect to the obtained ones with a standard methodology based on a single population. Moreover, the new proposal is much more efficient than other methods developed previously by us. ", chapter = "9", doi = "10.1007/978-3-642-32177-1_9", editor = "I. Jordanov and L.C. Jain", isbn = "978-3-642-32177-1", pages = "139-153", publisher = "Springer", series = "Studies in Computational Intelligence Innovations in Intelligent Machines -3 Contemporary Achievements in Intelligent Systems", title = "{A}n {E}xtended {A}pproach of a {T}wo-{S}tage {E}volutionary {A}lgorithm in {A}rtificial {N}eural {N}etworks for {M}ulticlassification {T}asks", url = "http://dx.doi.org/10.1007/978-3-642-32177-1_9", volume = "442/2013", year = "2013", }

Abstract:

This chapter considers a recent algorithm to add broader diversity at the beginning of the evolutionary process and extends it to sigmoidal neural networks. A simultaneous evolution of architectures and weights is performed with a two-stage evolutionary algorithm. The methodology operates with two initial populations, each one containing individuals with different topologies which are evolved for a small number of generations, selecting the half best individuals from each population and combining them to constitute a single population. At this point, the whole evolutionary cycle is applied to the new population. This idea was previously proposed by us for product unit neural networks, and we now extend to sigmoidal neural networks. The experimentation has been carried out on twelve data sets from the UCI repository and two complex real-world problems which differ in their number of instances, features and classes. The results have been contrasted with nonparametric statistical tests and show that our proposal significantly improves the test accuracy of the models with respect to the obtained ones with a standard methodology based on a single population. Moreover, the new proposal is much more efficient than other methods developed previously by us.