An Extended Approach of a Two-Stage Evolutionary Algorithm in Artificial Neural Networks for Multiclassification Tasks

Research areas:

• Methodology - Machine learning

Year:

2013

Type of Publication:

In Book

Authors:

• Tallón-Ballesteros, Antonio
• Hervás-Martínez, César
• Gutiérrez, Pedro Antonio

Editor:

I. Jordanov and L.C. Jain

Volume:

442/2013

Chapter:

9

Pages:

139-153

Publisher:

Springer

Series:

Studies in Computational Intelligence Innovations in Intelligent Machines -3 Contemporary Achievements in Intelligent Systems

ISBN:

978-3-642-32177-1

BibTex:

@inbook{ATallonLibro2013, author = "Antonio Tall{\'o}n-Ballesteros and C{\'e}sar Herv{\'a}s-Mart{\'i}nez and Pedro Antonio Guti{\'e}rrez", abstract = "This chapter considers a recent algorithm to add broader diversity at the beginning of the evolutionary process and extends it to sigmoidal neural networks. A simultaneous evolution of architectures and weights is performed with a two-stage evolutionary algorithm. The methodology operates with two initial populations, each one containing individuals with different topologies which are evolved for a small number of generations, selecting the half best individuals from each population and combining them to constitute a single population. At this point, the whole evolutionary cycle is applied to the new population. This idea was previously proposed by us for product unit neural networks, and we now extend to sigmoidal neural networks. The experimentation has been carried out on twelve data sets from the UCI repository and two complex real-world problems which differ in their number of instances, features and classes. The results have been contrasted with nonparametric statistical tests and show that our proposal significantly improves the test accuracy of the models with respect to the obtained ones with a standard methodology based on a single population. Moreover, the new proposal is much more efficient than other methods developed previously by us. ", chapter = "9", doi = "10.1007/978-3-642-32177-1_9", editor = "I. Jordanov and L.C. Jain", isbn = "978-3-642-32177-1", pages = "139-153", publisher = "Springer", series = "Studies in Computational Intelligence Innovations in Intelligent Machines -3 Contemporary Achievements in Intelligent Systems", title = "{A}n {E}xtended {A}pproach of a {T}wo-{S}tage {E}volutionary {A}lgorithm in {A}rtificial {N}eural {N}etworks for {M}ulticlassification {T}asks", url = "http://dx.doi.org/10.1007/978-3-642-32177-1_9", volume = "442/2013", year = "2013", }

Abstract:

This chapter considers a recent algorithm to add broader diversity at the beginning of the evolutionary process and extends it to sigmoidal neural networks. A simultaneous evolution of architectures and weights is performed with a two-stage evolutionary algorithm. The methodology operates with two initial populations, each one containing individuals with different topologies which are evolved for a small number of generations, selecting the half best individuals from each population and combining them to constitute a single population. At this point, the whole evolutionary cycle is applied to the new population. This idea was previously proposed by us for product unit neural networks, and we now extend to sigmoidal neural networks. The experimentation has been carried out on twelve data sets from the UCI repository and two complex real-world problems which differ in their number of instances, features and classes. The results have been contrasted with nonparametric statistical tests and show that our proposal significantly improves the test accuracy of the models with respect to the obtained ones with a standard methodology based on a single population. Moreover, the new proposal is much more efficient than other methods developed previously by us.