Limited evaluation cooperative co-evolutionary differential evolution for large-scale neuroevolution

Anil Yaman, Decebal Constantin Mocanu, Giovanni Iacca, George Fletcher, Mykola Pechenizkiy

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

8 Citations (Scopus)

Abstract

Many real-world control and classification tasks involve a large number of features. When artificial neural networks (ANNs) are used for modeling these tasks, the network architectures tend to be large. Neuroevolution is an effective approach for optimizing ANNs; however, there are two bottlenecks that make their application challenging in case of high-dimensional networks using direct encoding. First, classic evolutionary algorithms tend not to scale well for searching large parameter spaces; second, the network evaluation over a large number of training instances is in general time-consuming. In this work, we propose an approach called the Limited Evaluation Cooperative Co-evolutionary Differential Evolution algorithm (LECCDE) to optimize high-dimensional ANNs. The proposed method aims to optimize the pre-synaptic weights of each post-synaptic neuron in different subpopulations using a Cooperative Co-evolutionary Differential Evolution algorithm, and employs a limited evaluation scheme where fitness evaluation is performed on a relatively small number of training instances based on fitness inheritance. We test LECCDE on three datasets with various sizes, and our results show that cooperative co-evolution significantly improves the test error comparing to standard Differential Evolution, while the limited evaluation scheme facilitates a significant reduction in computing time.

Original languageEnglish
Title of host publicationGECCO 2018 - Proceedings of the 2018 Genetic and Evolutionary Computation Conference
EditorsHernan Aguirre
Place of PublicationNew York, NY
PublisherAssociation for Computing Machinery (ACM)
Pages569-576
Number of pages8
ISBN (Electronic)978-1-4503-5618-3
DOIs
Publication statusPublished - 2 Jul 2018
Externally publishedYes
Event2018 Genetic and Evolutionary Computation Conference, GECCO 2018 - Kyoto, Japan
Duration: 15 Jul 201819 Jul 2018

Conference

Conference2018 Genetic and Evolutionary Computation Conference, GECCO 2018
Abbreviated titleGECCO
CountryJapan
CityKyoto
Period15/07/1819/07/18

Keywords

  • Cooperative Co-evolution
  • Differential evolution
  • Direct encoding
  • Neuroevolution

Fingerprint

Dive into the research topics of 'Limited evaluation cooperative co-evolutionary differential evolution for large-scale neuroevolution'. Together they form a unique fingerprint.

Cite this