Multi-population cooperative bat algorithm-based optimization of artificial neural network model

Najmeh Sadat Jaddi, Salwani Abdullah, Abdul Razak Hamdan

Research output: Contribution to journalArticle

45 Citations (Scopus)

Abstract

The performance of an artificial neural network (ANN) depends on the connection weights and network structure. Many optimization algorithms have been applied for ANN model selection. This paper presents an optimization algorithm based on the cooperative bat-inspired algorithm. The advantage of the bat algorithm lies in the combination of a population-based algorithm and local search; however, it is more powerful in local search. Therefore to better balance exploration and exploitation in the population some modifications to the velocity equation of the standard bat algorithm are applied. In addition, we propose two new topologies for cooperation between subpopulations to further improve the algorithm's capability to maintain the diversity of bats in the population. The first is a combination of two known mechanisms (Ring and Master-Slave), and the second inserts a Coevolving strategy of slave subpopulations in the Master-Slave strategy. The proposed methods are applied for the selection of an ANN model, where both the structure of the ANN and its weights are optimized by the method. Six classification and two time series prediction benchmark datasets are tested and the performance of the proposed algorithms is evaluated and compared with other methods in the literature. Statistical analysis shows that for the classification problem there is a significant improvement in the bat algorithm with Ring and Master-Slave strategies cooperation compared to the other methods in the literature in terms of classification error for three cases out of five and a significant enhancement in the number of connection weights in the network. The analysis also shows that for time series prediction there is a significant improvement in the prediction error for all the cases.

Original languageEnglish
Pages (from-to)628-644
Number of pages17
JournalInformation Sciences
Volume294
DOIs
Publication statusPublished - 10 Feb 2015

Fingerprint

Neural Network Model
Artificial Neural Network
Neural networks
Optimization
Time Series Prediction
Local Search
Optimization Algorithm
Time series
Ring
Prediction Error
Artificial neural network
Network model
Network Structure
Model Selection
Classification Problems
Exploitation
Statistical Analysis
Enhancement
Benchmark
Topology

Keywords

  • Artificial neural network
  • Bat-inspired algorithm
  • Classification
  • Multi-population cooperation
  • Time series prediction

ASJC Scopus subject areas

  • Artificial Intelligence
  • Software
  • Control and Systems Engineering
  • Theoretical Computer Science
  • Computer Science Applications
  • Information Systems and Management

Cite this

Multi-population cooperative bat algorithm-based optimization of artificial neural network model. / Jaddi, Najmeh Sadat; Abdullah, Salwani; Hamdan, Abdul Razak.

In: Information Sciences, Vol. 294, 10.02.2015, p. 628-644.

Research output: Contribution to journalArticle

@article{48e5a7abc45449f48dd895dfa09aa4e0,
title = "Multi-population cooperative bat algorithm-based optimization of artificial neural network model",
abstract = "The performance of an artificial neural network (ANN) depends on the connection weights and network structure. Many optimization algorithms have been applied for ANN model selection. This paper presents an optimization algorithm based on the cooperative bat-inspired algorithm. The advantage of the bat algorithm lies in the combination of a population-based algorithm and local search; however, it is more powerful in local search. Therefore to better balance exploration and exploitation in the population some modifications to the velocity equation of the standard bat algorithm are applied. In addition, we propose two new topologies for cooperation between subpopulations to further improve the algorithm's capability to maintain the diversity of bats in the population. The first is a combination of two known mechanisms (Ring and Master-Slave), and the second inserts a Coevolving strategy of slave subpopulations in the Master-Slave strategy. The proposed methods are applied for the selection of an ANN model, where both the structure of the ANN and its weights are optimized by the method. Six classification and two time series prediction benchmark datasets are tested and the performance of the proposed algorithms is evaluated and compared with other methods in the literature. Statistical analysis shows that for the classification problem there is a significant improvement in the bat algorithm with Ring and Master-Slave strategies cooperation compared to the other methods in the literature in terms of classification error for three cases out of five and a significant enhancement in the number of connection weights in the network. The analysis also shows that for time series prediction there is a significant improvement in the prediction error for all the cases.",
keywords = "Artificial neural network, Bat-inspired algorithm, Classification, Multi-population cooperation, Time series prediction",
author = "Jaddi, {Najmeh Sadat} and Salwani Abdullah and Hamdan, {Abdul Razak}",
year = "2015",
month = "2",
day = "10",
doi = "10.1016/j.ins.2014.08.050",
language = "English",
volume = "294",
pages = "628--644",
journal = "Information Sciences",
issn = "0020-0255",
publisher = "Elsevier Inc.",

}

TY - JOUR

T1 - Multi-population cooperative bat algorithm-based optimization of artificial neural network model

AU - Jaddi, Najmeh Sadat

AU - Abdullah, Salwani

AU - Hamdan, Abdul Razak

PY - 2015/2/10

Y1 - 2015/2/10

N2 - The performance of an artificial neural network (ANN) depends on the connection weights and network structure. Many optimization algorithms have been applied for ANN model selection. This paper presents an optimization algorithm based on the cooperative bat-inspired algorithm. The advantage of the bat algorithm lies in the combination of a population-based algorithm and local search; however, it is more powerful in local search. Therefore to better balance exploration and exploitation in the population some modifications to the velocity equation of the standard bat algorithm are applied. In addition, we propose two new topologies for cooperation between subpopulations to further improve the algorithm's capability to maintain the diversity of bats in the population. The first is a combination of two known mechanisms (Ring and Master-Slave), and the second inserts a Coevolving strategy of slave subpopulations in the Master-Slave strategy. The proposed methods are applied for the selection of an ANN model, where both the structure of the ANN and its weights are optimized by the method. Six classification and two time series prediction benchmark datasets are tested and the performance of the proposed algorithms is evaluated and compared with other methods in the literature. Statistical analysis shows that for the classification problem there is a significant improvement in the bat algorithm with Ring and Master-Slave strategies cooperation compared to the other methods in the literature in terms of classification error for three cases out of five and a significant enhancement in the number of connection weights in the network. The analysis also shows that for time series prediction there is a significant improvement in the prediction error for all the cases.

AB - The performance of an artificial neural network (ANN) depends on the connection weights and network structure. Many optimization algorithms have been applied for ANN model selection. This paper presents an optimization algorithm based on the cooperative bat-inspired algorithm. The advantage of the bat algorithm lies in the combination of a population-based algorithm and local search; however, it is more powerful in local search. Therefore to better balance exploration and exploitation in the population some modifications to the velocity equation of the standard bat algorithm are applied. In addition, we propose two new topologies for cooperation between subpopulations to further improve the algorithm's capability to maintain the diversity of bats in the population. The first is a combination of two known mechanisms (Ring and Master-Slave), and the second inserts a Coevolving strategy of slave subpopulations in the Master-Slave strategy. The proposed methods are applied for the selection of an ANN model, where both the structure of the ANN and its weights are optimized by the method. Six classification and two time series prediction benchmark datasets are tested and the performance of the proposed algorithms is evaluated and compared with other methods in the literature. Statistical analysis shows that for the classification problem there is a significant improvement in the bat algorithm with Ring and Master-Slave strategies cooperation compared to the other methods in the literature in terms of classification error for three cases out of five and a significant enhancement in the number of connection weights in the network. The analysis also shows that for time series prediction there is a significant improvement in the prediction error for all the cases.

KW - Artificial neural network

KW - Bat-inspired algorithm

KW - Classification

KW - Multi-population cooperation

KW - Time series prediction

UR - http://www.scopus.com/inward/record.url?scp=84944443365&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84944443365&partnerID=8YFLogxK

U2 - 10.1016/j.ins.2014.08.050

DO - 10.1016/j.ins.2014.08.050

M3 - Article

AN - SCOPUS:84944443365

VL - 294

SP - 628

EP - 644

JO - Information Sciences

JF - Information Sciences

SN - 0020-0255

ER -