An Enhanced Binary Particle Swarm Optimization (EBPSO) algorithm based a V-shaped transfer function for feature selection in high dimensional data

Idheba Mohamad Swesi, Azuraliza Abu Bakar

Research output: Contribution to journalArticle

Abstract

A general problem faced in classification is a small number of samples compared with the large number of genes. In this case, the feature selection (FS) process becomes a challenging task to improve the classification performance by reducing the dimensionality. Particle swarm optimisation (PSO) is a powerful method for solving FS problems. The main ingredient of the binary PSO is its transfer function that allows mapping a continuous space to a discrete space. A sigmoid function was used to update positions in BPSO. However, due to its way of updating positions, this function is not very effective to dodge local minima and speed up the convergence. Thus, this paper suggests an enhanced BPSO, through the FS approach. The study employs a V type transfer function and a special method for updating positions. In addition, a hybrid FS method that integrates the information gain (IG) as a filter approach with the wrapper approach (EBPSO) is proposed. In a hybrid model, feature subsets are ranked based on their significance in a decreasing order. The EBPSO is applied to these subsets and then FS is performed. The proposed algorithm is tested on six microarray datasets and the results verify its superiority. Also, the results of the proposed hybrid FS model, supports its effectiveness because the model produced a small feature subset that showed high classification performance.

Original languageEnglish
Pages (from-to)217-238
Number of pages22
JournalInternational Journal of Advances in Soft Computing and its Applications
Volume9
Issue number3
Publication statusPublished - 2017

Fingerprint

Particle swarm optimization (PSO)
Transfer functions
Feature extraction
Microarrays
Set theory
Genes

Keywords

  • Feature selection
  • Gene expression data
  • Hybrid features selection particle swarm optimisation
  • Transfer function

ASJC Scopus subject areas

  • Computer Science Applications

Cite this

@article{35dce0b94ace4288aeb83a4cba4ddecf,
title = "An Enhanced Binary Particle Swarm Optimization (EBPSO) algorithm based a V-shaped transfer function for feature selection in high dimensional data",
abstract = "A general problem faced in classification is a small number of samples compared with the large number of genes. In this case, the feature selection (FS) process becomes a challenging task to improve the classification performance by reducing the dimensionality. Particle swarm optimisation (PSO) is a powerful method for solving FS problems. The main ingredient of the binary PSO is its transfer function that allows mapping a continuous space to a discrete space. A sigmoid function was used to update positions in BPSO. However, due to its way of updating positions, this function is not very effective to dodge local minima and speed up the convergence. Thus, this paper suggests an enhanced BPSO, through the FS approach. The study employs a V type transfer function and a special method for updating positions. In addition, a hybrid FS method that integrates the information gain (IG) as a filter approach with the wrapper approach (EBPSO) is proposed. In a hybrid model, feature subsets are ranked based on their significance in a decreasing order. The EBPSO is applied to these subsets and then FS is performed. The proposed algorithm is tested on six microarray datasets and the results verify its superiority. Also, the results of the proposed hybrid FS model, supports its effectiveness because the model produced a small feature subset that showed high classification performance.",
keywords = "Feature selection, Gene expression data, Hybrid features selection particle swarm optimisation, Transfer function",
author = "Swesi, {Idheba Mohamad} and {Abu Bakar}, Azuraliza",
year = "2017",
language = "English",
volume = "9",
pages = "217--238",
journal = "International Journal of Advances in Soft Computing and its Applications",
issn = "2074-8523",
publisher = "International Center for Scientific Research and Studies (ICSRS)",
number = "3",

}

TY - JOUR

T1 - An Enhanced Binary Particle Swarm Optimization (EBPSO) algorithm based a V-shaped transfer function for feature selection in high dimensional data

AU - Swesi, Idheba Mohamad

AU - Abu Bakar, Azuraliza

PY - 2017

Y1 - 2017

N2 - A general problem faced in classification is a small number of samples compared with the large number of genes. In this case, the feature selection (FS) process becomes a challenging task to improve the classification performance by reducing the dimensionality. Particle swarm optimisation (PSO) is a powerful method for solving FS problems. The main ingredient of the binary PSO is its transfer function that allows mapping a continuous space to a discrete space. A sigmoid function was used to update positions in BPSO. However, due to its way of updating positions, this function is not very effective to dodge local minima and speed up the convergence. Thus, this paper suggests an enhanced BPSO, through the FS approach. The study employs a V type transfer function and a special method for updating positions. In addition, a hybrid FS method that integrates the information gain (IG) as a filter approach with the wrapper approach (EBPSO) is proposed. In a hybrid model, feature subsets are ranked based on their significance in a decreasing order. The EBPSO is applied to these subsets and then FS is performed. The proposed algorithm is tested on six microarray datasets and the results verify its superiority. Also, the results of the proposed hybrid FS model, supports its effectiveness because the model produced a small feature subset that showed high classification performance.

AB - A general problem faced in classification is a small number of samples compared with the large number of genes. In this case, the feature selection (FS) process becomes a challenging task to improve the classification performance by reducing the dimensionality. Particle swarm optimisation (PSO) is a powerful method for solving FS problems. The main ingredient of the binary PSO is its transfer function that allows mapping a continuous space to a discrete space. A sigmoid function was used to update positions in BPSO. However, due to its way of updating positions, this function is not very effective to dodge local minima and speed up the convergence. Thus, this paper suggests an enhanced BPSO, through the FS approach. The study employs a V type transfer function and a special method for updating positions. In addition, a hybrid FS method that integrates the information gain (IG) as a filter approach with the wrapper approach (EBPSO) is proposed. In a hybrid model, feature subsets are ranked based on their significance in a decreasing order. The EBPSO is applied to these subsets and then FS is performed. The proposed algorithm is tested on six microarray datasets and the results verify its superiority. Also, the results of the proposed hybrid FS model, supports its effectiveness because the model produced a small feature subset that showed high classification performance.

KW - Feature selection

KW - Gene expression data

KW - Hybrid features selection particle swarm optimisation

KW - Transfer function

UR - http://www.scopus.com/inward/record.url?scp=85033715909&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85033715909&partnerID=8YFLogxK

M3 - Article

VL - 9

SP - 217

EP - 238

JO - International Journal of Advances in Soft Computing and its Applications

JF - International Journal of Advances in Soft Computing and its Applications

SN - 2074-8523

IS - 3

ER -