Implementation of Features Selection Based on Dragonfly Optimization Algorithm
Article Sidebar
Main Article Content
Abstract
Nowadays increasing dimensionality of data produces several issues in machine learning. Therefore, it is needed to decrease the number of features by choosing just the most important ones and eliminating duplicate features, also reducing the number of features that are important to the model. For this purpose, many methodologies known as Feature Selection are applied. In this study, a feature selection approach is proposed based on Swarm Intelligence methods, which search for the best points in the search area to achieve optimization. In this paper, a wrapper feature selection technique based on the Dragonfly algorithm is proposed. The dragonfly optimization technique is used to find the optimal subset of features that could accurately classify breast cancer as benign or malignant. Many times, the fitness function is defined as classification accuracy. In this study, hard vote classes are employed as a model developed to evaluate feature subsets that have been chosen. It is used as an evaluation function (fitness function) to evaluate each dragonfly in the population. The proposed ensemble hard voting classifier utilizes a combination of five machine-learning algorithms to produce a binary classification for feature selection: Support Vector Machine (SVM), K-Nearest Neighbors (K-NN), Naive Bayes (NB), Decision Tree (DT), and Random Forest (RF). According to the results of the experiments, the voting ensemble classifier has the greatest accuracy value among the single classifiers. The proposed method showed that when training the subset features, the accuracy generated by the voting classifier is high at 98.24%, whereas the training of all features achieved an accuracy of 96.49%. The proposed approach makes use of the UCI repository's Wisconsin Diagnostic Breast Cancer (WDBC) Dataset. Which consists of 569 instances and 30 features.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
L. Brezocnik, I. Fister, and V. Podgorelec, "Swarm intelligence algorithms for feature selection: A review," Appl. Sci., vol. 8, no. 9, 2018, doi: 10.3390/app8091521.
G. Kicska and A. Kiss, "Comparing swarm intelligence algorithms for dimension reduction in machine learning," Big Data Cogn. Comput., vol. 5, no. 3, 2021, doi: 10.3390/bdcc5030036.
A. Hazra, S. Kumar, and A. Gupta, "Study and Analysis of Breast Cancer Cell Detection using Naive Bayes, SVM and Ensemble Algorithms," Int. J. Comput. Appl., vol. 145, no. 2, pp. 39-45, 2016, doi: 10.5120/ijca2016910595.
M. M. Mafarja, D. Eleyan, I. Jaber, A. Hammouri, and S. Mirjalili, "Binary Dragonfly Algorithm for Feature Selection," Proc. - 2017 Int. Conf. New Trends Comput. Sci. ICTCS 2017, vol. 2018-Janua, pp. 12-17, 2017, doi: 10.1109/ICTCS.2017.43.
T. Xie, J. Yao, and Z. Zhou, "DA-based parameter optimization of combined kernel support vector machine for cancer diagnosis," Processes, vol. 7, no. 5, 2019, doi: 10.3390/pr7050263.
Y. Feng, P. Zhang, M. Yang, Q. Li, and A. Zhang, "Short term load forecasting of offshore oil field microgrids based on DA-SVM," Energy Procedia, vol. 158, pp. 2448-2455, 2019, doi: 10.1016/j.egypro.2019.01.318.
Q. H. Nguyen et al., "Breast Cancer Prediction using Feature Selection and Ensemble Voting," Proc. 2019 Int. Conf. Syst. Sci. Eng. ICSSE 2019, pp. 250-254, 2019, doi: 10.1109/ICSSE.2019.8823106.
K. Raza, Improving the prediction accuracy of heart disease with ensemble learning and majority voting rule. Elsevier Inc., 2019.
L. L. Li, X. Zhao, M. L. Tseng, and R. R. Tan, "Short-term wind power forecasting based on support vector machine with improved dragonfly algorithm," J. Clean. Prod., vol. 242, p. 118447, 2020, doi: 10.1016/j.jclepro.2019.118447.
R. Murtirawat, S. Panchal, V. K. Singh, and Y. Panchal, "Breast Cancer Detection Using K-Nearest Neighbors, Logistic Regression and Ensemble Learning," Proc. Int. Conf. Electron. Sustain. Commun. Syst. ICESC 2020, no. Icesc, pp. 534-540, 2020, doi: 10.1109/ICESC48915.2020.9155783.
A. S. Assiri, S. Nazir, and S. A. Velastin, "Breast Tumor Classification Using an Ensemble Machine Learning Method," J. Imaging, vol. 6, no. 6, 2020, doi: 10.3390/JIMAGING6060039.
F. L. vinmalar* and D. A. K. Kombaiya, "An Improved Dragonfly Optimization Algorithm based Feature Selection in High Dimensional Gene Expression Analysis for Lung Cancer Recognition," Int. J. Innov. Technol. Explor. Eng., vol. 9, no. 8, pp. 896-908, 2020, doi: 10.35940/ijitee.h6302.069820.
M. Rostami, K. Berahmand, E. Nasiri, and S. Forouzande, "Review of swarm intelligence-based feature selection methods," Eng. Appl. Artif. Intell., vol. 100, no. January, p. 104210, 2021, doi: 10.1016/j.engappai.2021.104210.
L. Wang, R. Shi, and J. Dong, "A hybridization of dragonfly algorithm optimization and angle modulation mechanism for 0-1 knapsack problems," Entropy, vol. 23, no. 5, pp. 1-24, 2021, doi: 10.3390/e23050598.
Y. Yue et al., "A Data Collection Method for Mobile Wireless Sensor Networks Based on Improved Dragonfly Algorithm," Comput. Intell. Neurosci., vol. 2022, pp. 1-16, 2022, doi: 10.1155/2022/4735687.
N. Devarakonda, S. Anandarao, R. Kamarajugadda, and Y. Wang, "UNIQUE DRAGONFLY OPTIMIZATION ALGORITHM FOR," 2019.
M. Alshinwan et al., "Dragonfly algorithm: a comprehensive survey of its results, variants, and applications," Multimed. Tools Appl., pp. 14979-15016, 2021, doi: 10.1007/s11042-020-10255-3.
C. M. Rahman and T. A. Rashid, "Dragonfly algorithm and its applications in applied science survey," Comput. Intell. Neurosci., vol. 2019, 2019, doi: 10.1155/2019/9293617.
J. Too and S. Mirjalili, "A Hyper Learning Binary Dragonfly Algorithm for Feature Selection: A COVID-19 Case Study," Knowledge-Based Syst., vol. 212, p. 106553, 2021, doi: 10.1016/j.knosys.2020.106553.
A. I. Hammouri, M. Mafarja, M. A. Al-Betar, M. A. Awadallah, and I. Abu-Doush, "An improved Dragonfly Algorithm for feature selection," Knowledge-Based Syst., vol. 203, p. 106131, 2020, doi: 10.1016/j.knosys.2020.106131.
A. Abdulmunim Abdulmajeed Althanoon and Y. S. Younis, "Supporting Classification of Software Requirements system Using Intelligent Technologies Algorithms," Tech. Rom. J. Appl. Sci. Technol., vol. 3, no. 11, pp. 32-39, 2021, doi: 10.47577/technium.v3i11.5417.
W. Shafqat, S. Malik, K. T. Lee, and D. H. Kim, "Pso based optimized ensemble learning and feature selection approach for efficient energy forecast," Electron., vol. 10, no. 18, 2021, doi: 10.3390/electronics10182188.
I. Zelinka, "A survey on evolutionary algorithms dynamics and its complexity - Mutual relations, past, present and future," Swarm Evol. Comput., vol. 25, pp. 2-14, 2015, doi: 10.1016/j.swevo.2015.06.002.
H. M. Osman, R. S. Alsawaf, and A. Y. Hammo, "Survey of using grasshopper algorithm," Tech. Rom. J. Appl. Sci. Technol., vol. 4, no. 3, pp. 37-44, 2022, doi: 10.47577/technium.v4i3.6344.
C. C. Aggarwal, X. Kong, Q. Gu, J. Han, and P. S. Yu, "Active learning: A survey," Data Classif. Algorithms Appl., pp. 571-605, 2014, doi: 10.1201/b17320.