Abstract
Feature selection is a required preprocess stage in most of the data mining tasks. This paper presents an improved Harris hawks optimization (HHO) to find high-quality solutions for global optimization and feature selection tasks. This method is an efficient optimizer inspired by the behaviors of Harris' hawks, which try to catch the rabbits. In some cases, the original version tends to stagnate to the local optimum solutions. Hence, a novel HHO called IHHO is proposed by embedding the salp swarm algorithm (SSA) into the original HHO to improve the search ability of the optimizer and expand the application fields. The update stage in the HHO optimizer, which is performed to update each hawk, is divided into three phases: adjusting population based on SSA to generate SSA-based population, generating hybrid individuals according to SSA-based individual and HHO-based individual, and updating search agent in the light of greedy selection and HHO’s mechanisms. A large group of experiments on many functions is carried out to investigate the efficacy of the proposed optimizer. Based on the overall results, the proposed IHHO can provide a faster convergence speed and maintain a better balance between exploration and exploitation. Moreover, according to the proposed continuous IHHO, a more stable binary IHHO is also constructed as a wrapper-based feature selection (FS) approach. We compare the resulting binary IHHO with other FS methods using well-known benchmark datasets provided by UCI. The experimental results reveal that the proposed IHHO has better accuracy rates over other compared wrapper FS methods. Overall research and analysis confirm the improvement in IHHO because of the suitable exploration capability of SSA.
Similar content being viewed by others
References
Xu Y et al (2019) An efficient chaotic mutative moth-flame-inspired optimizer for global optimization tasks. Expert Syst Appl 129:135–155
Luo J et al (2018) An improved grasshopper optimization algorithm with application to financial stress prediction. Appl Math Model 64:654–668
Heidari AA, Pahlavani P (2017) An efficient modified grey wolf optimizer with Lévy flight for optimization tasks. Appl Soft Comput 60:115–134
Liu G et al (2020) Predicting cervical hyperextension injury: a covariance guided sine cosine support vector machine. IEEE Access 8:46895–46908
Zhang Q et al (2019) Chaos-induced and mutation-driven schemes boosting Salp chains-inspired optimizers. IEEE Access 7:31243–31261
Deng W, Xu J, Zhao H (2019) An improved ant colony optimization algorithm based on hybrid strategies for scheduling problem. IEEE Access 7:20281–20292
Deng W et al (2017) A novel collaborative optimization algorithm in solving complex optimization problems. Soft Comput 21(15):4387–4398
Deng W et al (2020) An improved quantum-inspired differential evolution algorithm for deep belief network. IEEE Trans Instrum Meas. https://doi.org/10.1109/TIM.2020.2983233
Zhao X et al (2014) Feature selection based on improved ant colony optimization for online detection of foreign fiber in cotton. Appl Soft Comput 24:585–596
Wang M, Chen H (2020) Chaotic multi-swarm whale optimizer boosted support vector machine for medical diagnosis. Appl Soft Comput 88:105946
Zhao X et al (2019) Chaos enhanced grey wolf optimization wrapped ELM for diagnosis of paraquat-poisoned patients. Comput Biol Chem 78:481–490
Xu X, Chen H-L (2014) Adaptive computational chemotaxis based on field in bacterial foraging optimization. Soft Comput 18(4):797–807
Shen L et al (2016) Evolving support vector machines using fruit fly optimization for medical data classification. Knowl-Based Syst 96:61–75
Wang M et al (2017) Toward an optimal kernel extreme learning machine using a chaotic moth-flame optimization strategy with applications in medical diagnoses. Neurocomputing 267:69–84
Chen H et al (2020) An enhanced Bacterial Foraging Optimization and its application for training kernel extreme learning machine. Appl Soft Comput 86:105884
Zhang X et al (2019) Robust low-rank tensor recovery with rectification and alignment. IEEE Trans Pattern Anal Mach Intell. https://doi.org/10.1109/tpami.2019.2929043
Chen H et al (2019) A balanced whale optimization algorithm for constrained engineering design problems. Appl Math Model 71:45–59
Luo J et al (2019) Multi-strategy boosted mutative whale-inspired optimization approaches. Appl Math Model 73:109–123
Yu H et al (2020) Chaos-enhanced synchronized bat optimizer. Appl Math Model 77:1201–1215
Chen H et al (2020) Efficient multi-population outpost fruit fly-driven optimizers: framework and advances in support vector machines. Expert Syst Appl 142:500
Chen H, Wang M, Zhao X (2020) A multi-strategy enhanced sine cosine algorithm for global optimization and constrained practical engineering problems. Appl Math Comput 369:124872. https://doi.org/10.1016/j.amc.2019.124872
Zhang X et al (2020) Gaussian mutational chaotic fruit fly-built optimization and feature selection. Expert Syst Appl 141:112976
Gupta S, Deep K (2019) Improved sine cosine algorithm with crossover scheme for global optimization. Knowl-Based Syst 165:374–406
Syed MA, Syed R (2019) Weighted Salp Swarm Algorithm and its applications towards optimal sensor deployment. J King Saud Univ Comput Inf Sci 10:50. https://doi.org/10.1016/j.jksuci.2019.07.005
Mirjalili S (2015) Moth-flame optimization algorithm: a novel nature-inspired heuristic paradigm. Knowl-Based Syst 89:228–249
Kannan S et al (2004) Application of particle swarm optimization technique and its variants to generation expansion planning problem. Electr Power Syst Res 70(3):203–210
Salimi H (2015) Stochastic Fractal Search: a powerful metaheuristic algorithm. Knowl-Based Syst 75:1–18
Kitayama S, Arakawa M, Yamazaki K (2011) Differential evolution as the global optimization technique and its application to structural optimization. Appl Soft Comput 11(4):3792–3803
Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61
Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67
Mirjalili S et al (2017) Salp Swarm Algorithm: a bio-inspired optimizer for engineering design problems. Adv Eng Softw 114:163–191
Mirjalili S (2016) SCA: a Sine Cosine algorithm for solving optimization problems. Knowl-Based Syst 96:120–133
Kiran MS (2017) Particle swarm optimization with a new update mechanism. Appl Soft Comput 60:670–678
Mirjalili S, Mirjalili SM, Hatamlou A (2015) Multi-Verse Optimizer: a nature-inspired algorithm for global optimization. Neural Comput Appl 27(2):495–513
Mirjalili S (2015) The ant lion optimizer. Adv Eng Softw 83:80–98
Saremi S, Mirjalili S, Lewis A (2017) Grasshopper optimisation algorithm: theory and application. Adv Eng Softw 105:30–47
Yang XS, Hossein Gandomi A (2012) Bat algorithm: a novel approach for global engineering optimization. Eng Comput 29(5):464–483
Tighzert L, Fonlupt C, Mendil B (2018) A set of new compact firefly algorithms. Swarm Evol Comput 40:92–115
Pan W-T (2012) A new fruit fly optimization algorithm: taking the financial distress model as an example. Knowl-Based Syst 26:69–74
Li S et al (2020) Slime mould algorithm: a new method for stochastic optimization. Future Generation Computer Systems. https://doi.org/10.1016/j.future.2020.03.055
Yuan X et al (2014) On a novel multi-swarm fruit fly optimization algorithm and its application. Appl Math Comput 233:260–271
Xu Y et al (2019) Enhanced Moth-flame optimizer with mutation strategy for global optimization. Inf Sci 492:181–203
Abd Elaziz M, Oliva D, Xiong S (2017) An improved opposition-based sine cosine algorithm for global optimization. Expert Syst Appl 90:484–500
Kohli M, Arora S (2018) Chaotic grey wolf optimization algorithm for constrained optimization problems. J Comput Des Eng 5(4):458–472
Tian X, Li J (2019) A novel improved fruit fly optimization algorithm for aerodynamic shape design optimization. Knowl-Based Syst 179:77–91
Hegazy AE, Makhlouf MA, El-Tawel GS (2018) Improved salp swarm algorithm for feature selection. J King Saud Univ Comput Inf Sci. https://doi.org/10.1016/j.jksuci.2018.06.003
Singh N, Singh SB (2017) A novel hybrid GWO-SCA approach for optimization problems. Eng Sci Technol Int J 20(6):1586–1601
Chegini SN, Bagheri A, Najafi F (2018) PSOSCALF: a new hybrid PSO based on sine cosine algorithm and levy flight for solving optimization problems. Appl Soft Comput 73:697–726
Mafarja MM, Mirjalili S (2017) Hybrid whale optimization algorithm with simulated annealing for feature selection. Neurocomputing 260:302–312
Moayedi H, Hayati S (2018) Modelling and optimization of ultimate bearing capacity of strip footing near a slope by soft computing methods. Appl Soft Comput 66:208–219. https://doi.org/10.1016/j.asoc.2018.02.027
Moayedi H, Rezaei A (2019) An artificial neural network approach for under-reamed piles subjected to uplift forces in dry sand. Neural Comput Appl 31(2):327–336. https://doi.org/10.1007/s00521-017-2990-z
Moayedi H, Hayati S (2018) Applicability of a CPT-based neural network solution in predicting load-settlement responses of bored pile. Int J Geomech 18(6):06018009. https://doi.org/10.1061/(ASCE)GM.1943-5622.0001125
Qiao W, Moayedi H, Foong LK (2020) Nature-inspired hybrid techniques of IWO, DA, ES, GA, and ICA, validated through a k-fold validation process predicting monthly natural gas consumption. Energy and Buildings 217:110023
Qiao W, Bingfan L, Zhangyang K (2019) Differential scanning calorimetry and electrochemical tests for the analysis of delamination of 3PE coatings. Int J Electrochem Sci 7389–7400
Faris H et al (2018) An efficient binary Salp swarm algorithm with crossover scheme for feature selection problems. Knowl-Based Syst 154:43–67
Chen H et al (2019) An efficient double adaptive random spare reinforced whale optimization algorithm. Expert Syst Appl 201:113018
Chen H et al (2020) Efficient multi-population outpost fruit fly-driven optimizers: framework and advances in support vector machines. Expert Syst Appl 142:112999
Chen H et al (2019) An opposition-based sine cosine approach with local search for parameter estimation of photovoltaic models. Energy Convers Manag 195:927–942
Abbassi A et al (2020) Parameters identification of photovoltaic cell models using enhanced exploratory salp chains-based approach. Energy 20:117333
Tang H et al (2020) Predicting green consumption behaviors of students using efficient firefly grey wolf-assisted k-nearest neighbor classifiers. IEEE Access 8:35546–35562
Zhang H et al (2020) Orthogonal Nelder-Mead moth flame method for parameters identification of photovoltaic modules. Energy Convers Manag 211:112764
Arora S, Anand P (2019) Binary butterfly optimization approaches for feature selection. Expert Syst Appl 116:147–160
Mafarja M et al (2018) Binary dragonfly optimization for feature selection using time-varying transfer functions. Knowl-Based Syst 161:185–204
Baig MZ et al (2017) Differential evolution algorithm as a tool for optimal feature subset selection in motor imagery EEG. Expert Syst Appl 90:184–195
Gu S, Cheng R, Jin Y (2016) Feature selection for high-dimensional classification using a competitive swarm optimizer. Soft Comput 22(3):811–822
Rodrigues D et al (2014) A wrapper approach for feature selection based on Bat Algorithm and Optimum-Path Forest. Expert Syst Appl 41(5):2250–2258
Mafarja M et al (2019) Binary grasshopper optimisation algorithm approaches for feature selection problems. Expert Syst Appl 117:267–286
Arora S et al (2019) A new hybrid algorithm based on grey wolf optimization and crow search algorithm for unconstrained function optimization and feature selection. Ieee Access 7:26343–26361
Zorarpaci E, Ozel SA (2016) A hybrid approach of differential evolution and artificial bee colony for feature selection. Expert Syst Appl 62:91–103
Shunmugapriya P, Kanmani S (2017) A hybrid algorithm using ant and bee colony optimization for feature selection and classification (AC-ABC hybrid). Swarm Evol Comput 36:27–36
Heidari AA et al (2019) Harris hawks optimization: algorithm and applications. Future Gener Comput Syst 97:849–872
Ridha HM et al (2020) Boosted mutation-based Harris hawks optimizer for parameters identification of single-diode solar cell models. Energy Convers Manag 209:112660
Chen H et al (2020) Parameters identification of photovoltaic cells and modules using diversification-enriched Harris hawks optimization with chaotic driftse. J Clean Prod. https://doi.org/10.1016/j.jclepro.2019.118778
Wei Y et al (2020) Predicting entrepreneurial intention of students: an extreme learning machine with gaussian barebone harris hawks optimizer. IEEE Access. https://doi.org/10.1109/ACCESS.2020.2982796
Chen H et al (2020) Multi-population differential evolution-assisted Harris hawks optimization: framework and case studies. Future Gener Comput Syst. https://doi.org/10.1016/j.future.2020.04.008
Abdel ASHE et al (2019) Harmonic overloading minimization of frequency-dependent components in harmonics polluted distribution systems using harris hawks optimization algorithm. IEEE Access 7:100824–100837
Amiri GN, Gao H, Demirel H (2019) Satellite image de-noising with harris hawks meta heuristic optimization algorithm and improved adaptive generalized gaussian distribution threshold function. IEEE Access 7:57459–57468
Qais MH, Hasanien HM, Alghuwainem S (2020) Parameters extraction of three-diode photovoltaic model using computation and Harris hawks optimization. Energy. https://doi.org/10.1016/j.energy.2020.117040
Rodríguez-Esparza E et al (2020) An efficient harris hawks-inspired image segmentation method. Expert Syst Appl 20:113428
Shehabeldeen TA et al (2019) Modeling of friction stir welding process using adaptive neuro-fuzzy inference system integrated with harris hawks optimizer. J Mater Res Technol 8(6):5882–5892
Moayedi H et al (2019) A novel Harris hawks’ optimization and k-fold cross-validation predicting slope stability. Eng Comput 20:19. https://doi.org/10.1007/s00366-019-00828-8
Essa FA, Abd Elaziz M, Elsheikh AH (2020) An enhanced productivity prediction model of active solar still using artificial neural network and Harris hawks optimizer. Appl Thermal Eng 1:70. https://doi.org/10.1016/j.applthermaleng.2020.115020
Houssein EH et al (2020) A novel hybrid Harris hawks optimization and support vector machines for drug design and discovery. Comput Chem Eng. https://doi.org/10.1016/j.compchemeng.2019.106656
Moayedi H et al (2020) Herding Behaviors of grasshopper and Harris hawk for hybridizing the neural network in predicting the soil compression coefficient. Measurement. https://doi.org/10.1016/j.measurement.2019.107389
Ridha HM et al (2020) Boosted mutation-based Harris hawks optimizer for parameters identification of single-diode solar cell models. Energy Convers Manag. https://doi.org/10.1016/j.enconman.2020.112660
Chen H et al (2020) Parameters identification of photovoltaic cells and modules using diversification-enriched Harris hawks optimization with chaotic drifts. J Clean Product. https://doi.org/10.1016/j.jclepro.2019.118778
Yousri D, Allam D, Eteiba MB (2020) Optimal photovoltaic array reconfiguration for alleviating the partial shading influence based on a modified harris hawks optimizer. Energy Conver Manag. https://doi.org/10.1016/j.enconman.2020.112470
Jia H et al (2019) Dynamic Harris hawks optimization with mutation mechanism for satellite image segmentation. Remote Sens. https://doi.org/10.3390/rs11121421
Kamboj VK et al (2020) An intensify Harris hawks optimizer for numerical and engineering optimization problems. Appl Soft Comput. https://doi.org/10.1016/j.asoc.2019.106018
Ewees AA, Elaziz MA (2020) Performance analysis of Chaotic Multi-Verse Harris hawks optimization: a case study on solving engineering problems. Eng Appl Artif Intell. https://doi.org/10.1016/j.engappai.2019.103370
Abbassi A et al (2020) Parameters identification of photovoltaic cell models using enhanced exploratory salp chains-based approach. Energy 198:117333
Gupta S et al (2019) Harmonized salp chain-built optimization. Eng Comput. https://doi.org/10.1007/s00366-019-00871-5
Abbassi R et al (2019) An efficient salp swarm-inspired algorithm for parameters identification of photovoltaic cell models. Energy Convers Manag 179:362–372
Qais MH, Hasanien HM, Alghuwainem S (2019) Enhanced salp swarm algorithm: application to variable speed wind generators. Eng Appl Artif Intell 80:82–96
Ibrahim RA et al (2018) Improved salp swarm algorithm based on particle swarm optimization for feature selection. J Ambient Intell Humaniz Comput 10(8):3155–3169
Neggaz N et al (2020) Boosting salp swarm algorithm by sine cosine algorithm and disrupt operator for feature selection. Expert Syst Appl. https://doi.org/10.1016/j.eswa.2019.113103
Tubishat M et al (2020) Improved Salp Swarm Algorithm based on opposition based learning and novel local search algorithm for feature selection. Expert Syst Appl. https://doi.org/10.1016/j.eswa.2019.113122
Hussien AG, Hassanien AE, Houssein EH (2017) Swarming behaviour of salps algorithm for predicting chemical compound activities. In: 2017 eighth international conference on intelligent computing and information systems (ICICIS), pp 315–320
El-Fergany AA (2018) Extracting optimal parameters of PEM fuel cells using Salp Swarm optimizer. Renew Energy 119:641–648
Asaithambi S, Rajappa M (2018) Swarm intelligence-based approach for optimal design of CMOS differential amplifier and comparator circuit using a hybrid salp swarm algorithm. Rev Sci Instrum 89(5):054702
Gao W, Wu H, Siddiqui MK, Baig AQ (2018) Study of biological networks using graph theory. Saudi J Biol Sci 25(6):1212–1219
Xu Z et al (2020) Orthogonally-designed adapted grasshopper optimization: a comprehensive analysis. Expert Syst Appl 150:113282
Gao W, Wang W, Dimitrov D, Wang Y (2018) Nano properties analysis via fourth multiplicative ABC indicator calculating. Arab J Chem 11(6):793–801
Wei G, Guirao JLG, Basavanagoud B, Jianzhang Wu (2018) Partial multi-dividing ontology learning algorithm. Inform Sci 467:35-58
Gao W, Guirao JLG, Abdel-Aty M, Xi W (2019) An independent set degree condition for fractional critical deleted graphs discrete & continuous dynamical systems-S. vol.12, no. 4&5, pp 877–886
Jingqiao Z, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958
Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417
Brest J et al (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(6):646–657
Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans Evol Comput 15(1):55–66
Tanabe R, Fukunaga AS (2014) Improving the search performance of SHADE using linear population size reduction. IEEE Congress Evol Comput (CEC) 2014:1658–1665
Chen W-N et al (2013) Particle swarm optimization with an aging leader and challengers. IEEE Trans Evol Comput 17(2):241–258
Liang JJ et al (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans Evol Comput 10(3):281–295
Zhao X et al (2016) An efficient and effective automatic recognition system for online recognition of foreign fibers in cotton. IEEE Access 4:8465–8475
Lynn N, Suganthan PN (2015) Heterogeneous comprehensive learning particle swarm optimization with enhanced exploration and exploitation. Swarm Evol Comput 24:11–24
Lynn N, Suganthan PN (2017) Ensemble particle swarm optimizer. Appl Soft Comput 55:533–548
Ratnaweera A, Halgamuge SK, Watson HC (2004) Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients. IEEE Trans Evol Comput 8(3):240–255
Emary E, Zawbaa HM, Hassanien AE (2016) Binary grey wolf optimization approaches for feature selection. Neurocomputing 172:371–381
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of interest
The authors declare that there is no conflict of interests regarding the publication of article.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhang, Y., Liu, R., Wang, X. et al. Boosted binary Harris hawks optimizer and feature selection. Engineering with Computers 37, 3741–3770 (2021). https://doi.org/10.1007/s00366-020-01028-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00366-020-01028-5