Abstract
Space weather profoundly impacts Earth and its surrounding space environment, necessitating improved prediction to safeguard critical infrastructure such as communication and satellites. Solar flares can disrupt communications and pose radiation risks to airline passengers. While traditional methods offer rough estimates of solar activity trends, the potential of artificial intelligence in this domain warrants exploration. This study addresses this research gap by evaluating the performance of recurrent neural networks (RNNs) for sunspot forecasting and assessing the suitability of extreme gradient boosting (XGBoost) for solar event classification. Two publicly available datasets serve as the foundation for this research. To enhance algorithm performance through optimal hyperparameter selection, metaheuristic optimizers are employed. A unique contribution is the introduction of a modified particle swarm optimization algorithm, specifically tailored to the study’s needs. Two experiments were conducted: In the first, RNNs predicted sunspot occurrence up to three steps ahead. The best-performing model, optimized using the introduced modified metaheuristic, achieved an impressive \(R^2\) value of 0.840448, surpassing competing algorithms. In the second experiment, XGBoost models assessed solar flare severity, with the top model again optimized by the modified metaheuristic, achieving an accuracy of 0.981565. This novel approach highlights the potential for enhancing solar activity forecasting techniques and offers valuable insights into feature impacts on model decisions, thereby advancing our understanding of space weather.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
The datasets analyzed during the current study are available in the following URLs https://www.kaggle.com/datasets/robervalt/sunspots and https://zenodo.org/record/4603412.
References
Abbasi S, Choukolaei HA (2023) A systematic review of green supply chain network design literature focusing on carbon policy. Decis Anal J 6:100189
Abbasi S, Erdebilli B (2023) Green closed-loop supply chain networks’ response to various carbon policies during covid-19. Sustainability 15(4):3677
Abbasi S, Daneshmand-Mehr M, Kanafi AG (2023a) Designing a tri-objective, sustainable, closed-loop, and multi-echelon supply chain during the covid-19 and lockdowns. Found Comput Decis Sci 48(3):269–312
Abbasi S, Zahmatkesh S, Bokhari A, Hajiaghaei-Keshteli M (2023b) Designing a vaccine supply chain network considering environmental aspects. J Clean Prod 417:137935
Abbasi S, Daneshmand-Mehr M, Ghane Kanafi A (2023c) Green closed-loop supply chain network design during the coronavirus (covid-19) pandemic: a case study in the Iranian automotive industry. Environ Model Assess 28(1):69–103
Abbasi S, Sıcakyüz Ç, Erdebilli B (2023d) Designing the home healthcare supply chain during a health crisis. J Eng Res. https://doi.org/10.1016/j.jer.2023.100098
Abualigah L, Abd Elaziz M, Sumari P, Geem ZW, Gandomi AH (2022) Reptile search algorithm (RSA): a nature-inspired meta-heuristic optimizer. Expert Syst Appl 191:116158
AlHosni N, Jovanovic L, Antonijevic M, Bukumira M, Zivkovic M, Strumberger I, Mani JP, Bacanin N (2022) The xgboost model for network intrusion detection boosted by enhanced sine cosine algorithm. In: Third international conference on image processing and capsule networks: ICIPCN 2022. Springer, Berlin, pp 213–228
Aziz RM (2022) Application of nature inspired soft computing techniques for gene selection: a novel frame work for classification of cancer. Soft Comput 26(22):12179–12196
Bacanin N, Jovanovic L, Zivkovic M, Kandasamy V, Antonijevic M, Deveci M, Strumberger I (2023) Multivariate energy forecasting via metaheuristic tuned long-short term memory and gated recurrent unit neural networks. Inf Sci 642:119122
Berghmans D, Clette F, Cugnon P, Gabryl J-R, Hochedez J-F, Linden R, Verwichte E (2002) The solar influences data analysis centre. J Atmos Solar Terr Phys 64(5–6):757–761
Buzulukova N, Tsurutani B (2022) Space weather: from solar origins to risks and hazards evolving in time. arXiv:2212.11504
Chakraborty A, Kar AK (2017) Swarm intelligence: a review of algorithms. In: Patnaik S, Yang X-S, Nakamatsu K (eds) Nature-inspired computing and optimization: theory and applications. Springer, Berlin, pp 475–494
Chen T, Guestrin C (2016) Xgboost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 785–794
Cliver EW, Schrijver CJ, Shibata K, Usoskin IG (2022) Extreme solar events. Living Rev Sol Phys 19(1):2
Covert I, Lundberg SM, Lee S-I (2020) Understanding global feature contributions with additive importance measures. Adv Neural Inf Process Syst 33:17212–17223
Delgado R, Tibau X-A (2019) Why Cohen’s kappa should be avoided as performance measure in classification. PLoS ONE 14(9):0222916
Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18
Dokeroglu T, Sevinc E, Kucukyilmaz T, Cosar A (2019) A survey on new generation metaheuristic algorithms. Comput Ind Eng 137:106040
Domingo V, Fleck B, Poland A (1995) Soho: the solar and heliospheric observatory. Space Sci Rev 72:81–84
Eftimov T, Korošec P, Seljak BK (2016) Disadvantages of statistical comparison of stochastic optimization algorithms. In: Proceedings of the bioinspired optimizaiton methods and their applications, BIOMA, pp 105–118
Emrouznejad A, Abbasi S, Sıcakyüz Ç (2023) Supply chain risk management: a content analysis-based review of existing and emerging topics. Supply Chain Anal 3:100031
Gajevic M, Milutinovic N, Krstovic J, Jovanovic L, Marjanovic M, Stoean C (2023) Artificial neural network tuning by improved sine cosine algorithm for healthcare 4.0. In: Proceedings of the 1st international conference on innovation in information technology and business (ICIITB 2022), vol 104. Springer Nature, p 289
Gonzalez EDS, Abbasi S, Azhdarifard M (2023) Designing a reliable aggregate production planning problem during the disaster period. Sustain Oper Comput 4:158–171
Gurrola-Ramos J, Hernàndez-Aguirre A, Dalmau-Cedeño O (2020) Colshade for real-world single-objective constrained optimization problems. In: 2020 IEEE congress on evolutionary computation (CEC). IEEE, pp 1–8
Hathaway DH (2008) Solar cycle forecasting. In: Thompson MJ, Balogh A, Culhane JL, Nordlund Å, Solanki SK, Zahn JP (eds) The origin and dynamics of solar magnetism. space sciences series of ISSI, vol 32. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-0239-9_20
Hayakawa H, Suzuki D, Mathieu S, Lefèvre L, Takuma H, Hiei E (2023) Sunspot observations at Kawaguchi Science Museum: 1972–2013. Geosci Data J 10(1):87–98
Hensley K (2022) Understanding magnetic knots in delta sunspots. AAS Nova Highlights, p 10222
Hollanda A, Silva AEA, Cinto T (2021) Data set for solar flare prediction using HMI data. https://doi.org/10.5281/zenodo.4603412
Jovanovic L, Jovanovic D, Bacanin N, Jovancai Stakic A, Antonijevic M, Magd H, Thirumalaisamy R, Zivkovic M (2022a) Multi-step crude oil price prediction based on lstm approach tuned by salp swarm algorithm with disputation operator. Sustainability 14(21):14616
Jovanovic L, Bacanin N, Antonijevic M, Tuba E, Ivanovic M, Venkatachalam K (2022b) Plant classification using firefly algorithm and support vector machine. In: 2022 IEEE zooming innovation in consumer technologies conference (ZINC). IEEE, pp 255–260
Jovanovic L, Zivkovic M, Antonijevic M, Jovanovic D, Ivanovic M, Jassim HS (2022c) An emperor penguin optimizer application for medical diagnostics. In: 2022 IEEE zooming innovation in consumer technologies conference (ZINC). IEEE, pp 191–196
Jovanovic L, Jovanovic G, Perisic M, Alimpic F, Stanisic S, Bacanin N, Zivkovic M, Stojic A (2023) The explainable potential of coupling metaheuristics-optimized-xgboost and shap in revealing vocs’ environmental fate. Atmosphere 14(1):109
Karaboga D, Basturk B (2008) On the performance of artificial bee colony (ABC) algorithm. Appl Soft Comput 8(1):687–697
Kolarski A, Sreckovic V, Mijic Z (2022) Monitoring solar activity during 23/24 solar cycle minimum through VLF radio signals. Contrib Astron Obs Skalnaté Pleso 52(3):105–115
Li Z, Liu F, Yang W, Peng S, Zhou J (2021) A survey of convolutional neural networks: analysis, applications, and prospects. IEEE Trans Neural Netw Learn Syst 33:6999–7019
Lim B, Zohren S (2021) Time-series forecasting with deep learning: a survey. Philos Trans R Soc A 379(2194):20200209
Lundberg SM, Lee S-I (2017) A unified approach to interpreting model predictions. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R (eds) Advances in neural information processing systems, vol 30. Curran Associates Inc., Red Hook, pp 4765–4774
Medsker LR, Jain L (2001) Recurrent neural networks. Des Appl 5:64–67
Mirjalili S (2016) Sca: a sine cosine algorithm for solving optimization problems. Knowl Based Syst 96:120–133
Mirjalili S (2019) Evolutionary algorithms and neural networks. In: Studies in computational intelligence, vol 780. Springer, Berlin, Heidelberg, Germany. https://doi.org/10.1007/978-3-319-93025-1
Miteva R, Samwel SW (2022) M-class solar flares in solar cycles 23 and 24: properties and space weather relevance. Universe 8(1):39
Mohamed AW, Sallam KM, Agrawal P, Hadi AA, Mohamed AK (2023) Evaluating the performance of meta-heuristic algorithms on CEC 2021 benchmark problems. Neural Comput Appl 35(2):1493–1517
Moldwin M (2022) An introduction to space weather. Cambridge University Press, Cambridge
Nakariakov VM, Kolotkov DY (2020) Magnetohydrodynamic waves in the solar corona. Ann Rev Astron Astrophys 58:441–481
Naruei I, Keynia F, Sabbagh Molahosseini A (2022) Hunter-prey optimization: algorithm and applications. Soft Comput 26(3):1279–1314
Oliveira DM, Zesta E (2019) Satellite orbital drag during magnetic storms. Space Weather 17(11):1510–1533
Pesnell WD, Thompson BJ, Chamberlin P (2012) The solar dynamics observatory (SDO). Springer, Berlin
Petrovay K (2020) Solar cycle prediction. Living Rev Sol Phys 17(1):2
Petrovic A, Antonijevic M, Strumberger I, Jovanovic L, Savanovic N, Janicijevic S (2023) The xgboost approach tuned by tlb metaheuristics for fraud detection. In: Proceedings of the 1st international conference on innovation in information technology and business (ICIITB 2022), vol 104. Springer Nature, p 219
Rao S, Chakraborty M (2022) Ionospheric disturbances during x1. 5 class solar flare of 3 July 2021. In: 2022 URSI regional conference on radio science (USRI-RCRS). IEEE, pp 1–4
Strumberger I, Bezdan T, Ivanovic M, Jovanovic L (2021) Improving energy usage in wireless sensor networks by whale optimization algorithm. In: 2021 29th telecommunications forum (TELFOR). IEEE, pp 1–4
SWPC. Space weather operations (SWO): daily observations. National Oceanic and Atmospheric Administration. https://www.swpc.noaa.gov/products/solar-cycle-progression
Szarkowski E (2023) Effects of solar flare activity on GPS satellite timing sources. In: Proceedings of the 54th annual precise time and time interval systems and applications meeting, pp 48–54
Tlatov AG (2022) The shape of sunspots and solar activity cycles. Sol Phys 297(8):110
Wang D, Tan D, Liu L (2018) Particle swarm optimization algorithm: an overview. Soft Comput 22:387–408
Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82
Wu C, Khishe M, Mohammadi M, Taher Karim SH, Rashid TA (2023) Evolving deep convolutional neutral network by hybrid sine-cosine and extreme learning machine for real-time covid19 diagnosis from x-ray images. Soft Comput 27(6):3307–3326
Xu X, Wang Y, Wei F, Feng X, Bo M, Tang H, Wang D, Bian L, Wang B, Zhang W et al (2023) Characteristics of flight delays during solar flares. Sci Rep 13(1):6101
Yang X-S, Hossein Gandomi A (2012) Bat algorithm: a novel approach for global engineering optimization. Eng Comput 29(5):464–483
Yang X-S, Slowik A (2020) Firefly algorithm. In: Yang XS, Slowik A (eds) Swarm intelligence algorithms. CRC Press, Boca Raton, pp 163–174
Zheng Y, Li X, Wang X (2019) Solar flare prediction with the hybrid deep convolutional neural network. Astrophys J 885(1):73
Zivkovic M, Jovanovic L, Ivanovic M, Bacanin N, Strumberger I, Joseph PM (2022) Xgboost hyperparameters tuning by fitness-dependent optimizer for network intrusion detection. In: Communication and intelligent systems: proceedings of ICCIS 2021. Springer, Berlin, pp 947–962
Funding
This research was supported by the Ministry of Education, Science and Technological Development of Republic of Serbia, under Grant No. III-44006. This research was supported by the Science Fund of the Republic of Serbia, Grant No. 7373, Characterizing crises-caused air pollution alternations using an artificial intelligence-based framework - crAIRsis.
Author information
Authors and Affiliations
Contributions
NB and LJ—experiments and writing original draft; VS—review and editing; JM—validation; MZ—visualization and writing original draft; MS—data acquisition and preparation.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no relevant financial or non-financial interests to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Jovanovic, L., Bacanin, N., Simic, V. et al. Optimizing machine learning for space weather forecasting and event classification using modified metaheuristics. Soft Comput 28, 6383–6402 (2024). https://doi.org/10.1007/s00500-023-09496-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-023-09496-9