Optimizing machine learning for space weather forecasting and event classification using modified metaheuristics | Soft Computing Skip to main content

Advertisement

Log in

Optimizing machine learning for space weather forecasting and event classification using modified metaheuristics

  • Application of soft computing
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Space weather profoundly impacts Earth and its surrounding space environment, necessitating improved prediction to safeguard critical infrastructure such as communication and satellites. Solar flares can disrupt communications and pose radiation risks to airline passengers. While traditional methods offer rough estimates of solar activity trends, the potential of artificial intelligence in this domain warrants exploration. This study addresses this research gap by evaluating the performance of recurrent neural networks (RNNs) for sunspot forecasting and assessing the suitability of extreme gradient boosting (XGBoost) for solar event classification. Two publicly available datasets serve as the foundation for this research. To enhance algorithm performance through optimal hyperparameter selection, metaheuristic optimizers are employed. A unique contribution is the introduction of a modified particle swarm optimization algorithm, specifically tailored to the study’s needs. Two experiments were conducted: In the first, RNNs predicted sunspot occurrence up to three steps ahead. The best-performing model, optimized using the introduced modified metaheuristic, achieved an impressive \(R^2\) value of 0.840448, surpassing competing algorithms. In the second experiment, XGBoost models assessed solar flare severity, with the top model again optimized by the modified metaheuristic, achieving an accuracy of 0.981565. This novel approach highlights the potential for enhancing solar activity forecasting techniques and offers valuable insights into feature impacts on model decisions, thereby advancing our understanding of space weather.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Fig. 1
Algorithm 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

The datasets analyzed during the current study are available in the following URLs https://www.kaggle.com/datasets/robervalt/sunspots and https://zenodo.org/record/4603412.

Notes

  1. https://www.kaggle.com/datasets/robervalt/sunspots.

  2. https://zenodo.org/record/4603412.

References

  • Abbasi S, Choukolaei HA (2023) A systematic review of green supply chain network design literature focusing on carbon policy. Decis Anal J 6:100189

  • Abbasi S, Erdebilli B (2023) Green closed-loop supply chain networks’ response to various carbon policies during covid-19. Sustainability 15(4):3677

    Article  Google Scholar 

  • Abbasi S, Daneshmand-Mehr M, Kanafi AG (2023a) Designing a tri-objective, sustainable, closed-loop, and multi-echelon supply chain during the covid-19 and lockdowns. Found Comput Decis Sci 48(3):269–312

  • Abbasi S, Zahmatkesh S, Bokhari A, Hajiaghaei-Keshteli M (2023b) Designing a vaccine supply chain network considering environmental aspects. J Clean Prod 417:137935

  • Abbasi S, Daneshmand-Mehr M, Ghane Kanafi A (2023c) Green closed-loop supply chain network design during the coronavirus (covid-19) pandemic: a case study in the Iranian automotive industry. Environ Model Assess 28(1):69–103

  • Abbasi S, Sıcakyüz Ç, Erdebilli B (2023d) Designing the home healthcare supply chain during a health crisis. J Eng Res. https://doi.org/10.1016/j.jer.2023.100098

  • Abualigah L, Abd Elaziz M, Sumari P, Geem ZW, Gandomi AH (2022) Reptile search algorithm (RSA): a nature-inspired meta-heuristic optimizer. Expert Syst Appl 191:116158

    Article  Google Scholar 

  • AlHosni N, Jovanovic L, Antonijevic M, Bukumira M, Zivkovic M, Strumberger I, Mani JP, Bacanin N (2022) The xgboost model for network intrusion detection boosted by enhanced sine cosine algorithm. In: Third international conference on image processing and capsule networks: ICIPCN 2022. Springer, Berlin, pp 213–228

  • Aziz RM (2022) Application of nature inspired soft computing techniques for gene selection: a novel frame work for classification of cancer. Soft Comput 26(22):12179–12196

    Article  Google Scholar 

  • Bacanin N, Jovanovic L, Zivkovic M, Kandasamy V, Antonijevic M, Deveci M, Strumberger I (2023) Multivariate energy forecasting via metaheuristic tuned long-short term memory and gated recurrent unit neural networks. Inf Sci 642:119122

    Article  Google Scholar 

  • Berghmans D, Clette F, Cugnon P, Gabryl J-R, Hochedez J-F, Linden R, Verwichte E (2002) The solar influences data analysis centre. J Atmos Solar Terr Phys 64(5–6):757–761

    Article  Google Scholar 

  • Buzulukova N, Tsurutani B (2022) Space weather: from solar origins to risks and hazards evolving in time. arXiv:2212.11504

  • Chakraborty A, Kar AK (2017) Swarm intelligence: a review of algorithms. In: Patnaik S, Yang X-S, Nakamatsu K (eds) Nature-inspired computing and optimization: theory and applications. Springer, Berlin, pp 475–494

    Chapter  Google Scholar 

  • Chen T, Guestrin C (2016) Xgboost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 785–794

  • Cliver EW, Schrijver CJ, Shibata K, Usoskin IG (2022) Extreme solar events. Living Rev Sol Phys 19(1):2

    Article  Google Scholar 

  • Covert I, Lundberg SM, Lee S-I (2020) Understanding global feature contributions with additive importance measures. Adv Neural Inf Process Syst 33:17212–17223

    Google Scholar 

  • Delgado R, Tibau X-A (2019) Why Cohen’s kappa should be avoided as performance measure in classification. PLoS ONE 14(9):0222916

    Article  Google Scholar 

  • Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18

    Article  Google Scholar 

  • Dokeroglu T, Sevinc E, Kucukyilmaz T, Cosar A (2019) A survey on new generation metaheuristic algorithms. Comput Ind Eng 137:106040

    Article  Google Scholar 

  • Domingo V, Fleck B, Poland A (1995) Soho: the solar and heliospheric observatory. Space Sci Rev 72:81–84

    Article  Google Scholar 

  • Eftimov T, Korošec P, Seljak BK (2016) Disadvantages of statistical comparison of stochastic optimization algorithms. In: Proceedings of the bioinspired optimizaiton methods and their applications, BIOMA, pp 105–118

  • Emrouznejad A, Abbasi S, Sıcakyüz Ç (2023) Supply chain risk management: a content analysis-based review of existing and emerging topics. Supply Chain Anal 3:100031

    Article  Google Scholar 

  • Gajevic M, Milutinovic N, Krstovic J, Jovanovic L, Marjanovic M, Stoean C (2023) Artificial neural network tuning by improved sine cosine algorithm for healthcare 4.0. In: Proceedings of the 1st international conference on innovation in information technology and business (ICIITB 2022), vol 104. Springer Nature, p 289

  • Gonzalez EDS, Abbasi S, Azhdarifard M (2023) Designing a reliable aggregate production planning problem during the disaster period. Sustain Oper Comput 4:158–171

    Article  Google Scholar 

  • Gurrola-Ramos J, Hernàndez-Aguirre A, Dalmau-Cedeño O (2020) Colshade for real-world single-objective constrained optimization problems. In: 2020 IEEE congress on evolutionary computation (CEC). IEEE, pp 1–8

  • Hathaway DH (2008) Solar cycle forecasting. In: Thompson MJ, Balogh A, Culhane JL, Nordlund Å, Solanki SK, Zahn JP (eds) The origin and dynamics of solar magnetism. space sciences series of ISSI, vol 32. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-0239-9_20

  • Hayakawa H, Suzuki D, Mathieu S, Lefèvre L, Takuma H, Hiei E (2023) Sunspot observations at Kawaguchi Science Museum: 1972–2013. Geosci Data J 10(1):87–98

    Article  Google Scholar 

  • Hensley K (2022) Understanding magnetic knots in delta sunspots. AAS Nova Highlights, p 10222

  • Hollanda A, Silva AEA, Cinto T (2021) Data set for solar flare prediction using HMI data. https://doi.org/10.5281/zenodo.4603412

  • Jovanovic L, Jovanovic D, Bacanin N, Jovancai Stakic A, Antonijevic M, Magd H, Thirumalaisamy R, Zivkovic M (2022a) Multi-step crude oil price prediction based on lstm approach tuned by salp swarm algorithm with disputation operator. Sustainability 14(21):14616

  • Jovanovic L, Bacanin N, Antonijevic M, Tuba E, Ivanovic M, Venkatachalam K (2022b) Plant classification using firefly algorithm and support vector machine. In: 2022 IEEE zooming innovation in consumer technologies conference (ZINC). IEEE, pp 255–260

  • Jovanovic L, Zivkovic M, Antonijevic M, Jovanovic D, Ivanovic M, Jassim HS (2022c) An emperor penguin optimizer application for medical diagnostics. In: 2022 IEEE zooming innovation in consumer technologies conference (ZINC). IEEE, pp 191–196

  • Jovanovic L, Jovanovic G, Perisic M, Alimpic F, Stanisic S, Bacanin N, Zivkovic M, Stojic A (2023) The explainable potential of coupling metaheuristics-optimized-xgboost and shap in revealing vocs’ environmental fate. Atmosphere 14(1):109

    Article  Google Scholar 

  • Karaboga D, Basturk B (2008) On the performance of artificial bee colony (ABC) algorithm. Appl Soft Comput 8(1):687–697

    Article  Google Scholar 

  • Kolarski A, Sreckovic V, Mijic Z (2022) Monitoring solar activity during 23/24 solar cycle minimum through VLF radio signals. Contrib Astron Obs Skalnaté Pleso 52(3):105–115

    Google Scholar 

  • Li Z, Liu F, Yang W, Peng S, Zhou J (2021) A survey of convolutional neural networks: analysis, applications, and prospects. IEEE Trans Neural Netw Learn Syst 33:6999–7019

    Article  MathSciNet  Google Scholar 

  • Lim B, Zohren S (2021) Time-series forecasting with deep learning: a survey. Philos Trans R Soc A 379(2194):20200209

    Article  MathSciNet  Google Scholar 

  • Lundberg SM, Lee S-I (2017) A unified approach to interpreting model predictions. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R (eds) Advances in neural information processing systems, vol 30. Curran Associates Inc., Red Hook, pp 4765–4774

    Google Scholar 

  • Medsker LR, Jain L (2001) Recurrent neural networks. Des Appl 5:64–67

    Google Scholar 

  • Mirjalili S (2016) Sca: a sine cosine algorithm for solving optimization problems. Knowl Based Syst 96:120–133

    Article  Google Scholar 

  • Mirjalili S (2019) Evolutionary algorithms and neural networks. In: Studies in computational intelligence, vol 780. Springer, Berlin, Heidelberg, Germany. https://doi.org/10.1007/978-3-319-93025-1

  • Miteva R, Samwel SW (2022) M-class solar flares in solar cycles 23 and 24: properties and space weather relevance. Universe 8(1):39

    Article  Google Scholar 

  • Mohamed AW, Sallam KM, Agrawal P, Hadi AA, Mohamed AK (2023) Evaluating the performance of meta-heuristic algorithms on CEC 2021 benchmark problems. Neural Comput Appl 35(2):1493–1517

    Article  Google Scholar 

  • Moldwin M (2022) An introduction to space weather. Cambridge University Press, Cambridge

    Book  Google Scholar 

  • Nakariakov VM, Kolotkov DY (2020) Magnetohydrodynamic waves in the solar corona. Ann Rev Astron Astrophys 58:441–481

    Article  Google Scholar 

  • Naruei I, Keynia F, Sabbagh Molahosseini A (2022) Hunter-prey optimization: algorithm and applications. Soft Comput 26(3):1279–1314

  • Oliveira DM, Zesta E (2019) Satellite orbital drag during magnetic storms. Space Weather 17(11):1510–1533

    Article  Google Scholar 

  • Pesnell WD, Thompson BJ, Chamberlin P (2012) The solar dynamics observatory (SDO). Springer, Berlin

    Book  Google Scholar 

  • Petrovay K (2020) Solar cycle prediction. Living Rev Sol Phys 17(1):2

    Article  Google Scholar 

  • Petrovic A, Antonijevic M, Strumberger I, Jovanovic L, Savanovic N, Janicijevic S (2023) The xgboost approach tuned by tlb metaheuristics for fraud detection. In: Proceedings of the 1st international conference on innovation in information technology and business (ICIITB 2022), vol 104. Springer Nature, p 219

  • Rao S, Chakraborty M (2022) Ionospheric disturbances during x1. 5 class solar flare of 3 July 2021. In: 2022 URSI regional conference on radio science (USRI-RCRS). IEEE, pp 1–4

  • Strumberger I, Bezdan T, Ivanovic M, Jovanovic L (2021) Improving energy usage in wireless sensor networks by whale optimization algorithm. In: 2021 29th telecommunications forum (TELFOR). IEEE, pp 1–4

  • SWPC. Space weather operations (SWO): daily observations. National Oceanic and Atmospheric Administration. https://www.swpc.noaa.gov/products/solar-cycle-progression

  • Szarkowski E (2023) Effects of solar flare activity on GPS satellite timing sources. In: Proceedings of the 54th annual precise time and time interval systems and applications meeting, pp 48–54

  • Tlatov AG (2022) The shape of sunspots and solar activity cycles. Sol Phys 297(8):110

    Article  Google Scholar 

  • Wang D, Tan D, Liu L (2018) Particle swarm optimization algorithm: an overview. Soft Comput 22:387–408

    Article  Google Scholar 

  • Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82

    Article  Google Scholar 

  • Wu C, Khishe M, Mohammadi M, Taher Karim SH, Rashid TA (2023) Evolving deep convolutional neutral network by hybrid sine-cosine and extreme learning machine for real-time covid19 diagnosis from x-ray images. Soft Comput 27(6):3307–3326

    Article  Google Scholar 

  • Xu X, Wang Y, Wei F, Feng X, Bo M, Tang H, Wang D, Bian L, Wang B, Zhang W et al (2023) Characteristics of flight delays during solar flares. Sci Rep 13(1):6101

    Article  Google Scholar 

  • Yang X-S, Hossein Gandomi A (2012) Bat algorithm: a novel approach for global engineering optimization. Eng Comput 29(5):464–483

    Article  Google Scholar 

  • Yang X-S, Slowik A (2020) Firefly algorithm. In: Yang XS, Slowik A (eds) Swarm intelligence algorithms. CRC Press, Boca Raton, pp 163–174

    Chapter  Google Scholar 

  • Zheng Y, Li X, Wang X (2019) Solar flare prediction with the hybrid deep convolutional neural network. Astrophys J 885(1):73

    Article  Google Scholar 

  • Zivkovic M, Jovanovic L, Ivanovic M, Bacanin N, Strumberger I, Joseph PM (2022) Xgboost hyperparameters tuning by fitness-dependent optimizer for network intrusion detection. In: Communication and intelligent systems: proceedings of ICCIS 2021. Springer, Berlin, pp 947–962

Download references

Funding

This research was supported by the Ministry of Education, Science and Technological Development of Republic of Serbia, under Grant No. III-44006. This research was supported by the Science Fund of the Republic of Serbia, Grant No. 7373, Characterizing crises-caused air pollution alternations using an artificial intelligence-based framework - crAIRsis.

Author information

Authors and Affiliations

Authors

Contributions

NB and LJ—experiments and writing original draft; VS—review and editing; JM—validation; MZ—visualization and writing original draft; MS—data acquisition and preparation.

Corresponding author

Correspondence to Nebojsa Bacanin.

Ethics declarations

Conflict of interest

The authors have no relevant financial or non-financial interests to disclose.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jovanovic, L., Bacanin, N., Simic, V. et al. Optimizing machine learning for space weather forecasting and event classification using modified metaheuristics. Soft Comput 28, 6383–6402 (2024). https://doi.org/10.1007/s00500-023-09496-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-023-09496-9

Keywords

Navigation