Hurricane-Faster R-CNN-JS: Hurricane detection with faster R-CNN using artificial Jellyfish Search (JS) optimizer | Multimedia Tools and Applications
Skip to main content
Springer Nature Link
Log in

Hurricane-Faster R-CNN-JS: Hurricane detection with faster R-CNN using artificial Jellyfish Search (JS) optimizer

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

A hurricane is a type of storm called tropical cyclone (TC) and is likely to lead to severe storms and heavy rains. An early detection of hurricanes using satellite images can alarm people about upcoming disasters and thus minimize any casualties and material losses. Faster R-CNN is one of the most popular and recent object detection approaches. In the present study, AlexNet hyperparameters, which is a CNN model used as a feature extractor in Faster R-CNN, were optimized using artificial Jellyfish Search (JS), which is a recent algorithm, in order to propose a Faster R-CNN with a higher performance. The proposed approach is called Hurricane-Faster R-CNN-JS, since it is used as an early hurricane detection approach on satellite images before these hurricanes reach the land. The results of the present study demonstrated that hyperparameter optimization increased the detection performance of the proposed approach by 10% compared to AlexNet without optimized hyperparameters. As feature extractors of Faster R-CNN, the present study benefited from various architectures such as MobileNet-V2, GoogLeNet, AlexNet, ResNet 18, ResNet 50, VGG-16 and VGG-19 without any optimized hyperparameters to compare them with the proposed approach. It was observed that Average Precision (AP) of Hurricane-Faster R-CNN-JS was 97.39%, which was a remarkably higher AP level compared to other approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Alemany S, Beltran J, Perez A, Ganzfried S (2018) Predicting hurricane trajectories using a recurrent neural network. In arXiv:1802.02548v2, 2

  2. Asthana T, Krim H, Sun X, Roheda S, Xie L (2021) Atlantic hurricane activity prediction: a machine learning approach. Atmosphere 12(4):455

    Article  Google Scholar 

  3. Bai X, Wang C, Li C (2019) A streampath-based RCNN approach to ocean eddy detection. IEEE Access 7:106336–106345

    Article  Google Scholar 

  4. Bretschneider T, Odej K (2015)Content-based image retrieval. Ency- clopedia of Data Ware Housing Mining. Idea Group Publishing, Hershey, pp 212–216

    Google Scholar 

  5. Cao C, Wang B, Zhang W, Zeng X, Yan X, Feng Z, … Wu Z (2019) An improved faster R-CNN for small object detection. IEEE Access 7:106838–106846

  6. Chen R, Wang X, Zhang W, Zhu X, Li A, Yang C (2019) A hybrid CNN-LSTM model for typhoon formation forecasting. GeoInformatica 23(3):375–396

    Article  Google Scholar 

  7. Chou JS, Truong DN (2021) A novel metaheuristic optimizer inspired by behavior of jellyfish in ocean. Appl Math Comput 389:125535

    MathSciNet  MATH  Google Scholar 

  8. Dai X, Hu J, Zhang H, Shitu A, Luo C, Osman A, … Duan Y (2021)Multi-task faster R-CNN for nighttime pedestrian detection and distance estimation. Infrared Phys Technol 115:103694

  9. Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for ac- curate object detection and semantic segmentation. In: Conference on Com- puter Vision and Pattern Recognition (CVPR), IEEE, Columbus, pp 580–587

  10. Gonçalves DN, de Moares Weber VA, Pistori JGB, da Costa Gomes R, de Araujo AV, Pereira MF, ... Pistori H (2021) Carcass image segmentation using CNN-based methods. Inf Process Agric 8(4):560–572

  11. Hassan BA, Rashid TA (2020) Operational framework for recent advances in backtracking search optimisation algorithm: a systematic review and performance evaluation. Appl Math Comput 370:124919

    MathSciNet  MATH  Google Scholar 

  12. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  13. Hossain D, Capi G, Jindai M (2016) Object recognition and robot grasp- ing: A deep learning based approach. In: Proc. 34th Annu. Conf. Robot. Soc. Jpn. (RSJ), Yamagata, Japan, pp 1–5

  14. Huang H, Zhou H, Yang X, Zhang L, Qi L, Zang AY (2019) Faster R-CNN for marine organisms detection and recognition using data augmentation. Neurocomputing 337:372–384

    Article  Google Scholar 

  15. Huang, H., Wang, C., Liu, S., Sun, Z., Zhang, D., Liu, C., … Xu, R. (2020). Single spectral imagery and faster R-CNN to identify hazardous and noxious substances spills. Environ Pollut 258:113688

  16. Hussain KF, Sayed HA (2013) Enhancement of sky and cloud type classification. In: Proceedings of the international conference on intelligent systems and image processing, pp 179–185

  17. Jaworska T (2018) Image segment classification using CNN. In: International Workshop on Intuitionistic Fuzzy Sets and Generalized Nets. Springer, Cham, pp 409–425

  18. Jiang D, Li G, Tan C, Huang L, Sun Y, Kong J (2021) Semantic segmentation for multiscale target based on object recognition using the improved Faster-RCNN model. Futur Gener Comput Syst 123:94–104

    Article  Google Scholar 

  19. Kim W, Hasegawa O (2018) Prediction of tropical storm trajectory using self-organizing incremental neural networks and error evaluation. J Adv Comput Intell 22(4):465– 474, 2

  20. Kim S, Kim H, Lee J, Yoon S, Kahou SE, Kashinath K, Prabhat M (2019) Deep-hurricane-tracker: Tracking and forecasting extreme climate events. In: 2019 IEEE Winter Conference on Applications of Computer

  21. Kong T, Yao AB, Chen YR, Sun FC (2016) HyperNet: towards accurate region proposal generation and joint object detection. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, LasVegas, pp 1063–6919

  22. Krizhevsky A, Sutskever I, Hinton G (2012) ImageNet classification with deep convolutional neural networks. In NIPS’ 2012. 23, 24, 27, 100, 200, 371, 456, 460

  23. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436–444

    Article  Google Scholar 

  24. Ledig C, Theis L, Huszár F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z et al (2017)Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26; IEEE, New York

  25. Li CJ, Qu Z, Wang SY, Liu L (2021) A method of cross-layer fusion multi-object detection and recognition based on improved faster R-CNN model in complex traffic environment. Pattern Recognit Lett 145:127–134

    Article  Google Scholar 

  26. Lin Y, Han S, Mao H, Wang Y, Dally WJ (2017) Deep gradient compression: Reducing the communication bandwidth for distributed training. arXiv preprint arXiv:1712.01887

  27. Liu Y et al (2016) Application of deep convolutional neural networks for detecting extreme weather in climate datasets. ArXiv:1605.01156. 1, 2, 3, 6, 7

  28. Liu Y, Wang S (2021) A quantitative detection algorithm based on improved faster R-CNN for marine benthos. Ecol Inf 61:101228

    Article  Google Scholar 

  29. Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), pp3431–3440

  30. Mathworks (n.d) Preprocess Images for Deep Learning. Retrieved December 7, 2021. From https://www.mathworks.com/help/deeplearning/ug/preprocess-images-for-deep-learning.html

  31. Mathworks (n.d.) Object detection using faster R-CNN deep learning. Retrieved December 7, 2021. From https://www.mathworks.com/help/vision/ug/object-detection-using-faster-r-cnn-deep-learning.html

  32. Mathworks (n.d.) Train a Faster R-CNN deep learning object detector. Retrieved December 7, 2021. From https://www.mathworks.com/help/vision/ref/trainfasterrcnnobjectdetector.html

  33. Mustafa EM, Elshafey MA, Fouad MM (2019) Accuracy enhancement of a blind image steganalysis approach using dynamic learning rate-based CNN on GPUs. In: 2019 10th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS), vol 1. IEEE, pp 28–33

  34. NASA Video [Youtube Channel]. Retrieved April 8, 2021, from https://www.youtube.com/channel/UC_aP7p621ATY_yAa8jMqUVA

  35. Özyurt F, Sert E, Avci E, Dogantekin E (2019) Brain tumor detection based on Convolutional Neural Network with neutrosophic expert maximum fuzzy sure entropy. Measurement 147:106830

    Article  Google Scholar 

  36. Özyurt F, Sert E, Avcı D (2020) An expert system for brain tumor detection: Fuzzy C-means with super resolution and convolutional neural network with extreme learning machine. Med Hypotheses 134:109433

    Article  Google Scholar 

  37. Pang S, Xie P, Xu D, Meng F, Tao X, Li B, … Song T (2021) NDFTC: A new detection framework of tropical cyclones from meteorological satellite images with deep transfer learning. Remote Sens 13(9):1860

  38. Parvathi S, Selvi ST (2021) Detection of maturity stages of coconuts in complex background using Faster R-CNN model. Biosyst Eng 202:119–132

    Article  Google Scholar 

  39. Pascanu R, Mikolov T, Bengio Y (2013) On the difficulty of training recurrent neural networks. In: International conference on machine learning. PMLR, pp 1310–1318

  40. Prabhat S, Byna V, Vishwanath E, Dart M, Wehner WD, Collins et al (2015) TECA: Petascale pattern recognition for climate science. In: Proc. of the International Conference on Computer Analysis of Images and Patterns (CAIP), 2

  41. Quan L, Feng H, Lv Y, Wang Q, Zhang C, Liu J, Yuan Z (2019) Maize seedling detection under different growth stages and complex field environments based on an improved Faster R–CNN. Biosyst Eng 184:1–23

    Article  Google Scholar 

  42. R¨ubel O, Byna S, Wu K, Li F, Wehner M, Bethel W, Chen Z, Wang H et al (2012) TECA: A parallel toolkit for extreme climateanalysis. Procedia Comput Sci 9:866–876, 2012. 2, 5 [17] X. Shi, Z.Chen, H. Wang, D.-Y. Yeung, W.-K. Wong

  43. Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: Towards realtime object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149

    Article  Google Scholar 

  44. Sandler M, Howard A, Zhu M, Zhmoginov A, Chen LC (2018) Mobilenetv2: Inverted residuals and linear bottlenecks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4510–4520

  45. Shi X, Chen Z, Wang H, Yeung D-Y, Wong W-K, Woo W-c(2015) Convolutional LSTM network: A machine learning approach for precipitation nowcasting. In: Advances in Neural Information Processing Systems (NIPS)

  46. Shi J, Chang Y, Xu C, Khan F, Chen G, Li C (2020)Real-time leak detection using an infrared camera and Faster R-CNN technique. Comput Chem Eng 135:106780. https://doi.org/10.1016/j.compchemeng.2020.106780

    Article  Google Scholar 

  47. Si L, Xiong X, Wang Z, Tan C (2020) A deep convolutional neural network model for intelligent discrimination between coal and rocks in coal mining face. Math Problems Eng 2020:1–12

  48. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556

  49. Su Y, Li D, Chen X (2021) Lung Nodule Detection based on Faster R-CNN Framework. Comput Methods Programs Biomed 200:105866

  50. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, … Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9

  51. Too EC, Yujian L, Njuki S, Yingchun L (2019) A comparative study of fine-tuning deep learning models for plant disease identification. Comput Electron Agric 161:272–279. https://doi.org/10.1016/j.compag.2018.03.032

    Article  Google Scholar 

  52. Tran K, Panahi A, Adiga A, Sakla W, Krim H (2019) Nonlinear multi-scale super-resolution using deep learning. ICASSP 2019, 3182–3186

  53. Wiranata A, Wibowo SA, Patmasari R, Rahmania R, Mayasari R (2018) Investigation of padding schemes for faster R-CNN on vehicle detection. In 2018 International Conference on Control, Electronics, Renewable Energy and Communications (ICCEREC). IEEE, pp 208–212

  54. Yang D, Sun J (2017) Bm3d-net: A convolutional neural network for transform-domain collaborative filtering. IEEE Sign Process Lett 25(1):55–59

    Article  Google Scholar 

  55. Yang X, Wang N, Song B, Gao X (2019) BoSR: A CNN-based aurora image retrieval method. Neural Netw 116:188–197

    Article  Google Scholar 

  56. Yoo JH, Yoon HI, Kim HG, Yoon HS, Han SS (2019) Optimization of Hyper-parameter for CNN Model using Genetic Algorithm. In: 2019 1st International Conference on Electrical, Control and Instrumentation Engineering (ICECIE). IEEE, pp 1–6

  57. Zeng M, Nguyen LT, Yu B, Mengshoel OJ, Zhu J, Wu P, Zhang J (2014) Convolutional neural networks for human activity recognition using mobile sensors. In: 6th International Conference on Mobile Computing, Applications and Services. IEEE, pp 197–205

  58. Zeng L, Sun B, Zhu D (2021) Underwater target detection based on Faster R-CNN and adversarial occlusion network. Eng Appl Artif Intell 100:104190

    Article  Google Scholar 

  59. Zhang Z, Hong WC (2021) Application of variational mode decomposition and chaotic grey wolf optimizer with support vector regression for forecasting electric loads. Knowl Based Syst 228:107297

    Article  Google Scholar 

  60. Zhao X, Wei H, Wang H, Zhu T, Zhang K (2019)3D-CNN-based feature extraction of ground-based cloud images for direct normal irradiance prediction. Sol Energy 181:510–518

    Article  Google Scholar 

  61. Zhu YJ, Hu Y, Collins JM (2020) Estimating road network accessibility during a hurricane evacuation: A case study of hurricane Irma in Florida. Transp Res D Transp Environ 83:102334

  62. Zuo ZR, Yu K, Zhou Q, Wang X, Li T (2017) Traffic signs detection based on faster R-CNN. In: Computer International Conference on Distributed Computing Sys- tems Workshops (ICDCSW), IEEE, Atlanta, pp 1–9

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Malatya Turgut Özal University, 44210, Malatya, Turkey

    Soner Kızıloluk & Eser Sert

Authors
  1. Soner Kızıloluk
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eser Sert
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Eser Sert.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kızıloluk, S., Sert, E. Hurricane-Faster R-CNN-JS: Hurricane detection with faster R-CNN using artificial Jellyfish Search (JS) optimizer. Multimed Tools Appl 81, 37981–37999 (2022). https://doi.org/10.1007/s11042-022-13156-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13156-9

Keywords

Search

Navigation