Design of a High-Efficiency Temporal Engine for Real-Time Spatial Satellite Image Classification Using Augmented Incremental Transfer Learning for Crop Analysis | SN Computer Science Skip to main content
Springer Nature Link
Log in

Design of a High-Efficiency Temporal Engine for Real-Time Spatial Satellite Image Classification Using Augmented Incremental Transfer Learning for Crop Analysis

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

Satellite image processing is a multidomain task which involves design of image capturing, denoising, segmentation, feature extraction, feature reduction, classification, and post-processing tasks. A wide variety of satellite image processing models are proposed by researchers, and each of them has different data and process requirements. For instance, the image capturing module might obtain images in layered form, while feature extraction module might require data in 2D or 3D forms. Moreover, performance of these models also varies due to changes in internal process parameters and dataset parameters, which limits their accuracy and scalability when applied to real-time scenarios. To reduce the probability of these limitations, a novel high-efficiency temporal engine for real-time satellite image classification using augmented incremental transfer learning is proposed and discussed in this text. The model initially captures real-time satellite data using Google’s Earth Engine and processes it using a transfer learning-based convolutional neural network (CNN) via backscatter coefficient analysis. These coefficients indicate average intensity value of Precision Image (PRI) when evaluated over a distributed target. Due to extraction of backscattering coefficients, the model is capable of representing crop images in VV (vertical transmit, vertical receive), and HV (horizontal transmit vertical receive) modes. Thereby assisting the CNN model to extract a wide variety of features from input satellite image, which classifies these datasets (original, VV, and VH) into different crop categories. The classified images are further processed via an incremental learning layer, which assists in visual identification of affected regions. Due to use of incremental learning and CNN for classification, the proposed TRSAITL model is capable of achieving an average accuracy of 97.8% for crop type and severity of damage detection, with an average PSNR (Peak Signal-to-Noise Ratio) of 29.6 dB for different image types. The model was tested on different regions around our local geographical area, and consistent performance was observed. This performance was also compared with various state-of-the-art approaches. It was observed that the proposed TRSATL model has 5% better accuracy, 4.6% better precision, and 7.9% better recall when compared to them, which makes it highly useful for real-time satellite-based crop classification applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Data Availability Statement

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Luciani R, Laneve G, JahJah M. Agricultural monitoring, an automatic procedure for crop mapping and yield estimation: the great rift valley of Kenya case. IEEE J Sel Top Appl Earth Observ Remote Sens. 2019;12(7):2196–208. https://doi.org/10.1109/JSTARS.2019.2921437.

    Article  Google Scholar 

  2. Shelestov A, et al. Cloud approach to automated crop classification using sentinel-1 imagery. IEEE Trans Big Data. 2020;6(3):572–82. https://doi.org/10.1109/TBDATA.2019.2940237.

    Article  Google Scholar 

  3. Arri HS, Ramandeep S, Sudan J, Deepak P, Gyanendra PJ, Ill CD. Optimized task group aggregation-based overflow handling on fog computing environment using neural computing. Mathematics. 2021;9(19):2522. https://doi.org/10.3390/math9192522.

    Article  Google Scholar 

  4. Jiang J, et al. HISTIF: a new spatiotemporal image fusion method for high-resolution monitoring of crops at the subfield level. IEEE J Sel Top Appl Earth Observ Remote Sens. 2020;13:4607–26. https://doi.org/10.1109/JSTARS.2020.3016135.

    Article  Google Scholar 

  5. Li Z, Chen G, Zhang T. A CNN-transformer hybrid approach for crop classification using multitemporal multisensor images. IEEE J Sel Top Appl Earth Observ Remote Sens. 2020;13:847–58. https://doi.org/10.1109/JSTARS.2020.2971763.

    Article  Google Scholar 

  6. Rousi M, et al. Semantically enriched crop type classification and linked earth observation data to support the common agricultural policy monitoring. IEEE J Sel Top Appl Earth Observ Remote Sens. 2021;14:529–52. https://doi.org/10.1109/JSTARS.2020.3038152.

    Article  Google Scholar 

  7. Sun Z, Di L, Fang H, Burgess A. Deep learning classification for crop types in North Dakota. IEEE J Sel Top Appl Earth Observ Remote Sens. 2020;13:2200–13. https://doi.org/10.1109/JSTARS.2020.2990104.

    Article  Google Scholar 

  8. Quiros Vargas J, Khot LR, Peters RT, Chandel AK, Molaei B. Low orbiting satellite and small UAS-based high-resolution imagery data to quantify crop lodging: a case study in irrigated spearmint. IEEE Geosci Remote Sens Lett. 2020;17(5):755–9. https://doi.org/10.1109/LGRS.2019.2935830.

    Article  Google Scholar 

  9. Mestre-Quereda A, Lopez-Sanchez JM, Vicente-Guijalba F, Jacob AW, Engdahl ME. Time-series of sentinel-1 interferometric coherence and backscatter for crop-type mapping. IEEE J Sel Top Appl Earth Observ Remote Sens. 2020;13:4070–84. https://doi.org/10.1109/JSTARS.2020.3008096.

    Article  Google Scholar 

  10. Khan W, et al. On the performance of temporal stacking and vegetation indices for detection and estimation of tobacco crop. IEEE Access. 2020;8:103020–33. https://doi.org/10.1109/ACCESS.2020.2998079.

    Article  Google Scholar 

  11. Khan PW, Byun Y-C, Latif MA. Clifford geometric algebra-based approach for 3d modeling of agricultural images acquired by UAVs. IEEE Access. 2020;8:226297–308. https://doi.org/10.1109/ACCESS.2020.3045443.

    Article  Google Scholar 

  12. Tang P, Du P, Xia J, Zhang P, Zhang W. Channel attention-based temporal convolutional network for satellite image time series classification. IEEE Geosci Remote Sens Lett. 2022;19:1–5. https://doi.org/10.1109/LGRS.2021.3095505. (Art no. 8016505).

    Article  Google Scholar 

  13. Asad MH, Bais A. Crop and weed leaf area index mapping using multi-source remote and proximal sensing. IEEE Access. 2020;8:138179–90. https://doi.org/10.1109/ACCESS.2020.3012125.

    Article  Google Scholar 

  14. Solano-Correa YT, Bovolo F, Bruzzone L, Fernández-Prieto D. A method for the analysis of small crop fields in sentinel-2 dense time series. IEEE Trans Geosci Remote Sens. 2020;58(3):2150–64. https://doi.org/10.1109/TGRS.2019.2953652.

    Article  Google Scholar 

  15. Liu S, Zhou Z, Ding H, Zhong Y, Shi Q. Crop mapping using sentinel full-year dual-polarized SAR data and a CPU-optimized convolutional neural network with two sampling strategies. IEEE J Sel Top Appl Earth Observ Remote Sens. 2021;14:7017–31. https://doi.org/10.1109/JSTARS.2021.3094973.

    Article  Google Scholar 

  16. de Macedo MMG, Mattos AB, Oliveira DAB. Generalization of convolutional LSTM models for crop area estimation. IEEE J Sel Top Appl Earth Observ Remote Sens. 2020;13:1134–42. https://doi.org/10.1109/JSTARS.2020.2973602.

    Article  Google Scholar 

  17. Silva-Perez C, Marino A, Lopez-Sanchez JM, Cameron I. Multitemporal polarimetric SAR change detection for crop monitoring and crop type classification. IEEE J Sel Top Appl Earth Observ Remote Sens. 2021;14:12361–74. https://doi.org/10.1109/JSTARS.2021.3130186.

    Article  Google Scholar 

  18. Yang S, Gu L, Li X, Gao F, Jiang T. Fully automated classification method for crops based on spatiotemporal deep-learning fusion technology. IEEE Trans Geosci Remote Sens. 2022;60:1–16. https://doi.org/10.1109/TGRS.2021.3113014. (Art no. 5405016).

    Article  Google Scholar 

  19. Jo H-W, et al. Deep learning applications on multitemporal SAR (Sentinel-1) image classification using confined labeled data: the case of detecting rice paddy in South Korea. IEEE Trans Geosci Remote Sens. 2020;58(11):7589–601. https://doi.org/10.1109/TGRS.2020.2981671.

    Article  Google Scholar 

  20. Lampert T, Lafabregue B, Dao T-B-H, Serrette N, Vrain C, Gançarski P. Constrained distance-based clustering for satellite image time-series. IEEE J Sel Top Appl Earth Observ Remote Sens. 2019;12(11):4606–21. https://doi.org/10.1109/JSTARS.2019.2950406.

    Article  Google Scholar 

  21. Saini D, et al. MBAHIL: design of a multimodal hybrid bioinspired model for augmentation of hyperspectral imagery via iterative learning for continuous efficiency enhancements. IEEE Access. 2023;11:47781–93. https://doi.org/10.1109/ACCESS.2023.3273529.

    Article  Google Scholar 

  22. Sawant S, Mohite J, Sakkan M, Pappula S (2019) Near real time crop loss estimation using remote sensing observations. In: 2019 8th international conference on agro-geoinformatics (agro-geoinformatics), pp 1–5. https://doi.org/10.1109/Agro-Geoinformatics.2019.8820217

  23. Jones S, Saniie J. Using deep learning and satellite imagery to assess the damage to civil structures after natural disasters. IEEE Int Conf Electro Inf Technol (EIT). 2019;2019:189–93. https://doi.org/10.1109/EIT.2019.8833724.

    Article  Google Scholar 

  24. Sofue Y, Hongo C, Manago N, Sigit G, Homma K, Barus B. Estimation of normal rice yield considering heading stage based on observation data and satellite imagery. IEEE Int Geosci Remote Sens Symp IGARSS. 2021;2021:6439–42. https://doi.org/10.1109/IGARSS47720.2021.9554679.

    Article  Google Scholar 

  25. Sravan Kumar G, Venkatramaphanikumar S, Venkata Krishna Kishore K (2021) Smart farming—a flexible approach to improve crop yield and profit using machine learning techniques. In: 2021 2nd international conference for emerging technology (INCET), pp 1–6. https://doi.org/10.1109/INCET51464.2021.9456433

  26. Singh K, Jha S (2021) Cyber threat analysis and prediction using machine learning. In: 2021 3rd international conference on advances in computing, communication control and networking (ICAC3N), Greater Noida, India, pp 1981–1985. https://doi.org/10.1109/ICAC3N53548.2021.9725445

  27. Roy SK, Krishna G, Dubey SR, Chaudhuri BB. HybridSN: exploring 3-D–2-D CNN feature hierarchy for hyperspectral image classification. IEEE Geosci Remote Sens Lett. 2020;17(2):277–81. https://doi.org/10.1109/LGRS.2019.2918719.

    Article  Google Scholar 

  28. Roy SK, Manna S, Song T, Bruzzone L. Attention-based adaptive spectral-spatial kernel ResNet for hyperspectral image classification. IEEE Trans Geosci Remote Sens. 2021;59(9):7831–43. https://doi.org/10.1109/TGRS.2020.3043267.

    Article  Google Scholar 

  29. Chen Z, Hong D, Gao H. Grid network: feature extraction in anisotropic perspective for hyperspectral image classification. IEEE Geosci Remote Sens Lett. 2023;20:1–5. https://doi.org/10.1109/LGRS.2023.3297612. (Art no. 5507105).

    Article  Google Scholar 

  30. Zhonghao C, Guoyong W, Hongmin G, Yao D, Danfeng H, Bing Z. Local aggregation and global attention network for hyperspectral image classification with spectral-induced aligned superpixel segmentation. Expert Syst Appl. 2023;232:120828. https://doi.org/10.1016/j.eswa.2023.120828. (ISSN 0957-4174).

    Article  Google Scholar 

  31. Lakmal D, Kugathasan K, Nanayakkara V, Jayasena S, Perera AS, Fernando L (2019) Brown planthopper damage detection using remote sensing and machine learning. In: 2019 18th IEEE international conference on machine learning and applications (ICMLA), pp 97–104. https://doi.org/10.1109/ICMLA.2019.00024

  32. Haque S, Rahman N, Mostakim M (2021) Classification of damaged vegetation areas using convolutional neural network over unlabelled sentinel-2 images. In: 2021 26th international conference on automation and computing (ICAC), pp 1–7. https://doi.org/10.23919/ICAC50006.2021.9594269

  33. Rajagopal A, Jha S, Khari M, Ahmad S, Alouffi B, Alharbi A. A novel approach in prediction of crop production using recurrent cuckoo search optimization neural networks. Appl Sci. 2021;11(21):9816. https://doi.org/10.3390/app11219816.

    Article  Google Scholar 

  34. Jha S, et al. A novel approach for decision support system in cricket using machine learning. Int J Comp Appl Technol. 2022. https://doi.org/10.1504/IJCAT.2022.126097.

    Article  Google Scholar 

Download references

Funding

This study is supported via funding from Prince Sattam Bin Abdulaziz University project number (PSAU/2024/R/1445).

Author information

Authors and Affiliations

  1. Department of Electronics and Telecommunication Engineering, Lovely Professional University, Phagwara, Punjab, India

    Akshay Pramodrao Dhande

  2. School of Computer Science and Engineering, Lovely Professional University, Phagwara, Punjab, India

    Rahul Malik, Dipen Saini & Rachit Garg

  3. Department of Computer Science and Engineering, Kathmandu University, Dhulikhel, Nepal

    Sudan Jha

  4. Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, 11942, Alkharj, Saudi Arabia

    Jabeen Nazeer & Sultan Ahmad

  5. University Center for Research and Development (UCRD), Department of Computer Science and Engineering, Chandigarh University, Gharuan, Mohali, 140413, Punjab, India

    Sultan Ahmad

Authors
  1. Akshay Pramodrao Dhande
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rahul Malik
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dipen Saini
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rachit Garg
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sudan Jha
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jabeen Nazeer
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Sultan Ahmad
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to design and development of the system as well as the manuscript. All authors have read and approved the final manuscript.

Corresponding author

Correspondence to Sultan Ahmad.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Ethical Approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dhande, A.P., Malik, R., Saini, D. et al. Design of a High-Efficiency Temporal Engine for Real-Time Spatial Satellite Image Classification Using Augmented Incremental Transfer Learning for Crop Analysis. SN COMPUT. SCI. 5, 585 (2024). https://doi.org/10.1007/s42979-024-02939-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-024-02939-6

Keywords

Search

Navigation