Abstract
The need for accurate time series forecasting has questioned the potential of Federated Learning (FL) in solving regression problems with privacy-preserving and collaborative prognosis requirements. While recent Machine Learning (ML) studies have shown accurate predictions in time series forecasting using functional principal component analysis, the potential of integrating this approach with FL has not been previously evaluated. This paper depicts the potential of combining functional time series regression with FL through the implementation of a Functional Multilayer Perceptron (FMLP). Experimental results on one of the most innovative industrial maintenance strategies, Predictive Maintenance (PM), demonstrate that the integration of FMLP with the well-known Federated Averaging (FedAvg) algorithm achieves accurate time series forecasting while preserving data privacy. These results, obtained using NASA C-MAPSS datasets, outperformed traditional ML and Deep Learning (DL) approaches in estimating the Remaining Useful Life (RUL) of aircraft components.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Liu, Z., Zhu, Z., Gao, J., Xu, C.: Forecast methods for time series data: a survey. IEEE Access 9(1), 91896–91912 (2021). https://doi.org/10.1109/ACCESS.2021.3091162
Li, Y.: Federated learning for time series forecasting using hybrid model. Computer Science (2019)
Llasag Rosero, R., Silva, C., Ribeiro B.: Remaining useful life estimation in aircraft components with federated learning. Int. J. Prognostics Health Manage. 5(1), 9–17 (2020). https://doi.org/10.36001/phme.2020.v5i1.1228
Dhada, M., Palau, A.S., Parlikad, A.K.: Federated learning for collaborative prognosis. In: International Conference on Precision, Meso, Micro, and Nano Engineering (COPEN 2019), vol. IIT, Indore (2019). https://doi.org/10.17863/CAM.50577
Zhang, X., Yin, W., Hong, H., Chen, T.: Hybrid federated learning: algorithms and implementation (2020). arXiv:2012.12420
Conan-Guez, B., Rossi, F.: Functional multi-layer perceptron: a nonlinear tool for functional data analysis (2017). arXiv:0709.3642
Rossi, F., Conan-Guez, B., Fleuret, F.: Functional data analysis with multi layer perceptrons. In: Proceedings of the 2002 International Joint Conference on Neural Networks, IJCNN 2002 (Cat. No.02CH37290), Honolulu, vol. 3, pp. 2843–2848 (2002). https://doi.org/10.1109/IJCNN.2002.1007599
Stinchcombe, M.B.: Neural network approximation of continuous functionals and continuous functions on compactifications. Neural Netw. 12(3), 467–477 (1999). https://doi.org/10.1016/s0893-6080(98)00108-7
Tang, C., Shang, H.L., Yang, Y.: Clustering and forecasting multiple functional time series (2022). arXiv:2201.01024
McMahan, H.B., Moore, E., Ramage, D., Agüera y Arcas, B.: Federated learning of deep networks using model averaging (2016). arXiv:1602.05629
Beyaztas, U., Shang, H.: Forecasting functional time series using weighted likelihood methodology (2019). arXiv:1908.00336v1
Llasag, R.R., Silva, C., Ribeiro, B.: Remaining useful life estimation of cooling units via time-frequency health indicators with machine learning. Aerospace 9(6), 309 (2022). https://doi.org/10.3390/aerospace9060309
Ramsay, J., Hooker, G., Graves, S.: Functional Data Analysis, 1st edn. Springer, New York (2009)
Beyaztas, U., Shang, H.: Machine-learning-based functional time series forecasting: application to age-specific mortality rates. Forecasting 4, 394–408 (2002). https://doi.org/10.3390/forecast4010022
Sateesh Babu, G., Zhao, P., Li, X.-L.: Deep convolutional neural network based regression approach for estimation of remaining useful life. In: Navathe, S.B., Wu, W., Shekhar, S., Du, X., Wang, X.S., Xiong, H. (eds.) DASFAA 2016. LNCS, vol. 9642, pp. 214–228. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-32025-0_14
Zheng, S., Ristovski, K.S., Farahat, A., Gupta, C.: Long short-term memory network for remaining useful life estimation. In: 2017 IEEE International Conference on Prognostics and Health Management (ICPHM), Dallas, pp. 88–95 (2017). https://doi.org/10.1109/ICPHM.2017.7998311
Conan-Guez, B., Rossi, F.: Multi-layer perceptrons for functional data analysis: a projection based approach. In: Dorronsoro, J.R. (ed.) ICANN 2002. LNCS, vol. 2415, pp. 667–672. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-46084-5_109
Lei, R., et al.: A data-driven auto-CNN-LSTM prediction model for lithium-ion battery remaining useful life. Trans. Ind. Inf. 17(5), 3478–3487 (2021). https://doi.org/10.1109/TII.2020.3008223
Saxena, A., Goebel, K.: PHM08 challenge data set. (Vol. https://www.nasa.gov/content/prognostics-center-of-excellence-data-set-repository; Technical report). NASA Ames Prognostics Data Repository, NASA Ames Research Center, Moffett Field, CA (2008)
Acknowledgements
to (1) The Portuguese Foundation for Science and Technology (FCT) for supporting the project grant SFRH/BD/07344/2020, (2) The Center for Informatics and Systems of the University of Coimbra (CISUC), and (3) The European Union’s Horizon 2020 research and innovation programme under the project No 769288 untitled “Real-Time Condition-based Maintenance for Adaptive Maintenance Planning-ReMAP”
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Llasag Rosero, R., Silva, C., Ribeiro, B. (2023). Forecasting Functional Time Series Using Federated Learning. In: Iliadis, L., Maglogiannis, I., Alonso, S., Jayne, C., Pimenidis, E. (eds) Engineering Applications of Neural Networks. EANN 2023. Communications in Computer and Information Science, vol 1826. Springer, Cham. https://doi.org/10.1007/978-3-031-34204-2_40
Download citation
DOI: https://doi.org/10.1007/978-3-031-34204-2_40
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-34203-5
Online ISBN: 978-3-031-34204-2
eBook Packages: Computer ScienceComputer Science (R0)