{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,6]],"date-time":"2024-09-06T02:05:48Z","timestamp":1725588348025},"reference-count":26,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2023,3,27]],"date-time":"2023-03-27T00:00:00Z","timestamp":1679875200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Commission","award":["780732"]},{"DOI":"10.13039\/501100003759","name":"Universidad Polit\u00e9cnica de Madrid","doi-asserted-by":"publisher","award":["RP2161220029"],"id":[{"id":"10.13039\/501100003759","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Recently, a novel approach in the field of Industry 4.0 factory operations was proposed for a new generation of automated guided vehicles (AGVs) that are connected to a virtualized programmable logic controller (PLC) via a 5G multi-access edge-computing (MEC) platform to enable remote control. However, this approach faces a critical challenge as the 5G network may encounter communication disruptions that can lead to AGV deviations and, with this, potential safety risks and workplace issues. To mitigate this problem, several works have proposed the use of fixed-horizon forecasting techniques based on deep-learning models that can anticipate AGV trajectory deviations and take corrective maneuvers accordingly. However, these methods have limited prediction flexibility for the AGV operator and are not robust against network instability. To address this limitation, this study proposes a novel approach based on multi-horizon forecasting techniques to predict the deviation of remotely controlled AGVs. As its primary contribution, the work presents two new versions of the state-of-the-art transformer architecture that are well-suited to the multi-horizon prediction problem. We conduct a comprehensive comparison between the proposed models and traditional deep-learning models, such as the long short-term memory (LSTM) neural network, to evaluate the performance and capabilities of the proposed models in relation to traditional deep-learning architectures. The results indicate that (i) the transformer-based models outperform LSTM in both multi-horizon and fixed-horizon scenarios, (ii) the prediction accuracy at a specific time-step of the best multi-horizon forecasting model is very close to that obtained by the best fixed-horizon forecasting model at the same step, (iii) models that use a time-sequence structure in their inputs tend to perform better in multi-horizon scenarios compared to their fixed horizon counterparts and other multi-horizon models that do not consider a time topology in their inputs, and (iv) our experiments showed that the proposed models can perform inference within the required time constraints for real-time decision making.<\/jats:p>","DOI":"10.3390\/s23073516","type":"journal-article","created":{"date-parts":[[2023,3,28]],"date-time":"2023-03-28T05:41:34Z","timestamp":1679982094000},"page":"3516","source":"Crossref","is-referenced-by-count":5,"title":["Transformers for Multi-Horizon Forecasting in an Industry 4.0 Use Case"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"http:\/\/orcid.org\/0000-0003-4263-0206","authenticated-orcid":false,"given":"Stanislav","family":"Vakaruk","sequence":"first","affiliation":[{"name":"Departamento de Sistemas Inform\u00e1ticos, Escuela T\u00e9cnica Superior de Sistemas Inform\u00e1ticos, Universidad Polit\u00e9cnica de Madrid, 28031 Madrid, Spain"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-0311-6610","authenticated-orcid":false,"given":"Amit","family":"Karamchandani","sequence":"additional","affiliation":[{"name":"Departamento de Sistemas Inform\u00e1ticos, Escuela T\u00e9cnica Superior de Sistemas Inform\u00e1ticos, Universidad Polit\u00e9cnica de Madrid, 28031 Madrid, Spain"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-6088-9954","authenticated-orcid":false,"given":"Jes\u00fas Enrique","family":"Sierra-Garc\u00eda","sequence":"additional","affiliation":[{"name":"Departamento de Ingenier\u00eda Electromec\u00e1nica, Escuela Polit\u00e9cnica Superior, Universidad de Burgos, 09006 Burgos, Spain"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-9743-8604","authenticated-orcid":false,"given":"Alberto","family":"Mozo","sequence":"additional","affiliation":[{"name":"Departamento de Sistemas Inform\u00e1ticos, Escuela T\u00e9cnica Superior de Sistemas Inform\u00e1ticos, Universidad Polit\u00e9cnica de Madrid, 28031 Madrid, Spain"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-9757-7871","authenticated-orcid":false,"given":"Sandra","family":"G\u00f3mez-Canaval","sequence":"additional","affiliation":[{"name":"Departamento de Sistemas Inform\u00e1ticos, Escuela T\u00e9cnica Superior de Sistemas Inform\u00e1ticos, Universidad Polit\u00e9cnica de Madrid, 28031 Madrid, Spain"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-2849-9782","authenticated-orcid":false,"given":"Antonio","family":"Pastor","sequence":"additional","affiliation":[{"name":"Departamento de Sistemas Inform\u00e1ticos, Escuela T\u00e9cnica Superior de Sistemas Inform\u00e1ticos, Universidad Polit\u00e9cnica de Madrid, 28031 Madrid, Spain"},{"name":"Telef\u00f3nica I+D., 28050 Madrid, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"20200209","DOI":"10.1098\/rsta.2020.0209","article-title":"Time-series forecasting with deep learning: A survey","volume":"379","author":"Lim","year":"2021","journal-title":"Philos. Trans. R. Soc. A"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Mozo, A., Ordozgoiti, B., and G\u00f3mez-Canaval, S. (2018). Forecasting short-term data center network traffic load with convolutional neural networks. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0191939"},{"key":"ref_3","unstructured":"Siami-Namini, S., and Namin, A.S. (2018). Forecasting economics and financial time series: ARIMA vs. LSTM. arXiv."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chen, K., Zhou, Y., and Dai, F. (November, January 29). A LSTM-based method for stock returns prediction: A case study of China stock market. Proceedings of the 2015 IEEE International Conference on Big Data, Santa Clara, CA, USA.","DOI":"10.1109\/BigData.2015.7364089"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"327","DOI":"10.4995\/riai.2021.16111","article-title":"Redes neuronales y aprendizaje por refuerzo en el control de turbinas e\u00f3licas","volume":"18","author":"Santos","year":"2021","journal-title":"Rev. Iberoam. Autom. Inf. Ind."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"10503","DOI":"10.1007\/s00521-021-06323-w","article-title":"Deep learning and fuzzy logic to implement a hybrid wind turbine pitch control","volume":"34","author":"Santos","year":"2022","journal-title":"Neural Comput. Appl."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1080\/01691864.2017.1365009","article-title":"Deep learning in robotics: A review of recent research","volume":"31","author":"Pierson","year":"2017","journal-title":"Adv. Robot."},{"key":"ref_8","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_9","unstructured":"Wen, Q., Zhou, T., Zhang, C., Chen, W., Ma, Z., Yan, J., and Sun, L. (2022). Transformers in time series: A survey. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zerveas, G., Jayaraman, S., Patel, D., Bhamidipaty, A., and Eickhoff, C. (2021, January 14\u201318). A transformer-based framework for multivariate time series representation learning. Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, Singapore.","DOI":"10.1145\/3447548.3467401"},{"key":"ref_11","first-page":"6687816","article-title":"Mechatronic modelling of industrial AGVs: A complex system architecture","volume":"2020","author":"Santos","year":"2020","journal-title":"Complexity"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"82","DOI":"10.4995\/riai.2020.12846","article-title":"Transporte multi-AGV de una carga: Estado del arte y propuesta centralizada","volume":"18","author":"Espinosa","year":"2020","journal-title":"Rev. Iberoam. Autom. Inf. Ind."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"596","DOI":"10.1109\/COMST.2020.3037674","article-title":"Toward enabled industrial verticals in 5G: A survey on MEC-based approaches to provisioning and flexibility","volume":"23","author":"Spinelli","year":"2020","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1109\/MCOMSTD.2018.1700063","article-title":"Overview of 5G security challenges and solutions","volume":"2","author":"Ahmad","year":"2018","journal-title":"IEEE Commun. Stand. Mag."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1109\/MCOM.221.2001079","article-title":"Forecasting automated guided vehicle malfunctioning with deep learning in a 5G-based industry 4.0 scenario","volume":"59","author":"Vakaruk","year":"2021","journal-title":"IEEE Commun. Mag."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Yaovaja, K., Bamrungthai, P., and Ketsarapong, P. (2019, January 3\u20136). Design of an Autonomous Tracked Mower Robot Using Vision-Based Remote Control. Proceedings of the 2019 IEEE Eurasia Conference on IOT, Communication and Engineering (ECICE), Yunlin, Taiwan.","DOI":"10.1109\/ECICE47484.2019.8942741"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1950","DOI":"10.1016\/j.neucom.2009.11.030","article-title":"Multiple-Output Modeling for Multi-Step-Ahead Time Series Forecasting","volume":"73","author":"Sorjamaa","year":"2010","journal-title":"Neurocomputing"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Bengio, Y. (2009). Learning Deep Architectures for AI, Now, Publishers Inc.","DOI":"10.1561\/9781601982957"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1109\/72.279181","article-title":"Learning long-term dependencies with gradient descent is difficult","volume":"5","author":"Bengio","year":"1994","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_21","unstructured":"Hochreiter, S., Bengio, Y., Frasconi, P., and Schmidhuber, J. (2001). Gradient Flow in Recurrent Nets: The Difficulty of Learning Long-Term Dependencies, IEEE Press."},{"key":"ref_22","first-page":"84","article-title":"Modelado de un AGV h\u00edbrido triciclo-diferencial","volume":"19","author":"Santos","year":"2022","journal-title":"Rev. Iberoam. Autom. Inf. Ind."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Mozo, A., Karamchandani, A., G\u00f3mez-Canaval, S., Sanz, M., Moreno, J.I., and Pastor, A. (2022). B5GEMINI: AI-driven network digital twin. Sensors, 22.","DOI":"10.3390\/s22114106"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Pastor, A., Mozo, A., Lopez, D.R., Folgueira, J., and Kapodistria, A. (2018, January 27\u201330). The Mouseworld, a security traffic analysis lab based on NFV\/SDN. Proceedings of the 13th International Conference on Availability, Reliability and Security, Hamburg, Germany.","DOI":"10.1145\/3230833.3233283"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Binder, M., Moosbauer, J., Thomas, J., and Bischl, B. (2020). Multi-Objective Hyperparameter Tuning and Feature Selection Using Filter Ensembles. arXiv.","DOI":"10.1145\/3377930.3389815"},{"key":"ref_26","first-page":"500","article-title":"Using the R-MAPE index as a resistant measure of forecast accuracy","volume":"25","author":"Blasco","year":"2013","journal-title":"Psicothema"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3516\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,28]],"date-time":"2023-03-28T06:01:13Z","timestamp":1679983273000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3516"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,27]]},"references-count":26,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["s23073516"],"URL":"https:\/\/doi.org\/10.3390\/s23073516","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,27]]}}}