{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T15:42:27Z","timestamp":1740152547360,"version":"3.37.3"},"reference-count":21,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,7,20]],"date-time":"2022-07-20T00:00:00Z","timestamp":1658275200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Civil Aerospace Technology Advance Research Program","award":["A0201"]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"Missing observations in time series will distort the data characteristics, change the dataset expectations, high-order distances, and other statistics, and increase the difficulty of data analysis. Therefore, data imputation needs to be performed first. Generally, data imputation methods include statistical imputation, regression imputation, multiple imputation, and imputation based on machine learning methods. However, these methods currently have problems such as insufficient utilization of time characteristics, low imputation efficiency, and poor performance under high missing rates. In response to these problems, we propose the informer-WGAN, a network model based on adversarial training and a self-attention mechanism. With the help of the discriminator network and the random missing rate training method, the informer-WGAN can efficiently solve the problem of multidimensional time series imputation. According to the experimental results under different missing rates, the informer-WGAN model achieves better imputation results than the original informer on two datasets. Our model also shows excellent performance on time series imputation of the key parameters of a spacecraft control moment gyroscope (CMG).<\/jats:p>","DOI":"10.3390\/a15070252","type":"journal-article","created":{"date-parts":[[2022,7,20]],"date-time":"2022-07-20T15:22:24Z","timestamp":1658330544000},"page":"252","source":"Crossref","is-referenced-by-count":4,"title":["Informer-WGAN: High Missing Rate Time Series Imputation Based on Adversarial Training and a Self-Attention Mechanism"],"prefix":"10.3390","volume":"15","author":[{"given":"Yufan","family":"Qian","sequence":"first","affiliation":[{"name":"Faculty of Computing, Harbin Institute of Technology, Harbin 150000, China"}]},{"given":"Limei","family":"Tian","sequence":"additional","affiliation":[{"name":"Beijing Institute of Control Engineering, Beijing 100190, China"}]},{"given":"Baichen","family":"Zhai","sequence":"additional","affiliation":[{"name":"Beijing Institute of Control Engineering, Beijing 100190, China"}]},{"given":"Shufan","family":"Zhang","sequence":"additional","affiliation":[{"name":"Faculty of Computing, Harbin Institute of Technology, Harbin 150000, China"}]},{"given":"Rui","family":"Wu","sequence":"additional","affiliation":[{"name":"Faculty of Computing, Harbin Institute of Technology, Harbin 150000, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Chatfield, C. (2003). The Analysis of Time Series: An Introduction, CRC.","DOI":"10.4324\/9780203491683"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Luo, Y., Zhang, Y., Cai, X., and Yuan, X. (2019, January 10\u201316). E2gan: End-to-end generative adversarial network for multivariate time series imputation. Proceedings of the 28th International Joint Conference on Artificial Intelligence, Macao, China.","DOI":"10.24963\/ijcai.2019\/429"},{"key":"ref_3","unstructured":"Box, G.E., Jenkins, G.M., Reinsel, G.C., and Ljung, G.M. (2015). Time Series Analysis: Forecasting and Control, John Wiley & Sons."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Schafer, J.L. (1997). Analysis of Incomplete Multivariate Data, CRC Press.","DOI":"10.1201\/9781439821862"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2309","DOI":"10.1007\/s00180-013-0408-7","article-title":"Statistical analysis of autoregressive fractionally integrated moving average models in R","volume":"28","author":"Palma","year":"2013","journal-title":"Comput. Stat."},{"key":"ref_6","first-page":"17105","article-title":"Adversarial sparse transformer for time series forecasting","volume":"33","author":"Wu","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.knosys.2013.08.023","article-title":"Missing value imputation using decision trees and decision forests by splitting and merging records: Two novel techniques","volume":"53","author":"Rahman","year":"2013","journal-title":"Knowl.-Based Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.chemolab.2015.03.002","article-title":"Self-organizing maps for imputation of missing data in incomplete data matrices","volume":"143","author":"Folguera","year":"2015","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.patrec.2014.01.008","article-title":"A review of unsupervised feature learning and deep learning for time-series modeling","volume":"42","author":"Karlsson","year":"2014","journal-title":"Pattern Recognit. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1181","DOI":"10.1016\/j.ijforecast.2019.07.001","article-title":"DeepAR: Probabilistic forecasting with autoregressive recurrent networks","volume":"36","author":"Salinas","year":"2020","journal-title":"Int. J. Forecast."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2286","DOI":"10.1080\/03610918.2017.1341529","article-title":"Forecasting comparisons using a hybrid ARFIMA and LRNN models","volume":"47","author":"Pwasong","year":"2018","journal-title":"Commun. Stat.-Simul. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Liu, C., Hoi, S.C., Zhao, P., and Sun, J. (2016, January 12\u201317). Online arima algorithms for time series prediction. Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.","DOI":"10.1609\/aaai.v30i1.10257"},{"key":"ref_13","unstructured":"Zhang, J., and Man, K.F. (1998, January 14). Time series prediction using RNN in multi-dimension embedding phase space. Proceedings of the SMC\u201998 Conference Proceedings\u20141998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No. 98CH36218), San Diego, CA, USA."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lai, G., Chang, W.C., Yang, Y., and Liu, H. (2018, January 8\u201312). Modeling long-and short-term temporal patterns with deep neural networks. Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, Ann Arbor, MI, USA.","DOI":"10.1145\/3209978.3210006"},{"key":"ref_15","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8\u201313). Generative adversarial nets. Proceedings of the Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems 2014, Montreal, QC, Canada."},{"key":"ref_16","unstructured":"Luo, Y., Cai, X., Zhang, Y., Xu, J., and Yuan, X. (2018, January 3\u20138). Multivariate time series imputation with generative adversarial networks. Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, Montreal, QC, Canada."},{"key":"ref_17","unstructured":"Yoon, J., Jarrett, D., and Van der Schaar, M. (2019, January 8\u201314). Time-series generative adversarial networks. Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, Vancouver, BC, Canada."},{"key":"ref_18","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, Long Beach, CA, USA."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Correia, G.M., Niculae, V., and Martins, A.F. (2019). Adaptively sparse transformers. arXiv.","DOI":"10.18653\/v1\/D19-1223"},{"key":"ref_20","unstructured":"Martins, A., and Astudillo, R. (2016, January 20\u201322). From softmax to sparsemax: A sparse model of attention and multi-label classification. Proceedings of the International Conference on Machine Learning, New York, NY, USA."},{"key":"ref_21","unstructured":"Zhou, H., Zhang, S., Peng, J., Zhang, S., Li, J., Xiong, H., and Zhang, W. (2021, January 2\u20139). Informer: Beyond efficient transformer for long sequence time-series forecasting. Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI-21), Virtual."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/7\/252\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,2]],"date-time":"2024-08-02T11:55:48Z","timestamp":1722599748000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/7\/252"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,20]]},"references-count":21,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["a15070252"],"URL":"https:\/\/doi.org\/10.3390\/a15070252","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2022,7,20]]}}}