Abstract
This paper proposes a Gaussian process-based incremental neural network algorithm to handle the online regression problem. It can extract prototypes by an incremental neural network, where 1) Gaussian process approximations are adopted to update the threshold regions and the posterior distribution of the dependent variable at the weight vectors of nodes and 2) the optimal bandwidth matrix is derived for adapting to network structure. Besides, we discuss some properties of the proposed approach, and the experimental results show that our approach achieves remarkable accuracy improvement in extracting prototypes for online regression on noisy data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Wolfgang, H.: Applied Nonparametric Regression (Econometric Society Monographs). Cambridge University Pressk, Cambridge (1990)
Mount, N.J., Weaver, D.: Self-organizing maps and boundary effects: quantifying the benefits of torus wrapping for mapping SOM trajectories. Pattern Anal. Appl. 14, 139–148 (2011)
Shen, F., Hasegawa, O.: Self-organizing incremental neural network and its application. In: International Conference on Artificial Neural Networks, pp. 535–540 (2010)
Shen, F., Hasegawa, O.: A fast nearest neighbor classifier based on self-organizing incremental neural network. Neurocomputing 21, 1537–1547 (2008)
Nakamura, Y., Hasegawa, O.: Nonparametric density estimation based on self-organizing incremental neural network for large noisy data. IEEE Trans. Neural Netwo. Learn. Syst. 28, 25–32 (2016)
Alexey, T.: The problem of concept drift: definitions and related work. Tech. rep., Computer Science Department, Trinity College Dublin (2004)
Vincent, P., Bengio, Y.: Manifold parzen windows. In: Advances in Neural Information Processing Systems, pp. 825–832 (2002)
Bengio, Y., Delalleau, O., Le Roux, N.: The curse of dimensionality for local kernel machines. Tech rep. 1258, Université de Montréal (2005)
Wang, X., Casiraghi, G., Zhang, Y., Imura, J.: A Gaussian process-based self-organizing incremental neural network. In: International Joint Conference on Neural Networks, pp. 1–8 (2019)
Wang, X., Hasegawa, O.: Adaptive density estimation based on self-organizing incremental neural network using Gaussian process. In: International Joint Conference on Neural Networks, pp. 4309–4315 (2017)
Rasmussen, C.E., Williams, C.K.L.: Gaussian Processes for Machine Learning. MIT Press, Cambridge (2006)
Williams, C.K.L., Barber, D.: Bayesian classification with Gaussian processes. IEEE Trans. Pattern Anal. Mach. Intell. 20, 1342–1351 (1998)
Broderick, T., Boyd, N., Wibisono, A., Wilson, A.C., Jordan, M.I.: Streaming variational bayes. In: Advances in Neural Information Processing Systems, pp. 1727–1735 (2013)
Bui, T.D., Nguyen, C.V., Turner, R.E.: Streaming sparse Gaussian process approximations. In: Advances in Neural Information Processing Systems, pp. 3299–3307 (2017)
Terrell, G.R., Scott, D.W.: Estimation, variable kernel density. Ann. Stat. 20, 1236–1265 (1992)
Kim, H.C., Lee, J.: Clustering based on Gaussian processes. Neural Comput. 19, 3088–3107 (2007)
Bowman, A.W., Azzalini, A.: Applied Smoothing Techniques for Data Analysis. Clarendon Press, Oxford (1997)
Gheorghe, L., Chavarriaga, R., Millán, J.D.R.: Steering timing prediction in a driving simulator task. In: 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 6913–6916 (2013)
Gheorghe, L.: Detecting EEG correlates during preparation of complex driving maneuvers. Doctoral thesis, École Polytechnique Federale de Lausanne (2016)
Chavarriaga, R., et al.: Decoding neural correlates of cognitive states to enhance driving experience. IEEE Trans. Emerg. Top. Comput. Intell. 2, 288–297 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, X., Gheorghe, L., Imura, Ji. (2020). A Gaussian Process-Based Incremental Neural Network for Online Regression. In: Yang, H., Pasupa, K., Leung, A.CS., Kwok, J.T., Chan, J.H., King, I. (eds) Neural Information Processing. ICONIP 2020. Lecture Notes in Computer Science(), vol 12534. Springer, Cham. https://doi.org/10.1007/978-3-030-63836-8_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-63836-8_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63835-1
Online ISBN: 978-3-030-63836-8
eBook Packages: Computer ScienceComputer Science (R0)