Abstract
Probabilistic supervised learning within the Bayesian paradigm typically use Gaussian Processes (GPs) to model the sought function, and provide a means for securing reliable uncertainties in said functional learning, while offering interpretability. Prediction of the output of such a learnt function is closed-form in this approach. In this work, we present GP based learning of the functional relation between two variables, using various kinds of kernels that are called in to parametrise the covariance function of the invoked GP. However, such covariance kernels are typically parametric in the literature, with hyperparameters that are learnt from the data. Here, we discuss a new nonparametric covariance kernel, and compare its performance against existing non-stationary and stationary kernels, as well as against Deep Neural Networks. We present results on both univariate and multivariate data, to demonstrate the range of applicability of the presented learning scheme.
Supported by EPSRC DTP Studentship.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ali, M., Deo, R.C., Downs, N.J., Maraseni, T.: Cotton yield prediction with Markov chain monte Carlo-based simulation model integrated with genetic programing algorithm: a new hybrid copula-driven approach. Agric. Forest Meteorol. 263, 428–448 (2018)
Yan, B., Ren, F., Cai, M., Qiao, C.: Bayesian model based on Markov chain Monte Carlo for identifying mine water sources in submarine gold mining. J. Cleaner Prod. 253, 120008 (2020)
Lu, H., Kim, E., Gutierrez, M.: A probabilistic q-system using the Markov chain to predict rock mass quality in tunneling. Comput. Geotech. 145, 104689 (2022)
Begoli, E., Bhattacharya, T., Kusnezov, D.: The need for uncertainty quantification in machine-assisted medical decision making. Nat. Mach. Intell. 1(1), 20–23 (2019)
Dua, D., Graff, C.: UCI machine learning repository (2017). www.archive.ics.uci.edu/ml
Lee, C.H., Chang, K., Chen, Y.M., Tsai, J.T., Chen, Y.J., Ho, W.H.: Epidemic prediction of dengue fever based on vector compartment model and Markov chain Monte Carlo method. BMC Bioinf. 22(5), 1–11 (2021)
Magotra, A., Bangar, Y.C., Yadav, A.: Neural network and Bayesian-based prediction of breeding values in beetal goat. Trop. Anim. Health Prod. 54(5), 282 (2022)
Neal, R.M.: Monte Carlo implementation of gaussian process models for Bayesian regression and classification (1997). arXiv:physics/9701026
Paciorek, C., Schervish, M.: Nonstationary covariance functions for gaussian process regression. In: Advances in Neural Information Processing Systems 16 (2003)
Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. Adaptive Computation and Machine Learning. MIT Press, Cambridge (2006)
Rastogi, R., Ghosh, S., Ghosh, A.K., Vaze, K.K., Singh, P.K.: Fatigue crack growth prediction in nuclear piping using Markov chain Monte Carlo simulation. Fatigue & Fract. Eng. Mat. & Struct. 40(1), 145–156 (2017)
Remes, S., Heinonen, M., Kaski, S.: Non-stationary spectral kernels. In: Advances in Neural Information Processing Systems 30 (2017)
Roy, G., Chakrabarty, D.: Efficient uncertainty quantification for under-constraint prediction following learning using mcmc. In: Neural Information Processing, pp. 275–287. Springer Nature Singapore, Singapore (2023)
Salam, A., El Hibaoui, A.: Comparison of machine learning algorithms for the power consumption prediction:-case study of Tetouan city-. In: 2018 6th International Renewable and Sustainable Energy Conference (IRSEC), pp. 1–5. IEEE (2018)
Shen, X., Zhang, Y., Zhang, J., Wu, X.: An interval analysis scheme based on empirical error and mcmc to quantify uncertainty of wind speed. IEEE Trans. Ind. Appl. 58(6), 7754–7763 (2022)
Simpson, F., Lalchand, V., Rasmussen, C.E.: Marginalised gaussian processes with nested sampling. Adv. Neural. Inf. Process. Syst. 34, 13613–13625 (2021)
Smith, H.J., Dinev, T., Xu, H.: Information privacy research: an interdisciplinary review. MIS Q. 989–1015 (2011)
Wang, Y., Zhou, C., Chen, Z.: An enhanced approach for load behavior and battery residual capacity prediction using Markov chain and Monte Carlo method. IEEE J. Emerg. Selected Top. Ind. Electr. 4(1), 159–167 (2023)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Roy, G., Warrior, K., Chakrabarty, D. (2023). Covariance Kernel Learning Schemes for Gaussian Process Based Prediction Using Markov Chain Monte Carlo. In: Moniz, N., Vale, Z., Cascalho, J., Silva, C., Sebastião, R. (eds) Progress in Artificial Intelligence. EPIA 2023. Lecture Notes in Computer Science(), vol 14115. Springer, Cham. https://doi.org/10.1007/978-3-031-49008-8_15
Download citation
DOI: https://doi.org/10.1007/978-3-031-49008-8_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-49007-1
Online ISBN: 978-3-031-49008-8
eBook Packages: Computer ScienceComputer Science (R0)