Abstract
Self-organizing inductive modeling represented by the Group Method of Data Handling (GMDH) as an early implementation of Deep Learning is a proven and powerful data-driven modeling technology for solving ill-posed modeling problems as found in energy forecasting and other complex systems. It develops optimal complex predictive models, systematically, from sets of high-dimensional noisy input data. The paper describes the implementation of a rolling twelve weeks self-organizing modeling and probabilistic ex ante forecasting, exemplarily, for the Global Energy Forecasting Competition 2014 (GEFCom 2014) electricity price and wind power generation forecasting tracks using the KnowledgeMiner INSIGHTS inductive modeling tool out-of-the-box. The self-organized non-linear models are available analytically in explicit notation and can be exported to Excel, Python, or Objective-C source code for further analysis or model deployment. Based on the pinball loss function they show an overall performance gain of 67.3% for electricity price forecasting and 47.5% for wind power generation forecasting relative to corresponding benchmark measures.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
European Union: A Framework Strategy for a Resilient Energy Union with a Forward-Looking Climate Change Policy (2015). http://eur-lex.europa.eu/legal-content/EN/TXT/?uri=COM:2015:80:FIN
Farlow, S.J., (ed.) Self-organizing Methods in Modeling. GMDH Type Algorithm. Marcel Dekker, New York (1984). ISBN 0-8247-7161-3
Hong, T., Pinson, P., Fan, S., Zareipour, H., Troccoli, A., Hyndman, R.J.: Probabilistic energy forecasting: global energy forecasting competition 2014 and beyond. Int. J. Forecast. 32, 896–913 (2016)
Ivakhnenko, A.G.: Group method of data handling as a rival of stochastic approximation method. Sov. Autom. Control. 3, 58–72 (1968)
Ivakhnenko, A.G., Stepashko, V.S.: Pomechoustojcivost’ modelirovanija (Noise-immunity of modeling). Naukova dumka, Kiev (1985). (In Russian)
KnowledgeMiner Software: INSIGHTS - Self-organizing modeling and forecasting tool, v6.1.3 (2018 A). https://www.knowledgeminer.eu. Last Accessed 05 May 2018
KnowledgeMiner Software: OCKHAM – Global Sensitivity Analysis tool, v2.0.1 (2018 B). https://www.knowledgeminer.eu/ockham. Last Accessed 02 May 2018
Kondo, T., Ueno, J.: Feedback GMDH-type neural network self-selecting optimum neural network architecture and its application to 3-dimensional medical image recognition of the lungs. In: Proceedings of II International Workshop on Inductive Modelling, Czech Technical University, Prague, pp. 63–70 (2007)
Kordik, P.: Fully automated knowledge extraction using group of adaptive model evolution. Ph.D. thesis, Department of Computer Science and Computers, FEE, CTU in Prague (2006)
Lambert, R., Lemke, F., Kucherenko, S., Song, S., Shah, N.: Global sensitivity analysis using sparse high dimensional model representations generated by the group method of data handling technique. J. Math. Comput. Simul. 128, 42–54 (2016)
Madala, H.R., Ivakhnenko, A.G.: Inductive Learning Algorithms for Complex Systems Modelling. CRC Press Inc., Boca Raton, Ann Arbor, London, Tokyo (1994). ISBN 0-8493-4438-7
Müller, J.-A., Lemke, F.: Self-organizing Data Mining. Libri, Hamburg (2000). ISBN: 3-89811-861-4
Schmidhuber, J.: Deep learning in neural networks: an overview. Neural Netw. 61, 85–117 (2015)
Stepashko, V.S.: Potential noise immunity of modelling using a combinatorial GMDH algorithm without information regarding the noise. Sov. Autom. Control. 16(3), 15–25 (1983)
Stepashko, V.S.: Method of critical variances as analytical tool of theory of inductive modeling. J. Autom. Inf. Sci. 40(3), 4–22 (2008)
Weron, R.: Electricity price forecasting: a review of the state-of-the-art with a look into the future. Int. J. Forecast. 30, 1030–1081 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Lemke, F. (2019). Probabilistic Energy Forecasting Based on Self-organizing Inductive Modeling. In: Shakhovska, N., Medykovskyy, M. (eds) Advances in Intelligent Systems and Computing III. CSIT 2018. Advances in Intelligent Systems and Computing, vol 871. Springer, Cham. https://doi.org/10.1007/978-3-030-01069-0_29
Download citation
DOI: https://doi.org/10.1007/978-3-030-01069-0_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-01068-3
Online ISBN: 978-3-030-01069-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)