On the detection of patterns in electricity prices across European countries: An unsupervised machine learning approach

Dimitrios Saligkaras; Vasileios E. Papageorgiou; Dimitrios Saligkaras; Vasileios E. Papageorgiou

doi:10.3934/energy.2022054

AIMS Energy

2022, Volume 10, Issue 6: 1146-1164. doi: 10.3934/energy.2022054

Previous Article Next Article

Research article Topical Sections

On the detection of patterns in electricity prices across European countries: An unsupervised machine learning approach

Department of Mathematics, Aristotle University of Thessaloniki, Thessaloniki 54124, Greece

Received: 08 August 2022 Revised: 28 October 2022 Accepted: 03 November 2022 Published: 09 November 2022

The year 2022 is characterized by a generalized energy crisis, which leads to steadily increasing electricity prices around the world, while the corresponding salaries remain stable. Therefore, examining trends in electricity prices relative to existing income levels can provide valuable insights into the overpricing/underpricing of energy consumption. In this article, we examine the tendencies of 35 European countries according to their national kWh prices and the average household incomes. We use a series of established clustering methods that leverage available information to reveal price and income patterns across Europe. We obtain important information on the balance between family earnings and electricity prices in each European country and are able to identify countries and regions that offer the most and least favorable economic conditions based on these two characteristics studied. Our analysis reveals the existence of four price and income patterns that reflect geographical differences across Europe. Countries such as Iceland, Norway, and Luxembourg exhibit the most favorable balance between prices and earnings. Conversely, electricity prices appear to be overpriced in many southern and eastern countries, with Portugal being the most prominent example of this phenomenon. In general, average household incomes become more satisfactory for European citizens as we move from east to west and south to north. In contrast, the respective national electricity prices do not follow this geographical pattern, leading to notable imbalances. After identifying significant cases of inflated prices, we investigate the respective causes of the observed situation with the aim of explaining this extreme behavior with exogenous factors. Finally, it becomes clear that the recent increase in energy prices should not be considered as a completely unexpected event, but rather as a phenomenon that has occurred and developed gradually over the years.
- clustering algorithms,
- electricity prices,
- Partition Around Medoids,
- hierarchical clustering,
- household incomes,
- unsupervised machine learning
Citation: Dimitrios Saligkaras, Vasileios E. Papageorgiou. On the detection of patterns in electricity prices across European countries: An unsupervised machine learning approach[J]. AIMS Energy, 2022, 10(6): 1146-1164. doi: 10.3934/energy.2022054

Related Papers:

Abstract

The year 2022 is characterized by a generalized energy crisis, which leads to steadily increasing electricity prices around the world, while the corresponding salaries remain stable. Therefore, examining trends in electricity prices relative to existing income levels can provide valuable insights into the overpricing/underpricing of energy consumption. In this article, we examine the tendencies of 35 European countries according to their national kWh prices and the average household incomes. We use a series of established clustering methods that leverage available information to reveal price and income patterns across Europe. We obtain important information on the balance between family earnings and electricity prices in each European country and are able to identify countries and regions that offer the most and least favorable economic conditions based on these two characteristics studied. Our analysis reveals the existence of four price and income patterns that reflect geographical differences across Europe. Countries such as Iceland, Norway, and Luxembourg exhibit the most favorable balance between prices and earnings. Conversely, electricity prices appear to be overpriced in many southern and eastern countries, with Portugal being the most prominent example of this phenomenon. In general, average household incomes become more satisfactory for European citizens as we move from east to west and south to north. In contrast, the respective national electricity prices do not follow this geographical pattern, leading to notable imbalances. After identifying significant cases of inflated prices, we investigate the respective causes of the observed situation with the aim of explaining this extreme behavior with exogenous factors. Finally, it becomes clear that the recent increase in energy prices should not be considered as a completely unexpected event, but rather as a phenomenon that has occurred and developed gradually over the years.

References

[1]	Papageorgiou V (2021) Brain tumor detection based on features extracted and classified using a low-complexity neural network. Trait du Signal 38: 547–554. https://doi.org/10.18280/ts.380302 doi: 10.18280/ts.380302
[2]	Papageorgiou VE, Zegkos T, Efthimiadis GK, et al. (2022) Analysis of digitalized ECG signals based on artificial intelligence and spectral analysis methods specialized in ARVC. Int J Numer Meth Biomed Eng 38: e3644. https://doi.org/10.1002/cnm.3644 doi: 10.1002/cnm.3644
[3]	Khanam M, Mahboob T, Imtiaz W, et al. (2015) A survey on unsupervised machine learning algorithms for automation, classification and maintenance. Int J Comput Appl 119: 34–39. https://doi.org/10.5120/21131-4058 doi: 10.5120/21131-4058
[4]	Omran M, Engelbrecht A, Salman AA (2007) An overview of clustering methods. Intell Data Anal 11: 583–605. https://doi.org/10.3233/IDA-2007-11602 doi: 10.3233/IDA-2007-11602
[5]	Fraley C, Raftery AE (2002) Model-Based clustering, discriminant analysis, and density estimation. J Am Stat Assoc 97: 611–631. https://doi.org/10.2307/3085676 doi: 10.1198/016214502760047131
[6]	Namratha M (2012) A comprehensive overview of clustering algorithms in pattern recognition. IOSR J Comput Eng 4: 23–30. https://doi.org/10.9790/0661-0462330 doi: 10.9790/0661-0462330
[7]	Matuszewska-Janica A, Żebrowska-Suchodolska D, Mazur-Dudzińska A (2021) The situation of households on the energy market in the european union: Consumption, prices, and renewable energy. Energies 14: 6364. https://doi.org/10.3390/en14196364 doi: 10.3390/en14196364
[8]	Gostkowski M, Rokicki T, Ochnio L, et al. (2021) A clustering analysis of energy consumption in the countries of the visegrad group. Energies 14: 5612. https://doi.org/10.3390/en14185612 doi: 10.3390/en14185612
[9]	Poyrazoglu G (2021) Determination of price zones during transition from uniform to zonal electricity market: A case study for Turkey. Energies 14: 1014. https://doi.org/10.3390/en14041014 doi: 10.3390/en14041014
[10]	Martínez Álvarez F, Troncoso Α, Riquelme JC, et al. (2007) Discovering patterns in electricity price using clustering techniques. International Conference on Renewable Energies and Power Quality—ICREPQ, 174–181. https://doi.org/10.24084/repqj05.245 doi: 10.24084/repqj05.245
[11]	Verbič M, Filipović S, Radovanović M (2017) Electricity prices and energy intensity in Europe. Util Policy 47: 58–68. https://doi.org/10.1016/j.jup.2017.07.001 doi: 10.1016/j.jup.2017.07.001
[12]	Gil-Alana LA, Martin-Valmayor M, Wanke P (2020) The relationship between energy consumption and prices. Evidence from futures and spot markets in Spain and Portugal. Energy Strategy Rev 31: 100522. https://doi.org/10.1016/j.esr.2020.100522 doi: 10.1016/j.esr.2020.100522
[13]	Takentsi S, Sibanda K, Hosu YS (2022) Energy prices and economic performance in South Africa: an ARDL bounds testing approach. Cogent Econ Finance 10: 2069905. https://doi.org/10.1080/23322039.2022.2069905 doi: 10.1080/23322039.2022.2069905
[14]	Shah I, Igtikhar H, Ali S (2022) Modeling and forecasting electricity demand and prices: A comparison of alternative approaches. J Math 2022: 3581037. https://doi.org/10.1155/2022/3581037 doi: 10.1155/2022/3581037
[15]	Wang J, Li H (2021) The impact of electricity price on power-generation structure: Evidence from China. Front Environ Sci 9: 733809. https://doi.org/10.3389/fenvs.2021.733809 doi: 10.3389/fenvs.2021.733809
[16]	Papageorgiou V (2022) A study of primary school teachers' tendencies regarding the usefulness of dramatization in the educational process. Int J Cognitive Res Sci, Eng Educ (IJCRSEE) 10: 145–162. https://doi.org/10.23947/2334-8496-2022-10-2-145-162 doi: 10.23947/2334-8496-2022-10-2-145-162
[17]	Zhou Y, Zheng S (2020) Machine-learning based hybrid demand-side controller for high-rise office buildings with high energy flexibilities. Appl Energy 262: 114416. https://doi.org/10.1016/j.apenergy.2019.114416 doi: 10.1016/j.apenergy.2019.114416
[18]	Zhou Y, Zheng S, Liu Z, et al. (2020) Passive and active phase change materials integrated building energy systems with advanced machine-learning based climate-adaptive designs, intelligent operations, uncertainty-based analysis and optimisations: A state-of-the-art review. Renewable Sustainable Energy Rev 130: 109889. https://doi.org/10.1016/j.rser.2020.109889 doi: 10.1016/j.rser.2020.109889
[19]	Liu J, Zhou Y, Yang H, et al. (2022) Uncertainty energy planning of net-zero energy communities with peer-to-peer energy trading and green vehicle storage considering climate changes by 2050 with machine learning methods. Appl Energy 321: 119394. https://doi.org/10.1016/j.apenergy.2022.119394 doi: 10.1016/j.apenergy.2022.119394
[20]	Day WHE, Edelsbrunner H (1984) Efficient algorithms for agglomerative hierarchical clustering methods. J Classif 1: 7–24. https://doi.org/10.1007/BF01890115 doi: 10.1007/BF01890115
[21]	Murtagh F (1984) Complexities of hierarchic clustering algorithms: The state of the Art. Comput Stat Q 1: 101–113. Available from: https://www.researchgate.net/profile/Fionn-Murtagh-2/publication/238655641_Complexities_of_hierarchic_clustering_algorithms_State_of_the_art/links/5452a2970cf26d5090a377f1/Complexities-of-hierarchic-clustering-algorithms-State-of-the-art.pdf.
[22]	Murtagh F, Legendre P (2011) Ward's hierarchical clustering method: Clustering criterion and agglomerative algorithm. J Classif 31: 274–295. https://doi.org/10.1007/s00357-014-9161-z doi: 10.1007/s00357-014-9161-z
[23]	Jain AK, Dubes RC (1988) Algorithms for clustering data. Prentice-Hall, Inc. Division of Simon and Schuster One Lake Street Upper Saddle River, NJUnited States. Available from: https://homepages.inf.ed.ac.uk/rbf/BOOKS/JAIN/Clustering_Jain_Dubes.pdf.
[24]	Caliński T, Harabasz J (1974) A dendrite method for cluster analysis. Commun Stat 3: 1–27. https://doi.org/10.1080/03610927408827101 doi: 10.1080/03610927408827101
[25]	Lance G, Williams WT (1967) A general theory of classificatory sorting strategies: 1. Hierarchical Systems. Comput J 9: 373–380. https://doi.org/10.1093/COMJNL/9.4.373 doi: 10.1093/comjnl/9.4.373
[26]	Lloyd SP (1957) Least squares quantization in PCM. Technical Report RR-5497, Bell Lab. Available from: http://mlsp.cs.cmu.edu/courses/fall2010/class14/lloyd.pdf.
[27]	Papageorgiou V, Tsaklidis G (2021) Modeling of premature mortality rates from chronic diseases in Europe, investigation of correlations, clustering and granger causality. Commun Math Biol Neurosci. https://doi.org/10.28919/cmbn/5926 doi: 10.28919/cmbn/5926
[28]	Arthur D, Vassilvitskii S (2007) K-means++: The advantages of careful seeding. Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms. https://doi.org/10.1145/1283383.1283494 doi: 10.1145/1283383.1283494
[29]	Hamerly G, Elkan C (2002) Alternatives to the k-means algorithm that find better clusterings. CIKM '02: Proceedings of the Eleventh International Conference on Information and Knowledge Management, 600–607. https://doi.org/10.1145/584792.584890 doi: 10.1145/584792.584890
[30]	Kaufman L, Rousseeuw PJ (2005) Finding groups in data, an introduction to cluster analysis. John Wiley Sons. https://doi.org/10.1002/9780470316801 doi: 10.1002/9780470316801
[31]	Ester M, Kriegel HP, Sander J, et al. (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. Proceedings of 2^nd International Conference on Knowledge Discovery and Data Mining. Available from: https://www.aaai.org/Papers/KDD/1996/KDD96-037.pdf.
[32]	Saligkaras D, Papageorgiou VE (2022) Seeking the truth beyond the data. An unsupervised machine learning approach. https://doi.org/10.48550/arXiv.2207.06949
[33]	Kumar AV, Selvaraj JC (2016) A review on clustering algorithms. J Recent Res Appl Stud 8: 99–103. https://doi.org/10.2307/3085676 doi: 10.2307/3085676
[34]	Gu J (2021) Comparative analysis based on clustering algorithms. J Phys: Conference Series 1994: 012024. https://doi.org/10.1088/1742-6596/1994/1/012024 doi: 10.1088/1742-6596/1994/1/012024
[35]	Ankerst M, Breunig MM, Kriegel HP, et al. (1999) OPTICS: Ordering points to identify the clustering structure. ACM SIGMOD Rec 28: 49–60. https://doi.org/10.1145/304182.304187 doi: 10.1145/304182.304187
[36]	Diaz-Rozo J, Bielza C, Larranaga P (2018) Clustering of data streams with dynamic gaussian mixture models: An IOT application in industrial processes. IEEE Int Things J 5: 3533–3547. https://doi.org/10.1109/JIOT.2018.2840129 doi: 10.1109/JIOT.2018.2840129

Reader Comments

Your name:*

Email:*
© 2022 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)