Research article Special Issues

Dynamic correlation among title transfer facility natural gas, Brent oil and electricity EPEX spot markets: Spillover effects of economic shocks on returns and volatility

  • This research explores the spillover effects in the directional movement of returns and the persistence of shocks among three prominent energy spot markets: title transfer facility for natural gas, Brent crude oil and electricity markets from monthly price data spanning January 2010 to September 2022. Methodologically, we initially employ bivariate vector autoregressive models to detect potential lagged return effects from one spot market on another. Then, we examine the impact on the conditional mean returns and volatility across these spot markets using the standard dynamic conditional correlation (DCC) model, as well as the respective asymmetric (ADCC) and flexible (FDCC) extensions. In addition, we accommodate innovative insights that include recent datasets on the COVID-19 crisis and the Ukrainian war, which constitute a new addition to the existent literature. The empirical findings confirm the significant impact of these two unprecedented moments of contemporaneous history, given that both events are substantiated by an exponential increase in prices and by a rise in volatility. However, the effect on returns was not uniform across the time series. Specifically, there was a consistent increase in volatility for natural gas and electricity from the start of 2020 until the end of 2022, while Brent oil exhibited a substantial peak only in the first half of 2020. This study also reveals that previous lagged returns within each market, particularly for Brent oil and electricity, had statistically significant effects on current returns. There was also a robust unidirectional positive spillover effect from the Brent oil market to the returns of electricity and the natural gas markets. The study also reveals the presence of a weak positive autocorrelation between natural gas and electricity returns, and positive shocks to returns had a more pronounced impact on volatility compared to negative shocks across all the time series.

    Citation: Gustavo Soutinho, Vítor Miguel Ribeiro, Isabel Soares. Dynamic correlation among title transfer facility natural gas, Brent oil and electricity EPEX spot markets: Spillover effects of economic shocks on returns and volatility[J]. AIMS Energy, 2023, 11(6): 1252-1277. doi: 10.3934/energy.2023057

    Related Papers:

    [1] Ngo Thai Hung . Dynamic spillover effects between oil prices and stock markets: New evidence from pre and during COVID-19 outbreak. AIMS Energy, 2020, 8(5): 819-834. doi: 10.3934/energy.2020.5.819
    [2] Ngo Thai Hung . Interdependence of oil prices and exchange rates: Evidence from copula-based GARCH model. AIMS Energy, 2019, 7(4): 465-482. doi: 10.3934/energy.2019.4.465
    [3] Siming Liu, Honglei Gao, Peng Hou, Yong Tan . Risk spillover effects of international crude oil market on China’s major markets. AIMS Energy, 2019, 7(6): 819-840. doi: 10.3934/energy.2019.6.819
    [4] Mousa Tawfeeq, Alan R. Collins, Adam Nowak . The dynamic response of coal consumption to energy prices and GDP: An ARDL approach to the U.S.. AIMS Energy, 2020, 8(6): 1156-1172. doi: 10.3934/energy.2020.6.1156
    [5] Mojgan Pouralizadeh, Aliraza Amirtaimoori, Rossana Riccardi, Mohsen Vaez-Ghasemi . Supply chain performance evaluation in the presence of undesirable products: A case on power industry. AIMS Energy, 2020, 8(1): 48-80. doi: 10.3934/energy.2020.1.48
    [6] Mojgan Pouralizadeh . A DEA model to sustainability improvement of the electricity supply chain in presence dual-role factors and undesirable outputs: A case on the power industry. AIMS Energy, 2020, 8(4): 580-614. doi: 10.3934/energy.2020.4.580
    [7] Yassine Charabi, Sabah Abdul-Wahab . The optimal sizing and performance assessment of a hybrid renewable energy system for a mini-gird in an exclave territory. AIMS Energy, 2020, 8(4): 669-685. doi: 10.3934/energy.2020.4.669
    [8] Charalambos Chasos, George Karagiorgis, Chris Christodoulou . Technical and Feasibility Analysis of Gasoline and Natural Gas Fuelled Vehicles. AIMS Energy, 2014, 2(1): 71-88. doi: 10.3934/energy.2014.1.71
    [9] Yan Li, Yaheng Su, Qixin Zhao, Bala Wuda, Kaibo Qu, Lei Tang . An electricity price optimization model considering time-of-use and active distribution network efficiency improvements. AIMS Energy, 2025, 13(1): 13-34. doi: 10.3934/energy.2025002
    [10] Seyed Reza Mirnezami . Do Oil-Producing Countries Have Normal Oil Overconsumption? An Investigation of Economic Growth and Energy Subsidies. AIMS Energy, 2015, 3(3): 267-283. doi: 10.3934/energy.2015.3.267
  • This research explores the spillover effects in the directional movement of returns and the persistence of shocks among three prominent energy spot markets: title transfer facility for natural gas, Brent crude oil and electricity markets from monthly price data spanning January 2010 to September 2022. Methodologically, we initially employ bivariate vector autoregressive models to detect potential lagged return effects from one spot market on another. Then, we examine the impact on the conditional mean returns and volatility across these spot markets using the standard dynamic conditional correlation (DCC) model, as well as the respective asymmetric (ADCC) and flexible (FDCC) extensions. In addition, we accommodate innovative insights that include recent datasets on the COVID-19 crisis and the Ukrainian war, which constitute a new addition to the existent literature. The empirical findings confirm the significant impact of these two unprecedented moments of contemporaneous history, given that both events are substantiated by an exponential increase in prices and by a rise in volatility. However, the effect on returns was not uniform across the time series. Specifically, there was a consistent increase in volatility for natural gas and electricity from the start of 2020 until the end of 2022, while Brent oil exhibited a substantial peak only in the first half of 2020. This study also reveals that previous lagged returns within each market, particularly for Brent oil and electricity, had statistically significant effects on current returns. There was also a robust unidirectional positive spillover effect from the Brent oil market to the returns of electricity and the natural gas markets. The study also reveals the presence of a weak positive autocorrelation between natural gas and electricity returns, and positive shocks to returns had a more pronounced impact on volatility compared to negative shocks across all the time series.



    In recent years, energy markets have experienced important upheaval, exerting a substantial impact on the European economy and contributing to increased living costs and inflation [1]. These markets are marked by intricate geopolitical factors, amplifying the instability in various sectors and industries due to pronounced price volatility [2,3,4,5]. Notably, oil and natural gas (NG) stand out as the most pivotal commodities among the energy sources, with biofuels also meriting attention [6,7]. Despite their importance, existing literature has predominantly focused on the adverse effects of rising oil and natural gas prices on economic growth [8]. For oil, two primary reasons are typically cited to rationalize these effects: their critical roles as inputs in the production process and the perception of crude oil as a lucrative investment asset [9,10]. Indeed, Brent oil continues to hold a crucial position in the transportation industry and as a raw material for the chemical industry. Consequently, forecasting oil prices remains a relevant action to ensure energy supply security and to inform policymakers [11].

    However, the influence of NG has also been expanding in global energy markets [12]. This was particularly noticed with the war in Ukraine and the European Union (EU) sanctions against Russia, which led to a reduced importance of oil compared to NG and electricity in driving inflation and economic growth in Europe [13]. According to the International Energy Agency (IEA), NG consumption witnessed a robust 4.6% growth in 2018, contributing significantly to the overall increase in global energy demand [14]. NG also plays a pivotal role in achieving a fully decarbonized economy, aligning with the EU's decision to reduce greenhouse gas emissions by at least 55% by 2030 compared to 1990 levels [15]. It is worth highlighting that NG can be utilized across various sectors, including residential, commercial, industrial, power generation and transportation.

    There is extensive literature addressing the impact of energy markets on economy and financial crises. Among them, [16] argues that oil price shocks can affect a country's performance due to their capacity to disrupt the purchase of goods and investment realization. Some studies [17,18,19] extend the vision on energy resources by investigating the relationship among various energy prices, power markets and clean energy stocks. Others, such as [20,21], analyze volatility spillovers between oil and stock markets in Europe, the United States of America (USA) and Gulf Cooperation Council (GCC) countries. [22,23] explore volatility spillovers between oil and natural gas and between energy markets and European energy stock prices. Additionally, [24] investigated the impact of European Union Allowance (EUA) price fluctuations on the stock performance of electricity firms, while [25] examined correlations between United States equity indices, European equity indices and the Chinese stock market.

    The COVID-19 pandemic triggered a severe economic shock, resulting in an unprecedented adverse impact on world economies. Accordingly, [26] compares this recent crisis to the great economic recession of the subprime mortgage crisis (2007–2008). The global economy contracted by 3.3% in 2020 compared to the growth of 2.8% achieved in 2019. In particular, lockdowns had a profound impact on citizens' lifestyle and financial markets, as reported by [27,28,29,30]. The global economy also took a huge toll after the invasion of Ukraine by Russia. All countries were hit by higher commodity prices, especially in the energy and food industries. This geopolitical instability naturally hampered the recovery of the global economy in the post-pandemic phase [31]. For instance, the crude oil market suffered another shock in 2022, with prices skyrocketing from around 76 USD per barrel in January 2022 to over 110 USD in March 2022 [32]. Moreover, NG spot market prices exhibited exponential growth since the first half of 2021. For example, the IEA projected in its 2022 Q4 gas market report that global NG consumption is expected to increase at an annual average rate of 0.8% from 2022 to 2025 [33]. Several studies describe that these geopolitical factors had a significant impact on energy trade [34,35], energy prices [36,37] and counter-cyclically [38,39].

    In recent decades, there has been an increased interest in modeling and forecasting the volatility of time series, as well as examining the relationships among them [40]. This heightened focus is a consequence of time series typically exhibiting time-varying conditional variance, commonly referred to as volatility, and correlations. Higher volatilities increase the risk of assets, while higher conditional correlations lead to an increased risk in portfolios. In this context, our interest lies not in examining the variance of such time series throughout the sample period but specifically in the varying or conditional variance. Another crucial phenomenon related to the relationships among time series is the spillover effect, which occurs when one event (e.g., oil price return) triggers another event (i.e., NG returns) in a similar manner [41]. These spillover effects and volatility have undergone detailed analysis. For instance, [42] investigated the volatility spillover between crude oil, natural gas and the S & P500 markets during the COVID-19 pandemic. Additionally, [43] implemented a time-varying Granger causality test to confirm the bilateral contagion effect between the World Trade Institute (WTI) and gold during this period. [44] adopted the Multifractal Detrended Fluctuation Analysis (MF-DFA) approach to analyze the asymmetric multifractality between Brent crude oil and gold prices, and [45,46] examined the dynamic spillover effects between bitcoin and crude oil during the pandemic crisis.

    To thoroughly analyze these events, generalized autoregressive conditional heteroskedastic (GARCH) models have been widely employed in various types of portfolios for modeling time series volatility [47]. These models generalize ARCH models [48], as the conditional variance does not depend solely on previous squared error values but also on previous values of the same variance [47]. Therefore, as their main advantages, they allow for accommodating both effects: conditional standard deviations of the returns on stocks in the portfolio will co-evolve, and correlations between the returns will also vary [49]. There are several types of GARCH models, such as the exponentially weighted moving average (EWMA) model, the diagonal vector error correction (VEC) model, the dynamic conditional correlations (DCC) model, orthogonal GARCH or the dynamical orthogonal components model, whose usefulness has been confirmed in various studies involving energy markets. For example, [50] investigated the portfolio and hedging implications based on DCC and corrected DCC-GARCH models, reporting that oil-importing nations are significantly affected by lagged oil price shocks, although there is less evidence of interdependence between stock markets for both oil-importing and oil-exporting countries. Furthermore, [51] utilized DCC-GARCH models to assess the time-varying dynamics of value-at-risk (VaR) on daily stock returns of emerging markets. Results confirmed that this approach captures the volatility of stock returns better than traditional VaR models. Regarding the main limitations of GARCH models, [52] asserts that stock market returns are negatively correlated with changes in volatility returns, implying that volatility tends to rise in response to bad news and fall in response to good news. Another constraint is the non-negativity of parameters to ensure the positivity of the conditional variance [47]. Specifically, for multivariate GARCH models (MGARCH) in situations with a high number of parameters (d > 10), the estimation of the volatility matrix may become infeasible [49]. Thus, despite being a popular choice, one limitation of the method is the requirement of a large sample size [32].

    Furthermore, conditional correlation models have emerged as a more practical alternative for predicting and interpreting parameters [53]. In this context, the DCC-GARCH model [54] is more realistic than the constant conditional correlation CCC-GARCH model [55] as it allows for conditional correlations to change over time. The asymmetric ADCC [56] model is an extension of the DCC, enabling the presence of asymmetric dynamic correlations. Finally, the FDCC [57] introduces a more flexible parameterization of correlation dynamics by relaxing the equality for all correlations. Numerous examples in the literature confirm the relevance of these models for capturing the dynamic dependence of time-varying correlation coefficients. For instance, [58] concludes that DCC models provide a better estimation of the dynamic correlation structure, enabling more efficient capture of volatilities and forecasting of returns than other models.

    Motivated by the insights mentioned above, this paper aims to examine the spillover effects on returns and volatility among three prominent energy spot markets: title transfer facility (TTF) for natural gas (NG), Brent crude oil, and the electricity market (EPEX). To achieve this, we employ a two-step approach. First, we use vector autoregressive (VAR) models to identify lagged return effects from one spot market to another. Second, we utilize a set of models belonging to the family of DCC, which has proven to be suitable in previous studies. With these models, we assess the impact on the conditional mean returns and volatility across the spot markets. Despite several papers addressing different types of energy resources, none have comprehensively analyzed the joint impacts on the persistence shocks of NG, oil and electricity spot markets, as presented in this research. We also introduce innovative insights by incorporating recent datasets covering the role of the COVID-19 pandemic crisis and the war in Ukraine on returns and volatilities. In terms of methodology, given the prominence of the family of DCC methods in the literature, we introduce a comparative analysis of results for estimating dynamical conditional correlations, utilizing DCC models and their subsequent extensions: asymmetric (ADCC) and flexible (FDCC). This constitutes an innovation in the literature, especially when considering these three spot markets, which has not been done in the past.

    Given the significance of the COVID-19 pandemic and the war in Ukraine, both of which led to unprecedented instability in economies, our study proposes to test the following research hypotheses concerning this topic:

    A1: The pandemic crisis had a substantial impact on the returns of the TTF NG, Brent crude oil and electricity EPEX spot markets, but the impact was not uniform across these markets.

    A2: The Ukraine conflict extended the influence of the pandemic crisis on the returns and volatilities of these spot markets, albeit with varying degrees of intensity.

    The impacts of NG, oil and electricity on other activity sectors are frequently discussed in the literature. This paper also aims to offer new and recent insights by combining these three energy sources. The goal is to provide information for stakeholders in the energy markets regarding the following research hypothesis:

    B1: Lagged returns significantly influenced the returns of TTF NG, Brent crude oil and electricity over time.

    B2: There was a notable spillover effect on returns and volatility among these spot markets.

    C: The persistence of shocks affected the dynamic conditional correlations differently among the spot markets.

    As the main empirical findings, this paper reveals the considerable effect of the pandemic crisis and the Ukrainian war on the increase in volatility, but with different impacts on returns among energy sources. This study also highlights the significant effect of previous lagged returns within each market, particularly for Brent oil and electricity. Additionally, it identifies a robust unidirectional positive spillover effect from the Brent oil market to the returns of electricity and NG markets. Finally, the time-varying correlation coefficient of the DCC-GARCH model reveals weak positive autocorrelation between NG and electricity returns. Furthermore, positive shocks to returns had a more pronounced impact on volatility compared to negative shocks across all the time series.

    The study is structured as follows: section 2 provides a description of the datasets and the mathematical foundation underlying the empirical models employed. section 3 presents the results, and section 4 summarizes the main conclusions, limitations and potential avenues for future research.

    We have curated three distinct datasets, each comprising 153 monthly price records, representing natural gas, oil and electricity from the following sources: TTF NG in the Netherlands, Brent crude oil and electricity from the Germany-Luxembourg (DE/LU) spot market. These datasets cover the period from January 2010 to September 2022, selected to provide an overview of these markets since the beginning of the 2010 decade, shortly after the subprime mortgage crisis [59], until the last available data at the time of data collection for our study. The choice of monthly data was based on the periodicity retrieved from Nasdaq Data Link [60] and the USA Energy Information Administration (EIA) [61], for TTF NG and Brent crude oil, respectively. For consistency of results, we also selected monthly data for electricity from the Energy-Charts [62] website. TTF NG, renowned for its high liquidity, is a key player in the European NG market and is primarily traded on the European Energy Exchange (EEX) [63]. It distinguishes itself as a prominent NG trading hub in Europe. Brent crude oil, on the other hand, holds substantial global significance and serves as a crucial benchmark for global oil pricing. It is closely monitored by central banks and international institutions [64]. Lastly, EPEX SPOT operates day-ahead power markets for various European countries. In our analysis, we specifically focus on electricity prices from the Germany-Luxembourg spot market [62], representing this facet of the energy market.

    Before delving into the empirical models, we conducted a preliminary analysis involving a six-step procedure as follows:

    ● Return calculation

    ● Normal distribution check

    ● Serial data correlation verification

    ● Correlation analysis over time

    ● Unit root analysis

    ● Autoregressive conditional heteroscedasticity (ARCH) effects examination

    Initially, we computed price returns from the NG, Brent oil and electricity spot markets. These returns (denoted as 'r') signify the proportion gained or lost (p) since the previous time period. This calculation can be approximated as follows:

    rt=ptpt1pt1log(pt)log(pt1) (1)

    This approximation is effective when rt is close to zero. Obviously, a possible asset may be risky if its returns exhibit significant fluctuations over time. Market volatility tends to surge when major news or events occur, and it may require several periods for the market to fully assimilate and respond to such developments. In the second step, we examined the normal distribution of each series using the Jarque-Bera (JB) test [65]. Rejecting the null hypothesis in this context indicates that a given time series deviates from a normal distribution at a specified critical significance level, typically 0.05. Another crucial aspect to consider is the presence of serial correlation, which can impact the unbiased and consistent estimation of regression model coefficients. In the third step, we employed the Ljung-Box Q test to assess autocorrelation within the series [66]. Rejection of the null hypothesis at the 0.05 significance level signifies the presence of serial correlation. Moving on to the fourth step, we employed Pearson's correlation coefficient to evaluate the association between two variables [67]. As a fifth step, we conducted tests to check the stationarity of the time series. This is essential to avoid spurious correlations in autoregressive models. We utilized the augmented Dickey-Fuller (ADF) and Phillips-Perron (PP) tests for this purpose. The presence of unit roots in a time series can manifest when there are changes in the mean, variance or autocovariance of its distribution over time [68]. The ADF test extends the Dickey-Fuller test by incorporating additional lagged terms of dependent variables to eliminate autocorrelation [69]. Rejection of the null hypothesis in both tests indicates that the time series is stationary. Lastly, we investigated the presence of serial dependence (i.e., ARCH effects). To accomplish this, we employed Engle's ARCH test, which is a Lagrange multiplier (LM) test designed to assess the significance of these effects [48]. Alternatively, the Ljung-Box Q test can be used with Engle's ARCH test to examine ARCH effects in the first m lags of the squared residual series.

    ARCH models are frequently used in macroeconomics. For instance, [48,70] found evidence that large and small forecast errors may occur in some clusters. The GARCH model introduced by [49] is a more robust model by enabling the conditional variance to be dependent on previous lags [71]. We implemented a multivariate GARCH model, which has the power to examine returns and volatility linkages [72,73,74]. To infer the variance of residuals of VAR (1) and to estimate the dynamic conditional correlation between prices and returns of TTF NG, Brent oil and electricity EPEX spot markets, we use DCC, ADCC and FDCC models. Several studies reveal the ability of this approach to capture spillover effects on returns and volatility [51,53,72,73,74].

    Consider the model with p-order in terms of lags as follows:

    rt=δ+Φ1rt1+Φ2rt2+Φprtp+ht (2)

    where δ=(δ1,δ2,,δn) is a vector of the constant terms, Φ a matrix of the previous own lag time (t−1) returns and ht=(h1t,,hnt) a vector of the serial uncorrelated error terms that follows E(ht)=0, E(htht)=Σ, and E(hths)=0 for ts.

    We implemented bivariate VAR (1) models that, for the specific case of NG (r1) and oil (r2) returns, can be represented by the following expressions:

    r1t=δ1+Φ11r1,t1+Φ12r2,t1+h1t (3)
    r2t=δ2+Φ21r2,t1+Φ22r2,t1+h2t (4)

    where ϕ is a 2×2 matrix with the terms that indicate the effect of previous time lag returns on the current bivariate returns of the model. To ascertain the presence of serial correlation in the residuals for each of the three bivariate VAR (1) models, we conducted both the Portmanteau test (asymptotic) and Engle's test to detect ARCH effects. To determine the optimal lag order of the VAR model, we use the Hannan-Quinn information criterion (HQIC) and the Schwarz information criterion (SBIC). Additionally, we employed Granger causality tests to determine whether one time series can effectively forecast another. The definition of Granger causality, as proposed by [75], holds paramount significance in examining dynamic relationships between time series. It leverages the concept of temporal precedence, distinguishing it from causal notions grounded in controlled variation [76]. The null hypothesis of no Granger causality remains unaltered unless and until lagged values of an explanatory variable are included in the regression.

    Let rt be a 3×1 series of returns of TTF NG, Brent oil and EPEX electricity returns. We specify the mean equation with autoregressive model VAR (1) term of rt, which can be specified as follows:

    ri,t=η+νri,t1+hi,t,hi,tN(0,σit) (5)

    The univariate GARCH model is used to derive the expression of residual variances. Following [77], we consider that a first order of the GARCH (1, 1) model is sufficient to assess the conditional variance (σ2t), which is specified by:

    σ2i,t=ϖ+αi,1h2t1+βi,1σ2i,t1 (6)

    where α and β are 3×1 vectors that respectively measure the conditional variance in the ARCH's terms (i.e., the short-term persistence effect) and the conditional volatility in the GARCH's terms (i.e., the long-term persistence effect) [73].

    The DCC model was introduced by [54]. Let Σt represent a 3×3 conditional covariance matrix formally given by Σt=DtRtDt, where Dt is the 3×3 diagonal conditional matrix that includes time-varying standard deviations on the diagonal and Rt is the time-varying correlation matrix such that:

    Dt=diag(σ11,t12σ33,t12) (7)
    Rt=diag(q11,t1/2q33,t1/2)Qtdiag(q11,t1/2q33,t1/2) (8)

    where Qt is a symmetric positive matrix specified as follows:

    Qt=(1θ1θ2)Q+θ1ht1ht1+θ2Qt1 (9)

    with Q materializing a 3×3 unconditional correlation matrix of the standardized residuals hit. Parameters θ1 and θ2 are non-negative with a sum less than unity. Under a DCC specification, the typical element of the time-varying correlations will be of the form:

    ρij,t=qij,tqii,tqjj,t (10)

    Therefore, Rt is a matrix of time-varying correlations in which ρij,t take values of one on its main diagonal:

    [1ρ12,tρ13,tρ21,t1ρ23,tρ31,tρ32,t1] (11)

    The asymmetric dynamic conditional correlation generalized autoregressive conditional heteroskedasticity (ADCC-GARCH) model was proposed by [56] to generalize the DCC model by permitting the presence of asymmetric dynamic correlations. This extension is adequate to examine dynamic correlation among different asset classes and investigate the presence of asymmetric responses in conditional variances and correlations to negative returns. Intuitively, it is useful to explain the increase in the conditional correlation during market downturn periods [63]. In this new approach, the Qt matrix is given as follows:

    Qt=(1θ1θ2)Qθ3Z+θ1ht1ht1+θ2Qt1+θ3Z (13)

    where the coefficient θ3 explains the presence of asymmetric effects. Moreover, Z=ξt1ξt1 is the covariance matrix of [E(ξt1ξt1)], with ξt1=I[ht<0]ht. Note that is the Hamadard product, whereas I[.] is a function that takes value 1 when the residuals are negative and 0 otherwise.

    The flexible dynamic conditional correlation generalized autoregressive conditional heteroskedasticity (FDCC-GARCH) model proposed by [57] relaxes the assumption of equal dynamics for all the correlations by introducing a block-diagonal structure, thereby allowing to extend the original DCC model. Hence, it provides a more flexible parameterization of correlation dynamics, while maintaining the number of parameters at a feasible level. In the FDCC-GARCH model, the Qt matrix is given as follows:

    Qt=cc+aaht1ht1+bbQt1 (14)

    where c, a and b are partitioned 3-dimensional vectors with the following structure:

    a=[a1×im1a2×im2aw×imw] (15)

    where ih is an h-dimensional vector of ones and w is the number of blocks (similarly applied to b and c). The coefficient vectors contain w different coefficients, each of them possibly repeated mj times, with j = 1, 2, , w. As a result of the block structure of coefficient matrices, the dynamics are equal only for groups of variables and not for the whole correlation matrix. Finally, Engle's DCC model, whose main innovation is the relaxation of the common correlation dynamics hypothesis among all the assets, can be obtained by considering the following setting:

    a=α×ik,β=β×ik,cc=(1aabb)Q (16)

    In this section, we present and analyze the results obtained in our study. In section 3.1, we aim to assess the impacts of the pandemic crisis and the subsequent war in Ukraine on the TTF NG, Brent crude oil and electricity EPEX spot markets, as hypothesized in A1 and A2. We base this assessment on our preliminary analysis of the datasets. Moving onto section 3.2, we utilize the empirical models to investigate the presence of spillover effects on the returns and volatility among the three spot markets, in line with hypotheses B1 and B2. Furthermore, we observe whether the persistence of shocks has led to varying degrees of influence on the dynamic conditional correlations among the spot markets, as posited in hypothesis C.

    Figure 1 depicts the price trends of TTF NG, Brent oil and the electricity EPEX spot market in Germany-Luxembourg (DE/LU) from January 2010 to September 2022.

    Figure 1.  Time-series plots of (a) NG TTF, (b) Brent oil and (c) electricity EPEX SPOT prices.

    These prices followed distinct patterns over time. Initially, there was a gradual price increase until early 2012, followed by relatively stable fluctuations until the first half of 2020. However, a significant shift occurred thereafter, with prices skyrocketing in response to the pandemic crisis and the Ukraine-Russia war. Notably, Brent oil prices exhibit three distinct phases: from 2010 to 2014, prices remained consistently high, mostly above?100. From 2015 to 2020, there was a notable price reduction, with the lowest point reached in the first half of 2020, primarily due to various governmental measures, including lockdowns, which directly impacted lifestyles and reduced crude oil consumption. EPEX SPOT electricity prices remained relatively stable until the first half of 2020, after which they exhibited an exponential growth trend, reaching a peak in the middle of 2022 at?455.38.

    Figure 2 presents the monthly returns of TTF NG, Brent oil and the electricity EPEX spot market. While all three series exhibit a mean close to zero, the highest volatility is observed in the returns of NG and electricity, particularly noticeable around late 2019 and reaching its peak negativity in the first half of 2020 during the onset of the pandemic crisis. Electricity returns show relatively consistent variations over time but become more pronounced since the pandemic's outset. Brent oil returns exhibit more uniform variability, ranging between –0.2 and 0.2, with two prominent peaks coinciding with the early stages of the pandemic crisis in the first half of 2020. These observations are further corroborated by the monthly squared returns, as shown in Figure S1 in the supplementary. Notably, both the pandemic crisis and Russia's invasion of Ukraine significantly impacted the increase in return volatility, especially evident for TTF NG (since early 2020), Brent oil (with a substantial peak in the first half of 2020) and electricity, which became even more pronounced since early 2022.

    Figure 2.  Time-series plots of TTF NG, Brent crude oil and electricity EPEX SPOT (DE/LU) returns.

    Table 1 provides a summary of descriptive statistics for NG, Brent crude oil and electricity prices, as well as their corresponding returns. The results highlight that the standard deviation was highest for electricity prices, exceeding the mean price. The standard deviation for NG was also relatively close to the average, aligning with the exponential variations observed since 2020. Minimum and maximum price points for all three series occurred in the pre-pandemic and post-pandemic crisis periods.

    Table 1.  Descriptive statistics for prices and returns of TTF NG, Brent crude oil and electricity.
    Prices Returns
    NG Oil Elect. NG Oil Elect.
    Mean 10.330 77.390 54.580 0.0131 0.001 0.014
    Std. Dev. 9.524 26.655 58.308 0.137 0.113 0.177
    Min. 1.460 18.308 17.050 –0.354 –0.555 –0.468
    Max. 69.980 125.450 455.38 0.465 0.469 0.688
    Median 8.480 74.170 38 –0.001 0.015 0.022
    Q1 5.540 55.890 32 –0.031 –0.047 –0.088
    Q3 11.110 107.480 49 0.052 0.063 0.105
    Kurtosis 17.749 1.783 23.220 4.908 11.032 3.963
    Skew. 3.512 0.094 4.221 0.740 –1.132 0.262
    JB 1701.2 9.665 3060 36.912 441.010 7.611
    P-value < 0.001*** 0.008*** < 0.001*** < 0.001*** < 0.001*** 0.022**
    Q (10) 467.200 1008.5 399.770 32.212 26.512 16.275
    P-value < 0.001*** < 0.001*** < 0.001*** < 0.001*** 0.003*** 0.092
    Obs. 153 153 153 153 153 153
    Unconditional correlation matrix (Pearson's coefficients)
    NG 1
    Oil 0.457*** 1
    Elect. 0.958*** 0.278*** 1
    NG 1
    Oil 0.109 1
    Elect. 0.516*** 0.211*** 1
    Notes: *: p < 0.1, **: p < 0.05, ***: p < 0.01. JB denotes the Jarque-Bera statistic. Q shows the Ljung-Box statistic for serial correlation for 10 lags.

     | Show Table
    DownLoad: CSV

    Regarding returns, the data confirm the higher volatility of electricity compared to the other energy sources, with a standard deviation of 0.177, followed by NG and oil, with values of 0.137 and 0.113, respectively. Except for oil, all series exhibit positive skewness tails, with higher skewness values for NG and electricity due to extreme price movements since 2020. Moreover, except for oil prices, all other series display kurtosis values exceeding the reference range for normally distributed data (between –2 and 2). Figure S2 presents the distributions of all series. NG, Brent oil and electricity returns exhibit more symmetric distributions when compared to the price series. The results of the Jarque-Bera test, conducted with a significance level of 0.05, indicate that none of the price and return series follow a normal distribution. Among the series, electricity returns (JB = 7.611, p-value = 0.222) and Brent crude oil prices (JB = 7.666, p-value = 0.008) display relatively minor deviations from normality.

    The assessment of serial correlation holds utmost significance in preventing the occurrence of spurious regressions within the empirical models proposed in this study. Table 1 additionally presents findings indicating that electricity returns stand as the sole series lacking significant serial correlation (Q = 16.275, p = 0.092). Figure S3 furnishes supplementary insights via autocorrelation function (ACF) plots. These plots serve as valuable tools in identifying discernible patterns and deviations from randomness within price series. It is worth noting that NG returns exhibit values exceeding predefined bounds at multiple lags, thereby contributing to the rejection of the white noise assumption and, consequently, indicating the presence of autocorrelation. Furthermore, the outcomes of unconditional cross correlations provide substantial insights. Notably, a strong positive correlation is evident between NG and electricity price series (r = 0.958, p-value < 0.001). This is followed by a moderate correlation between NG and oil returns (r = 0.457, p-value < 0.001), and a weak correlation between oil and electricity prices (r = 0.278, p-value < 0.001). Additionally, based on the results of Pearson's coefficient with a significance level of 0.05, we can assert the absence of a significant association between NG and Brent oil returns. While the correlation between NG and electricity returns exhibits the highest values, it still represents a moderate correlation (r = 0.516, p-value < 0.001), whereas the correlation between oil and electricity returns indicates a weak relationship (r = 0.211, p-value = 0.007).

    Subsequently, we proceeded with unit root tests to assess the stationary condition, a prerequisite for applying an autoregressive process in our empirical return models. The results of ADF and PP tests are presented in Table 2. Both tests consistently indicate that NG, crude oil and electricity prices exhibit nonstationary behavior. This observation aligns with the price trends depicted in Figure 1, emphasizing that the data undergoes clear changes over time. To address this nonstationary behavior and achieve stationary processes, we computed the first difference values, representing changes from one period to the next (Figures S4a, b and c). The evolving trends confirm that the first differences I (1) of all price series now exhibit variations around a mean of zero. Specifically, the first differences in crude oil prices reveal relatively consistent variance over time, while NG and electricity I (1) prices display higher variation, particularly in recent years since the onset of the pandemic crisis and the Ukrainian war.

    Table 2.  Results of unit root tests for prices and returns series.
    ADF tests PP tests
    Level 1st difference level 1st difference
    Prices NG 0.706++ –11.906*** 1.537++ –11.739***
    Oil –2.256 (0.470) –8.373*** –1.785 (0.666) –8.772***
    Electricity 1.766++ –10.883*** 0.786++ –14.463***
    Returns NG –7.806*** –7.483*** –9.588*** –20.907***
    Oil –9.471*** –9.211*** –8.789*** –18.875***
    Electricity –10.297*** –7.576*** –15.412*** –36.895***
    Notes: *: p < 0.1, **: p < 0.05, ***: p < 0.01. ++: p > 0.99.

     | Show Table
    DownLoad: CSV

    As for returns, the outcomes of the ADF and PP tests affirm that both the return levels and first difference series for NG, crude oil, and electricity are stationary, with p-values < 0.010. This alignment is consistent with the trends observed for each series in Figure 2, where variations center around zero. Notably, variability over time appears to be less stable for NG and electricity returns, particularly since the third quarter of 2021. Nevertheless, the first differences for return processes remain stationary. Figures S4d, e and f further illustrate the relatively consistent variance in crude oil returns, whereas NG and electricity exhibit more pronounced variation, particularly with elevated values since 2022. Figure S4e additionally highlights a peak in crude oil returns at the onset of the COVID-19 pandemic in the first half of 2020.

    Hereinafter, the focus of the analysis is restricted to NG, crude oil and electricity returns, which will be used in the empirical models outlined in section 2.3. To this end, we initiated an examination of the existence of ARCH effects to determine whether variances in these series exhibit temporal variation. Table S1 presents the outcomes of Engle's ARCH and the Ljung-Box tests, which assess the time-varying conditional variance of squared residual errors (h2) within the dynamic models for return series. Both tests consistently indicate highly significant ARCH effects in all series. These findings align with the observed variations in squared residual errors generated by the dynamic models, as depicted in Figure 3. Notably, there is clear serial correlation in h2 for all series.

    Figure 3.  Time-varying conditional variance of residual errors for dynamic models of (a) TTF NG, (b) crude oil and (c) electricity EPEX SPOT (DE/LU) returns.

    For NG, distinct clusters of conditional volatility can be identified. First, there is a period until 2015 characterized by relatively small variation. From 2015 until the pre-pandemic phase, volatility began to increase. Finally, starting from that moment, there is a substantial change in variability. During this period, a reduction in residuals to values similar to the second cluster can be observed around the beginning of 2021 (Figure 3a).

    In the case of Brent oil, volatility remains relatively consistent over time but exhibits clear autocorrelation in squared residuals. Once again, a peak in volatility is evident in the first half of 2020.

    In relative terms, volatility in electricity EPEX returns surpasses that of NG and Brent oil, with h2 fluctuating between 0 and 0.1 until the onset of the pandemic in 2020, at which point the first peak above 0.2 emerges. Subsequently, volatility decreased but started rising again following Russia's invasion of Ukraine in 2022.

    Lastly, Pearson's coefficients reveal the extent of correlation among the series. Notably, NG and electricity exhibit a higher correlation (r = 0.479, p-value < 0.001), representing a moderate association. This is followed by the correlation between NG and oil (r = 0.229, p-value = 0.004), which is very weak. The correlation between oil and electricity is not significant (r = 0.07, p-value = 0.372).

    In this section, we unveil the outcomes of the empirical models we employed. Initially, we conducted separate bivariate VAR models to examine potential effects of lagged returns from one market on another (hypothesis B1). Subsequently, we employed a series of DCC-GARCH models to delve into the repercussions on the conditional mean returns and volatility across the markets (hypothesis B2). Furthermore, we explored the dynamic conditional correlations between these markets, characterized by varying intensities (hypothesis C).

    Table 3 displays the parameters of the bivariate VAR (1) model employed to estimate mean returns. For each model, we have constant terms represented by δ1 and δ2 for spot markets 1 and 2, corresponding to TTF NG and Brent crude oil returns in the first model, TTF NG and electricity EPEX (DE/LU) returns in the second model and Brent oil and electricity EPEX returns in the third model. The terms Φ11 and Φ22 signify the autocorrelation in returns based on the previous lag (t−1) for the considered spot markets within each of the three VAR (1) models. We explored various lag orders, but since many terms were not statistically significant, we did not include them in our study. Finally, Φ12 and Φ21 represent the return spillovers between the spot markets.

    Table 3.  Results of bivariate VAR (1) models for TTF NG, Brent oil and EPEX electricity markets.
    TTF NG/Brent crude oil returns
    Statistic Estimate Std. Error T p-value
    δ1 0.009 0.011 0.880 0.380
    δ2 0.002 0.009 0.220 0.826
    Φ11 0.219 0.078 2.812 0.006**
    Φ12 0.322 0.094 3.434 0.001***
    Φ21 –0.081 0.066 –1.235 0.218
    Φ22 0.286 0.079 3.613 < 0.001***
    P 56.283 0.102
    LM 277.980 < 0.001***
    G (NGOil) 1.525 0.218
    G (OilNG) 11.793 < 0.001***
    TTF NG/electricity EPEX (DE/LU) returns
    Statistic Estimate Std. Error T p-value
    δ1 0.009 0.011 0.824 0.411
    δ2 0.016 0.014 1.116 0.266
    Φ11 0.195 0.093 2.096 0.037**
    Φ12 0.077 0.072 1.062 0.290
    Φ21 0.213 0.120 1.773 0.078*
    Φ22 –0.297 0.093 –3.191 0.002**
    P 65.648 0.019**
    LM 212.370 < 0.001***
    G (NGElectricity) 37.187 0.077*
    G (ElectricityNG) 1.129 0.289
    Brent crude oil/electricity EPEX (DE/LU) returns
    Statistic Estimate Std. Error T p-value
    δ1 0.002 0.009 0.209 0.835
    δ2 0.018 0.014 1.283 0.202
    Φ11 0.300 0.081 3.717 < 0.001***
    Φ12 0.070 0.052 –1.344 0.181
    Φ21 0.389 0.125 3.122 0.002***
    Φ22 –0.266 0.080 –3.314 0.001***
    P 40.894 0.606
    LM 207.430 < 0.001***
    G (OilElectricity) 9.748 0.002***
    G (ElectricityOil) 1.807 0.180
    Notes: *: p < 0.1, **: p < 0.05, ***: p < 0.01. P denotes the Portmanteau test (asymptotic) for autocorrelation for residuals of the models. LM shows the Engle's ARCH statistic for ARCH effects for residuals. G represents the Granger causality statistic.

     | Show Table
    DownLoad: CSV

    The results of the first model reveal a significant impact of NG and Brent oil's own lagged returns on their current returns (Φ11 = 0.219, p-value = 0.006; Φ22 = 0.286, p-value < 0.001). Regarding the spillovers between these two markets, only the current NG returns were positively influenced by the previous lagged returns (t−1) of oil (Φ12 = 0.322, p-value < 0.001). Granger causality tests also confirm the positive impact of the Brent oil market on TTF NG returns (G = 11.793, p-value < 0.001). Figure S5a visually illustrates this impact, with confidence interval bounds above the horizontal line y=0. A diagnostic analysis of the VAR (1) residuals suggests that they can be considered white noise (P = 56.283, p-value = 0.102) but it also indicates the presence of ARCH effects, which will be investigated in section 3.2.2.

    The second model reveals the existence of autocorrelation between the previous own lagged returns for NG and electricity (Φ11 = 0.195, p-value = 0.037; Φ22 = –0.297, p-value = 0.002). There was a weak positive autocorrelation between the lagged TTF NG returns and current EPEX electricity returns (Φ21 = 0.213, p-value = 0.078). Granger causality tests also suggest a weak positive effect of NG on electricity returns (G = 3.144, p-value = 0.077). Although the diagnostic analysis of residuals reveals the presence of serial correlation in this bivariate VAR (1) model (P = 65.648, p-value = 0.019), the results of the HQIC (–2.131) and SBIC (–2.059) information criteria confirm one period as the optimal lag order for this bivariate model (Table S2). The limited impact of NG on electricity is depicted in Figure S5b.

    Table 3 also confirms the significant effect of lagged returns on current returns for Brent oil and electricity EPEX spot markets (Φ11 = 0.300, p-value < 0.001; Φ22 = –0.266, p-value = 0.001). There was also a unidirectional return spillover from the Brent oil market to the electricity EPEX market (Φ21 = 0.389, p-value = 0.002). The bivariate residuals suggest serial correlation (P = 40.894, p-value = 0.606) and the presence of ARCH effects (LM = 207.430, p-value < 0.001). The Granger causality test also indicates a positive effect of the oil market on electricity returns (G = 9.748, p-value = 0.002), as shown by Figure S5c). These results suggest the possibility of a simultaneous impact of the Brent oil spot market on TTF NG and EPEX electricity markets. This assumption is substantiated by the results of Table S3 after applying a trivariate VAR (1). In this model, current returns (t) for each spot market are determined by the immediate lags (t−1) of three variables (NG, Oil, and Electricity). The results confirm a positive autocorrelation between oil and NG (Φ12 = 0.313, p-value = 0.001) and oil and electricity (Φ32 = 0.391, p-value = 0.002). There is also a significant effect of own lagged returns on returns for NG, oil and electricity. Furthermore, the results demonstrate that the model residuals do not exhibit serial correlation (P = 119.51, p-value = 0.079), and they indicate the presence of ARCH effects (LM = 651.28, p-value < 0.001). Both HQIC (–3.723) and SBIC (–3.578) information criteria also suggest a lag of one period as the optical order (Table S4). Finally, Granger causality test results reveal a significant unidirectional effect of the Brent oil market simultaneously on TTF NG and EPEX electricity markets (G = 6.743, p-value = 0.001).

    Table 4 presents the results for all DCC-GARCH models, which produced similar outcomes. Consequently, we decided to use the DCC model estimates for the remaining analysis, as they correspond to the simplest model and yielded the lowest AIC value (–4.550). We also considered that the asymmetric term for DCC is not significant (θ3<0.001, p-value 1), and FDCC did not provide better results than the DCC method. The results indicate that the conditional mean returns (η) were not statistically significant for any of the markets, with values close to zero. The δ terms represent the short-term persistence of returns in the VAR (1) models. Except for TTF NG, Brent oil and electricity EPEX, the previous own lagged returns were statistically significant for the current returns (t) (δoil = 0.192, p-value = 0.018; δelect = –0.259, p-value = 0.001). The parameter α reflects the effect of unexpected news or shocks, while the parameter β captures the effect of lagged conditional variance in NG, oil and electricity markets, corresponding to the long-term persistence of volatility. Strong evidence exists for the positive impact of the short-term persistence effect of the previous own conditional variance on the current returns for TTF NG (αNG = 0.195, p-value < 0.001) and Brent oil (αoil = 0.732, p-value = 0.006) spot markets. Additionally, there is a significant positive long-term volatility persistence for NG (βNG = 0.804, p-value < 0.001), oil (βoil = 0.251, p-value = 0.012) and the electricity EPEX market (βelect = 0.915, p-value < 0.001). In this context, long-term volatility persistence corresponds to the effect of the previous own conditional variance on the current one, meaning that positive shocks (or news) on returns have a greater impact on volatility than negative shocks for all the time series. Furthermore, the sum of the ARCH (α) and GARCH (β) coefficients for all return series is less than unity, indicating volatility clustering in all variables, which aligns with the conclusions drawn from Figure 3. As we can observe, βoil shows low values associated with a higher αoil, which can occur in some circumstances. According to [78], this leads to GARCH volatilities that are spikier than those with relatively low alpha and relatively high beta. This may be attributed to GARCH volatilities with high volatility-of-volatility (vol-of-vol). Further research should be conducted for a better understanding of long-term volatility persistence compared to other types of models.

    Table 4.  Results of multivariate VAR (1)-GARCH (1, 1) models.
    Models DCC ADCC FDCC
    Statistic Estimate (SE) T (p-value) Estimate (SE) T (p-value) Estimate (SE) T (p-value)
    ηNG –0.003 (0.003) –1.027 (0.304) –0.003 (0.002) –1.027 (0.305) –0.003 (0.003) –1.022 (0.307)
    νNG 0.114 (0.096) 1.187 (0.235) 0.113 (0.096) 1.186 (0.238) 0.114 (0.097) 1.178 (0.239)
    ϖNG < 0.001 (<0.001) 0.495 (0.621) < 0.001 (<0.001) 0.495 (0.621) < 0.001 (<0.001) 0.502 (0.616)
    αNG 0.195 (0.045) 4.306 (<0.001***) 0.195 (0.045) 4.311 (<0.001***) 0.195 (0.045) 4.351 (<0.001***)
    βNG 0.804 (0.070) 11.443 (<0.001***) 0.804 (0.703) 11.429 (<0.001***) 0.804 (0.067) 11.520 (<0.001***)
    λNG 4.189 (0.796) 5.263 (<0.001***) 4.189 (0.803) 5.218 (<0.001***) 4.189 (0.786) 5.328 (<0.001***)
    ηoil 0.005 (0.007) 0.798 (0.425) 0.005 (0.007) 0.788 (0.430) 0.005 (0.007) 0.796 (0.426)
    νoil 0.192 (0.081) 2.364 (0.018**) 0.192 (0.082) 2.351 (0.019**) 0.192 (0.081) 2.371 (0.018**)
    ϖoil 0.002 (0.001) 1.835 (0.066*) 0.002 (0.001) 1.827 (0.068*) 0.002 (0.001) 1.852 (0.064*)
    αoil 0.732 (0.264) 2.773 (0.006***) 0.732 (0.265) 2.768 (0.006***) 0.732 (0.268) 2.736 (0.006**)
    βoil 0.251 (0.100) 2.502 (0.012**) 0.251 (0.101) 2.475 (0.013**) 0.250 (0.010) 2.519 (0.012**)
    λoil 8.456 (5.050) 1.675 (0.094*) 8.456 (5.055) 1.673 (0.094*) 8.456 (5.063) 1.670 (0.095*)
    ηelect 0.004 (0.009) 0.464 (0.643) 0.004 (0.009) 0.464 (0.642) 0.004 (0.009) 0.465 (0.642)
    νelect –0.259 (0.078) –3.310 (<0.001***) –0.259 (0.078) –3.303 (0.001***) –0.259 (0.079) –3.292 (<0.001***)
    ϖelect < 0.001 (0.003) 0.138 (0.890) < 0.001 (0.003) 0.139 (0.890) < 0.001 (0.003) 0.138 (0.890)
    αelect 0.084 (0.094) 0.890 (0.374) 0.084 (0.094) 0.896 (0.370) 0.084 (0.094) 0.892 (0.373)
    βelect 0.915 (0.198) 4.620 (<0.001***) 0.915 (0.197) 4.641 (<0.001***) 0.915 (0.198) 4.630 (<0.001***)
    λelect 99.959 (171.186) 0.584 (0.559) 99.959 (170.495) 0.586 (0.558) 99.960 (170.055) 0.588 (0.557)
    θ1 0.043 (0.013) 3.427 (<0.001***) 0.043 (0.014) 3.169 (0.002***) 0.180 (0.066) 2.733 (0.006***)
    θ2 0.938 (0.018) 50.792 (<0.001***) 0.938 (0.019) 49.045 (<0.001***) 0.820 (0.052) 15.784 (<0.001***)
    θ3 < 0.001 (0.015) < 0.001 (1.000)
    AIC –4.550 –4.537 –4.469
    Notes: *: p < 0.1, **: p < 0.05, ***: p < 0.01. P denotes the Portmanteau test (asymptotic) for autocorrelation for residuals of the models. LM shows the Engle's ARCH statistic for ARCH effects for residuals. G represents Granger causality test statistic.

     | Show Table
    DownLoad: CSV

    The shape's term (λ) represents the degrees of freedom in the t distribution and is statistically significant only for NG (λ = 4.189, p-value < 0.001). Finally, θ1 and θ2 denote the dynamic correlations of the series. θ1 represents the short-term shock persistence among the conditional correlations of the markets, while θ2 gives the long-term persistent shock effect on the conditional correlation of the markets. Both terms are statistically significant and positive (θ1 = 0.043, p-value = 0.001; θ2 = 0.936, p-value < 0.001), indicating significant short and long-term correlations among the markets. The sum of coefficients is less than one, suggesting dynamic conditional correlation as mean-converging. Table S5 reports the bivariate DCC-GARCH models, providing pairwise comparisons between the three series. The results closely resemble those obtained using the trivariate setting presented in Table 4. However, new terms for dynamic correlation between TTF NG, Brent oil and electricity EPEX markets are now obtained. The results reveal significant short-term persistence of shock in the dynamic conditional correlation between the TTF NG and EPEX electricity spot markets (θ1 = 0.102, p-value = 0.001). Regarding long-term persistent shock effects, there was high significance in the dynamic conditional correlation between NG and Brent oil (θ2 = 0.930, p-value < 0.001), NG and electricity EPEX (θ2 = 0.889, p-value < 0.001) and Brent oil and electricity EPEX (θ2 = 0.919, p-value = 0.029) spot markets.

    Finally, Figure 4 displays the dynamical conditional correlations between pairs of spot markets. The lines represent the linear dynamic correlation averaged over time. The DCC between NG and oil fluctuates between –0.10 (very weak correlation) and a weak correlation of 0.25, resulting in a global dynamic correlation of approximately 0.086 with a null slope (Figure 4a). The DCC between TTF NG and electricity EPEX (DE/LU) spot markets exhibits the highest variations, ranging from a negative very weak correlation (ρ = –0.176) to a strong correlation (ρ = 0.624). Essentially, the DCC slightly decreased until 2015 and began increasing from that point, reaching its highest correlation in September 2022 (Figure 4b). Lastly, the DCC between Brent oil and electricity EPEX shows more significant fluctuations, varying from a minimum negative correlation (ρ = –0.029) to a weak correlation of 0.332, with a negative average trend (slope = –0.001) (Figure 4c). In terms of evolution, we can identify three main clusters: the first with a weak correlation (between 0.120 and 0.332) until early 2014, followed by a period of decreased correlations until 2019, and finally, since the first quarter of 2020, DCC has become more similar to the first period.

    Figure 4.  Dynamic conditional correlations between (a) NG and oil, (b) NG and electricity and (c) oil and electricity.

    This study aimed to analyze the evolution of three spot markets: TTF natural gas, Brent crude oil and electricity EPEX of Germany-Luxembourg (DE/LU). It focused on three main aspects outlined in hypotheses A, B and C. As major contributions to the energy literature, we highlight the joint analysis of these energy markets in terms of spillover effects on returns and the implementation of a set of dynamical conditional correlation methods (DCC, ADCC and FDCC) for modeling the repercussions on the conditional mean returns and volatility across these markets. Our study also includes recent datasets that allowed us to analyze the impacts of COVID-19 and the subsequent war, representing a new advance in knowledge about these spot markets.

    Firstly, the study investigated the impact of COVID-19 on return volatility and how the Russian invasion of Ukraine might have extended this impact (hypothesis A1). The analysis revealed that the COVID-19 pandemic crisis had a strong effect on the exponential growth of prices and an increase in volatility. However, this effect was not uniform across the return series. While prices for all spot markets increased since the first quarter of 2020, Brent oil prices returned to pre-pandemic crisis levels, whereas TTF NG and electricity EPEX prices continued to increase exponentially, reaching their highest values by the beginning of the third quarter of 2022. From this point, prices began to gradually decrease. However, when examining returns, it was evident that volatility increased from the beginning of 2020 until the end of the study for NG and electricity EPEX, while for Brent oil, there was only a significant peak in the first quarter of 2020. Therefore, the war in Ukraine did not have the same impact on each series (hypothesis A2). Intuitively, this means that both hypotheses were validated.

    The study also revealed that lagged returns from previous periods for Brent oil and EPEX electricity had significant impacts on current returns (δoil = 0.192, p-value = 0.018; δelect = –0.259, p-value = 0.001). Moreover, the results of the VAR (1) models indicated that lagged returns for TTF NG also had an impact on current returns (hypothesis B1). Regarding possible spillover effects on returns and volatility among markets, as raised in hypothesis B2, the results showed a strong short-term persistence effect of the previous own conditional variance for TTF NG (αNG = 0.195, p-value < 0.001) and Brent oil (αoil = 0.732, p-value = 0.006) spot markets. Additionally, positive shocks on returns were found for NG (βNG = 0.804, p-value < 0.001), oil (βoil = 0.251, p-value = 0.012) and electricity EPEX markets (βelect = 0.915, p-value < 0.001).

    Finally, this study confirms that shock persistence affected the dynamical conditional correlations between spot markets in different ways (hypothesis C). Results showed that long-term persistent shock effects highly affect the dynamic conditional correlation between NG and Brent oil (θ2 = 0.930, p-value < 0.001), NG and electricity EPEX (θ2 = 0.889, p-value < 0.001) and Brent oil and electricity EPEX (θ2 = 0.919, p-value = 0.029) spot markets. However, there was only a significant short-term persistence of shock in the dynamical conditional correlation between the NG TTF and EPEX electricity spot markets (θ1 = 0.102, p-value = 0.001). By analyzing DCC coefficients, it was concluded that the highest DDC occurred between TTF and electricity EPEX (DE/LU), ranging from a very negative, very weak correlation to a strong correlation over time. During the pandemic crisis and the war in Ukraine, this correlation remained strong, reaching a peak in this period.

    While this study contributes to the energy literature, future research should consider extending the series to include other NG, oil and electricity spot markets to investigate potential differences among them and validate the results presented here. Additionally, expanding the dataset to include periods before 2010 would allow for a comparison of return evolutions and volatility during different shock periods. Finally, it is important to address the limitations of this research, including difficulties in accessing open data and the inability to relate NG, oil and electricity prices to other indicators that may directly impact returns and volatility.

    FCT projects DSCAIPA-CS-0086-2020, UIDB/04105/2020 and UIDP/04105/2020.

    The authors declare that there are no conflicts of interest in the execution and publication of this work.

    Gustavo Soutinho was responsible for data collection, analysis, methodology development, and the initial draft of the manuscript. Vitor Miguel Ribeiro wrote the final version of the manuscript, supervised the analysis and the methodology development, and secured funding for the project. Isabel Soares played a crucial role in reviewing the work, supervising the research, and securing funding for the project.



    [1] Grubb M (2022) Renewables are cheaper than ever-so why are household energy bills only going up? The Conversation. Available from: https://theconversation.com/renewables-are-cheaper-than-ever-so-why-are-household-energy-bills-only-going-up-174795.
    [2] Mensi W, Rehman MU, Maitra D, et al. (2021) Oil, natural gas and BRICS stock markets: Evidence of systemic risks and co-movements in the time-frequency domain. Resour Policy 72: 102062. https://doi.org/10.1016/j.resourpol.2021.102062 doi: 10.1016/j.resourpol.2021.102062
    [3] Qin Y, Hong K, Chen J, et al. (2020) Asymmetric effects of geopolitical risks on energy returns and volatility under different market conditions. Energy Econ 90: 104851. https://doi.org/10.1016/j.eneco.2020.104851 doi: 10.1016/j.eneco.2020.104851
    [4] Lee Y, Yoon SM (2020) Dynamic spillover and hedging among carbon, biofuel and oil. Energies 13: 4382. https://doi.org/10.3390/en13174382 doi: 10.3390/en13174382
    [5] Benlagha N, Karim S, Naeem MA, et al. (2022) Risk connectedness between energy and stock markets: Evidence from oil importing and exporting countries. Energy Econ 115: 106348. https://doi.org/10.1016/j.eneco.2022.106348 doi: 10.1016/j.eneco.2022.106348
    [6] Gong X, Liu Y, Wang X (2021) Dynamic volatility spillovers across oil and natural gas futures markets based on a time-varying spillover method. Int Rev Financ Anal 76: 101790. https://doi.org/10.1016/j.irfa.2021.101790 doi: 10.1016/j.irfa.2021.101790
    [7] Lovcha Y, Perez-Laborda A (2020) Dynamic frequency connectedness between oil and natural gas volatilities. Econ Model 84: 181–189. https://doi.org/10.1016/j.econmod.2019.04.008 doi: 10.1016/j.econmod.2019.04.008
    [8] Hamilton JD (1983) Oil and the macroeconomy since World War Ⅱ. J Polit Econ 91: 228–248. https://doi.org/10.1086/261140 doi: 10.1086/261140
    [9] Narayan P, Narayan S, Sharma S (2013) An analysis of commodity markets: What gain for investors? J Bank Financ 37: 3878–3889. https://doi.org/10.1016/j.jbankfin.2013.07.009 doi: 10.1016/j.jbankfin.2013.07.009
    [10] Narayan P, Amhed H, Narayan S (2015) Do momentum-based trading strategies work in the commodity futures markets? J Futures Mark 35: 868–891 https://doi.org/10.1002/fut.21685 doi: 10.1002/fut.21685
    [11] Zhao LT, Yan JL, Wang Y (2017) Empirical study of the functional changes in price discovery in the Brent crude oil market. Energy Procedia 142: 2917–2922. https://doi.org/10.1016/j.egypro.2017.12.417 doi: 10.1016/j.egypro.2017.12.417
    [12] Zhang W, He X, Nakajima T, et al. (2020) How does the spillover among natural gas, crude oil, and electricity utility stocks change over Time? Evidence from North America and Europe. Energies 13: 727. https://doi.org/10.3390/en13030727 doi: 10.3390/en13030727
    [13] Adolfsen JF, Kuik F, Lis EM, et al. (2022) The impact of the war in Ukraine on euro area energy markets. ECB. Available from: https://www.ecb.europa.eu/pub/economic-bulletin/focus/2022/html/ecb.ebbox202204_01~68ef3c3dc6.en.html.
    [14] IEA (2023). Available from: https://www.iea.org/fuels-and-technologies/gas.
    [15] Erias AE, Iglesias EM (2022) Price and income elasticity of NG demand in Europe and the effects of lockdowns due to Covid-19. Energy Strategy Rev 44: 100945. https://doi.org/10.1016/j.esr.2022.100945 doi: 10.1016/j.esr.2022.100945
    [16] Hamilton JD (2003) What is an oil shock? J Econom 113: 363–398. https://doi.org/10.1016/S0304-4076(02)00207-5 doi: 10.1016/S0304-4076(02)00207-5
    [17] Emery GW, Liu WQ (2002) An analysis of the relationship between electricity and natural-gas futures prices. J Futures Mark 22: 95–122. https://doi.org/10.1002/fut.2209 doi: 10.1002/fut.2209
    [18] Woo C, Olson A, Horowitz I, et al. (2006) Bi-directional causality in California's electricity and natural-gas markets. Energy Policy 34: 2060–2070. https://doi.org/10.1016/j.enpol.2005.02.016 doi: 10.1016/j.enpol.2005.02.016
    [19] Serletis A, Shahmoradi A (2006) Measuring and testing natural gas and electricity markets volatility: Evidence from Alberta's deregulated markets. Stud Nonlinear Dyn Econ 10: 1341. https://doi.org/10.2202/1558-3708.1341 doi: 10.2202/1558-3708.1341
    [20] Arouri MEH, Jouini J, Nguyen DK (2011) Volatility spillovers between oil prices and stock sector returns: Implications for portfolio management. J Int Money Finance 30: 1387–1405. https://doi.org/10.1016/j.jimonfin.2011.07.008 doi: 10.1016/j.jimonfin.2011.07.008
    [21] Arouri MEH, Lahiani A, Nguyen DK (2011) Return and volatility transmission between world oil prices and stock markets of the GCC countries. Econ Model 28: 1815–1825. https://doi.org/10.1016/j.econmod.2011.03.012 doi: 10.1016/j.econmod.2011.03.012
    [22] Ewing BT, Malik F, Ozfidan O (2002) Volatility transmission in the oil and natural gas markets. Energy Econ 24: 525–538. https://doi.org/10.1016/S0140-9883(02)00060-9 doi: 10.1016/S0140-9883(02)00060-9
    [23] Oberndorfer U (2009) Energy prices, volatility, and the stock market: Evidence from the Eurozone. Energy Policy 37: 5787–5795. https://doi.org/10.1016/j.enpol.2009.08.043 doi: 10.1016/j.enpol.2009.08.043
    [24] Oberndorfer U (2009) EU emission allowances and the stock market: Evidence from the electricity industry. Ecol Econ 68: 1116–1129. https://doi.org/10.1016/j.ecolecon.2008.07.026 doi: 10.1016/j.ecolecon.2008.07.026
    [25] Luo C, Wu D (2016) Environment and economic risk: An analysis of carbon emission market and portfolio management. Environ Res 149: 297–301. https://doi.org/10.1016/j.envres.2016.02.007 doi: 10.1016/j.envres.2016.02.007
    [26] Shehzad K, Xiaoxing L, Kazouz H (2020) COVID-19's disasters are perilous than global financial crisis: a rumor or fact? Finance Res Lett 36: 101669. https://doi.org/10.1016/j.frl.2020.101669 doi: 10.1016/j.frl.2020.101669
    [27] Conlon T, McGee R (2020) Safe haven or risky hazard? Bitcoin during the COVID-19 bear market. Finance Res Lett 35: 101607. https://doi.org/10.1016/j.frl.2020.101607 doi: 10.1016/j.frl.2020.101607
    [28] Conlon T, Corbet S, McGee RJ (2020) Are cryptocurrencies a safe haven for equity markets? An international perspective from the COVID-19 pandemic. Res Int Bus Finance 54: 101248. https://doi.org/10.1016/j.ribaf.2020.101248 doi: 10.1016/j.ribaf.2020.101248
    [29] Goodell JW (2020) Covid-19 and finance: Agendas for future research. Finance Res Lett 35: 101512. https://doi.org/10.1016/j.frl.2020.101512 doi: 10.1016/j.frl.2020.101512
    [30] Goutte S, Péran T, Porcher T (2020) The role of economic structural factors in determining pandemic mortality rates: Evidence from the COVID-19 outbreak in france. Res Int Bus Finance 54:101281. https://doi.org/10.1016/j.ribaf.2020.101281 doi: 10.1016/j.ribaf.2020.101281
    [31] Chaaya C, Thambi VD, Sabuncu Ö, et al. (2022) Ukraine–Russia crisis and its impacts on the mental health of Ukrainian young people during the COVID-19 pandemic. Ann Med Surg 79: 104033. https://doi.org/10.1016/j.amsu.2022.104033 doi: 10.1016/j.amsu.2022.104033
    [32] Roy A, Soni A, Deg S (2023) A wavelet-based methodology to compare the impact of pandemic versus Russia–Ukraine conflict on crude oil sector and its interconnectedness with other energy and non-energy markets. Energy Econ 124: 106830. https://doi.org/10.1016/j.eneco.2023.106830 doi: 10.1016/j.eneco.2023.106830
    [33] European Commission (2022) Quarterly report on European gas markets. Market Observatory for Energy DG Energy. Available from: https://energy.ec.europa.eu/system/files/2023-05/Quarterly%20Report%20on%20European%20Gas%20Markets%20report%20Q4%202022.pdf.
    [34] Inshakov OV, Bogachkova LY, Popkova EG (2019) The transformation of the global energy markets and the problem of ensuring the sustainability of their development. Lect Notes Netw Syst 44: 135–148. https://doi.org/10.1007/978-3-319-90966-0_10 doi: 10.1007/978-3-319-90966-0_10
    [35] Liu Y, Yu L, Yang C, et al. (2021) Heterogeneity of the impact of geopolitical events on energy trade: an empirical study based on regression discontinuity design. Front Environ Sci 9: 322. https://doi.org/10.3389/fenvs.2021.722910 doi: 10.3389/fenvs.2021.722910
    [36] Gong X, Sun Y, Du Z (2022) Geopolitical risk and China's oil security. Energy Policy 163: 112856. https://doi.org/10.1016/j.enpol.2022.112856 doi: 10.1016/j.enpol.2022.112856
    [37] Zhang Z, He M, Zhang Y, et al. (2022) Geopolitical risk trends and crude oil price predictability. Energy 258: 124824. https://doi.org/10.1016/j.energy.2022.124824 doi: 10.1016/j.energy.2022.124824
    [38] Dutta A, Dutta P (2022) Geopolitical risk and renewable energy asset prices: Implications for sustainable development. Renew Energy 196: 518–525. https://doi.org/10.1016/j.renene.2022.07.029 doi: 10.1016/j.renene.2022.07.029
    [39] Su CW, Khan K, Umar M, et al. (2021) Does renewable energy redefine geopolitical risks? Energy Policy 158. https://doi.org/10.1016/j.enpol.2021.112566 doi: 10.1016/j.enpol.2021.112566
    [40] Ali F, Suri P, Kaur T, et al. (2022) Modelling time-varying volatility using GARCH models: Evidence from the Indian stock market. F1000Res 27: 1098. https://doi.org/10.12688/f1000research.124998.2 doi: 10.12688/f1000research.124998.2
    [41] Nandy S, Chattopadhyay AK (2019) Indian stock market volatility: A study of inter-linkages and spillover effects. J Emerg Mark Finance 18: 183–212. https://doi.org/10.1177/0972652719846321 doi: 10.1177/0972652719846321
    [42] Jebabli I, Kouaissah N, Arouri M (2022) Volatility spillovers between stock and energy markets during crises: A comparative assessment between the 2008 global financial crisis and the COVID-19 pandemic crisis. Finance Res Lett 46: 102363. https://doi.org/10.1016/j.frl.2021.102363 doi: 10.1016/j.frl.2021.102363
    [43] Gharib C, Mefteh-Wali S, Jabeur SB (2021) The bubble contagion effect of COVID-19 outbreak: Evidence from crude oil and gold markets. Finance Res Lett 38: 101703. https://doi.org/10.1016/j.frl.2020.101703 doi: 10.1016/j.frl.2020.101703
    [44] Mensi W, Sensoy A, Vo XV, et al. (2020) Impact of COVID-19 outbreak on asymmetric multifractality of gold and oil prices. Resour Policy 69: 101829. https://doi.org/10.1016/j.resourpol.2020.101829 doi: 10.1016/j.resourpol.2020.101829
    [45] Wen F, Tong X, Ren X (2022) Gold or bitcoin, which is the safe haven during the COVID-19 pandemic? Int Rev Financ Anal 81: 102121. https://doi.org/10.1016/j.irfa.2022.102121 doi: 10.1016/j.irfa.2022.102121
    [46] Elsayed AH, Gozgor G, Lau CKM (2022) Risk transmissions between bitcoin and traditional financial assets during the COVID-19 era: The role of global uncertainties. Int Rev Financ Anal 81: 102069. https://doi.org/10.1016/j.irfa.2022.102069 doi: 10.1016/j.irfa.2022.102069
    [47] Dritsaki C (2017) An empirical evaluation in GARCH volatility modeling: Evidence from the Stockholm stock exchange. J math financ 7: 366–390. https://doi.org/10.4236/jmf.2017.72020 doi: 10.4236/jmf.2017.72020
    [48] Engle RF (1982) Autoregressive conditional heteroscedasticity with estimates of the variance of UK inflation. Econometrica 50: 987–1007. https://doi.org/10.2307/1912773 doi: 10.2307/1912773
    [49] Bollerslev T (1986) Generalized autoregressive conditional heteroskedasticity. J Econom 31: 307–327. https://doi.org/10.1016/0304-4076(86)90063-1 doi: 10.1016/0304-4076(86)90063-1
    [50] Sarwar S, Shahbaz M, Anwar A (2019) The importance of oil assets for portfolio optimization: the analysis of firm level stocks. Energy Econ 78: 217–234. https://doi.org/10.1016/j.eneco.2018.11.021 doi: 10.1016/j.eneco.2018.11.021
    [51] Afzal F, Haiying P, Afzal F, et al. (2021) Value-at-risk analysis for measuring stochastic volatility of stock returns: using GARCH-based dynamic donditional correlation Model. SAGE Open 11. https://doi.org/10.1177/21582440211005758 doi: 10.1177/21582440211005758
    [52] Black F (1976) Studies in stock price volatility changes of the nominal excess return on stocks. Proceedings of the business and economics statistics section, American statistical association 81: 177–181.
    [53] Ari Y (2020) Volatility transmission model using DCC-GARCH representation. In: Samet Evci, Anshuman Sharma. Studies at the Crossroads of Management & Economics, London: IJOPEC, 237–250.
    [54] Engle RF (2002) Dynamic conditional correlation: A simple class of multivariate generalized autoregressive conditional heteroskedasticity models. J Bus Econ Stat 20: 339–350. https://www.jstor.org/stable/1392121
    [55] Bollerslev T (1990) Modelling the coherence in short-run nominal exchange rates: A multivariate generalized ARCH model. Rev Econ Stat 72: 498–505. https://doi.org/10.2307/2109358 doi: 10.2307/2109358
    [56] Cappiello L, Engle RF, Sheppard K (2006) Asymmetric dynamics in the correlations of global equity and bond returns. J Financ Econ 4: 537–572. https://doi.org/10.1093/jjfinec/nbl005 doi: 10.1093/jjfinec/nbl005
    [57] Billio M, Caporin M, Gobbo M (2006) Flexible dynamic conditional correlation multivariate GARCH models for asset allocation. Appl Financ Econ Lett 2: 123–130. https://doi.org/10.1080/17446540500428843 doi: 10.1080/17446540500428843
    [58] Celik S (2012) The more contagion effect on emerging markets: the evidence of DCC-GARCH model. Econ Modell 29: 1946–1959. https://doi.org/10.1016/j.econmod.2012.06.011 doi: 10.1016/j.econmod.2012.06.011
    [59] Duca JV (2023) Subprime mortgage crisis. Federal Reserve History. Available from: https://www.federalreservehistory.org/essays/subprime-mortgage-crisis.
    [60] Nasdaq Data Link (2023). Available from: https://data.nasdaq.com/data/ODA/PNGASEU_USD-natural-gas-netherlands-ttf-natural-gas-forward-day-ahead-us-per-million-metric-british-thermal-unit.
    [61] US Energy Information Administration (EIA), 2023. Available from: https://www.eia.gov/dnav/pet/hist/LeafHandler.ashx?n = PET & s = RBRTE & f = M.
    [62] Energy-Charts (2023). Available from: https://www.energy-charts.info/index.html?l = en & c = DE.
    [63] EEX (2023). Available from: https://www.powernext.com/spot-market-data.
    [64] Manescu C, Van Robays I (2014) Forecasting the brent oil price addressing time-variation in forecast performance. European Central Bank. Available from: https://www.ecb.europa.eu/pub/pdf/scpwps/ecbwp1735.pdf.
    [65] Jarque CM, Bera AK (1980) Efficient tests for normality, homoscedasticity and serial independence of regression residuals. Econ Lett 6: 255–259. https://doi.org/10.1016/0165-1765(80)90024-5 doi: 10.1016/0165-1765(80)90024-5
    [66] Ljung G, Box G (1978) On a Measure of a lack of fit in time series models. Biometrika 65: 297–303. https://doi.org/10.1093/biomet/65.2.297 doi: 10.1093/biomet/65.2.297
    [67] PennState-Eberly College of Science (2023) STAT 509, Design and Analysis of Clinical Trials. Available from: https://online.stat.psu.edu/stat509/lesson/18/18.1.
    [68] Greene WH (2017) Econometric Analysis. Pearson.
    [69] Dickey DA, Fuller WA (1979) Distribution of the estimators for autoregressive time series with a unit root. J AM STAT ASSOC 74: 427–431. https://doi.org/10.2307/2286348 doi: 10.2307/2286348
    [70] Cragg JG (1983) More efficient estimation in the presence of heteroskedasticity of unknown form. Econometrica 51: 751–764. https://doi.org/10.2307/1912156 doi: 10.2307/1912156
    [71] Brooks, C (2014) Introductory econometrics for finance, Cambridge: Cambridge University Press.
    [72] Dutta A, Bouri E, Noor MH (2018) Return and volatility linkages between CO2 emission and clean energy stock prices. Energy 164: 803–810. https://doi.org/10.1016/j.energy.2018.09.055 doi: 10.1016/j.energy.2018.09.055
    [73] Ahmad W (2017) On the dynamic dependence and investment performance of crude oil and clean energy stocks. Res Int Bus Finance 42: 376–389. https://doi.org/10.1016/j.ribaf.2017.07.140 doi: 10.1016/j.ribaf.2017.07.140
    [74] Ahmad W, Sadorsky P, Sharma A (2018) Optimal hedge ratios for clean energy equities. Econ Modell 72: 278–295. https://doi.org/10.1016/j.econmod.2018.02.008 doi: 10.1016/j.econmod.2018.02.008
    [75] Granger C (1969) Investigating causal relations by econometric models and cross-spectral Methods. Econometrica 37: 424–438. https://doi.org/10.2307/1912791 doi: 10.2307/1912791
    [76] Troster V (2018) Testing for granger-causality in quantiles. Econom Rev 7: 850–866. https://doi.org/10.1080/07474938.2016.1172400 doi: 10.1080/07474938.2016.1172400
    [77] Engle R, Sheppard K (2001) GARCH 101: The use of ARCH/GARCH models in applied econometrics. J Econ Perspect 15: 157–168. https://doi.org/10.1257/jep.15.4.157 doi: 10.1257/jep.15.4.157
    [78] Alexander C (2008) Market Risk Analysis: Pricing, Hedging and Trading Financial Instruments. Hoboken: John Wiley & Sons Ltd.
  • Reader Comments
  • © 2023 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(1674) PDF downloads(76) Cited by(0)

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog