Decay properties for evolution-parabolic coupled systems related to thermoelastic plate equations

1.   Introduction

Since Engle's groundbreaking work on the univariate ARCH model ^[12], and the subsequent generalization to the GARCH model by Bollerslev ^[9], as well as the introduction of the threshold GARCH by Glosten et al. ^[20], these models have become fundamental tools for capturing the key stylized facts of financial time series. The capability to model the co-movements of multiple series is of paramount practical importance. Analyzing them as components of a multivariate process is of particular benefit, especially in the presence of temporal or contemporaneous dependencies. The spectrum of multivariate (A)GARCH models is expanding, with a substantial body of literature already established ^[3,15,26,28]. This includes significant probabilistic, structural, and asymptotic findings that support various estimation methods for a wide range of multivariate GARCH models and their extensions.

Engle and Kroner ^[13] set the groundwork for covariance stationarity in multivariate generalized ARCH models. The existence of a 4th-moment structure in the CCC-GARCH model was validated by He and Terasvirta ^[22] and Aue et al. ^[1]. Jeantheau ^[23] demonstrated the robust consistency of the Quasi-Maximum Likelihood Estimator (QMLE) in multivariate ARCH models. Ling and McAleer ^[25] furthered this by establishing the asymptotic properties of the QMLE for vector ARMA-GARCH models, contingent on the finiteness of the 4th-moment of the observed process. Notably, while asymptotic results for some asymmetric models were known, the works of ^[2] extended these to a broader class of multidimensional causal processes, including asymmetries. McAleer et al. ^[27] contributed to the structure and asymptotic theory of the VARMA-AGARCH model, a direction further expanded by Francq and Zakoïan ^[14,15], who provided results for a variety of multivariate (A)GARCH models without relying on moment assumptions for the observed process. Extensions of the EGARCH model to the multivariate context were also proposed by Koutmos and Booth ^[24]. In terms of more recent developments, stationary multivariate GARCH models have evolved from time-invariant to time-varying coefficients. These models allow coefficients to depend on an unobservable, time-homogeneous Markov chain, as demonstrated in the multivariate MS-GARCH model by Haas and Liu ^[21].

Francq and Zakoïan (2010, ^[14]) investigated the quasi-maximum likelihood estimation of a class of symmetric multivariate GARCH models without imposing moment conditions for the observed process. They extended this study to multivariate asymmetric GARCH models in their subsequent paper (Francq and Zakoïan, 2012, ^[15]). In ^[5], Bibi (2018) extended the symmetric multivariate GARCH models studied by Francq and Zakoïan (2010, ^[14]) by investigating the asymptotic properties of QML estimation for symmetric multivariate periodic CCC-GARCH models. Maïnassara et al. (2022, ^[26]) made additions that can be considered an extension of Francq and Zakoïan's models by studying the estimation of multivariate asymmetric power GARCH models.

We extend the work undertaken in these studies. On the one hand, we extend the standard models by introducing coefficients related to time-varying and periodicity (for more details, see Ghezal et al. ^[16,17]); on the other, we extend Bibi's paper by incorporating the effect of asymmetry. More accurately, in our paper, we expanded the standard models to include the effects of temporal and periodic factors on the model coefficients. Additionally, we incorporate the effects of asymmetry in multivariate GARCH models, allowing for cross-leverage effects, which was not considered in Bibi's paper, which focused solely on symmetric models. Moreover, our paper illustrates our major findings by application to a bivariate exchange rates series, while Bibi's paper focused solely on the theoretical aspects of periodic multivariate CCC-GARCH models. Furthermore, our primary contribution lies in providing asymptotic results for this model category without imposing moment assumptions for the observed process, a topic further explored by Ghezal et al. ^[7,16]. These differences highlight the unique contribution of our research to the development of multivariate GARCH models.

In this context, the following symbols are utilized:

$-$ $I_{(n)}$ represents the $n\times n$ identity matrix and $O_{(k, l)}$ represents a matrix of size $k\times l$ with all entries being zeros. For clarity, let us consider: $\underline{O}_{(k)}: = O_{(k, 1)}$ and $O_{(k)} : = O_{(k, k)}$.

$-$ $A^{\otimes s}$ signifies $A\otimes A\otimes...\otimes A$ repeated $s\ $times, where $\otimes$ represents the usual Kronecker product of matrices. $Vec\left(A\right)$ denotes the vector stacking operator. If $\left(A(k), k\in K\right)$ is a sequence of $n\times n$ matrices, it is important to note that for any integers m and t, ${ \prod\limits_{i = m}^{t}} A(i) = A(m)A(m+1)\ldots A(t)$ if $m\leq t$, and $I_{(n)}$ otherwise.

$-$ $\rho\left(A\right)$ represents the spectral radius of the squared matrix $A,$ $\det\left(A\right)$ (resp. $Tr(A)$) denotes the determinant (resp. trace) of $A.$ Moreover, for any matrices A, B, and C with suitable dimensions, $Tr\left(B^{\prime}A\right) = Vec\left(B\right) ^{\prime}Vec\left(A\right)$ and $Vec\left(BAC\right) = \left(C^{\prime}\otimes B\right) Vec\left(A\right)$. Let $\left\Vert.\right\Vert$ represent any induced matrix norm on the set of $r\times p$ and $r\times1$ matrices. This norm verifies, for any $p\times r$ matrix A and $r\times p$ matrix B, that $\left\vert Tr\left(AB\right) \right\vert \leq\sqrt{nm}$ $\left\Vert A\right\Vert \left\Vert B\right\Vert,$ $\left\Vert A\right\Vert ^{2}\leq Tr\left(A^{\prime}A\right) \leq m\left\Vert A\right\Vert ^{2}$, and $\left\vert A^{\prime}A\right\vert \leq\left\Vert A\right\Vert ^{2m}.$

$-$ $\nabla_{\underline{\theta}}$ represents the vector of first-order partial derivatives with respect to $\underline{\theta}$, $\nabla _{\underline{\theta}}^{2}$ represents the matrix of second-order partial derivatives with respect to $\underline{\theta}$, and $\rightsquigarrow$ represents convergence in the distribution.

$-$ Recall that if $g\left(B\right)$ is a real-valued function of a matrix B depending on some parameter $\underline{\theta}$, then $\nabla_{\underline{\theta}}g\left(B\right) = Tr\left(\frac{\partial g\left(B\right) }{\partial B^{\prime}}\nabla_{\underline{\theta}}B\right).$ Furthermore, assuming the invertibility of matrix A, the following holds true for any vector $\underline{x}$ and matrices B and C with suitable dimensions:

and

2.   The multivariate periodic asymmetric GARCH model

We begin with the CCC-PAGARCH models defined for a $r-$dimensional $\left\{ \underline{X}_{t} = \left(X_{1t}, ..., X_{rt}\right) ^{\prime }\right\}$ as follows

where $\underline{\sigma}_{t}^{\tau}: = \left(\sigma_{1t}^{\tau}, ..., \sigma_{rt}^{\tau}\right) ^{\prime},$ $\tau\in\mathbb{R}_{+}^{\ast},$ $\underline{X}_{t}^{+}: = \left(X_{1t}^{+2}, ..., X_{rt}^{+2}\right) ^{\prime },$ $\underline{X}_{t}^{-}: = \left(X_{1t}^{-2}, ..., X_{rt}^{-2}\right) ^{\prime},$ $z^{-} = \left(-z\right) ^{+} = \left(-z\right) \vee0,$ $z^{\pm2} = \left(z^{\pm}\right) ^{2},$ $\mathcal{F}_{t}: = \sigma\left\{ \underline{X}_{t-i}, i\geq0\right\}$, M represents a constant conditional correlation matrix, $\underline{a}_{0}\left(.\right)$ represents a $r\times1$ vector whose entries are strictly positive, the $A_{i}\left(.\right),$ $B_{i}\left(.\right)$ and $C_{j}\left(.\right)$ for all $i, j$ are $r\times r$ matrices with positive entries, the functions $\underline{a}_{0}\left(t\right), A_{i}\left(t\right),$ $B_{i}\left(t\right)$ and $C_{j}\left(t\right)$ exhibit periodicity in t with a period of s, and $\left(\underline{\eta}_{t}\right)$ is an i.i.d. random vector with a mean and covariance matrix $\left(\underline{O}_{\left(r\right) }, I_{\left(r\right) }\right).$ Now, it is important to emphasize that this model is limited to the periodic case, i.e., by setting $t = ns+v$, where $v = 1, ..., s$ and $n\in\mathbb{Z}$. Consequently, the model (2.1) can be expressed in the following form

CCC-PAGARCH is a comprehensive framework that encompasses several models previously explored in the literature. This includes standard CCC-AGARCH models when $s = 1$, as discussed in ^[15], conventional symmetric CCC-PeriodicGARCH models when $A_{.}\left(.\right) = B_{.}\left(.\right),$ as explored in ^[5], and periodic asymmetric GARCH models when $r = 1,$ as studied by Ghezal et al. ^[6]. Now, such as seen in several time series models, it is usually beneficial to express (2.1) as an analogous stochastic recurrence equation to facilitate a more streamlined analysis (see ^[17,18,19]). For this reason, we write $\underline{X}_{t} = H_{t}\widetilde{\underline{\eta}_{t} },$ $\underline{X}_{t}^{+} = G_{t}^{+}\underline{\sigma}_{t}$ and $\underline{X}_{t}^{-} = G_{t}^{-}\underline{\sigma}_{t}$, where $\widetilde {\underline{\eta}_{t}} = M^{1/2}\underline{\eta}_{t}$ and $G_{t}^{\pm} =$ $diag\left(\widetilde{\underline{\eta}_{t}}^{\pm2}\right),$ and we consider the $r\left(2q+p\right) \times r\left(2q+p\right)$ matrix

where

Consequently, we have $\underline{X}_{t} = G_{t}\underline{\sigma}_{t}$ and $\underline{\sigma}_{t} = F^{\prime}\underline{\Lambda}_{t}$, such that

where

and

Now, iterating (2.3) $s$times, we get

in which $\Omega_{t} = \prod\limits_{j = 0}^{s-1}\Delta_{st-j}$ and $\underline {\Xi}_{t} = \sum\limits_{i = 0}^{s-1}$ $\left\{ \prod\limits_{l = 0}^{i-1} \Delta_{st-l}\right\} \underline{\Pi}_{st-i}$ where, as is customary, emptied products are defined to be equal to $I_{(r\left(2q+p\right))}$. Note here that $\left(\Omega_{t}\right)$ (resp. $\left(\underline{\Xi}_{t}\right)$) represents a sequence of i.i.d. positive random matrices (resp. vectors), independent of $\underline{\Gamma}_{n}$, $n < t$. Therefore, a causal, periodically ergodic, and strictly periodical solution (short form: PE and SPS) for Eq (2.3), with an equivalent representation in (2.2), holds true if Eq (2.4) has a causal, ergodic, and strictly stationary (short form: SS) solution. Observe that according to (2.3) and (2.4) are correct for all integer t, through recursive substitution, we derive formal series solutions denoted, respectively, by

and

3.   Probabilistic properties of periodic CCC-AGARCH models

The uniqueness of the non-anticipative SS solution $(\underline {\Gamma}_{t})$ to the model (2.4) appears in a form comparable to that of Bougerol and Picard ^[10] through the use of the top$-$Lyapunov exponent $\gamma_{\Omega}$ linked to the sequence of stochastic matrices $\Omega = \left(\Omega_{t}\right)$ defined by

Furthermore, since $E\left\{ \log^{+}\left\Vert \Omega_{1}\right\Vert \right\} \leq$ $E\left\{ \left\Vert \Omega_{1}\right\Vert \right\} < +\infty$ where $\log^{+}z$ represents $\log z\vee0,$ $\forall z > 0$, this ensures the existence of $\gamma_{\Omega}$. Building upon the preceding discussion, we are ready to unveil the following outcomes.

Theorem 1. Consider the process $\left(\underline{X}_{t}\right) _{t\in\mathbb{Z}}$ defined by the model (2.1) with a periodic vector representation (2.3), and suppose that $E\left\{ \left\Vert \underline{\eta}_{t}\right\Vert \right\} < +\infty$. The following statements are thus equivalent:

● The Eq (2.4) having a unique, strictly stationary, causal and ergodic solution provided by $\underline{\Gamma}_{t}$(2).

● The Eq (2.3) having a unique, SPS, causal and PE solution provided by $\underline{\Gamma}_{t}$(1).

● $\gamma_{\Omega} < 0$.

Furthermore, for all $t\in\mathbb{Z}$, the series $\underline{\Gamma} _{t}$(1) and $\underline{\Gamma}_{t}$(2) converge absolutely almost surely, $\underline{\Gamma}_{t}$(1) $\overset{a.s}{ = }\underline{\Gamma}_{t}$(2).

We also need the subsequent simple outcome which characterizes a necessary condition for SS.

Corollary 1. If the $CCC-PAGARCH\left(p, q\right)$ model described in (2.1) satisfies $\gamma_{\Omega} < 0$, thus $\rho\left(\prod\limits_{v = 0}^{s-1}C_{s-v}\right) < 1$, where $C_t=\left(\begin{array}{lll} C_1(t) & \cdots & C_p(t) \\ I_{(r(p-1))} && O_{(r(p-1), r)} \end{array}\right)$.

Now, the subsequent proposition introduces conditions that are slightly more robust, guaranteeing the negativity of $\gamma_{\Omega}$.

Proposition 1. Consider the $CCC-PAGARCH\left(p, q\right)$ model, then

$a.$ $\rho\left(E\left\{ \Omega_{1}\right\} \right) < 1$ implies that $\gamma_{\Omega} < 0$.

$b.$ $E\left\{ \log\left\Vert \prod\limits_{i = 0}^{t-1}\Omega _{t-i}\right\Vert \right\} < 0$ or $E\left\{ \left\Vert \prod\limits_{i = 0} ^{t-1}\Omega_{t-i}\right\Vert \right\} < 1$ for some $t\geq1\Longrightarrow$ $\gamma_{\Omega} < 0$.

Moreover, if $\gamma_{\Omega} < 0$, then there is $\varsigma > 0$ such that $\forall t,$ $E\left\{ \left\Vert \underline{\sigma}_{t}\right\Vert ^{\varsigma}\right\} < +\infty$, $E\left\{ \left\Vert \underline{X} _{t}\right\Vert ^{\varsigma}\right\} < +\infty.$

The following results establish the geometric ergodicity and $\beta-$mixing of Markov chain $\left(\underline{\Gamma}_{t}\right)$ with state space $\mathbb{R}^{r\left(2q+p\right) }$ whose $n-$step transition probability is given by $P_{\underline{x}_{0}}^{n}\left(D\right) = P\left(\left. \underline{\Gamma}_{t}\in D\right\vert \underline{\Gamma} _{0} = \underline{x}_{0}\right)$ for any Borel set $D\in\mathcal{B} _{\mathbb{R}^{r\left(2q+p\right) }}$.

Theorem 2. If $\left(\underline{X}_{t}\right) _{t\in\mathbb{Z}}$ is the process governed by (2.1), characterized by a state-space representation as described in (2.4), then

$i.$ $\rho\left(E\left\{ \Omega_{1}\right\} \right) < 1$ entails the existence of only one invariant distribution of $P_{\underline{x}}\left(.\right),$ $\forall\underline{x},$ a non-negative Borel measurable function $h\geq1$ defined on $\mathbb{R}^{r\left(2q+p\right) }$, a compact set W in $\mathcal{B}_{\mathbb{R}^{r\left(2q+p\right) }}$, a constant $\kappa$ and $\delta\in\left] 0, 1\right[$ such that for any $\underline{x}\in W^{c},$ $E\left\{ h\left(\underline{\Gamma}_{n+1}\right) \left\vert \underline{\Gamma}_{n} = x\right. \right\} \leq\delta h\left(\underline {x}\right) -\kappa$ and $\sup_{\underline{x}\in W}E\left\{ h\left(\underline{\Gamma}_{n+1}\right) \left\vert \underline{\Gamma}_{n} = x\right. \right\} < +\infty.$

$ii.$ The chain $\left(\underline{\Gamma}_{n}\right)$ is geometrically ergodic and $\beta-$mixing property with exponential decay rate with $E\left\{ \underline{\Gamma}_{n}\right\} < +\infty$ if, and only if, $\rho\left(E\left\{ \Omega_{1}\right\} \right) < 1.$

$iii.$ $\sup_{1\leq v\leq s}\rho\left(\sum\limits_{i = 1}^{q}\left(A_{i}\left(v\right) +B_{i}\left(v\right) \right) +\sum\limits_{j = 1} ^{p}C_{j}\left(v\right) \right) < 1$ implies that the chain $\left(\underline{\Gamma}_{n}\right)$ is geometrically ergodic.

4.   Estimation

In this section, we consider the QMLE for estimating the parameters of the $CCC-PAGARCH\left(p, q\right)$ model assembled in

where

and

with

for all $1\leq v\leq s,$ $\theta_{i}\left(v\right) = a_{0, i}\left(v\right), i = 1, ..., r,$ $\theta_{r+ijk}\left(v\right) = \alpha_{ijk}\left(v\right), i, j = 1, ..., r, k = 1, ..., q,$ $\theta_{r+r^{2}q+ijk}\left(v\right) = \beta_{ijk}\left(v\right), i, j = 1, ..., r, k = 1, ..., q,$ $\theta_{r+2r^{2} q+ijk}\left(v\right) = \gamma_{ijk}\left(v\right), i, j = 1, ..., r, k = 1, ...p$ and $M = \left(m_{ij}\right)$ is the symmetric matrix with $m_{ii} = 1$ (i.e., $\underline{m}^{\prime}: = \left(m_{21}, ..., m_{r1}, m_{32}, ..., m_{r2}, ..., m_{rr-1}\right)).$ The true parameter value, symbolized by $\underline{\theta}_{0}$ and belonging to the parameter space$\ \Theta,$ is unknown and needs to be estimated$.$ In pursuit of this, consider that the observations $\underline{X}_{1}, ..., \underline{X}_{n = sN}$ constitute a time series from the unique, SPS and causal solution of (2.1). A QMLE of $\underline{\theta}$ is defined as any measurable solution $\widehat{\underline{\theta}}_{n}$ of

For initial values $\underline{X}_{0}, ..., \underline{X}_{1-q}, \underline {\widetilde{\sigma}}_{0}\left(\underline{\theta}\right), ..., \underline {\widetilde{\sigma}}_{1-p}\left(\underline{\theta}\right),$ the Gaussian $\log-$likelihood function for $\underline{\theta}\in\Theta$ is given up to an additive constant by

with $\widetilde{l}_{t}\left(\underline{\theta}\right) = \log\det\left(\widetilde{V}_{t}\right) +\underline{X}_{t}^{\prime}\widetilde{V}_{t} ^{-1}\underline{X}_{t}$, where $\widetilde{V}_{t}$ is recursively defined for $t\geq1$ by

Due to the strong dependency of $\widetilde{V}_{t}\left(\underline{\theta }\right)$ on initial values, the process $\left(\widetilde{l}_{t}\left(\underline{\theta}\right) \right)$ is neither an $S\ PS$ nor PE process. Hence, it would be appropriate to replace the process $\left(\widetilde {l}_{t}\left(\underline{\theta}\right) \right)$ with its $SP\ S$ and PE version. Therefore, we introduce an approximate version $L_{Ns}\left(\underline{\theta}\right) = -\left(Ns\right) ^{-1}\sum\nolimits_{t = 1} ^{N}\sum\nolimits_{v = 0}^{s-1}l_{st+v}\left(\underline{\theta}\right)$ of the likelihood (4.2) with $l_{t}\left(\underline{\theta}\right) = \log\det\left(V_{t}\right) +\underline{X} _{t}^{\prime}V_{t}^{-1}\underline{X}_{t}$. The upcoming findings in this paper confirm the robust consistency of $\widehat{\underline{\theta}}_{Ns}$ and its asymptotic normality.

4.1.   Robust consistency of QMLE

Take into account the regularity assumptions listed below:

$\textbf{A0}$ $\underline{\theta}_{0}\in\Theta$ and $\Theta$ is compact$.$

$\textbf{A1}$ Consider the polynomials $\mathcal{A}_{0, v}\left(z\right) = \sum\nolimits_{i = 1}^{q}A_{0, i}\left(v\right) z^{i},$ $\mathcal{B}_{0, v}\left(z\right) = \sum\nolimits_{i = 1}^{q}B_{0, i}\left(v\right) z^{i}$ and $\mathcal{C}_{0, v}\left(z\right) = I_{\left(r\right) }-\sum\nolimits_{j = 1}^{p}C_{0, j}\left(v\right) z^{j}$ adheres to the convention $\mathcal{A}_{0, v}\left(z\right) = \mathcal{B}_{0, v}\left(z\right) = O_{\left(r\right) }$ if $q = 0$ and $\mathcal{C}_{0, v}\left(z\right) = I_{\left(r\right) }$ if $p = 0,$ for all $v\in\left\{ 1, ..., s\right\}.$ If $p > 0,$ $\mathcal{A}_{0, v}\left(1\right) +\mathcal{B}_{0, v}\left(1\right) \neq O$, $\mathcal{A}_{0, v}\left(z\right)$, $\mathcal{B}_{0, v}\left(z\right)$ and $\mathcal{C} _{0, v}\left(z\right)$ are left-coprime and $\left[ A_{0, q}\left(v\right) \text{ }B_{0, q}\left(v\right) {\ \ }C_{0, p}\left(v\right) \right]$ has full rank r for all $v\in\left\{ 1, ..., s\right\}.$

$\textbf{A2}$ $\gamma_{\Omega^{0}} < 0$ with $\Omega^{0}$ in place of $\Omega$ to confirm that the unknown parameter is $\underline{\theta}_{0}$ and $\rho\left(\prod\limits_{v = 0}^{s-1}C_{0, s-v}\right) < 1.$

$\textbf{A3}$ The distribution of the components of $\widetilde {\underline{\eta}}_{t}$ isn't focused on two points and $P\left(\widetilde{\eta}_{it}\in\left(0, +\infty\right) \right) \in\left(0, 1\right)$ for $i = 1, \dots, r.$ $\textbf{A4}$ M represents a correlation matrix that is positive-definite.

Currently, we have the capability to articulate our initial finding.

Theorem 3. Assuming the specified Assumptions, A0–A4, $\widehat{\underline{\theta}}_{Ns}$ exhibits robust consistency, meaning that

To establish the proof of Theorem 3, we articulate the subsequent technical statements encapsulated in the following lemma.

Lemma 1. Assuming the specified Assumptions, A0–A4, we obtain

Ⅰ. $\underset{\underline{\theta}\in\Theta}{\sup}\left\vert \left(\widetilde{L}_{Ns}-L_{Ns}\right) \left(\underline{\theta}\right) \right\vert \underset{N}{\overset{a.s.}{\longrightarrow}}0$.

Ⅱ. There exists an integer $t\in\mathbb{Z}$ such that $\underline{\sigma}_{t}\left(\underline{\theta}\right) \overset{a.s.} { = }\underline{\sigma}_{t}\left(\underline{\theta}_{0}\right)$ and $M = M_{0}\Rightarrow$ $\underline{\theta} = \underline{\theta}_{0}.$

Ⅲ. $\sum\nolimits_{v = 1}^{s}E_{\underline{\theta}_{0} }\left\{ l_{st+v}\left(\underline{\theta}_{0}\right) \right\} < \infty$ and $\sum\nolimits_{v = 1}^{s}E_{\underline{\theta}_{0}}\left\{ l_{st+v}\left(\underline{\theta}\right) \right\}$ is minimized at $\underline{\theta } = \underline{\theta}_{0}.$

Ⅳ. $\forall\underline{\theta}\neq\underline{\theta}_{0}$, there exists a neighborhood $\mathcal{V}\left(\underline{\theta}\right)$ such that $\sum\nolimits_{v = 1}^{s}E_{\underline{\theta}_{0}}\left\{ l_{st+v}\left(\underline{\theta}_{0}\right) \right\} < \underset {N\rightarrow \infty}{\lim\inf}\underset{\widetilde{\underline{\theta}} \in\Theta}{\inf}\left(\widetilde{L}_{Ns}\left(\widetilde{\underline {\theta}}\right) \right)$ a.s.

4.2.   Asymptotic normality (AN) of QMLE

To demonstrate the AN of $\widehat{\underline{\theta}}_{Ns}$, the analysis relies on additional assumptions.

$\textbf{A5}$ $\underline{\theta}_{0}\in\mathring{\Theta},$ where $\mathring{\Theta}$ represents the interior of the parameter space $\Theta.$

$\textbf{A6}$ $E\left\{ \left\Vert \underline{\eta}_{t}\underline{\eta }_{t}^{\prime}\right\Vert ^{2}\right\} < \infty.$

These supplementary assumptions are essential to establishing the required conditions under which the estimator $\widehat{\underline{\theta} }_{Ns}$ exhibits asymptotic normality. The second principal outcome is encapsulated in the following theorem

Theorem 4. Assuming that $\left(\underline{X}_{t}, t\in\mathbb{Z}\right)$ is formed by the model referenced in (2.1), under the conditions specified in A0–A6 we obtain

where the matrix $K = \sum\nolimits_{v = 1}^{s}E_{\underline{\theta}_{0}}\left\{ \nabla_{\underline{\theta}}^{2}l_{st+v}\left(\underline{\theta}_{0}\right) \right\}$is positive-definite and the matrix

The demonstration of Theorem 4 relies on the classical technique of a Taylor series expansion of $\nabla_{\underline{\theta}} L_{Ns}\left(\underline{\theta}\right)$ around $\underline{\theta}_{0}$, and this expansion is expressed as

Here, the coordinates of $\widetilde{\underline{\theta}}$ lie between $\widehat{\underline{\theta}}_{Ns}$ and $\underline{\theta}_{0}.$ The theorem will consequently follow straightforwardly. To achieve this, we will establish the subsequent intermediate outcomes, consolidated in the following lemma

Lemma 2. Assuming A0–A6, we obtain

$\boldsymbol{a.}$ $\sum\nolimits_{v = 1}^{s}E_{\underline{\theta}_{0}}\left\{ \underset{\underline{\theta}\in\mathcal{\Theta}}{\sup}\left\Vert \nabla_{\underline{\theta}}l_{st+v}\left(\underline{\theta}_{0}\right) \nabla_{\underline{\theta}}^{\prime}l_{st+v}\left(\underline{\theta} _{0}\right) \right\Vert \right\} < \infty$ and $\sum\limits_{v = 1} ^{s}E\left\{ \underset{\underline{\theta}\in\mathcal{\Theta}}{\sup}\left\Vert \nabla_{\underline{\theta}}^{2}l_{st+v}\left(\underline{\theta}_{0}\right) \right\Vert \right\} < \infty$.

$\boldsymbol{b.}$ K is invertible and the existence of the matrix U.

$\boldsymbol{c.}$ $\exists\mathcal{V}\left(\underline{\theta}_{0}\right)$ of $\underline{\theta}_{0}$ such that $\sum\nolimits_{v = 1}^{s}E_{\underline {\theta}_{0}}\left\{ \underset{\underline{\theta}\in\mathcal{V}\left(\underline{\theta}_{0}\right) }{\sup}\left\vert \dfrac{\partial^{3} l_{st+v}\left(\underline{\theta}\right) }{\partial\theta_{i}\left(v\right) \partial\theta_{j}\left(v\right) \partial\theta_{k}\left(v\right) }\right\vert \right\} < \infty$ for all $1\leq i, j, k\leq l.$

$\textbf{d.}$ $\left(Ns\right) ^{-\frac{1}{2}}\sum\limits_{t = 1} ^{Ns}\nabla_{\underline{\theta}}l_{t}\left(\underline{\theta}_{0}\right) \ \leadsto\mathcal{N}\left(\underline{O}, U\right) \ $as $N\rightarrow \infty.$

Remark 4.1. The extension of the existing models to accommodate asymmetries, as highlighted in the symmetric CCC-PGARCH paper by Bibi ^[5], addresses a crucial aspect of volatility modeling in financial time series data. Asymmetries arise when positive and negative past values of the process have different impacts on the current volatility, thereby affecting the current volatility differently. This phenomenon introduces complexities in characterizing the usual leverage effect, particularly when considering the possibility of positive or negative volatility values. To address these asymmetries, researchers have proposed extensions to existing models, such as asymmetric specifications of GARCH models, and incorporating correlations between volatility process noise and observation series noise in the stochastic volatility framework. The aim of these efforts is to enhance the models' ability to capture the nuanced dynamics of financial markets, including asymmetric responses to market shocks. Therefore, the proposed extension to the class of CCC-PGARCH models fills an important gap in the literature and contributes to advancing our understanding of volatility dynamics in financial time series data.

Remark 4.2. In our study, we introduce the concept of an expanded model derived from our primary model, presenting an open problem that invites scientific inquiry and exploration. This extended model, termed the double-switching CCC-$\left(A\right) GARCH$ model, combines the principles of a CCC-$\left(A\right) GARCH$ model with Markov switching and a periodic sequence (see., Zerari et al. ^[30] for further ideas). The aim of integrating these elements is to establish a robust analytical framework to comprehend volatility within financial markets. By enhancing the predictive capabilities of volatility models and refining risk management strategies, this approach not only contributes to more effective financial analysis but also lays the groundwork for future research endeavors in the field of financial data analysis.

Remark 4.3. The extension of Bibi's theories in our paper offers substantial value-added contributions to this field. While Bibi's work primarily focused on extending symmetric multivariate GARCH models to include periodic features and investigate the asymptotic properties of QML estimation, our paper goes further by incorporating the effects of asymmetry. This extension is crucial as it allows for a more comprehensive understanding of the dynamics of financial time series data, particularly in capturing cross-leverage effects and asymmetric behavior. Additionally, our paper provides asymptotic results for a class of generally nonstationary multivariate GARCH models, a topic that has not been extensively explored in the existing literature. By doing so without imposing moment assumptions on the observed process, we contribute to a deeper understanding of the underlying processes governing financial time series data, thereby enhancing the applicability and robustness of multivariate GARCH models in real-world scenarios.

5.   Simulation results

Herein, we present a simulation study to assess the effectiveness of the QMLE, where we simulated 500 independent trajectories, each with lengths of $n = 1000$ and $n = 3000$, from a bivariate periodic stationary CCC-$AGARCH$(1.1) model, with $\mathcal{N}(\underline{O}_{\left(2\right) }, I_{\left(2\right) })$ and $t_{15}$ as innovations distributions with a $\underline{O}_{\left(2\right) }$ mean and a $I_{\left(2\right) }$ covariance matrix. The parameter $\underline{\theta}_{0}$ is selected to meet the SPS condition $\gamma_{\Omega} < 0$. The Root Mean Square Errors (RMSE) of $\widehat{{ \underline{\theta}}}$ $\left(v\right)$, where $v = 1, \dots, s$, are computed to assess the performance of the estimators.

5.1.   Bivariate standard $CCC-AGARCH(1.1)$ model

Our initial Monte Carlo study involves the estimation of a bivariate standard $CCC-AGARCH$(1.1) model, with the parameters associated with this model gathered in vector $\underline{\theta} = \left(\underline {a}_{0}^{\prime}, Vec^{\prime}\left(A_{1}\right), Vec^{\prime}\left(B_{1}\right), Vec^{\prime}\left(C_{1}\right), m_{21}\right) ^{\prime},$ where $C_{1}$ is a diagonal matrix, implying that the volatility of each component is associated with its own lagged value, as well as the lagged values of the squared observations of both components. The results of the simulation, reported in Table 1, are in accordance with the consistency.

5.2.   Bivariate periodic $CCC-AGARCH(1.1)$ model

Our second Monte Carlo study involved the estimation of a bivariate periodic $CCC-AGARCH$(1.1) model, with the parameters associated with this model gathered in vector $\underline{\theta} = \left(\underline {\theta}^{\prime}\left(1\right), \underline{\theta}^{\prime}\left(2\right), m_{21}\right) ^{\prime}$ with $\underline{\theta}\left(v\right) = \left(\underline{a}_{0}^{\prime}\left(v\right), Vec^{\prime}\left(A_{1}\left(v\right) \right), Vec^{\prime}\left(B_{1}\left(v\right) \right), Vec^{\prime }\left(C_{1}\left(v\right) \right) \right) ^{\prime}$, is chosen to ensure the $SPS$ condition, where the matrix $C_{1}$ (1) (resp. $C_{1}$ (2)) is diagonal, implying that the volatility of each component is associated with its own lagged value, as well as the lagged values of the squared observations of both components. The first results of the simulation presented in Table 2 align with the consistency.

From Tables 1 and 2, and as expected, the QMLE estimates for the coefficients of the periodic $CCC-AGARCH$(1.1) model exhibit a decrease in RMSE as the sample size increases. Additionally, it is observed that the estimates based on the normal distribution $\mathcal{N}\left(0, 1\right)$ generally demonstrate greater efficiency compared to those corresponding to the $t-$distribution with $15$ degrees of freedom $t_{15}$.

6.   Empirical application

This section is devoted to modeling, with periodic CCC-AGARCH(1, 1) model, two datasets, namely the daily time series $(X_{1t})_{t\geq1}$ for the exchange rate Euro/Algerian dinar $(EUR/DZD)$, and the daily time series $(X_{2t})_{t\geq1}$ for the exchange rate U.S. dollar/ Algerian dinar $(USD/DZD)$.

We first removed all the days when the market was closed, including holidays and weekends. The observations extended over the period from 2000-01-03 to 2011-09-29. In order to do so, we collected the two exchange rates at time t in the vector $\underline{X}_{t}^{\prime} = \left(X_{1t}, X_{2t}\right) = \left(EUR/DZD_{t}, USD/DZD_{t}\right),$ and their corresponding $\log-$return series in the vector $\underline{r}_{t}^{\prime} = \left(r_{1t}, r_{2t}\right),$ where $r_{kt} = \log\left(X_{kt}/X_{kt-1}\right),$ for $k = 1, 2.$ The plots of prices $\left(X_{1t}, X_{2t}\right)$ and the daily returns series of prices $\left(r_{1t}, r_{2t}\right),$ squad and absolute returns are plotted in Figures 1 and 2.

The findings indicate that for the $EUR/DZD$ (resp. $USD/DZD$), the lowest returns ($-0.0233$) (resp. $-0.0191$) and the highest returns ($0.0497$) (resp. $0.0335$). The skewness for two $\log-$return series is positive. Moreover, one of the features which prominently stands out from Tables 3 and 4 is that the kurtosis for two $\log-$returns is much larger than 3, suggesting that models dependent on the Gaussian assumption may not adequately describe the data. Now, we suggest the 5-periodic CCC-$AGARCH$(1.1) model that permits for the description of the intraweek effect in the daily exchange rate, where the parameters are allowed to vary with the day of the week, $v = 1$ corresponds to Monday, $v = 2$ to Tuesday, and so forth. The estimated parameters of the $5$-periodic CCC-$(A)GARCH$(1.1) model and their RMSE are reported in Tables 5 and 6.

Several rudimentary descriptive statistics are provided for the two $\log$-return series in Tables 3 and 4.

In Tables 5 and 6, we unveil the outcomes from the QML parameter estimation conducted for the periodic CCC-AGARCH(1, 1) vis-à-vis periodic CCC-GARCH(1, 1) models. The results distinctly showcase that the periodically estimated models exhibit periodic stationarity. Notably, the measurement invariance estimates of the periodic $CCC$-$AGARCH$(1, 1) model are significantly smaller than those obtained from the periodic CCC-GARCH(1, 1) model fitted by Bibi (2018, ^[5]). Furthermore, the empirical coverages of the prediction intervals based on the periodic CCC-AGARCH(1, 1) model tend to closely align with the nominal coverages, unlike those derived from the periodic $(EUR/DZD, USD/DZD)$-CCC model. These observations suggest that the periodic GARCH(1, 1)-5 model, fitted to daily CCC log returns time series, evinces enhanced precision and superior forecasting efficacy relative to its $AGARCH$(1, 1)-$\widehat{\underline{a}}_{0}$ counterpart. This comparative analysis underscores the significant contribution of Patton (2011, ^[29]) to developing volatility forecasting models, offering improved efficiency and accuracy.

7.   Conclusions

This research marks a significant advancement in asymmetric multivariate stochastic difference volatility modeling. Through meticulous analysis, we have successfully extended and enhanced various probabilistic and statistical properties that have been a focal point in the prior literature. A key achievement of this study is the establishment of periodic stationarity and periodic ergodicity within the model, underscoring its dynamic and adaptable nature. Furthermore, our in-depth exploration of the Quasi-Maximum Likelihood Estimator (QMLE) reveals its robust consistency and asymptotic normality. This rigorous examination not only fortifies the theoretical foundation of QMLE but also underscores its reliability and efficiency in practical scenarios. The analytical insights gained here significantly bolster the estimator's credibility in complex stochastic modeling contexts.

The practical implications of our findings are illustrated through a series of applications, demonstrating the model's versatility and relevance in real-world situations. These applications validate our theoretical results and showcase the model's potential in addressing a range of challenging problems in stochastic volatility modeling.

In summary, this study not only enriches the theoretical framework of stochastic volatility modeling, but also paves the way for future investigations. By pushing the boundaries of current understanding and application, it opens new avenues for research and development in this ever-evolving domain. The implications of this work extend beyond the immediate scope of this study, offering valuable insights and tools for both researchers and practitioners in the field of financial econometrics and beyond.

Author contributions

Omar Alzeley: Methodology, Validation, Formal analysis, Investigation, Visualization, Writing-review and Editing; Ahmed Ghezal: Software, Validation, Resources, Data curation, Writing-original draft preparation, Supervision, Project administration. All authors have read and approved the final version of the manuscript for publication.

Use of AI tools declaration

The authors declare they have not used Artificial Intelligence (AI) tools in the creation of this article.

Acknowledgments

We would like to express our gratitude to the Editor-in-Chief of the journal, the Assistant Editors, and the three anonymous referees for their constructive comments, valuable suggestions, and remarks, which were instrumental in improving the final version of the paper. Additionally, we extend our thanks to Prof. Dr. Amirouche Bouchelaghem, Director of the University Center, and our colleague, Dr. Khalil Zerrari, for their important encouragement and support.

Conflict of interest

The authors declare no conflicts of interest.

Appendix

Proof of Theorem 1. The proof of the sufficient condition is analogous to that provided by Bougerol and Picard ^[10,11], since $E\left\{ \widetilde {\underline{e}}_{t}^{\otimes2}\right\} < \infty$, where

hence $E\left\{ \log^{+}\left\Vert \Omega_{t}\right\Vert \right\} < \infty.$ By employing Cauchy's root test when $\gamma_{\Omega} < 0$, it follows that the series $\underline{\Gamma}_{t}\left(2\right)$ converges almost surely for all $t$. Consequently, an $SPS$ solution to the model (2.1) is attained, denoted as $\underline {X}_{t} = \left\{ diag\left(\underline{\Lambda}_{2q+1, t}\right) \right\} ^{1/2}M^{1/2}\underline{\eta}_{t}$, where $\underline{\Lambda}_{2q+1, t}$ is the subvector of $\underline{\Lambda}_{t}$ corresponding to the $\left(2q+1\right) ^{th}$ element. This solution is thus nonanticipative and $PE$. To prove the uniqueness, let $(\widetilde{\underline{\Gamma}}_{t})$ be another non-negative and $SS$ solution of (2.4). For all positive integers $n\geq0$, $\underline{\Gamma}_{t} = \left\{ \prod \limits_{j = 0}^{n}\Omega_{t-j}\right\} \underline{\Gamma}_{t-n-1} +\widetilde{\underline{\Gamma}}_{t}\left(n\right)$, where $\widetilde {\underline{\Gamma}}_{t}\left(n\right) : = \underline{\Xi}_{t}+\sum \limits_{i = 0}^{n}\left\{ \prod\limits_{j = 0}^{i}\Omega_{t-j}\right\} \underline{\Xi}_{t-i-1}.$ Then $\left\Vert \underline{\Gamma}_{t} -\widetilde{\underline{\Gamma}}_{t}\right\Vert \leq\left\Vert \prod \limits_{j = 0}^{n}\Omega_{t-j}\right\Vert \left\Vert \underline{\Gamma} _{t-n-1}\right\Vert +\left\Vert \widetilde{\underline{\Gamma}}_{t}\left(n\right) -\widetilde{\underline{\Gamma}}_{t}\right\Vert.$ The second term on the right-hand side converges to 0 almost surely as $n$ approaches infinity. Moreover, we have $\left\Vert \prod\limits_{j = 0}^{n}\Omega_{t-j}\right\Vert \longrightarrow0$ with a probability of $1$ when $n\longrightarrow\infty$ and $\left\Vert \prod\limits_{j = 0}^{n}\Omega_{t-j}\right\Vert \left\Vert \underline{\Gamma}_{t-n-1}\right\Vert \longrightarrow0$ in probability as $n\longrightarrow\infty.$ We have shown that $\underline{\Gamma} _{t} = \widetilde{\underline{\Gamma}}_{t}$ for any $t$, a.s. Now, we give a simple direct proof. Since the necessary part is easy, see Bougerol and Picard ^[10], we prove only $\left\Vert \prod\limits_{j = 0}^{n}\Delta_{t-j}\right\Vert \longrightarrow0$ as $n\longrightarrow\infty$. For this, it will suffice to show that

for all $k = 1, \dots, 2q+p$, where $\varphi_{k} = \underline{\psi}_{k}\otimes I_{\left(r\right) }$ and $\underline{\psi}_{k}$ represents the $k^{th}$ element of the canonical basis of $\mathbb{R}^{2q+p}.$ Indeed, assume that model (2.3) admits a causal, $SPS$ solution $\left(\underline{\Lambda}_{t}\right)$. We exploit the non-negativity of the coefficients of $\Delta_{t}$ and $\underline{\Lambda}_{t}$, from which it follows that for all $n\geq2,$ $\underline{\Lambda}_{t}\geq\underline{\Pi} _{t}+\sum\limits_{k = 0}^{n}\left\{ \prod\limits_{j = 0}^{k}\Delta_{t-j}\right\} \underline{\Pi}_{t-k-1}$ $\forall n$ implies that $\left\{ \prod \limits_{j = 0}^{n}\Delta_{t-j}\right\} \underline{\Pi}_{t-n-1}\longrightarrow \underline{O}$ a.s. as $n\longrightarrow\infty.$ Using the relationship

we have

and

Since the components of $\underline{a}_{0}\left(t-n-1\right)$ are strictly positive, (A.1) thus holds for $n = 2q+1$. Using

with the convention that

In this context, the inequalities are considered componentwise. Moreover, (A.1) is valid for $k = q+2$, and, by induction, for $k = 2q+l,$ $l = 1, \dots, p$. Moreover, since

(A.1) holds for $k = 2q$ (resp. $k = q$), we reach a similar finding for the remaining values of $k$ through an upward recursion. □

Proof of Corollary 1. Since $\Delta_{t}$ is non-negative, given that all its elements are non-negative, it is evident that $\gamma_{\Omega}$ corresponding to the nonrandom sequence of matrices $\left(\Omega_{t}^{0}\right)$ attained through substitution of the matrices $A_{j}\left(t\right)$ and $B_{j}\left(t\right)$ with a null matrix in $\Delta_{t}.$ In a different sense, it implies $\log\rho\left(\prod\limits_{v = 0}^{s-1}C_{s-v}\right) \leq \gamma_{\Omega} < 0.$ Consequently, the conclusion stated in the corollary is affirmed. □

Proof of Proposition 1. To prove (a). By Kingman's subadditive ergodic theorem, we get

which completes the proof of (a). We now prove (b). By Jensen's inequality, we get

Furthermore, the rest is analogous to that of Lemma 2.3 of Berkes et al.^[4] in the univariate case, and ^[5] in the multivariate case that the $SPS$ solution conforms to $E\left\{ \left\Vert \underline {\Lambda}_{t}\right\Vert ^{\varsigma}\right\} < \infty$ for some $\varsigma > 0$. The result is a natural consequence of $\left\Vert \underline{X} _{t}\right\Vert \leq\left\Vert \underline{\Lambda}_{t}\right\Vert$ and $\left\Vert \underline{\sigma}_{t}\right\Vert \leq\left\Vert \underline {\Lambda}_{t}\right\Vert$. □

Proof of Theorem 2. The arguments in the proof closely resemble those found in ^[5]. □

Proof of Lemma 1. Rewrite (2.2) in a vector form as

where

and

Proof of $\mathbf{(I)}$: Initial values are asymptotically irrelevant. In view of the last part imposed in assumption A2 and Corollary 1, we have

Iteratively using (A.2), as in the univariate case, we have

If we represent the vectors attained from certain initial values as $\widetilde{\underline{\Sigma}}_{t}\left(\underline{\theta}\right)$ and $\widetilde{\underline{\pi}}_{t}$, then we obtain

Hence, we deduce that a.s.

where $\lambda > 0$ and $\omega\in\left(0, 1\right)$, which implies that $\sup_{\underline{\theta}\in\Theta}\left\Vert \widetilde{V}_{t}\left(\underline{\theta}\right) -V\left(\underline{\theta}\right) \right\Vert \leq\lambda\omega^{t}$ $\forall t$. Since $H_{t}^{-1}\left(\underline {\theta}\right) \leq\left\{ \min_{j}\sigma_{t, j}^{2}\right\} ^{-1}$, we have

Similarly, we obtain $\sup_{\underline{\theta}\in\Theta}\left\Vert V_{t} ^{-1}\left(\underline{\theta}\right) \right\Vert \leq\lambda$.

Now,

The first sum can be written as

Using the Cesaro lemma, the Borel–Cantelli lemma, the Markov inequality, and by applying Proposition 1, we have

which implies $\omega^{t}\underline{X}_{t}^{\prime}\underline{X}_{t} \overset{a.s.}{\longrightarrow}0$. Now, using the inequality for $y+1\geq0$, $y\geq\log\left(1+y\right)$, we have

and, by symmetry,

so we deduce that the second sum tends to $0$. Therefore, we have demonstrated that

□

Proof of $\mathbf{(II)}$: Parameter identifiability.. Suppose that, for some $\underline{\theta}\neq\underline{\theta}_{0},$ $\underline{\sigma }_{t}\left(\underline{\theta}\right) = \underline{\sigma}_{t}\left(\underline{\theta}_{0}\right)$ a.s. and $M = M_{0}.$

Consequently, it immediately follows that $\underline{m} = \underline{m}_{0}$, and by leveraging the invertibility of the polynomial $\left(\mathcal{C}_{0, v}\left(z\right) \right) _{1\leq v\leq s}$ under the assumption A2, then we have a.s. $\forall v = 1, ..., s,$

where $L$ denotes the lag operator,

with

and isolating the terms that are functions of $\underline{\eta}_{t-1}$,

Since $P_{1}\left(t\right) G_{t-1}^{+}+Q_{1}\left(t\right) G_{t-1}^{-}$ is independent of this $\sigma-$field and $\underline{\sigma}_{t-1}$ and $\underline{\sigma}_{t-1} > 0$, we have

for some constant matrix $T$, the matrix equality for the element $\left(k, l\right)$ writes $\left(P_{1}\left(t\right) \right) \left(k, l\right) \widetilde{\underline{\eta}}_{t-1}^{+2}\left(l\right) +\left(Q_{1}\left(t\right) \right) \left(k, l\right) \widetilde {\underline{\eta}}_{t-1}^{-2}\left(l\right) = T\left(k, l\right).$ If $\left(P_{1}\left(t\right) \right) \left(k, l\right) \left(Q_{1}\left(t\right) \right) \left(k, l\right) \neq0.$ The contradiction with Assumption A3 arises from the fact that $\widetilde {\underline{\eta}}_{t-1}\left(l\right)$ takes at most two distinct values.

If $\left(P_{1}\left(t\right) \right) \left(k, l\right) \neq0$ and $\left(Q_{1}\left(t\right) \right) \left(k, l\right) = 0,$ thus $\left(P_{1}\left(t\right) \right) \left(k, l\right) \widetilde {\underline{\eta}}_{t-1}^{+2}\left(l\right) = T\left(k, l\right),$ which entails $T\left(k, l\right) = 0,$ because $P\left(\widetilde{\underline {\eta}}_{t-1}^{-}\left(l\right) > 0\right) \neq0,$ and thus $\widetilde {\underline{\eta}}_{t-1}^{-}\left(l\right) \overset{a.s.}{ = }0$, which contradicts A3. Therefore, we have $P_{1}\left(t\right) = Q_{1}\left(t\right) = 0$. Similarly in this way, we show that $\mathcal{P}_{v}\left(L\right) = \mathcal{Q}_{v}\left(L\right) = 0$ for all $v = 1, \dots, s$. Therefore, in view of A4, we have $\underline{a} _{0}\left(v\right) = \underline{a}_{0, 0}\left(v\right),$ $\underline {\alpha}\left(v\right) = \underline{\alpha}_{0}\left(v\right),$ $\underline{\beta}\left(v\right) = \underline{\beta}_{0}\left(v\right)$ and $\underline{\gamma}\left(v\right) = \underline{\gamma}_{0}\left(v\right)$ for all $v = 1, ..., s$. Hence $\underline{\theta} = \underline{\theta }_{0}$. Thus, we have successfully established $\mathbf{(II)}$. □

Proof of $\mathbf{(III)}$: The limit criterion attains its minimum at $\underline{\theta}_{0}$.. At $\underline{\theta}_{0}$, Jensen's inequality and Proposition 1 entail that

As a result,

We now have

where $\delta_{j}\left(v\right)$ is the positive eigenvalues of $V_{st+v}\left(\underline{\theta}\right) V_{st+v}^{-1}\left(\underline{\theta}_{0}\right),$ because $y-1\geq\log y,$ $\forall y > 0,$ where equality holds iff $y = 1$, thus we obtain $\sum\nolimits_{v = 1} ^{s}E_{\underline{\theta}_{0}}\left\{ l_{st+v}\left(\underline{\theta }\right) \right\} -\sum\nolimits_{v = 1}^{s}E_{\underline{\theta}_{0}}\left\{ l_{st+v}\left(\underline{\theta}_{0}\right) \right\} \geq0,$ and hence the inequality is strict unless if, for all $j$ and $v$, $\delta_{j}\left(v\right) \overset{a.s.}{ = }1$, meaning that $V_{st+v}\left(\underline {\theta}\right) \overset{a.s.}{ = }V_{st+v}\left(\underline{\theta} _{0}\right).$ Therefore, we have $\underline{\sigma}_{st+v}\left(\underline{\theta}\right) \overset{a.s.}{ = }\underline{\sigma}_{st+v}\left(\underline{\theta}_{0}\right)$, $v = 1, ..., s$ and $M = M_{0}\ $and thus $\underline{\theta} = \underline{\theta}_{0}.$ □

Proof. To demonstrate $\mathbf{(IV), }$ $\forall\underline{\theta}\in\Theta$ and every integer $k$, let $\mathcal{V}_{k}\left(\underline{\theta}\right)$ be an open sphere of centre $\underline{\theta}$ and radius $\dfrac{1}{k}$. Utilizing $\left(\mathbf{I}\right),$ we obtain

By applying the ergodic theorem to the i.i.d. sequence $\left(\sum \limits_{v = 1}^{s}l_{st+v}\left(\underline{\theta}^{\ast}\right) \right) _{t},$ where $E\left\{ \sum\limits_{v = 1}^{s}l_{st+v}\left(\underline {\theta}^{\ast}\right) \right\} \in\mathbb{R}\cup\left\{ \infty\right\}$ (see., ^[8]), we have

and according to the Beppo-Levi theorem (see., ^[8]), we get

as $k\rightarrow \infty.$ This concludes the proof of the lemma. □

Proof of Theorem 3. The proof is now complete by an argument of compactness of $\Theta$ and Lemma 1. Now, for all neighborhood $\mathcal{V}\left(\underline{\theta}_{0}\right),$ we obtain

The compact set $\Theta$ is reconstructed as the union of a neighborhood $\mathcal{V}\left(\underline{\theta}_{0}\right)$ and a set of neighborhoods $\mathcal{V}\left(\underline{\theta}\right)$, where $\underline{\theta}\in\Theta\diagdown\mathcal{V}\left(\underline{\theta} _{0}\right)$. Consequently, there exists a finite sub-covering of $\Theta$ by $\mathcal{V}\left(\underline{\theta}_{0}\right), \mathcal{V}\left(\underline{\theta}_{1}\right), ..., \mathcal{V}\left(\underline{\theta} _{k}\right)$ such that

The latter relation indicates that $\widehat{\underline{\theta}}_{Ns} \in\mathcal{V}\left(\underline{\theta}_{0}\right)$ for $N$ is sufficiently large, thereby completing the proof of Theorem 3. □

Proof of Lemma 2. The demonstration closely follows that of ^[15] for the standard case, employing the $SPS$ and $PE$ arguments in place of the stationarity and ergodicity considerations, respectively. First and foremost, we can write the first-and second-order derivatives of $l_{t}\left(\underline{\theta}\right)$ as follows:

for all $1\leq v\leq s$, where

where $L_{3}\left(v\right)$ (resp. $L_{5}\left(v\right)$) is obtained by permuting $\underline{X}_{v}\underline{X}_{v}^{\prime}$ and $M^{-1}$ (resp.$\dfrac{\partial H_{v}\ }{\partial\theta_{i}\left(v\right) }$) in $L_{4}\left(v\right)$. To prove $\mathbf{(a)}$ it would be appropriate to use the Cauchy–Schwarz inequality, from which we obtain

Now, letting $\sigma_{i, t}$ (resp. $\Sigma_{i, st+v}$) denote the $i^{th}$ component of $\underline{\sigma}_{t}$ (resp. $\underline{\Sigma}_{st+v}$), it is thus sufficient to prove that

Then, we have a.s.

Furthermore, we have

where

So, we get a.s.

where $0\leq n\leq s-1$ and $C_{\left(i\right) }$ is a matrix whose entries are all zero except for a $1$ situated in the same location as $\theta _{i}\left(v\right)$ in $C_{st+v}$. Applying the inequality $y^{\tau} \geq\frac{y}{1+y}$ for $y > 0$ and any $\tau\in\lbrack0;1]$ and the fact that, almost surely $\log\left\Vert \prod\limits_{k = 0}^{j-1}C_{st+v-k}\right\Vert \leq\omega+j\gamma_{\left(s\right) }\left(C\right)$, we can obtain the inequalities

and, setting

we obtain

Using the same technique as Francq and Zakoïan ^[15], we can demonstrate a result that is even more robust than the one initially stated: $\forall1\leq i, j, k\leq \widetilde{r},$ all $1\leq n\leq r$ and all $m\geq0,$ $\exists\vartheta \left(\underline{\theta}_{0}\right)$ of $\underline{\theta}_{0}$, such that

and

We now prove $\mathbf{(b)}$, clearly, $\nabla_{\underline{\theta} }l_{t}\left(\underline{\theta}_{0}\right)$ is $SPS$ and measurable with respect to $\mathcal{F}_{t} = \sigma\left(\underline{\eta}_{n}, n\leq t\right).$ The property stated in proof $\mathbf{(a)}$ ensures the existence of matrices $U$ and $K$ in Theorem 4. Moreover, it can be seen that $\forall\underline{\lambda}\in\mathbb{R}^{l}$, the sequence $\left(\underline{\lambda}^{\prime}\nabla_{\underline{\theta}}l_{t}\left(\underline{\theta}_{0}\right), \mathcal{F}_{t}\right)$ is an $SPS$, $PE$, and square-integrable martingale difference. The $C.L.T$ of Bllingsley implies

□