Research article

Stability of stochastic dynamic systems of a random structure with Markov switching in the presence of concentration points

  • Received: 31 May 2023 Revised: 06 July 2023 Accepted: 19 July 2023 Published: 16 August 2023
  • MSC : 03C45, 60J25, 93D05, 93E15

  • This article aims to investigate sufficient conditions for the stability of the trivial solution of stochastic differential equations with a random structure, particularly in contexts involving the presence of concentration points. The proof of asymptotic stability leverages the use of Lyapunov functions, supplemented by additional constraints on the magnitudes of jumps and jump times, as well as the Markov property of the system solutions. The findings are elucidated with an example, demonstrating both stable and unstable conditions of the system. The novelty of this work is in the consideration of jump concentration points, which are not considered in classical works. The assumption of the existence of concentration points leads to additional constraints on jumps, jump times and relations between them.

    Citation: Taras Lukashiv, Igor V. Malyk, Maryna Chepeleva, Petr V. Nazarov. Stability of stochastic dynamic systems of a random structure with Markov switching in the presence of concentration points[J]. AIMS Mathematics, 2023, 8(10): 24418-24433. doi: 10.3934/math.20231245

    Related Papers:

    [1] Lin Xu, Linlin Wang, Hao Wang, Liming Zhang . Optimal investment game for two regulated players with regime switching. AIMS Mathematics, 2024, 9(12): 34674-34704. doi: 10.3934/math.20241651
    [2] Ruofeng Rao, Xiaodi Li . Input-to-state stability in the meaning of switching for delayed feedback switched stochastic financial system. AIMS Mathematics, 2021, 6(1): 1040-1064. doi: 10.3934/math.2021062
    [3] Guojie Zheng, Taige Wang . The moment exponential stability of infinite-dimensional linear stochastic switched systems. AIMS Mathematics, 2023, 8(10): 24663-24680. doi: 10.3934/math.20231257
    [4] Yueli Huang, Jin-E Zhang . Asymptotic stability of impulsive stochastic switched system with double state-dependent delays and application to neural networks and neural network-based lecture skills assessment of normal students. AIMS Mathematics, 2024, 9(1): 178-204. doi: 10.3934/math.2024011
    [5] Min Han, Bin Pei . An averaging principle for stochastic evolution equations with jumps and random time delays. AIMS Mathematics, 2021, 6(1): 39-51. doi: 10.3934/math.2021003
    [6] Xuan Jia, Junfeng Zhang, Tarek Raïssi . Linear programming-based stochastic stabilization of hidden semi-Markov jump positive systems. AIMS Mathematics, 2024, 9(10): 26483-26498. doi: 10.3934/math.20241289
    [7] Jawdat Alebraheem . Asymptotic stability of deterministic and stochastic prey-predator models with prey herd immigration. AIMS Mathematics, 2025, 10(3): 4620-4640. doi: 10.3934/math.2025214
    [8] Xin-Jiang He, Sha Lin . Analytical formulae for variance and volatility swaps with stochastic volatility, stochastic equilibrium level and regime switching. AIMS Mathematics, 2024, 9(8): 22225-22238. doi: 10.3934/math.20241081
    [9] Huijuan Li . Input-to-state stability for discrete-time switched systems by using Lyapunov functions with relaxed constraints. AIMS Mathematics, 2023, 8(12): 30827-30845. doi: 10.3934/math.20231576
    [10] Jingjing Yang, Jianqiu Lu . Stabilization in distribution of hybrid stochastic differential delay equations with Lévy noise by discrete-time state feedback controls. AIMS Mathematics, 2025, 10(2): 3457-3483. doi: 10.3934/math.2025160
  • This article aims to investigate sufficient conditions for the stability of the trivial solution of stochastic differential equations with a random structure, particularly in contexts involving the presence of concentration points. The proof of asymptotic stability leverages the use of Lyapunov functions, supplemented by additional constraints on the magnitudes of jumps and jump times, as well as the Markov property of the system solutions. The findings are elucidated with an example, demonstrating both stable and unstable conditions of the system. The novelty of this work is in the consideration of jump concentration points, which are not considered in classical works. The assumption of the existence of concentration points leads to additional constraints on jumps, jump times and relations between them.



    In the vast majority of works with jump changes of the trajectory, it is assumed that the distance between jumps is not less than some δ, i.e., |tktk1|>δ. According to this assumption, only a finite number of jumps occur on a finite interval, which is an important condition for proving the stability and exponential boundedness of the solution. In this case, the conditions of existence, unity and stability of the systems of stochastic differential equations with jumps are reduced to the corresponding statements for systems without jumps.

    This work considers the case in which jumps can be concentrated at some point, which leads to the following relationship

    limktk=t<.

    In this case, the cumulative effect of jumps can lead to a lack of stability of the system. This effect can be illustrated by a simple example of an ordinary differential equation

    dx(t)=x(t)dt,

    with jumps

    x(tk)=x(tk)(1+k2),

    at the points

    tk=αk,α>0.

    It can be easily concluded that

    limtα|x(t)|=

    for x(0)0. This simple example indicates that the size of the jumps plays an important role in the presence of concentration points in the system.

    The models proposed in this work can be applied in the field of catastrophe theory. Random events with a frequency that exponentially increases over a finite time interval are considered there. Moreover, solving applied problems, one should consider the possibility of the collapse of the system in case of large disturbances and/or small intervals between disturbances g. The conditions of instability in such cases may have the following form

    |tktk1|<δmin

    for some k.

    Among others, resonant systems could be examples of the considered systems. There, the impact of external factors intensifies as the period changes or the influence amplitude increases. More works devoted to real phenomena and processes that can be described using the system (2.1)–(2.3) were referenced in the introduction of the work [1].

    One of the main results for ordinary stochastic differential equations is considered in the paper [2]. In this work, sufficient conditions for the existence and uniqueness of the solution, based on the convergence of jumps and the presence of concentration points, are considered. In a more general case of stochastic differential equations, one should take into account not only the average value of the jumps but also the variance of the jumps.

    The novelty of this work, in contrast to classical works, is consideration of concentration points of jumps, without setting a limit at jump moments, i.e., |tktk1|>δmin. The absence of this condition in a real system may lead to an accumulation of jumps and the solution can tend to infinity. Thus, to analyze the stability of a trivial solution, it is necessary to consider additional conditions for the moments and magnitudes of jumps, which are considered in Theorems 2.2 and 4.1.

    On the probabilistic basis (Ω,F,F,P) [3,4], we consider a stochastic dynamic system of random structure given by a stochastic differential equation (SDE)

    dx(t)=a(t,ξ(t),x(t))dt+b(t,ξ(t),x(t))dw(t),tR+K, (2.1)

    with Markov switching

    Δx(t)=g(tk,ξ(tk),ηk,x(tk)),tkK={tn}, (2.2)

    and initial conditions

    x(0)=x0Rm,ξ(0)=yY,η0=hH. (2.3)

    Here ξ(t),t0, is a Markov chain with a finite number of states Y={1,2,...,Nξ} and generator Q={˜qij},i,j={1,...,Nξ}; {ηk,k0} is a Markov chain with values in space H and with a transition probability matrix PH; x:[0,+)×ΩRm; w(t),t0, is a m-dimensional standard Wiener process; the processes w,ξ and η are independent random processes [3,4].

    We denote by

    Ftk=σ(ξ(s),w(s),ηe,stk,tetk)

    the minimal σ-algebra with respect to which ξ(t),t[0,tk] and ηn,nk, are measured.

    As in the works [4,5], assume that measured by a set of variables functions a:R+×Y×RmRm, b:R+×Y×RmRm×Rm, g:R+×Y×H×RmRm satisfy the boundedness condition and the Lipschitz condition

    |a(t,y,x)|2+|b(t,y,x)|2+|g(t,y,h,x)|2C(1+|x|2); (2.4)
    |a(t,y,x1)a(t,y,x2)|2+|b(t,y,x1)b(t,y,x2)|2L|x1x2|2,x1,x2Rm; (2.5)
    |g(tk,y,h,x1)g(tk,y,h,x2)|2Lk|x1x2|2,x1,x2Rm,k=1Lk<. (2.6)

    Consider the case of a point of concentration of jumps, i.e.,

    limntn=t[0,T].

    Let's assume that the following relations are true:

    k=1γk<,γk=supxRm,yY,hH|g(tk,y,h,x)|, (2.7)

    and

    limε0(lnε+NεNεk=1Lk)=,Nε:=inf{k1:m=kγm<ε}. (2.8)

    The conditions (2.4)–(2.8) guarantee the existence of a strong solution to the Cauchy problem (2.1)–(2.3) [1]. Without loss of generality, we can assume that filtration F is the natural filtration constructed by the random processes w(t),t0;ξ(t),t0;ηk,k0.

    We denote by

    Pk((y,h,x),Γ×G×C):=P((ξ(tk+1),ηk+1,x(tk+1))Γ×G×C|(ξ(tk),ηk,x(tk))=(y,h,x)),

    the transition probability of the Markov chain (ξ(tk),ηk,x(tk)), that determine the solution to the problem (2.1)–(2.3) on the k-th step.

    Definition 2.1. Discrete Lyapunov operator (lvk)(y,h,x) on a sequence of measurable scalar functions vk(y,h,x):Y×H×RmR1,kN{0}, for the SDE (2.1) with Markov switching (2.2) is defined by the equality

    (lvk)(y,h,x):=
    Y×H×RmPk((y,h,x)(du×dz×dl))vk+1(u,z,l)vk(y,h,x). (2.9)

    Here vk(y,h,x),kN, is a Lyapunov function defined by the following definition.

    Definition 2.2. The Lyapunov function for the system (2.1)–(2.3) is a sequence of non-negative functions {vk(y,h,x),k0}, for whom

    (1) for all k0,yY,hH,xRm the discrete Lyapunov operator (lvk)(y,h,x) (2.9) is defined;

    (2) if r

    ˉv(r)infkN,yY,hH,|x|rvk(y,h,x)+;

    (3) if r0

    v_(r)supkN,yY,hH,|x|rvk(y,h,x)0;

    where ˉv(r) and v_(r) are continuous and monotonic for r>0.

    Definition 2.3. A system with a random structure (2.1)–(2.3) is called:

    stable in probability, if for ε1>0,ε2>0 it can specify δ>0 such that the inequality |x|<δ implies the inequality

    P{supt0|x(t)|>ε1}<ε2, (2.10)

    for all yY,hH;

    asymptotically stochastically stable, if it is stable in probability and for any ε>0 exists δ2>0 such that

    limTP{suptT|x(t)|>ε}=0, (2.11)

    for all |x|<δ2, yY,hH and T0.

    Definition 2.4. A system with a random structure (2.1)–(2.3) is called:

    mean square stable, if for ε>0 it can specify the following δ>0, that the inequality |x|<δ implies the inequality

    E|x(t)|2<ε, (2.12)

    for all t[0,T],yY,hH;

    mean square asymptotically stable, if it is mean square stable for any T>0 and

    limtsupyY,hHE|x(t)|2=0. (2.13)

    If (2.10)–(2.13) hold true for all xRm, then the system is stable in the corresponding probabilistic sense on the whole.

    For solving the problem (2.1)–(2.3) on the intervals [tk,tk+1), the following estimate is obtained.

    Theorem 2.1. Let the coefficients a,b of the Eq (2.1) satisfy the condition of uniform boundedness (2.4), and the condition (2.6) holds for the function g.

    Then for all k0 for a strong solution of the Cauchy problem (2.1)–(2.3) holds the next inequality

    E{suptkttk+1|x(t)|2}9e5C(1+2Lk+1)[E|x(tk)|2+C(tk+1tk)]. (2.14)

    Proof. We use the same methodology as in [6,7]. A strong solution of the Cauchy problem (2.1), (2.3) for all t[tk,tk+1),k0, can be written in the integral form

    x(t)=x(tk)+ttka(τ,ξ(τ),x(τ))dτ+ttkb(τ,ξ(τ),x(τ))dw(τ). (2.15)

    After squaring the left and right sides of (2.15), calculating sup, and applying the Cauchy–Schwarz inequality, we obtain:

    suptkt<tk+1|x(t)|23suptkt<tk+1{|x(tk)|2+|ttka(τ,ξ(τ),x(τ))dτ|2+|ttkb(τ,ξ(τ),x(τ))dw(τ)|2}3[suptkt<tk+1|x(tk)|2+suptkt<tk+1ttk|a(τ,ξ(τ),x(τ))|2dτ+suptkt<tk+1|ttkb(τ,ξ(τ),x(τ))dw(τ)|2].

    To the last inequality, we apply the conditional mathematical expectation operation with respect to the σ-algebra Ftk and, taking into account the properties of the Ito integral and Markov property, we obtain

    E{suptkt<tk+1|x(t)|2/Ftk}3[E|x(tk)|2+C(tk+1tk)+Ctk+1tkE|x(τ)|2dτ+4Ctk+1tkE|x(τ)|2dτ]=3[E|x(tk)|2+C(tk+1tk)+5Ctk+1tkE|x(τ)|2dτ].

    Using the Gronwall inequality, we obtain an estimate of

    E{suptkt<tk+1|x(t)|2/Ftk}3[E|x(tk)|2+C(tk+1tk)]e5C.

    For t=tk+1 the strong solution of the system (2.1)–(2.3), obviously, must satisfy the inequality

    E{|x(tk+1)|2/Ftk}3[E{|x(tk+1)|2/Ftk}+2E{|g(tk+1,ξ(tk+1),ηk+1,x(tk+1))g(tk+1,ξ(tk+1),ηk+1,0)|2/Ftk}+2E{|g(tk+1,ξ(tk+1),ηk+1,0)|2/Ftk}]3[(1+2Lk+1)E{suptkttk+1|x(t)|2/Ftk}+C].

    Combining the last two inequalities, we get the desired estimate (2.14).

    Remark 2.1. We will consider the stability of the trivial solution x0, i.e. the satisfying of (2.4), if C=0 [5], [8], [9].

    Remark 2.2. Note that the Lipschitz condition (2.5) was not used in the proof of the Theorem 2.1, i.e., any (not necessarily unique) solution to the problem (2.1)–(2.3) satisfies the condition of the Theorem 2.1.

    Theorem 2.2. Let:

    1) the conditions (2.4)–(2.8) are hold;

    2) the Lyapunov functions vk(y,h,x) and ak(y,h,x),k0, exist, such that, based on the system, the following inequality

    (lvk)(y,h,x(t))ak(y,h,x(t)),k0, (2.16)

    is correct.

    Then the system of random structure (2.1)–(2.3) is asymptotically stochastically stable on the whole.

    Proof. Define by Ftk=σ(ξ(s),ηe,stk,tetk) a minimal σ-algebra, relative to which are measured ξ(t) for all t[0,tk] and ηn for nk. The conditional mathematical expectation is calculated by the formula

    E{vk+1(ξ(tk+1),ηk+1,x(tk+1))/Ftk}=Y×H×RmPk((ξ(tk),ηk,x)(du×dz×dl)vk+1(u,z,l)). (2.17)

    Then, by the definition of the discrete Lyapunov operator (lvk)(y,h,x) (see (2.9)) from equality (2.17), considering (2.16), we get the inequality

    E{vk+1(ξ(tk+1),ηk+1,x(tk+1))/Ftk}=vk(ξ(tk),ηk,x(tk))+(lvk)(ξ(tk),ηk,x(tk))ˉv(|x(tk)|). (2.18)

    From Theorem 2.1 (because the existence of the second moment implies the existence of the first moment) and from properties of the function ˉv follows the existence of a conditional mathematical expectation of the left-hand side of the inequality (2.18).

    Now, using (2.17), (2.18), we write the discrete Lyapunov's operator (lvk)(y,h,x), which given on the solutions (2.1)–(2.3):

    lvk(ξ(tk),ηk,x(tk))=E{vk+1(ξ(tk+1),ηk+1,x(tk+1))/Ftk}vk(ξ(tk),ηk,x(tk))ak(ξ(tk),ηk,x(tk))0. (2.19)

    Then, at k0 the next inequality holds

    E{vk+1(ξ(tk+1),ηk+1,x(tk+1))/Ftk}vk(ξ(tk),ηk,x(tk)).

    This means that a sequence of random variables

    vk(ξ(tk),ηk,x(tk)),

    forms a supermartingale in relation to Ftk [10].

    Taking the mathematical expectation of both parts of inequality (2.19), we summarize the obtained expressions for k from n0 to N, and obviously, we have the next inequality:

    E{vN+1(ξ(tN+1),ηN+1,x(tN+1))}E{vn(ξ(tn),ηn,x(tn))}=Nk=nE{lvk(ξ(tk),ηk,x(tk))}Nk=nE{ak(ξ(tk),ηk,x(tk))}0. (2.20)

    Since a random variable suptkttk+1|x(t)|2 does not depend on events of σ-algebra Ftk [11], then

    E{suptkttk+1|x(t)|2/Ftk}=E{suptkttk+1|x(t)|2}, (2.21)

    that is, the inequality (2.14) also holds for the simple mathematical expectation

    E{suptkttk+1|x(t)|2}3E|x|2.

    Next, we have

    P{supt0|x(t)|>ε1}=P{supnNsuptn1ttn|x(t)|>ε1}P{supnN3|x(tn1)|>ε1}P{supnN|x(tn1)|>ε13}P{supnNvn1(ξ(tn1),ηn1,x(tn1))ˉv(ε13)}. (2.22)

    If sup|x(tk)|r, then, based on the definition of the Lyapunov function, the next inequality holds:

    supk0vk(ξ(tk),ηk,x(tk))infk0,yY,hH,|x|rvk(y,h,x)=ˉv(r). (2.23)

    Now let's use the well-known inequality for nonnegative supermartingales [3,10] to evaluate the right-hand side of (2.22):

    P{supnNvn1(ξ(tn1),ηn1,x(tn1))ˉv(ε13)}1ˉv(ε13)vk(y,h,x)ˉv(|x|)ˉv(ε13). (2.24)

    Given inequality (2.22), inequality (2.24) make it possible to guarantee the fulfillment of inequality (2.10) of stability in probability on the whole of the system (2.1)–(2.3).

    From the inequality (2.20) follows the estimate

    E{vN+1(ξ(tN+1),ηN+1,x(tN+1))}v0(y,h,x)Nk=0E{ak(ξ(tk),ηk,x(tk))}v0(y,h,x), (2.25)

    for all N0,yY,hH,xRm.

    Since the sequence {ak},k0, forms Lyapunov functions, there must exist continuous strictly monotone functions a_(r) and ˉa(r), which are zero if r=0 [12] and such that

    ˉa(|x|)ak(y,h,x)a_(|x|), (2.26)

    for kN,yY,hH and xRm.

    Thus, from the convergence of the series on the left side of the inequality (2.25) (which will be convergent in the case of convergence of the series k=1Lk) follows the convergence of the series k=0E{ˉa(|x(t)|} for ttk,yY,hH,xRm.

    Then, taking into account the continuity of a_(r) and the equality a_(0)=0, we have:

    limk|x(t)|=0,ttk. (2.27)

    And from (2.27) it follows tends to zero in probability of the sequence ˉv(|x(t)|) for k for all ttk,yY,hH,xRm.

    So, from the properties of the Lyapunov function, we conclude that the non-negative supermartingale vk(ξ(tk),ηk,x(tk)) for k+ tends to zero in probability for all realizations of the process ξ and sequence ηk.

    Further, the nonnegative bounded supermartingale has a bound with probability 1 [3]. Based on Theorem 2.1 (inequality (2.14) for the usual mathematical expectation), we obtain the asymptotic stochastically stability on the whole of the system (2.1)–(2.3) by the Definition 2.3 (see (2.11)). Theorem 2.2 is proven.

    Theorem 2.3. Suppose that the conditions of Theorem 2.2 are satisfied, and the Lyapunov functions {vk},{ak},k0, satisfy the inequalities

    c1|x|2vk(y,h,x)c2|x|2, (2.28)
    c3|x|2ak(y,h,x)c4|x|2, (2.29)

    for some ci>0,i=¯1,4, for all kN,yY,hH,xRm.

    Then, the system of random structure (2.1)–(2.3) is asymptotically stable in the mean square.

    The proof is similar to the proof of Theorem 3 in [7].

    Theorem 2.4 (Corollary). If the conditions of Theorem 2.3 are fulfilled and the inequality (2.28) holds, then the system of random structure (2.1)–(2.3) is stable in the mean square on the whole.

    Based on the method [13], we will obtain an expression for calculating the explicit form of the weak infinitesimal operator (WIO) based on the system (2.1)–(2.3), which plays the role of the Lyapunov operator.

    Let U(t,y,h,x) be such a scalar integral function, that the sequence

    {vk(y,h,x)U(tk,y,h,x),k0}

    is a Lyapunov function.

    It is possible to prove [3] that the pair (ξ(t),x(t),t0,) is a Markov process and it is possible to introduce WIO

    (LU)(t,y,h,x):=limΔt01Δt[E(t)y,h,x{U(t+Δt,ξ(t+Δt),η(t+Δt),x(t+Δt))U(t,y,h,x)}], (3.1)

    where E(t)y,h,xU=E{U|ξ(t)=y,η(t)=h,x(t)=x}, η(t):=ηk and tkt<tk+1,k0. It is natural to assume that the function U, defined above, belongs to the domain of definition of the operator L, if the limit (3.1) exists in the sense of uniform convergence in some neighborhood of the point (y,x) uniformly by hH.

    Let's introduce the operator L0 which is related to Markov switching (2.2) at the moment tk,k0:

    (L0U):=ItK[HU(t,y,h,x)Pk(h,dz)U(t,y,h,x)], (3.2)

    where Pk(h,dz) is the transition probability of the Markov chain at the k-th step, I is the indicator of the set K.

    At the moment τ of changing of the structure of the parameter ξ of the system yiyj there is a jump-like change in the phase vector x with transition probability,

    pij(τ,x,A):=P{x(τ)A|x(τ)=x,ξ(τ)=yi,ξ(τ)=yj},ARm. (3.3)

    Theorem 3.1. Let the conditions (2.4)–(2.8) are hold. Then weak infinitesimal operator L on the solutions of the system (2.1)–(2.3) of the function U is calculated by the formula

    (LU)(t,y,h,x)=(LtU)(t,y,h,x)+(LxU)(t,y,h,x)+(LyU)(t,y,h,x)+(L0U)(t,y,h,x), (3.4)

    where

    (LtU)(t,y,h,x)=U(t,y,h,x)t, (3.5)
    (LxU)(t,y,h,x)=(xU,a(t,y,x))+12Sp(2xxUb(t,y,x),bT(t,y,x)), (3.6)
    (LyU)(t,y,h,x)=ij[RmU(t,yj,h,ζ)pij(t,x,dζ)U(t,yi,h,x)]qij. (3.7)

    Here, (,) is a scalar product; (ΔU)=(Ux1,...,Uxm)T, Uxi,i=¯1,m is the derivative of the i-th coordinate of the vector xRm; 2xxU=[2Uxixj]mi,j=1 is a matrix of second derivatives; Sp is a trace of the matrix; qij=˜qij˜qi; (L0U)(t,y,h,x) calculated by formula (3.2); U is a function differentiable with respect to t, which has derivatives of the 1st and 2nd order by the last argument.

    Proof. By Definition (3.1)

    (LU)(t,y,h,x):=limΔt01Δt[E(t)y,h,x{U(t+Δt,ξ(t+Δt),η(t+Δt),x(t+Δt))U(t,y,h,x)}].

    Next,

    (LU)(t,y,h,x):=limΔt01Δt[E(t)y,h,x{U(t+Δt,ξ(t+Δt),η(t+Δt),x(t+Δt))U(t,y,h,x)±U(t,ξ(t+Δt),η(t+Δt),x(t+Δt))±U(t,y,η(t+Δt),x(t+Δt))±U(t,y,h,x(t+Δt))}].

    Therefore, L can be represented as

    (LU)(t,y,h,x):=limΔt01Δt[E(t)y,h,x{U(t+Δt,ξ(t+Δt),η(t+Δt),x(t+Δt))U(t,ξ(t+Δt),η(t+Δt),x(t+Δt))}]+limΔt01Δt[E(t)y,h,x{U(t,ξ(t+Δt),η(t+Δt),x(t+Δt))U(t,y,η(t+Δt),x(t+Δt))}]+limΔt01Δt[E(t)y,h,x{U(t,y,η(t+Δt),x(t+Δt))U(t,y,h,x(t+Δt))}]+ limΔt01Δt[E(t)y,h,x{U(t,y,h,x(t+Δt))U(t,y,h,x}].

    Let's consider each term separately.

    The form of the first term LtU is obvious.

    Let's establish the explicit form of the term LxU. Consider a complete group of disjoint events constructed as follows: denote by Hi the event which means that the structure (2.1) does not change in the interval (t,t+Δt], i.e., ξ(τ)=yi at τ(t,t+Δt]. Then, with an accuracy of o(Δt), we obtain [14]

    P(Hi)=qiΔt.

    Next, denote by Hij event, which means that in the interval (t,t+Δt] a change yiyjyi occurs. Then, with accuracy up to o(Δt), we have

    P(Hij)=qijΔt.

    Denote by ΔiU:=U(t+Δt,ξ(t+Δt),h,x(t+Δt)U(t,yi,h,x) and by ΔijU the increment ΔU upon occurrence of the event Hij. Let's calculate the increments ΔiU and ΔijU of the function U when events Hi,Hij,ij, occur, neglecting terms of order o(Δt):

    ΔiH=[Ut+(xU,a(t,yi,x))+12Sp(2xxUb(t,yi,x),bT(t,yi,x))]Δt+o(Δt). (3.8)

    Here, the partial derivatives are calculated at a point (t,yi,x), where x is the solution of Eq (2.1) with initial condition ξ(t)=yi,x(t)=x,s>t0. Next, for LyU in the case of a change in the structure yiyj in the interval (t.t+Δt], we will get an increase

    ΔijU=U(t+Δt,yj,h,x(t+Δt))U(t,yi,h,x) (3.9)

    with the probability qijΔt.

    The terms that illustrate the possibility of changing the structure of ξ are not included in the last equality and there are no Markov switching. This is because, after averaging, they have the order of o(Δt) and we can ignore them.

    To calculate E{ΔU|ξ(t)=yi,η0=h,x(t)=x}, we use the full probability formula

    E{ΔU|ξ(t)=yi,η0=h,x(t)=x}=E{E{ΔU|ξ(t)=yj,ξ(t)=yi,η0=h,x(t)=x}},

    where the external mathematical expectation on the right-hand side is calculated by the variable ξ at the moment t.

    Ignoring terms of order o(Δt), from (3.8) and (3.9) we obtain

    E{ΔU|ξ(t)=yi,η0=h,x(t)=x}=[Ut+(xU,a(t,yi,x))+12Sp(2xxUb(t,yi,x),bT(t,yi,x))](1qiΔt)Δt+ij[RmU(t,yj,h,ζ)pij(t,x,dζ)U(t,yi,h,x)]qijΔt+o(Δt).

    When calculating the third term, we used the property xTBx=Sp(BxxT) and the property of the Wiener process with respect to the covariance of the increment [3,10].

    Using division by Δt and passing to the boundary at Δ0, we obtain the first, second, and third terms in (3.4). The idea of calculating the fourth term L0U can be found in [8], pp. 163–164. Theorem 3.1 is proved.

    One-dimensional linear stochastic system of random structure given by SDE

    dx(t)=a(ξ(t))x(t)dt+b(ξ(t)),x(t)dw(t),tR+K, (4.1)

    with Markov switching

    Δx(t)=g(tk,ξ(tk),ηk,x(tk)),
    tkK={tn},limntn=t[0,T<], (4.2)

    and initial conditions

    x(0)=x0R1,ξ(0)=yY,η0=hH, (4.3)

    where xR1 is a strong solution of the SDE (4.1); t is a concentration point; ξ is a Markov chain with a finite number of states Y={1,2,...,Nξ} and generator Q={˜qij},i,j={1,...,Nξ}; {ηk,k0} is a Markov chain with values in space H and the transition probability at the k-th step Pk(h,dz); w(t),t0 is a one-dimensional standard Wiener process; the processes w,ξ and η are independent [3,4].

    We obtain sufficient conditions for the stability of the system (4.1)–(4.3) in probability on the whole.

    Let's choose a Lyapunov function in the form [14]

    v(ξ(t),h,x)=γξ(t)|x|β,γ>0. (4.4)

    Let the functions a(i)=ai, b(i)=bi be such that for all i={1,...,Nξ}

    aib2i2<ε. (4.5)

    Then in (4.4)

    β=εb2,b=maxi={1,...,N}{bi}. (4.6)

    We can show which restrictions must satisfy the transitional probabilities qij of the Markov chain ξ and Pk(h,dz) of the Markov chain η, so that the system (4.1)–(4.3) is stable in probability on the whole.

    Calculating Lv on the solutions of the system (4.1)–(4.3), we obtain

    (Lv)(tk,y,h,x)=γ|x|β{bi(ai+β12bi)+kji(ji)qij}+Hγi|x+g(tk,y,h,x)|βPk(h,dz)γi|x|β.

    Considering (4.4)–(4.6), at the point (ξ(t)=i,x) we have

    (Lv)(tk,y,h,x)=γ|x|β[βiε2+ai]+iγ[H|x+g(tk,y,h,x)|βPk(h,dz)|x|β], (4.7)

    where ai=kj>i(ji)qij,ak=0.

    Assuming that for hH of the Markov chain η the transition probability at the k-th step Pk(h,dz) such that

    H|x+g(tk,y,h,x)|βPk(h,dz)2|x|β, (4.8)

    then the right-hand side of (4.7) will take the form

    (Lv)(tk,y,h,x)=γ|x|β[βiε2+ai+i]=γ|x|β[i(βε+2)2+ai].

    The function (4.4) satisfies the condition Lv<0 if the expression in square brackets is negative. Thus, we can formulate the following statement.

    Theorem 4.1. If the conditions (4.5), (4.6) are met and

    ai<i(βε+2)2,i={1,...,Nξ}, (4.9)

    then the solution of the system (4.1)–(4.3) is stable in probability on the whole for all fixed yY and hH.

    Consider the linear stochastic differential equation

    dx(t)=a(ξ(t))x(t)dt+b(ξ(t))x(t)dw(t),t0,r>0, (5.1)

    with impulse action

    Δx(21k)=x(21k)+eαkηk(x(21k)1),k, (5.2)

    and initial condition

    x(0)=10,ξ(0)=y0Y,η0=1. (5.3)

    Here a and b are constants that depend on Markov process ξ with values in dimensional space (Y,Y) with generator Q, and ηk,k0, is Markov chain with two non-absorbing states h1=0 and h2=1.

    According to [1] the solution of the system (5.1)–(5.3) exists, for example, when α=1.673.

    Case 1. Let's consider the same coefficients as in [1]:

    - if ξ=1: a=1,b=0.3;

    - if ξ=2: a=0.5,b=2.1;

    - ηk{1,2}.

    In this case condition (4.5) is not hold for i=1 because

    10.322=0.955>0.

    Therefore, the solution can be unstable. Indeed, if we consider an example of the realization of the solution of the system (5.1)–(5.3) with indicated parameters, then we observe a rapid growth (see Figure 1a).

    Figure 1.  Estimated solution trajectories (by Euler-Maruyama method): (a) case 1 (unstable), (b) case 2 (stable), (c) case 3 (unstable with an extreme growth at t=2). The red line corresponds to the system's solution x(t) evolution, blue marks – moments of impulse actions.

    Case 2. Next, we consider the values of the coefficients:

    - if ξ=1: a=1,b=0.3;

    - if ξ=2: a=0.5,b=2;

    - ηk{1,2}.

    Condition (4.5) for i=1 has the next form

    10.322=1.045<ε,

    and for i=2 has the form

    0.5222=1.5<ε,

    and holds for ε=0.1.

    According to (4.6)

    β=0.122=0.025.

    And (4.9) hold:

    - if i=1: 1<1(0.0250.1+2)2=1.00125;

    - if ξ=2: 0.5<2(0.0250.1+2)2=2.0025.

    So, all conditions of Theorem 4.1 are held and the solution of the system (5.1)–(5.3) with indicated parameters is stable in probability on the whole. Indeed, in the realization (see Figure 1b) we observe a direction to zero after the point t=3.

    Case 3. Here, the values of the coefficients are the same as in Case 2, but the impulse action has the next form

    Δx(21k)=x(21k)+eαkηk(x(21k)1),k.

    In this case, condition (4.8) does not hold and we cannot guarantee stability in the probability of solution of the system (5.1)–(5.3): we observe a very rapid growth (see Figure 1c).

    In this work, we consider dynamic stochastic systems with Markov parameters and switching that is condensed in one or several time points. For such a system, we obtain sufficient conditions for the asymptotic stochastic stability and asymptotic stability in mean square. We find an explicit form of a weak infinitesimal operator on the solutions of the system, which plays the role of the Lyapunov operator. For a linear case of the stochastic system, we find a condition that defines the stability area.

    As was previously reported in [15], the condition (4.5) means that stability in probability can be ensured due to larger values of the coefficients and the fulfillment of the condition (4.8), even when the system is unstable

    dx(t)=aix(t)dt.

    For example, if we consider the second case of the model example with the coefficients a=0.5,b=2, we will see that the solution of the system corresponding to the deterministic part is not Lyapunov stable, but the solution of the stochastic system, as was demonstrated, is stable in probability.

    The limitation of this work is the assumption that real systems should be described by Ito's differential equations. In this way, an assumption is made about the influence of a large number of independent factors. These differential equations are widely used in financial mathematics and information transmission systems. Another limitation concerns the absence of an aftereffect, as a result of which we can use the Markov properties of systems, but we lose a wide field of applications of the theory.

    This paper explores sufficient conditions for the asymptotic stability of stochastic differential equations with a random structure, particularly in the context of jump concentration points. Our main result is presented in Theorem 2.2, which leverages the second Lyapunov method and involves the construction of corresponding Lyapunov functions. An important consideration in analyzing systems of random structure is the relationship between the magnitudes of jumps, denoted as Lk, and the jump times, denoted as τk. The implications of Theorem 2.2 are demonstrated through an example system whose stability can be modulated by varying parameters. We also highlight a remarkable observation that the system can maintain asymptotic stability even if, for some fixed value of the random process ξ(t), the system described by Eq (2.1) becomes unstable when jumps (2.2) are absent.

    In future studies, we plan to investigate the stability of stochastic differential equations with a random structure, particularly when the jump moments, denoted as τk, are random variables satisfying the condition

    P(limktk=t<)>0.

    This implies a non-zero occurrence of concentration points. Furthermore, the weak independence between the jumps and their corresponding moments will also be considered as part of this analysis.

    The authors declare they have not used Artificial Intelligence (AI) tools in the creation of this article.

    The authors declare the usage of AI tools only for spelling correction (Grammarly, https://app.grammarly.com/) and word/phrase translation between Ukrainian/Russian/English languages (DeepL, https://www.deepl.com/).

    We would like to acknowledge the administrations of the Luxembourg Institute of Health (LIH) and Luxembourg National Research Fund (FNR) for their support in organizing scientific contacts between research groups in Luxembourg and Ukraine.

    This work was supported by the Luxembourg National Research Fund C21/BM/15739125/DIOMEDES to T.L. and P.V.N., and by PRIDE21/16763386/CANBIO2 to M.C.

    The authors declare no conflict of interest.



    [1] T. Lukashiv, I. Malyk, Existence and uniqueness of solution of stochastic dynamic systems with Markov switching and concentration points, Int. J. Differ. Equ., 2017 (2017), 7958398. https://doi.org/10.1155/2017/7958398 doi: 10.1155/2017/7958398
    [2] A. P. Trofymchuk, A. P. Trofymchuk, Switching systems with fixed moments shocks the general location: Existence, uniqueness of the solution and the correctness of the Cauchy problem, Ukrainian Math. J., 42 (1990), 230–237.
    [3] E. B. Dynkin, Markov processes, Heidelberg: Springer, 1965. https://doi.org/10.1007/978-3-662-00031-1_4
    [4] B. Oksendal, Stochastic differential equation, Heidelberg: Springer, 2013. https://doi.org/10.1007/978-3-642-14394-6_5
    [5] R. Khasminskii, Stochastic stability of differential equations, Berlin: Springer, 2011.
    [6] T. Lukashiv, Y. Litvinchuk, I. V. Malyk, A. Golebiewska, P. V. Nazarov, Stabilization of stochastic dynamical systems of a random structure with Markov switchings and poisson perturbations, Mathematics, 11 (2023), 582. https://doi.org/10.3390/math11030582 doi: 10.3390/math11030582
    [7] T. O. Lukashiv, I. V. Yurchenko, V. K. Yasinskii, Lyapunov function method for investigation of stability of stochastic Ito random-structure systems with impulse Markov switchings. I. General theorems on the stability of stochastic impulse systems, Cybernet. Systems Anal., 45 (2009), 281–290. https://doi.org/10.1007/s10559-009-9102-8 doi: 10.1007/s10559-009-9102-8
    [8] M. L. Sverdan, E. F. Tsar'kov, Stability of stochastic impulse systems, Riga: RTU, 1994.
    [9] A. V. Skorokhod, Asymptotic methods in the theory of stochastic differential equations, American Mathematical Society, 2009.
    [10] J. Jacod, A. N. Shiryaev, Limit theorems for stochastic processes, Heidelberg: Springer Berlin, 2003. https://doi.org/10.1007/978-3-662-05265-5
    [11] J. L. Doob, Stochastic processes, Wiley-Interscience, 1991.
    [12] A. M. Lyapunov, General problem of stability of motion, CRC Press, 1992.
    [13] T. Lukashiv, One form of Lyapunov operator for stochastic dynamic system with Markov parameters, J. Math., 2016 (2016), 1694935. https://doi.org/10.1155/2016/1694935 doi: 10.1155/2016/1694935
    [14] I. Ya. Kats, Lyapunov function method in problems of stability and stabilization of random-structure systems, 1998.
    [15] V. K. Yasinsky, Stability in the first approximation of random-structure diffusion systems with aftereffect and external Markov switchings, Cybern. Syst. Anal., 50 (2014), 248–259. https://doi.org/10.1007/s10559-014-9612-x doi: 10.1007/s10559-014-9612-x
  • Reader Comments
  • © 2023 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(1656) PDF downloads(77) Cited by(0)

Figures and Tables

Figures(1)

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog