On a combination of fractional differential and integral operators associated with a class of normalized functions

1.   Introduction

Recently, neural networks (NNs) have drawn considerable attention in many fields of science and engineering applications for example associative memories, fixed-point computation, control, static image processing and combinatorial optimization Ref. ^[1,2,3]. However, time-delay is common in various biological and physical phenomena, which is demonstrated by applying of mathematical modelling with time-delay in a wide range of applications for instance mechanical transmission, fluid transmission, metallurgical processes and networked control systems which is frequently a source of chaos, instability and poor control performance. These applications are extensively dependent upon the stability of the equilibrium of NNs. So, stability is much importance in dynamical properties of NNs when NNs are designed. As research results, the stability problem and the performance of the NNs with time-delay have been improved in Ref. ^{[4,5,6,7,8,9,10,11,12]}. However, most results were discussed only on the discrete delay in NNs. In contrast, the distributed delay should be associated with a model of a system that there exists a distribution of propagation delays over a period of time in some cases as discussed in Ref. ^[13,14]. Therefore, there has been an increasing interest in the delayed NNs, and a great number of results on these topics have been reported in the literature Ref. ^{[15,16,17,18,19,20,21,22,23]} as well.

On the other hand, the passivity is interesting problem and is closely related to the circuit analysis method. The properties of the passivity are that the system can keep the system internally stable Ref. ^[24,25]. Especially, the passive system employs the product of input and output as the energy provision and embodies the energy attenuation character. A passive system only burns energy without energy production and passivity represents the property of energy consumption Ref. ^[26]. The issue of passivity performance analysis has been used in various areas such as fuzzy control, signal processing, networked control and sliding mode control Ref. ^[27]. Due to these features, the passivity problems have been an active area of research in recently decades with NNs.

In the same way, Ref. ^[28,29,30] also studied the passivity analysis of neural network with discrete and distributed delays. In addition, many uncertain factors such as uncertain parameters, disturbance and environmental noise are regularly encountered in many practical and engineering systems, and these make it difficult to develop an exact mathematical model. Therefore, the parameter uncertainties are very important and unavoidable while modelling NNs in both theoretical and practical cases. Meanwhile, improved the delay-dependent approach to passivity analysis for uncertain NNs with discrete interval and distributed time-varying delays has also discussed in Ref. ^[31,32]. However, there are few results for studying this problem with uncertainties to the best of the authors's knowledge, we study delay-dependent passivity criteria for uncertain NNs with discrete interval and distributed time-varying delays.

Recently, several approaches to reduce the conservatism for the system with time delay have been reported in the literature, namely an appropriate Lyapunov-Krasovskii functional method by utilizing information of the neuron activation function and some techniques to evaluate the bounds on some cross-terms product arising in the analysis of the delay-dependent stability problem such as integral inequality, refined Jensen's inequality, and free weighting matrices approach etc. These approaches will give better maximum allowable upper bound for time-varying delay over some existing ones Ref. ^{[33,34,35,36,37,38,39,40]}. However, these previous works still study on delay-derivative-dependent stability criteria. Practically time delays can occur in an irregular fashion such as sometimes the time-varying delays are not differentiable.

Therefore in this paper, we have followed robust passivity analysis of NNs with interval nondifferentiable and distributed time-varying delays to obtain a better maximum bound value and to relax the derivative condition of delay. Moreover, system is assumed that the parameter uncertainties are norm-bounded for checking the passivity of the addressed NNs in LMIs, which can be checked numerically using the effective LMI toolbox in MATLAB. This is the first time that we apply the methods to study the networks model to reduce the condition of delays being non-differentiable delays. Moreover, the system can be turned into the delayed NNs proposed in Ref. ^[36,39,40] which means that this work is more general than them. Furthermore, the main ideas of this work are given as follows:

$\bullet$ The challenge of this paper is studying the new result on robust passivity analysis of NNs with non-differentiable mixed time-varying delays which mean that this work can be used for various systems with fast time-varying delays compared with previous works considered on differentiable delay ($\dot{r}(t)\le \mu$).

$\bullet$ The new Lyapunov Krasovskii functional establishes more relationships among different vectors, avoids the extra conservatism arising from estimating the time-varying delays and utilizes more information about the upper and lower bounds of the time delays existing in the systems.

$\bullet$ The new sufficient conditions based on refined Jensen-based inequalities proposed in Ref. ^[41], are less conservative than the others proposed Ref. ^{[33,34,35,36,37,38,39,40]} which are shown in the comparison examples.

The rest of paper is organized as follows: Section 2 provides some mathematical preliminaries and network model. Section 3 presents the passivity analysis of uncertain NNs with interval and distributed time-varying delays. Numerical examples are given in Section 4. Finally, the conclusion is provided in Section 5.

2.   Network model and mathematics preliminaries

Notations: $\mathbb{R}^n$ is the $n$-dimensional Euclidean space; $\mathbb{R}^{m\times n}$ denotes the set of $m \times n$ real matrices; $I_n$ represents the $n$-dimensional identity matrix. Let $\mathbb{S}_n^{+}$ denotes the set of symmetric positive definite matrices in $\mathbb{R}^{n\times n}$. We also denoted by $\mathbb{D}_n^{+}$ the set of positive diagonal matrices. $A$ matrix $D = \text{diag}\{d_1, d_2, ..., d_n\}\in\mathbb{D}_n^{+}$ if $d_i > 0 \ (i = 1, 2, ..., n)$. The notation $X \geq 0$ (respectively, $X > 0$) means that $X$ is positive semi-definite (respectively, positive definite); $\rm{diag} (\ldots)$ denotes a block diagonal matrix; $\left[{\begin{array}{*{20}c} X & Y \\ \star & Z \\ \end{array}} \right]$ stands for $\left[{\begin{array}{*{20}c} X & Y \\ Y^T & Z \\ \end{array}} \right]$; Matrix dimensions, if not explicitly stated, are assumed to be compatible for algebraic operations.

Consider the following of NNs with nondifferentiable interval and distributed time-varying delays in the form:

where $n$ denotes the number of neurons in the network, $p(t) = [p_{1}(t), \hskip0.1cm p_{2}(t), ..., p_{n}(t)]^T$ $\in \mathbb{R}^n$ is the neurons state vector, $q(t)\in \mathbb{R}^n$ is the output vector and $u(t)$ is the external input of the network, $D = \text{diag}\{d_{1}, d_{2}, ..., d_{n}\}$ is a positive diagonal matrix, $A, A_{1}, A_{2}$ are interconnection weight matrices, $C_{1}, C_{2}, C_{3}, C_{4}$ are real matrices, $g(p(t)) = [g_{1}(p_{1}(t)), \hskip0.1cm g_{2}(p_{2}(t)), ..., g_{n}(p_{n}(t))]^T \in \mathbb{R}^n$ denotes the activation function, $g(p(t-r(t))) = [g_{1}(p_{1}(t-r(t))), \hskip0.1cm g_{2}(p_{2}(t-r(t))), ..., \hskip0.1cm g_{n}(p_{n}(t-r(t)))]^T \in \mathbb{R}^n$. and $\phi(t) \in \mathbb{R}^n$ is the initial function.

The variables $r(t)$ and $d(t)$ represent the mixed delays of the model in (2.1) and satisfy

where $r_{1}, \hskip0.2cm r_{2}, \hskip0.2cm \text{and} \hskip0.2cm d$ are constants.

The neural activation functions $g_{i}(p_{i}(t))$ are continuous $g_{i}(0) = 0$ and there exist constants $l_{i}^-, l_{i}^+$ $(i = 1, 2, ..., n)$ such that

Definition 2.1. ^[5] The neural network (2.1) is said to be passive if there exists a scalar $\gamma > 0$ such that for all $t_{f}\ge 0$

under the zero initial condition.

Lemma 2.2. ^[41] For a given matrix $Q \in \mathbb{S}_{n}^+$ and a function $e:[u, v]\to \mathbb{R}^n$ whose derivative $\dot{e} \in C([u, v], \mathbb{R}^n)$, the following inequalities hold:

where $\bar{Q} = \text{diag}\{Q, 3Q, 5Q\}$, $\hat{Q} = \text{diag}\{Q, 2Q\}$, $\hat{\varepsilon} = [\varepsilon_{1}^T, \varepsilon_{2}^T, \varepsilon_{3}^T]^T$, $\hat{\Gamma} = [\Gamma_{1}^T, \Gamma_{2}^T]^T$ and

Lemma 2.3. ^[6] For a positive definite matrix $P > 0$, and an integral function $\Big{\{}e(\alpha)|\alpha\in [u, v]\Big{\}}$, then the following inequalities hold:

Lemma 2.4. ^[6] Let $M, N \hskip0.2cm \mathit{\text{and}} \hskip0.2cm F(t)$ be real matrices of appropriate dimensions with $F(t)$ satisfying $F^T(t)F(t)\le I$. Then for any scalar $\epsilon > 0$.

Lemma 2.5. ^[6] Given constant symmetric matrices $P, Q, R$ with appropriate dimensions satisfying $P = P^T$, $Q = Q^T > 0$. Then $P+R^TQ^{-1}R < 0$ if and only if

3.   Main results

In this section, the new result on robust passivity analysis for NNs with interval nondifferentiable and distributed time-varying delays will be established. Let us set

$L_{1} = \text{diag}\{l_{1}^-, l_{2}^-, ..., l_{n}^-\}$,     $L_{2} = \text{diag}\{l_{1}^+, l_{2}^+, ..., l_{n}^+\}$,     $r_{12} = r_{2}-r_{1}$,

$\bar{S}_{k} = \text{diag}\{S_{k}, 3S_{k}, 5S_{k}\},$ $k = 1, 2$,     $T = \left[\begin{array}{cccc} I_{n} & -I_{n} & 0 & 0\\ I_{n} & I_{n} & -2I_{n} & 0\\ I_{n} & -I_{n} & 6I_{n} & -6I_{n} \end{array} \right],$

$\Sigma_{1}(r) = [\varphi_{1}^T \hskip0.2cm r_{1}\varphi_{9}^T\hskip0.2cm (r-r_{1})\varphi_{10}^T+(r_{2}-r)\varphi_{11}^T \hskip0.2cm \frac{r_{1}^2}{2}\varphi_{12}^T]^T$,

$\Sigma_{2} = [\mathcal{A}^T \hskip0.2cm (\varphi_{1}-\varphi_{2})^T \hskip0.2cm (\varphi_{2}-\varphi_{4})^T \hskip0.2cm r_{1}(\varphi_{1}-\varphi_{9})^T]^T$,

$\Sigma_{3} = [\varphi_{2}^T \hskip0.2cm \varphi_{8}^T]^T$,    $\Sigma_{4} = [\varphi_{4}^T \hskip0.2cm \varphi_{7}^T]^T$,    $\Sigma_{5} = [\varphi_{1}^T \hskip0.2cm \varphi_{5}^T]^T$,

$\Sigma_{6} = [\varphi_{1}^T\hskip0.2cm \varphi_{2}^T \hskip0.2cm \varphi_{9}^T\hskip0.2cm \varphi_{12}^T]^T$,    $\Sigma_{7} = [\varphi_{3}^T\hskip0.2cm \varphi_{4}^T \hskip0.2cm \varphi_{11}^T\hskip0.2cm \varphi_{14}^T]^T$,    $\Sigma_{8} = [\varphi_{2}^T\hskip0.2cm \varphi_{3}^T \hskip0.2cm \varphi_{10}^T\hskip0.2cm \varphi_{13}^T]^T$,

$\Sigma_{9}(r) = [((r-r_{1})\varphi_{10}+(r_{2}-r)\varphi_{11})^T \hskip0.2cm (\varphi_{16}+\varphi_{17})^T]^T$,

$\Sigma_{10} = \frac{r_{1}^2}{2}\varphi_{1}-\frac{r_{2}^2}{2}\varphi_{12}$,     $\Sigma_{11}(r) = \frac{r_{12}^2}{2}\varphi_{2}-\frac{(r-r_{1})^2}{2}\varphi_{13}-\frac{(r_{2}-r)^2}{2}\varphi_{14}$,

$\Sigma_{12} = \varphi_{5}-L_{1}\varphi_{1}, \hskip1.9cm \Sigma_{13} = L_{2}\varphi_{1}-\varphi_{5}$,

$\Sigma_{14} = \varphi_{6}-L_{1}\varphi_{3}, \hskip1.9cm \Sigma_{15} = L_{2}\varphi_{3}-\varphi_{6}$,

$\Sigma_{16} = \varphi_{5}-\varphi_{6}-L_{1}(\varphi_{1}-\varphi_{3}), \quad \quad \Sigma_{17} = L_{2}(\varphi_{1}-\varphi_{3})-\varphi_{5}+\varphi_{6}$,

$\Sigma_{18} = \varphi_{5}-\varphi_{8}-L_{1}(\varphi_{1}-\varphi_{2}), \quad \quad \Sigma_{19} = L_{2}(\varphi_{1}-\varphi_{2})-\varphi_{5}+\varphi_{8}$,

$\Sigma_{20} = \varphi_{5}-\varphi_{7}-L_{1}(\varphi_{1}-\varphi_{4}), \quad \quad \Sigma_{21} = L_{2}(\varphi_{1}-\varphi_{4})-\varphi_{5}+\varphi_{7}$,

$\Sigma_{22} = \varphi_{7}-\varphi_{8}-L_{1}(\varphi_{4}-\varphi_{2}), \quad \quad \Sigma_{23} = L_{2}(\varphi_{4}-\varphi_{2})-\varphi_{7}+\varphi_{8}$,

$\Sigma_{24} = \varphi_{6}-\varphi_{8}-L_{1}(\varphi_{3}-\varphi_{2}), \quad \quad \Sigma_{25} = L_{2}(\varphi_{3}-\varphi_{2})-\varphi_{6}+\varphi_{8}$,

$\Sigma_{26} = \varphi_{7}-\varphi_{6}-L_{1}(\varphi_{4}-\varphi_{3}), \quad \quad \Sigma_{27} = L_{2}(\varphi_{4}-\varphi_{3})-\varphi_{7}+\varphi_{6}$,

$\Gamma_{0}(r) = \Sigma_{1}^T(r)P\Sigma_{2}+\varphi_{1}^T(L_{2}W_{2}-L_{1}W_{1})\mathcal{A}-\varphi_{5}^T(W_{2}-W_{1})\mathcal{A}$,

$\Gamma_{1} = \varphi_{1}^T(Q_{2}+Q_{3})\varphi_{1}-\varphi_{2}^TQ_{2}\varphi_{2}-\varphi_{4}^TQ_{3}\varphi_{4}+\Sigma_{3}^TQ_{1}\Sigma_{3}-\Sigma_{4}^TQ_{1}\Sigma_{4}+r_{12}^2\Sigma_{5}^TS_{3}\Sigma_{5}+d^2\varphi_{5}^TS_{4}\varphi_{5}$,

$\Gamma_{2} = \mathcal{A}^T[r_{1}^2S_{1}+r_{12}^2S_{2}+\frac{r_{1}^2}{2}R_{1}+\frac{r_{12}^2}{2}R_{2}+\frac{r_{1}^6}{36}Z_{1}+\frac{(r_{2}^3-r_{1}^3)(r_{2}-r_{1})^3}{36}Z_{2}]\mathcal{A}$,

$\Gamma_{3} = \varphi_{15}^T(\gamma I_{n}+2C_{4})\varphi_{15}+\text{Sym}(\varphi_{15}^T(C_{1}\varphi_{5}+C_{2}\varphi_{6}+C_{3}\varphi_{18}))$,

$\Omega_{1}(r) = \text{Sym}(\Gamma_{0}(r))+\Gamma_{1}+\Gamma_{2}-\Gamma_{3}$,

$\Omega_{2} = \Sigma_{6}^TT^T\bar{S}_{1}T\Sigma_{6}$,    $\Omega_{3} = \Sigma_{7}^TT^T\bar{S}_{2}T\Sigma_{7}$,    $\Omega_{4} = \Sigma_{8}^TT^T\bar{S}_{2}T\Sigma_{8}$,

$\Omega_{5} = 2(\varphi_{1}-\varphi_{9})^TR_{1}(\varphi_{1}-\varphi_{9})+4(\varphi_{1}+2\varphi_{9}-3\varphi_{12})^TR_{1}(\varphi_{1}+2\varphi_{9}-3\varphi_{12})$,

$\Omega_{6} = 2(\varphi_{2}-\varphi_{10})^TR_{2}(\varphi_{2}-\varphi_{10})+4(\varphi_{2}+2\varphi_{10}-3\varphi_{13})^TR_{2}(\varphi_{2}+2\varphi_{10}-3\varphi_{13})+2(\varphi_{3}-\varphi_{11})^TR_{2}(\varphi_{3}-\varphi_{11})+$

$4(\varphi_{3}+2\varphi_{11}-3\varphi_{14})^TR_{2}(\varphi_{3}+2\varphi_{11}-3\varphi_{14})$,

$\Pi(r) = \Sigma_{9}^T(r)S_{3}\Sigma_{9}(r)+\Sigma_{10}^TZ_{1}\Sigma_{10}+\Sigma_{11}^T(r)Z_{2}\Sigma_{11}(r)$,

$\Delta_{0} = \Sigma_{12}^T\Delta_{1}\Sigma_{13}+\Sigma_{14}^T\Delta_{2}\Sigma_{15} +\Sigma_{16}^T\Delta_{3}\Sigma_{17}+\Sigma_{18}^T\Delta_{4}\Sigma_{19} +\Sigma_{20}^T\Delta_{5}\Sigma_{21}+\Sigma_{22}^T\Delta_{6}\Sigma_{23} +\Sigma_{24}^T\Delta_{7}\Sigma_{25}+ \Sigma_{26}^T\Delta_{8}\Sigma_{27}$,

$\mathcal{A} = D\varphi_{1}+A\varphi_{5}+A_{1}\varphi_{6}+A_{2}\varphi_{18}+\varphi_{15}$,

and $\varphi_{i} = [0_{n\times (i-1)n} \hskip0.2cm I_{n} \hskip0.2cm 0_{n\times (18-i)n}] \hskip0.2cm(i = 1, 2, ..., 18)$.

Based on the Lyapunov–Krasovskii functional approach, we present our new theorem for passivity of NNs (2.1).

Theorem 3.1. The delayed neural network in (2.1) is passive in the sense of definition 2.1 for any delays $r(t) \hskip0.1cm \mathit{\text{and}} \hskip0.1cm d(t)$ satisfying $0\le r_{1} \le r(t)\le r_{2}$ and $0\le d(t)\le d$ if there exist matrices $P \in \mathbb{S}_{4n}^+; Q_{1}, S_{3}\in \mathbb{S}_{2n}^+; Q_{2}, Q_{3}, S_{1}, S_{2}, S_{4}, R_{1}, R_{2}, Z_{1}, Z_{2} \in \mathbb{S}_{n}^+; \Delta_{k}, W_{\sigma} \in \mathbb{D}_{n}^+$, $(k = 1, 2, ..., 8; \sigma = 1, 2)$, and a scalar $\gamma > 0$ satisfy the following LMI:

Proof. Consider the following Lyapunov-Krasovskii functional:

where,

Let $\Delta_{k} = \text{diag}\{\lambda_{k1}, \lambda_{k2}, ..., \lambda_{kn}\} \hskip0.1cm (k = 1, 2, ..., 8)$, $W_{\sigma} = \text{diag}\{w_{\sigma1}, w_{\sigma2}, ..., w_{\sigma n}\}$ $(j = 1, 2)$, and

The derivative of $V(t, p_{t})$ along the solution of system (2.1) as follows:

We conclude that,

According to Lemma 2.2, we have

By splitting, we have

Applying Lemma 2.2 yields

In the same way, applying the inequalities (2.7) and (2.8), then we obtain

For $\lambda_{1i} > 0, \quad i = 1, 2, \ldots, n$, it can be deduced from (2.3) that

and thus

From (3.13), we have

Then, to show that NNs (2.1) is passive, we define $J(t_{f}) = { \int_{0}^{t_{f}}\Big[-\gamma u^T(t)u(t)-2q^T(t)u(t)\Big]\, dt}$ where $t_{f}\ge0$. Consider the zero initial condition and we have

From (3.2) to (3.14), it can be deduced that

where $\Phi(r)$ is an affine function in $r$, for $\Phi(r) < 0$, $r \in [r_{1}, r_{2}]$ if and only if $\Phi(r_{1}) < 0$ and $\Phi(r_{2}) < 0$. if (3.1) holds for $r = r_{1}$ and $r = r_{2}$ and we have $\Phi(r) < 0$, then

Considering, we have $J(t_{f}) < 0$ for any $t_{f}\ge 0$ if condition (2.3) is satisfied. Thus, the system of NNs (2.1) is passive. The proof is completed.

Remark 1. We can see that the time delay in this work is a continuous function which belongs to a given interval. It means that the lower and upper bounds of the time-varying delay are available. Moreover, there is no need to be differentiable for the delay function. Therefore, the delays considering in this brief are more general than those studied in ^{[29,33,34,38]}.

Remark 2. The activation function in inequality (2.3) studied by ^[40] is more general than ^{[28,33,36,39]} because the constants $l_i^-$ and $l_i^+$ can be positive, zero or negative. We can see that the activation function under (2.3) can be unbounded, non-monotonic, non-differentiable. Hence, the passivity condition is considered in this work is less conservative than Ref. ^{[28,33,36,39]}.

Remark 3. The proof of theorem 3.1 shows estimating of integral terms by lemma 2.2 applying equations (3.3), (3.4), (3.5), (3.6), (3.7) and (3.8), which obtained a tighter upper bound than Jensen's inequality used in Ref. ^{[25,29,33,36]}.

Based on the presented passivity condition in theorem 3.1, we will develop passivity analysis of uncertain NNs established as follows. Consider

where $\Delta D(t), \hskip0.2cm \Delta A(t), \hskip0.2cm \Delta A_{1}(t), \hskip0.2cm \Delta A_{2}(t)$ are the time-varying parameter uncertainties, which are assumed to be of the form

where $M, N_{1}, N_{2}, N_{3} \hskip0.1cm \text{and} \hskip0.1cm N_{4}$ are known real constant matrices, and $F(\cdot)$ is an unknown time-varying matrix function satisfying $F^T(t)F(t)\le I$ then we have the following result.

Theorem 3.2. The delayed neural network in (3.15) is passive in the sense of definition 2.1 for any delays $\tau(t) \hskip0.1cm \mathit{\text{and}} \hskip0.1cm d(t)$ satisfying $0\le r_{1} \le r(t)\le r_{2}$ and $0\le d(t)\le d$ if there exist matrices $P \in \mathbb{S}_{4n}^+; Q_{1}, S_{3}\in \mathbb{S}_{2n}^+; Q_{2}, Q_{3}, S_{1}, S_{2}, S_{4}, R_{1}, R_{2}, Z_{1}, Z_{2} \in \mathbb{S}_{n}^+; \Delta_{k}, W_{\sigma} \in \mathbb{D}_{n}^+$, $(k = 1, 2, ......, 8; \sigma = 1, 2)$, and a scalar $\gamma > 0$ satisfy the following LMI:

where

and $\Phi(r)$ is defined in theorem 3.1.

Proof. Replacing $D, A, A_{1}, \hskip0.1cm \text{and} \hskip0.1cm A_{2}$ in theorem 3.1 with $D+MF(t)N_{1}$, $A+MF(t)N_{2}, A_{1}+MF(t)N_{3}, A_{2}+MF(t)N_{4}$ respectively, so we have

Applying lemma 2.4, it can be deduced that for $\epsilon > 0$

From lemma 2.5 shows that (3.19) is equivalent to (3.17), therefore the proof is completed.

Remark 4. If delayed NNs (2.1) are setting as $C_2 = 0, C_3 = 0$ and $C_4 = 0$, the networks model turns into the delayed NNs proposed in ^{[28,33,38,40]}:

Hence, our network model (2.1) includes previous network model, which can be regarded as a special case of neural network (2.1).

Remark 5. To illuminate how to solve the upper bound of $r_2$ for system (2.1) satisfying time-varying delays (2.2) and neural activation functions (2.3), the following steps are performed.

Step 1: Given positive diagonal matrix $D$, real matrices $A, A_1, A_2, C_1, C_2, C_3$ and positive constants $r_1, d$.

Step 2: Select a positive constant $\gamma$.

Step 3: Define variable matrices with appropriate dimensions $P, Q_1, S_3, Q_2, Q_3, S_1, S_2, S_4, R_1, R_2,$ $Z_1, Z_2, \Delta_k, W_\sigma\ (k = 1, 2, ..., 8; \sigma = 1, 2)$.

Step 4: Use matlab software to compute the value of the variable.

Step 5: Calculate the value of LMIs, in (3.1).

4.   Numerical examples

In this section, three numerical examples are given to illustrate the merits of the proposed robust passivity results.

Example 4.1. Consider a neural network (2.1) with the following parameters:

$L_{1} = \text{diag}\{0, 0\}$, $L_{2} = \text{diag}\{1, 1\}$, $C_{1} = I$, and $C_{2} = C_{3} = C_{4} = 0$. The neural activation functions are assumed to be $g_{i}(p_{i}) = \frac{1}{2}(|p_{i}+1|-|p_{i}-1|)\ (i = 1, 2)$. It is easy to check that the neural activation functions are satisfied (2.3) with $l^-_i = 0$ and $l^+_i = 0\ (i = 1, 2)$. Using Matlab LMI Toolbox, we can conclude that the upper bound of $r_{2}$ without non differentiable $\mu$ which is shown in Table 1 is feasibility of the LMI in theorem 3.1. In addition, the results from ^{[36,37,38,39,40]} without distributed delay are listed in Table 1. As shown in this table, the criterion of this paper is less conservative than those results obtained in ^{[36,37,38,39,40]}. According to Figure 1, it can be confirmed that neural network (2.1) under zero input and the initial condition $[p_1(t), p_2(t)]^T = [-1, 1]^T$ is stable.

Example 4.2. Consider a uncertain neural network (3.15) with the following parameters:

$M = \text{diag}\{0.1, 0.1\}$, $N_{1} = N_{2} = N_{3} = N_{4} = \text{diag}\{1, 1\}$. With these parameters, we can conclude that the upper bound of $r_{2}$ are shown in Table 2 is feasibility of the LMI in theorem 3.2. Moreover, the results from ^[33,35,40] are listed in Table 2. As shown in this table, the criteria of this paper is less conservative than those results obtained in ^[33,35,40]. We have activation functions as above and set $\Delta D(t) = \Delta A(t) = \Delta A_{1}(t) = \Delta A_{2}(t) = \left[\begin{array}{c c} 0.1\sin(t) & 0\\ 0 & 0.1\sin(t) \end{array} \right]$ shown in Figure 2. From Figure 2, it can be confirmed that the neural network (3.15) without input $u(t)$ is robustly stable, which the initial condition $[p_1(t), p_2(t)]^T = [1.5, -1.5]^T$.

Example 4.3. Consider a uncertain neural network (3.15) with the following parameters:

$M = \text{diag}\{0.1, 0.1\}$, $N_{1} = 0.1, N_{2} = 0.2I, \hskip0.2cm N_{3} = 0.3I, \hskip0.2cm N_{4} = \text{diag}\{0, 0\}$ and $C_{1} = C_{2} = C_{3} = C_{4} = I$. In this example, we can conclude that the upper bounds of $r_{2}$ are shown in Table 3 is feasibility of the LMI in theorem 3.2. Moreover, the results from ^[33,34,40] without distributed delay are listed in Table 3. As shown in this table, the criterion of this paper is less conservative than those results obtained in ^[33,34,40]. We have activation functions as above and set $\Delta D(t) = \left[\begin{array}{c c} 0.01\sin(t) & 0\\ 0 & 0.01\sin(t) \end{array} \right], \hskip0.2cm \Delta A(t) = \left[\begin{array}{c c} 0.02\sin(t) & 0\\ 0 & 0.02\sin(t) \end{array} \right], \hskip0.2cm \Delta A_{1}(t) = \left[\begin{array}{c c} 0.03\sin(t) & 0\\ 0 & 0.03\sin(t) \end{array} \right]$ shown in Figure 3. From Figure 3, it can be confirmed that the neural network (3.15) without input $u(t)$ is robustly stable, which the initial condition $[p_1(t), p_2(t)]^T = [2,-1]^T$.

Remark 6. An important property in linear circuit and system theory is passivity which is applicable to the analysis of properties of immittance or hybrid matrices of various classes of neural networks, inverse problem of linear optimal control, Popov criterion, circle criterion and spectral factorization by algebra ^[42]. In the recent years, passivity properties have also been related to the neural networks ^{[36,37,38,39,40]}. It should be pointed out that the aforementioned results have the restrictions on the derivative time-varying delays which mean that the delayed conditions in this work are more applicable in the real-world system by establishing Lyapunov-Krasovskii functional fully of the information of the delays $r_1, r_2$ and $d$. On the other hand, in this work, we use the refined Jensen's inequality to estimate single and double integrals. By applying the aforementioned techniques, we obtain the less conservative results than the others ^{[25,29,33,36]}.

Example 4.4. Consider a uncertain neural network (3.15) with the following parameters:

$M = \text{diag}\{0.1, 0.1, 0.1\}$, $N_{1} = 0.1I, \ N_{2} = 0.2I, \ N_{3} = 0.2I, \ N_{4} = 0.1I$, $C_{1} = C_{2} = C_{3} = C_{4} = I$ and

In Example 4.4, the state trajectory of neural network (3.15) for $r_1 = 1, r_2 = 2, d = 0.5$ and $g_1(s) = g_2(s) = g_3(s) = tanh(s)$ without input $u(t)$ has been analyzed. The result is robustly stable shown in Figure 4 with the initial condition $[p_1(t), p_2(t), p_3(t)]^T = [2,1,-2,]^T$.

5.   Conclusions

In this research, we focused on new results for robust passivity analysis of NNs with interval nondifferentiable and distributed time-varying delays. Using refined Jensen's inequalities, and applying the Lyapunov-Krasovskii functional containing single, double, triple and quadruple integrals, the new conditions were obtained in terms of LMI which can be checked by using LMI toolbox in MATLAB. Moreover, These results are less conservative than the existing ones and can be an effective method. Compared with existing ones, the obtained criteria are more effective because of the application of refined Jensen-based inequality technique comprising single and double inequalities evaluating. Three numerical examples have been proposed to show the effectiveness of the methods. For further research, we can use these methods to consider the dynamic networks with Markovian jumping delayed complex networks or stochastic delayed complex networks.

Acknowledgments

The first author was financially supported by the Thailand Research Fund (TRF), the Office of the Higher Education Commission (OHEC) (grant number : MRG6280149) and Khon Kaen University. The fourth author was financial supported by University of Pha Yao. The fifth author was supported by Rajamangala University of Technology Isan (RMUTI) and Thailand Science Research and Innovation (TSRI). Contract No.Contract No. FRB630010/0174-P6-03.

Conflict of interest

The authors declare that there is no conflict of interests regarding the publication of this paper.