
One of the most significant challenges of the mining industry is resource yield estimation from visual data. An example would be identification of the rock chunk distribution parameters in an open pit. Solution of this task allows one to estimate blasting quality and other parameters of open-pit mining. This task is of the utmost importance, as it is critical to achieving optimal operational efficiency, reducing costs and maximizing profits in the mining industry. The mentioned task is known as rock fragmentation estimation and is typically tackled using computer vision techniques like instance segmentation or semantic segmentation. These problems are often solved using deep learning convolutional neural networks. One of the key requirements for an industrial application is often the need for real-time operation. Fast computation and accurate results are required for practical tasks. Thus, the efficient utilization of computing power to process high-resolution images and large datasets is essential. Our survey is focused on the recent advancements in rock fragmentation, blast quality estimation, particle size distribution estimation and other related tasks. We consider most of the recent results in this field applied to open-pit, conveyor belts and other types of work conditions. Most of the reviewed papers cover the period of 2018-2023. However, the most significant of the older publications are also considered. A review of publications reveals their specificity, promising trends and best practices in this field. To place the rock fragmentation problems in a broader context and propose future research topics, we also discuss state-of-the-art achievements in real-time computer vision and parallel implementations of neural networks.
Citation: Mikhail V. Ronkin, Elena N. Akimova, Vladimir E. Misilov. Review of deep learning approaches in solving rock fragmentation problems[J]. AIMS Mathematics, 2023, 8(10): 23900-23940. doi: 10.3934/math.20231219
[1] | Yanting Xiao, Yifan Shi . Robust estimation for varying-coefficient partially nonlinear model with nonignorable missing response. AIMS Mathematics, 2023, 8(12): 29849-29871. doi: 10.3934/math.20231526 |
[2] | Heng Liu, Xia Cui . Adaptive estimation for spatially varying coefficient models. AIMS Mathematics, 2023, 8(6): 13923-13942. doi: 10.3934/math.2023713 |
[3] | Yanping Liu, Juliang Yin . B-spline estimation in varying coefficient models with correlated errors. AIMS Mathematics, 2022, 7(3): 3509-3523. doi: 10.3934/math.2022195 |
[4] | Anum Iftikhar, Hongbo Shi, Saddam Hussain, Ather Qayyum, M. El-Morshedy, Sanaa Al-Marzouki . Estimation of finite population mean in presence of maximum and minimum values under systematic sampling scheme. AIMS Mathematics, 2022, 7(6): 9825-9834. doi: 10.3934/math.2022547 |
[5] | Sanaa Al-Marzouki, Christophe Chesneau, Sohail Akhtar, Jamal Abdul Nasir, Sohaib Ahmad, Sardar Hussain, Farrukh Jamal, Mohammed Elgarhy, M. El-Morshedy . Estimation of finite population mean under PPS in presence of maximum and minimum values. AIMS Mathematics, 2021, 6(5): 5397-5409. doi: 10.3934/math.2021318 |
[6] | Jieqiong Lu, Peixin Zhao, Xiaoshuang Zhou . Orthogonality based modal empirical likelihood inferences for partially nonlinear models. AIMS Mathematics, 2024, 9(7): 18117-18133. doi: 10.3934/math.2024884 |
[7] | Zawar Hussain, Atif Akbar, Mohammed M. A. Almazah, A. Y. Al-Rezami, Fuad S. Al-Duais . Diagnostic power of some graphical methods in geometric regression model addressing cervical cancer data. AIMS Mathematics, 2024, 9(2): 4057-4075. doi: 10.3934/math.2024198 |
[8] | Peng Lai, Wenxin Tian, Yanqiu Zhou . Semi-supervised estimation for the varying coefficient regression model. AIMS Mathematics, 2024, 9(1): 55-72. doi: 10.3934/math.2024004 |
[9] | Dayang Dai, Dabuxilatu Wang . A generalized Liu-type estimator for logistic partial linear regression model with multicollinearity. AIMS Mathematics, 2023, 8(5): 11851-11874. doi: 10.3934/math.2023600 |
[10] | Abdullah Mohammed Alomair, Weineng Zhu, Usman Shahzad, Fawaz Khaled Alarfaj . Non-parametric calibration estimation of distribution function under stratified random sampling. AIMS Mathematics, 2025, 10(2): 4457-4472. doi: 10.3934/math.2025205 |
One of the most significant challenges of the mining industry is resource yield estimation from visual data. An example would be identification of the rock chunk distribution parameters in an open pit. Solution of this task allows one to estimate blasting quality and other parameters of open-pit mining. This task is of the utmost importance, as it is critical to achieving optimal operational efficiency, reducing costs and maximizing profits in the mining industry. The mentioned task is known as rock fragmentation estimation and is typically tackled using computer vision techniques like instance segmentation or semantic segmentation. These problems are often solved using deep learning convolutional neural networks. One of the key requirements for an industrial application is often the need for real-time operation. Fast computation and accurate results are required for practical tasks. Thus, the efficient utilization of computing power to process high-resolution images and large datasets is essential. Our survey is focused on the recent advancements in rock fragmentation, blast quality estimation, particle size distribution estimation and other related tasks. We consider most of the recent results in this field applied to open-pit, conveyor belts and other types of work conditions. Most of the reviewed papers cover the period of 2018-2023. However, the most significant of the older publications are also considered. A review of publications reveals their specificity, promising trends and best practices in this field. To place the rock fragmentation problems in a broader context and propose future research topics, we also discuss state-of-the-art achievements in real-time computer vision and parallel implementations of neural networks.
Recently, neural networks such as the Hopfield neural network, cellular neural network, Cohen-Grossberg neural network and bidirectional associative neural network have attracted much attention due to their significant promise for many practical applications[1,2,3,4,5,6]. For example, in the field of signal processing, based on the theoretical results of discrete-time high-order switched neural networks synchronization, the encryption and decryption scheme of multi-channel audio signal design has good security [3]. In the field of fault diagnosis, by using deep parameter-free reconstruction-classification networks with parameter-free adaptively rectified linear units, the fault characteristics of vibration signals under the same fault state under different operating conditions can be better captured [5]. In the field of image processing, the theoretical results of random synchronization control framework based on semi-Markov switching quaternion-valued neural networks can be effectively applied to image encryption [6]. In particular, stability properties of the neural networks play a significant role in their design for solving practical problems. There are some different factors to influence the stability of neural networks. In particular, time delay is often unavoidable. Moreover, for the neural networks with time delay, there exists many techniques to reduce the conservatism of stability conditions, such as the improved bounding technique [7], free-weighting matrix theory [8], integral inequality technique [9] and so on.
It is well known that many dynamical systems may switch in different unpredictable modes, such as random failures [10]. As an effective tool, the Markovian jump process can be used to model these switching systems. Until now, there existed many literatures to investigate the stability, stabilization and observation for Markovian jump systems. For example, the authors investigated the adaptive sliding mode control problem of nonlinear Markovian jump systems with partly unknown transition probabilities, and obtained some conditions to guarantee the stochastic stability of the closed-loop system in [11]. The authors in [12] discussed the realization of H∞ finite-time control for a class of uncertain stochastic time-delay systems with unmeasured states through sliding mode control, and obtained some conditions to guarantee the system state was stabilized within a limited time interval. In [13], the authors established some passivity analysis criteria for Markovian jump singularly perturbed systems with partially unknown probabilities by using the hidden Markov model, and presented a unified controller design method to ensure the passivity of the system. Much more literatures can be found in [14,15,16].
In recent years, sliding mode control has become an effective robust control method because it is insensitive to model uncertainties, parameter variations and external disturbances. So, the sliding mode control has been used for lots of physical systems, such as robot manipulators, automotive engines and power systems. There are some existing results for linear or nonlinear systems[17,18,19,20,21,22]. For example, the authors in [17] investigated the adaptive sliding mode control issue for switched nonlinear systems with matched and mismatched uncertainties, designed the switched adaptive sliding mode control law and estimated the upper bound parameters of the matched uncertainty. The authors in [18] considered the synchronization of delayed chaotic neural networks with unknown disturbance via the observer-based sliding mode control, where the sliding surface involves an integral structure and a discontinuous controller.
In addition, synchronization has received considerable attention from various research fields, such as secure communication [3], engineering [23] and chemistry [24]. Synchronization phenomenons can be observed in many real systems such as neural systems, lasers and electronic circuits [25,26,27,28]. For example, the authors in [25] dealt with chaos synchronization for master-slave piecewise linear systems and provided some new sufficient conditions by using a Lyapunov approach and the so-called S-procedure. In [26], the authors designed a proportional-derivative (PD) controller for the master-slave synchronization of chaotic Lurie systems and presented a new synchronization criterion based on Lyapunov functions with a quadratic form of states and nonlinear functions of the systems. In [27], the authors studied the finite-time lag synchronization issue of master-slave complex networks with unknown signal propagation delays by the linear and adaptive error state feedback approaches and discovered that the setting time was related to initial values.
Motivated by the above discussion, we will consider the master-slave synchronization for uncertain neural networks with time-delay by using the sliding mode control method. The main contributions of our paper are as follows: (1) The master-slave synchronization for uncertain Markov jump neural networks with time-delay is considered by using the sliding mode control method, (2) the effect of time-delay and uncertainty for the neural networks stability are considered, and the uncertain parts in the neural networks only need be bounded other than any structure condition and (3) the provided sliding mode controller is very general.
The rest of this letter is organized as follows. In Section 2, the considered neural network model and some preliminaries are given. In Section 3, some sufficient conditions are proposed by the sliding mode control. In Section 4, a numerical example is provided to illustrate the effectiveness of the method proposed. In the last section, conclusions are presented.
Notation:
Rn: the n-dimensional Euclidean space; Rn×m: the set of all n×m real matrices; ||⋅||: the two-norm of a vector; ||⋅||1: its one-norm; In: the n order unit matrix; λmin(H): the minimum eigenvalues of matrix H; the notation X>Y, where X,Y are symmetric matrices, meaning that X−Y is a positive definite symmetric matrix. For a given matrix A∈Rn×n, AT denotes its transpose. sign(⋅) is the sign function. ∗ in a symmetric matrix denotes the symmetric terms.
Let (Ω,F,Ft,P) be a probability space related to an increasing family {Ft}t≥0 of the σ-algebras Ft⊂F, where Ω is the sample space. F is the σ-algebras of the sample space and P is the probability measure defined on F.
Consider the uncertain time delay neural networks with the Markovian jump defined on the probability space (Ω,F,Ft,P) as follows:
M:{˙xm(t)=−A(r(t))xm(t)+[B(r(t))+ΔB(r(t))]f(xm(t))+[C(r(t))+ΔC(r(t))]g(xm(t−d(t)))+J,xm(t)=φ(t),t∈[−d,0], | (2.1) |
where xm(t)=(xm1(t),xm2(t),...,xmn(t))T∈Rn is the state of neuron networks and A(r(t))∈Rn×n and B(r(t))∈Rn×m and C(r(t))∈Rn×m are coefficient matrices. ΔB(r(t)) and ΔC(r(t))∈Rn×m denote the system's uncertain parts and satisfy
[ΔB(r(t))ΔC(r(t))]=M(r(t))W(t)[N1(r(t))N2(r(t))], |
where matrix W(t) satisfies WT(t)W(t)≤I, M(r(t)),N1(r(t)),N2(r(t)) are some known matrices with appropriate dimensions. d(t) represents time delay and satisfies 0≤d(t)≤d and ˙d(t)≤μ≤1. f(xm(t)) and g(xm(t−d(t))) are the neuron activation functions, and J∈Rn is a constant vector. {r(t),t≥0} is a finite state Markov jumping process and represents the switching process among different modes, which takes values in a state space L={1,2,...,l}, and l is the number of modes. Let ∏=[πij]l×l denote the transition rate matrix, where the mode transition probabilities are
Pr{r(t+Δt)=j|r(t)=i}={πijΔt+o(Δt),i≠j,1+πiiΔt+o(Δt),i=j, | (2.2) |
where Δt>0 and limΔt→0o(Δt)Δt=0, πij satisfies πij>0 with i≠j and πii=−∑lj=1,j≠iπij for each mode i.
In order to be notional convenience, for the i-th mode, system (2.1) can be rewritten as
{˙xm(t)=−Aixm(t)+(Bi+ΔBi)f(xm(t))+(Ci+ΔCi)g(xm(t−d(t)))+J,xm(t)=φ(t),t∈[−d,0]. | (2.3) |
Let (2.3) be the master system, then the slave system is
S:{˙xs(t)=−A(r(t))xs(t)+B(r(t))f(xs(t))+C(r(t))g(xs(t−d(t)))+J+u(t),xs(t)=ψ(t),t∈[−d,0]. | (2.4) |
Definition 1. [29] Master system (2.3) and slave system (2.4) are said to be asymptotic synchronization if
limt→∞||xm(t)−xs(t)||=0 |
for any initial conditions.
In this paper, our objective is to design a suit controller u(t) such that the master system (2.3) and slave system (2.4) are in synchronization by using the sliding mode control method.
To the end, writing the state error e(t)=xs(t)−xm(t), and the corresponding state error system can be described by
{˙e(t)=−Aie(t)+BiF(e(t))+CiG(e(t−d(t)))−ΔBif(xm(t))−ΔCig(xm(t−d(t)))+u(t),e(t)=ψ(t)−φ(t),t∈[−d,0], | (2.5) |
where F(e(t))=f(xs(t))−f(xm(t)) and G(e(t−d(t)))=g(xs(t−d(t)))−g(xm(t−d(t))).
First, we take the sliding mode surface as
σi(t)=e(t)+∫t0[(Ai+Ki)e(θ)−BiF(e(θ))−CiG(e(θ−d(θ)))]dθ. | (2.6) |
Thus, the derivative of σi(t) is
˙σi(t)=˙e(t)+(Ai+Ki)e(t)−BiF(e(t))−CiG(e(t−d(t)))=Kie(t)−ΔBif(xm(t))−ΔCig(xm(t−d(t)))+u(t), | (2.7) |
where Ki(1≤i≤l) are some unknown matrices to be determined later. When the state trajectories reach the sliding mode surface, then ˙σi(t)=0 and σi(t)=0. So, we obtain the equivalent controller
ueq(t)=−Kie(t)+ΔBif(xm(t))+ΔCig(xm(t−d(t))). | (2.8) |
Substituting (2.8) into (2.5), we have
{˙e(t)=−(Ai+Ki)e(t)+BiF(e(t))+CiG(e(t−d(t))),e(t)=ψ(t)−φ(t),t∈[−d,0]. | (2.9) |
In this paper, the following assumptions for the neuron activation functions are needed.
Assumption 1. [30] Assume that each component of the nonlinear function f(⋅) and g(⋅) are continuous and bounded and satisfy
η−k≤fk(z1)−fk(z2)z1−z2≤η+k, |
θ−k≤gk(z1)−gk(z2)z1−z2≤θ+k,∀k=1,2,...,n, |
for any z1,z2∈R, where η−k>0,η+k>0,θ−k>0,θ+k>0 are some known positive constants.
From Assumption 1, it is easy to get the following inequalities
[eT(t)FT(e(t))][Θ1HΘ2H∗H][e(t)F(e(t))]≤0 | (2.10) |
and
[eT(t)GT(e(t−d(t)))][Θ3HΘ4H∗H][e(t)G(e(t−d(t)))]≤0, | (2.11) |
where H=diag{h1,h2,...,hn} is a positive definite diagonal matrix,
Θ1=diag{η−1η+1,η−2η+2,...,η−nη+n},Θ2=diag{−η−1+η+12,−η−2+η+22,...,−η−n+η+n2}, |
Θ3=diag{θ−1θ+1,θ−2θ+2,...,θ−nθ+n},Θ4=diag{−θ−1+θ+12,−θ−2+θ+22,...,−θ−n+θ+n2}. |
Assumption 2.[31] Assume that each component of the nonlinear functions f(⋅) and g(⋅) are bounded, which means that there exists positive scalars Bf and Bg such that
||fk(⋅)||≤Bf,||gk(⋅)||≤Bg |
for k=1,2,...,n.
Remark 1. In fact, the activation functions of neural networks are usually bounded. For example, the Logistic Sigmoid function h1(x)={1+e−ax}−1 and the threshold value function
h2(x)={1,x≥0,−1,x<0, |
and so on.
Throughout the paper, we need the following lemmas.
Lemma 1.[32] For any positive definite symmetric matrix W∈Rn×n and scalar τ>0, there is
∫tt−τxT(s)dsW∫tt−τx(s)ds≤τ∫tt−τxT(s)Wx(s)ds. |
Lemma 2.[33] The linear matrix inequality
[S11S12ST12S22]<0 |
is equivalent to the following condition
S22<0,S11−S12S−122ST12<0, |
where S11 and S22 are symmetric matrices.
Now, we will analyze the synchronization condition and construct the sliding mode controller.
Theorem 1. Under Assumption 1, if there exists positive definite symmetric matrices Pi,Wi,Ri∈Rn×n such that
Φ1i=[Φ1i,1101dRiPiBi−Θ2HPiCi−Θ4H−ATiRi−KTiRi∗−(1−μ)Wi0000∗∗−1dRi000∗∗∗−H0BTiRi∗∗∗∗−HCTiRi∗∗∗∗∗−1dRi]<0 | (3.1) |
for i=1,2,...,l, then the master system (2.1) and slave system (2.4) are in synchronization, where
Φ1i,11=−PiAi−ATiPi−PiKi−KTiPi+l∑j=1,j≠iπij(Pj−Pi)+Wi−1dRi−Θ1H−Θ3H. |
Proof. Constructing the following Lyapunov function
V(t)=eT(t)Pie(t)+∫tt−d(t)eT(θ)Wie(θ)dθ+∫0−d∫tt+s˙eT(θ)Ri˙e(θ)dθds. |
The derivative of V(t) along with the trajectories of system (2.9) is
˙V(t)=2eT(t)Pi˙e(t)+eT(t)∑lj=1πijPje(t)+eT(t)Wie(t)−(1−˙d(t))eT(t−d(t))Wie(t−d(t))+d˙eT(t)Ri˙e(t)−∫tt−d˙eT(θ)Ri˙e(θ)dθ≤2eT(t)Pi[−(Ai+Ki)e(t)+BiF(e(t))+CiG(e(t−d(t)))]+eT(t)∑lj=1,j≠iπij(Pj−Pi)e(t)+eT(t)Wie(t)−(1−μ)eT(t−d(t))Wie(t−d(t))+d[−(Ai+Ki)e(t)+BiF(e(t))+CiG(e(t−d(t)))]TRi⋅[−(Ai+Ki)e(t)+BiF(e(t))+CiG(e(t−d(t)))]−1d[e(t)−e(t−d)]TRi[e(t)−e(t−d)]. |
Letting ξ(t)=(eT(t),eT(t−d(t)),eT(t−d),FT(e(t))andGT(e(t−d(t)))T, one yields
˙V(t)≤ξT(t)[Φ2i+dΨTRiΨ]ξ(t), | (3.2) |
where
Φ2i=[Φ2i,1101dRiPiBiPiCi∗−(1−μ)Wi000∗∗−1dRi00∗∗∗00∗∗∗∗0], |
Ψ=[−Ai−Ki00BiCi], |
Φ2i,11=−PiAi−ATiPi−PiKi−KTiPi+l∑j=1,j≠iπij(Pj−Pi)+Wi−1dRi. |
It is noted that
ξT(t)[Φ2i+dΨTRiΨ]ξ(t)−[eT(t)FT(e(t))][Θ1HΘ2H∗H][e(t)F(e(t))]−[eT(t)GT(e(t−d(t)))][Θ3HΘ4H∗H][e(t)G(e(t−d(t)))]=ξT(t)[Φ3i+dΨTRiΨ]ξ(t), | (3.3) |
where
Φ3i=[Φ1i,1101dRiPiBi−Θ2HPiCi−Θ4H∗−(1−μ)Wi000∗∗−1dRi00∗∗∗−H0∗∗∗∗−H]. |
By using Lemma 2, we know that Φ3i+dΨTRiΨ<0 is equivalent to Φ1i<0. Thus, one obtains ˙V(t)<0 and system (2.9) is asymptotically stable, which shows that the master system (2.1) and slave system (2.4) are in synchronization. The proof is completed.
Theorem 2. Under Assumption 2 and the action of controller
u(t)=−Kie(t)−ζ(t)sign(σi(t)), | (3.4) |
master system (2.1) and slave system (2.4) are in synchronization, where
ζ(t)=Bf⋅||Mi||⋅||N1i||+Bg⋅||Mi||⋅||N2i||+α, |
and α>0 is a positive scalar.
Proof. Constructing the following Lyapunov function
U(t)=12σTi(t)σi(t), |
then
˙U(t)=σTi(t)˙σi(t)=σTi(t)[Kie(t)−ΔBif(xm(t))−ΔCig(xm(t−d(t)))−Kie(t)−ζ(t)sign(σi(t))]≤||σi(t)||[||ΔBi||⋅||f(xm(t))||+||ΔCi||⋅||g(xm(t−d(t)))||]−ζ(t)||σi(t)||. | (3.5) |
Because of
||ΔBi||⋅||f(xm(t))||+||ΔCi||⋅||g(xm(t−d(t)))||≤||Mi||[Bf⋅||N1i||+Bg⋅||N2i||], |
then
˙U(t)≤−α||σi(t)||=−α√2U(t). |
Thus, the state trajectories can attain the sliding mode surface in the finite time interval [0,T∗], where T∗≤√2U(0)2α. The proof is completed.
Remark 2. Compared with the uncertain system in [15], we especially considered the effect of time delay. From Theorems 1 and 2, we see that the designed sliding mode controller can realize the master-slave synchronization of the Markov jump neural networks.
Remark 3. The control gain Ki can be obtained from matrix inequality (3.1). However, (3.1) is not a linear matrix inequality. In order to solve it, we can take Pi=Ri.
From Theorem 1, we can obtain the following useful corollary as r(t)=1, which means that system (2.1) only has one mode.
Corollary 1. Under Assumption 1, if there exist positive definite symmetric matrices P,W,R∈Rn×n such that
Φ1=[Φ1,1101dRPB−Θ2HPC−Θ4H−ATR−KTR∗−(1−μ)W0000∗∗−1dR000∗∗∗−H0BTR∗∗∗∗−HCTR∗∗∗∗∗−1dR]<0, | (3.6) |
then the master system
{˙xm(t)=−Axm(t)+(B+ΔB)f(xm(t))+(C+ΔC)g(xm(t−d(t)))+J,xm(t)=φ(t),t∈[−d,0] | (3.7) |
and slave system
{˙xs(t)=−Axs(t)+Bf(xs(t))+Cg(xs(t−d(t)))+J+u(t),xs(t)=ψ(t),t∈[−d,0] | (3.8) |
are in synchronization, where
Φ1,11=−PA−ATP−PK−KTP+W−1dR−Θ1H−Θ3H. |
Consider master system (2.1) and slave system (2.4) with the following parameters
A1=[42105−20−26],A2=[5120700−18],B1=[0.20.60.20.2−0.200.2−0.1−0.1], |
B2=[0.20.50.30.2−0.400.3−0.1−0.2],C1=[0.50.4−0.30.50.10.10.50.10.5],C2=[0.8−0.30.30.10.20.2−0.60.30.2], |
Π=[−221−1],M1=[−0.20.50.7],M2=[0.30.8−0.4], |
N11=[0.1−0.2−0.1],N12=[0.05−0.1−0.03], |
N21=[−0.40.10.3],N22=[−0.10.020.07],μ=0.5,d=2, |
f(x(t))=[tanh(0.5x1(t)),tanh(0.4x2(t)),tanh(0.6x3(t))]T, |
g(x(t))=[tanh(0.3x1(t)),tanh(0.4x2(t)),tanh(0.2x3(t))]T, |
J1=0.5I3,J2=0.3I3,Θ1=Θ3=I3,Θ2=Θ4=−I3,w(t)=sin(t). |
By using the linear matrix inequality (LMI) toolbox in the MATLAB, we obtain the following solutions of inequality (3.1):
P1=[23.4405−7.37377.0525−7.373765.8658−20.94927.0525−20.949240.9154],P2=[21.2128−6.29397.4587−6.293961.5282−19.50707.4587−19.507038.4827], |
W1=[10.4452−3.21871.4795−3.218724.3005−7.12561.4795−7.125615.5240],W2=[5.7913−1.22002.4543−1.220016.4749−4.94762.4543−4.947610.7346], |
K1=[0.13660.0093−0.01880.00930.05500.0266−0.01880.02660.0902],K2=[0.13660.0093−0.01880.00930.05500.0266−0.01880.02660.0902], |
H=[76.637400059.824500045.2654]. |
For the initial values xm(0)=(−25,5,25)T and xs(0)=(30,−5,−25)T, Figure 1 is the Markovian jump process in different modes. Figure 2 is the state trajectories of error system (2.5), which shows that the error system is convergent and the master system synchronizes with the slave system. Figure 3 is the curve of the sliding mode surface, which shows that the state trajectories can arrive at the surface in a finite time interval.
In this paper, the master-slave synchronization for uncertain neural networks with time delay by using the sliding mode control method has been studied. An integral sliding mode surface and sliding mode controller was designed. Moreover, the state trajectories of the neural networks can reach the sliding mode surface in finite time under the action of the controller. Sufficient conditions in terms of linear matrix inequalities were presented to guarantee the neural networks asymptotical stability. Finally, an example was provided to illustrate the validity of the proposed design method. In the future, we will consider how to solve some physical problems by applying the obtained theoretical results.
The authors declare they have not used Artificial Intelligence (AI) tools in the creation of this article.
This work is supported by the National Natural Science Foundation (NNSF) of China under Grant 11602134.
The authors declare that they have no conflicts of interest.
[1] |
W. Zhou, H. Wang, Z. Wan, Ore image classification based on improved CNN, Comput. Electr. Eng., 99 (2022), 107819. https://doi.org/10.1016/j.compeleceng.2022.107819 doi: 10.1016/j.compeleceng.2022.107819
![]() |
[2] |
S. S. Amiripallia, G. N. Rao, J. Beharaa, K. Sanjay, Mineral rock classification using convolutional neural network, Adv. Parallel Comput., 39 (2021), 499–505. https://doi.org/10.3233/APC210235 doi: 10.3233/APC210235
![]() |
[3] |
X. Liu, H. Wang, H. Jing, A. Shao, L. Wang, Research on intelligent identification of rock types based on Faster R-CNN method, IEEE Access, 8 (2020), 21804–21812. https://doi.org/10.1109/ACCESS.2020.2968515 doi: 10.1109/ACCESS.2020.2968515
![]() |
[4] |
S. Karimpouli, P. Tahmasebi, Segmentation of digital rock images using deep convolutional autoencoder networks, Comput. Geosci., 126 (2019), 142–150. https://doi.org/10.1016/j.cageo.2019.02.003 doi: 10.1016/j.cageo.2019.02.003
![]() |
[5] |
J. Maitre, K. Bouchard, L. P. Bédard, Mineral grains recognition using computer vision and machine learning, Comput. Geosci., 130 (2019), 84–93. https://doi.org/10.1016/j.cageo.2019.05.009 doi: 10.1016/j.cageo.2019.05.009
![]() |
[6] |
M. He, Z. Zhang, J. Ren, J. Huan, G. Li, Y. Chen, et al., Deep convolutional neural network for fast determination of the rock strength parameters using drilling data, Int. J. Rock Mech. Min. Sci., 123 (2019), 104084. https://doi.org/10.1016/j.ijrmms.2019.104084 doi: 10.1016/j.ijrmms.2019.104084
![]() |
[7] |
F. Alzubaidi, P. Mostaghimi, P. Swietojanski, S. R. Clark, R. T. Armstrong, Automated lithology classification from drill core images using convolutional neural networks, J. Pet. Sci. Eng., 197 (2021), 107933. https://doi.org/10.1016/j.petrol.2020.107933 doi: 10.1016/j.petrol.2020.107933
![]() |
[8] | F. Zeng, A. Jacobson, D. Smith, N. Boswell, T. Peynot, M. Milford, Lookup: Vision-only real-time precise underground localisation for autonomous mining vehicles, In: 2019 International conference on robotics and automation (ICRA), IEEE, 2019, 1444–1450. https://doi.org/10.1109/ICRA.2019.8794453 |
[9] |
T. Chen, N. Hu, R. Niu, N. Zhen, A. Plaza, Object-oriented open-pit mine mapping using Gaofen-2 satellite image and convolutional neural network, for the Yuzhou City, China, Remote Sens., 12 (2020), 3895. https://doi.org/10.3390/rs12233895 doi: 10.3390/rs12233895
![]() |
[10] |
J. Baek, Y. Choi, Deep neural network for predicting ore production by truck-haulage systems in open-pit mines, Appl. Sci., 10 (2020), 1657. https://doi.org/10.3390/app10051657 doi: 10.3390/app10051657
![]() |
[11] |
J. Williams, J. Singh, M. Kumral, J. Ramirez Ruiseco, Exploring deep learning for dig-limit optimization in open-pit mines, Nat. Resour. Res., 30 (2021), 2085–2101. https://doi.org/10.1007/s11053-021-09864-y doi: 10.1007/s11053-021-09864-y
![]() |
[12] |
T. Vu, T. Bao, Q. V. Hoang, C. Drebenstetd, P. V. Hoa, H. H. Thang, Measuring blast fragmentation at Nui Phao open-pit mine, Vietnam using the Mask R-CNN deep learning model, Min. Technol., 130 (2021), 232–243. https://doi.org/10.1080/25726668.2021.1944458 doi: 10.1080/25726668.2021.1944458
![]() |
[13] | G. Somua-Gyimah, S. Frimpong, W. Nyaaba, E. Gbadam, A computer vision system for terrain recognition and object detection tasks in mining and construction environments, In: SME Annual Conference, 2019. |
[14] |
R. Gao, Z. Sun, W. Li, L. Pei, Y. Hu, L. Xiao, Automatic coal and gangue segmentation using U-Net based fully convolutional networks, Energies, 13 (2020), 829. https://doi.org/10.3390/en13040829 doi: 10.3390/en13040829
![]() |
[15] |
X. Liu, Y. Zhang, H. Jing, L. Wang, S. Zhao, Ore image segmentation method using U-Net and Res_Unet convolutional networks, RSC Adv., 10 (2020), 9396–9406. https://doi.org/10.1039/C9RA05877J doi: 10.1039/C9RA05877J
![]() |
[16] | L. Si, X. Xiong, Z. Wang, C. Tan, A deep convolutional neural network model for intelligent discrimination between coal and rocks in coal mining face, Math. Probl. Eng., 2020. https://doi.org/10.1155/2020/2616510 |
[17] |
C. Su, S. Xu, K. Zhu, X. Zhang, Rock classification in petrographic thin section images based on concatenated convolutional neural networks, Earth Sci. Inform., 13 (2020), 1477–1484. https://doi.org/10.1007/s12145-020-00505-1 doi: 10.1007/s12145-020-00505-1
![]() |
[18] | V. Zyuzin, M. Ronkin, S. Porshnev, A. Kalmykov, Computer vision system for the automatic asbestos content control in stones, In: Journal of Physics: Conference Series, vol. 1727, IOP Publishing, 2021, 012014. 10.1088/1742-6596/1727/1/012014 |
[19] |
A. Azizi, H. Moomivand, A new approach to represent impact of discontinuity spacing and rock mass description on the median fragment size of blasted rocks using image analysis of rock mass, Rock Mech. Rock Eng., 54 (2021), 2013–2038. https://doi.org/10.1007/s00603-020-02360-4 doi: 10.1007/s00603-020-02360-4
![]() |
[20] |
S. Shrivastava, S. Bhattacharjee, D. Deb, Segmentation of mine overburden dump particles from images using Mask R CNN, Sci. Rep., 13 (2023), 2046. https://doi.org/10.1038/s41598-023-28586-0 doi: 10.1038/s41598-023-28586-0
![]() |
[21] |
M. Babaeian, M. Ataei, F. Sereshki, F. Sotoudeh, S. Mohammadi, A new framework for evaluation of rock fragmentation in open pit mines, J. Rock Mech. Geotech. Eng., 11 (2019), 325–336. https://doi.org/10.1016/j.jrmge.2018.11.006 doi: 10.1016/j.jrmge.2018.11.006
![]() |
[22] |
S. Mkwelo, V. Nicolls, G. De Jager, Watershed-based segmentation of rock scenes and proximity-based classification of watershed regions under uncontrolled lighting, SAIEE Afr. Res. J., 96 (2005), 28–34. https://doi.org/10.23919/SAIEE.2005.9488146 doi: 10.23919/SAIEE.2005.9488146
![]() |
[23] |
T. Bamford, K. Esmaeili, A. P. Schoellig, A deep learning approach for rock fragmentation analysis, Int. J. Rock Mech. Min. Sci., 145 (2021), 104839. https://doi.org/10.1016/j.ijrmms.2021.104839 doi: 10.1016/j.ijrmms.2021.104839
![]() |
[24] |
D. Jung, Y. Choi, Systematic review of machine learning applications in mining: exploration, exploitation, and reclamation, Minerals, 11 (2021), 148. https://doi.org/10.3390/min11020148 doi: 10.3390/min11020148
![]() |
[25] | J. A. Franklin, T. Katsabanis, Measurement of blast fragmentation, Rotterdam: CRC Press, 1996. |
[26] |
A. Tosun, A modified Wipfrag program for determining muckpile fragmentation, J. S. Afr. Inst. Min. Metall., 118 (2018), 1113–1199. https://doi.org/10.17159/2411-9717/2018/v118n10a13 doi: 10.17159/2411-9717/2018/v118n10a13
![]() |
[27] |
J. P. Latham, J. Kemeny, N. Maerz, M. Noy, J. Schleifer, S. Tose, A blind comparison between results of four image analysis systems using a photo-library of piles of sieved fragments, Fragblast, 7 (2003), 105–132. https://doi.org/10.1076/frag.7.2.105.15899 doi: 10.1076/frag.7.2.105.15899
![]() |
[28] |
Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, et al., Backpropagation applied to handwritten zip code recognition, Neural Comput., 1 (1989), 541–551. https://doi.org/10.1162/neco.1989.1.4.541 doi: 10.1162/neco.1989.1.4.541
![]() |
[29] | Y. LeCun, B. Boser, J. Denker, D. Henderson, R. Howard, W. Hubbard, et al., Handwritten digit recognition with a back-propagation network, In: Advances in Neural Information Processing Systems (Ed. D. Touretzky), vol. 2, Morgan-Kaufmann, 1989. |
[30] |
C. Lu, Z. Wang, B. Zhou, Intelligent fault diagnosis of rolling bearing using hierarchical convolutional network based health state classification, Mech. Syst. Signal Process., 32 (2017), 139–151. https://doi.org/10.1016/j.aei.2017.02.005 doi: 10.1016/j.aei.2017.02.005
![]() |
[31] |
W. Zhang, C. Li, G. Peng, Y. Chen, Z. Zhang, A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load, Mech. Syst. Signal Process., 100 (2018), 439–453. https://doi.org/10.1016/j.ymssp.2017.06.022 doi: 10.1016/j.ymssp.2017.06.022
![]() |
[32] |
Y. J. Cha, W. Choi, O. Büyüköztürk, Deep learning-based crack damage detection using convolutional neural networks, Comput. Aided Civ. Infrastruct. Eng., 32 (2017), 361–378. https://doi.org/10.1111/mice.12263 doi: 10.1111/mice.12263
![]() |
[33] |
H. V. Dang, M. Raza, T. V. Nguyen, T. Bui-Tien, H. X. Nguyen, Deep learning-based detection of structural damage using time-series data, Struct. Infrastruct. Eng., 17 (2021), 1474–1493. https://doi.org/10.1080/15732479.2020.1815225 doi: 10.1080/15732479.2020.1815225
![]() |
[34] |
F. Yessoufou, J. Zhu, One-class convolutional neural network (OC-CNN) model for rapid bridge damage detection using bridge response data, KSCE J. Civ. Eng., 27 (2023), 1640–1660. https://doi.org/10.1007/s12205-023-0063-7 doi: 10.1007/s12205-023-0063-7
![]() |
[35] |
D. Ai, J. Cheng, A deep learning approach for electromechanical impedance based concrete structural damage quantification using two-dimensional convolutional neural network, Mech. Syst. Signal Pr., 183 (2023), 109634. https://doi.org/10.1016/j.ymssp.2022.109634 doi: 10.1016/j.ymssp.2022.109634
![]() |
[36] |
Y. LeCun, L. Bottou, Y. Bengio, P. Haffner, Gradient-based learning applied to document recognition, Proc. IEEE, 86 (1998), 2278–2324. https://doi.org/10.1109/5.726791 doi: 10.1109/5.726791
![]() |
[37] | I. Goodfellow, Y. Bengio, A. Courville, Deep Learning, Cambridge, MA: MIT Press, 2016. |
[38] | A. Zhang, Z. C. Lipton, M. Li, A. J. Smola, Dive into deep learning, (2023). https://doi.org/10.48550/arXiv.2106.11342 |
[39] |
H. Li, C. Pan, A. Chen, Z. Wulamu, A. Yang, Ore image segmentation method based on U-Net and Watershed, Comput. Mater. Contin., 65 (2020), 563–578. https://doi.org/10.32604/cmc.2020.09806 doi: 10.32604/cmc.2020.09806
![]() |
[40] |
D. Yang, X. Wang, H. Zhang, Z. Yin, D. Su, J. Xu, A Mask R-CNN based particle identification for quantitative shape evaluation of granular materials, Powder Technol., 392 (2021), 296–305. https://doi.org/10.1016/j.powtec.2021.07.005 doi: 10.1016/j.powtec.2021.07.005
![]() |
[41] |
M. Li, X. Wang, H. Yao, H. Saxén, Y. Yu, Analysis of particle size distribution of coke on blast furnace belt using object detection, Processes, 10 (2022), 1902. https://doi.org/10.3390/pr10101902 doi: 10.3390/pr10101902
![]() |
[42] | M. Ronkin, A. Kalmykov, K. Reshetnikov, V. Zyuzin, Investigation of object detection based method for open-pit blast quality estimation, In: 2022 Ural-Siberian Conference on Biomedical Engineering, Radioelectronics and Information Technology (USBEREIT), IEEE, 2022,248–251. https://doi.org/10.1109/USBEREIT56278.2022.9923353 |
[43] |
G. Xue, S. Li, P. Hou, S. Gao, R. Tan, Research on lightweight Yolo coal gangue detection algorithm based on resnet18 backbone feature network, Internet Things, 22 (2023), 100762. https://doi.org/10.1016/j.iot.2023.100762 doi: 10.1016/j.iot.2023.100762
![]() |
[44] | A. K. Sangaiah, Deep learning and parallel computing environment for bioengineering systems, St. Louis, MO: Academic Press, 2019. |
[45] | S. Beucher, Use of watersheds in contour detection, In: Proceedings of the International Workshop on Image Processing, CCETT, 1979. |
[46] |
Z. Yang, H. Ding, L. Guo, M. Lian, Superpixel image segmentation-based particle size distribution analysis of fragmented rock, IEEE Access, 9 (2021), 59048–59058. https://doi.org/10.1109/ACCESS.2021.3072998 doi: 10.1109/ACCESS.2021.3072998
![]() |
[47] |
Q. Guo, Y. Wang, S. Yang, Z. Xiang, A method of blasted rock image segmentation based on improved watershed algorithm, Sci. Rep., 12 (2022), 7143. https://doi.org/10.1038/s41598-022-11351-0 doi: 10.1038/s41598-022-11351-0
![]() |
[48] | O. Ronneberger, P. Fischer, T. Brox, U-Net: Convolutional networks for biomedical image segmentation, In: International Conference on Medical image computing and computer-assisted intervention, Springer, 2015,234–241. https://doi.org/10.1007/978-3-319-24574-4_28 |
[49] |
N. Siddique, S. Paheding, C. P. Elkin, V. Devabhaktuni, U-Net and its variants for medical image segmentation: A review of theory and applications, IEEE Access, 9 (2021), 82031–82057. https://doi.org/10.1109/ACCESS.2021.3086020 doi: 10.1109/ACCESS.2021.3086020
![]() |
[50] |
X. X. Yin, L. Sun, Y. Fu, R. Lu, Y. Zhang, U-Net-based medical image segmentation, J. Healthc. Eng., 2022 (2022), 4189781. https://doi.org/10.1155/2022/4189781 doi: 10.1155/2022/4189781
![]() |
[51] |
J. Wu, Y. Guo, F. Gou, Z. Dai, A medical assistant segmentation method for MRI images of osteosarcoma based on DecoupleSegNet, Int. J. Intell. Syst., 37 (2022), 8436–8461. https://doi.org/10.1002/int.22949 doi: 10.1002/int.22949
![]() |
[52] |
Z. Ling, S. Yang, F. Gou, Z. Dai, J. Wu, Intelligent assistant diagnosis system of osteosarcoma mri image based on transformer and convolution in developing countries, IEEE J. Biomed. Health Inform., 26 (2022), 5563–5574. https://doi.org/10.1109/JBHI.2022.3196043 doi: 10.1109/JBHI.2022.3196043
![]() |
[53] |
Z. Zhou, F. Gou, Y. Tan, J. Wu, A cascaded multi-stage framework for automatic detection and segmentation of pulmonary nodules in developing countries, IEEE J. Biomed. Health Inform., 26 (2022), 5619–5630. https://doi.org/10.1109/JBHI.2022.3198509 doi: 10.1109/JBHI.2022.3198509
![]() |
[54] | J. Wu, W. Liu, C. Li, T. Jiang, I. M. Shariful, H. Sun, et al., A state-of-the-art survey of U-Net in microscopic image analysis: from simple usage to structure mortification, (2022). https://doi.org/10.48550/arXiv.2202.06465 |
[55] |
W. Qiao, Y. Zhao, Y. Xu, Y. Lei, Y. Wang, S. Yu, et al., Deep learning-based pixel-level rock fragment recognition during tunnel excavation using instance segmentation model, Tunn. Undergr. Space Technol., 115 (2021), 104072. https://doi.org/10.1016/j.tust.2021.104072 doi: 10.1016/j.tust.2021.104072
![]() |
[56] |
Z. Xue, L. Chen, Z. Liu, F. Lin, W. Mao, Rock segmentation visual system for assisting driving in tbm construction, Mach. Vis. Appl., 32 (2021), 77. https://doi.org/10.1007/s00138-021-01203-8 doi: 10.1007/s00138-021-01203-8
![]() |
[57] |
X. Zhou, Q. Gong, Y. Liu, L. Yin, Automatic segmentation of tbm muck images via a deep-learning approach to estimate the size and shape of rock chips, Autom. Constr., 126 (2021), 103685. https://doi.org/10.1016/j.autcon.2021.103685 doi: 10.1016/j.autcon.2021.103685
![]() |
[58] |
W. Wang, Q. Li, C. Xiao, D. Zhang, L. Miao, L. Wang, An improved boundary-aware U-Net for ore image semantic segmentation, Sensors, 21 (2021), 2615. https://doi.org/10.3390/s21082615 doi: 10.3390/s21082615
![]() |
[59] |
D. Xiao, X. Liu, B. T. Le, Z. Ji, X. Sun, An ore image segmentation method based on RDU-Net model, Sensors, 20 (2020), 4979. https://doi.org/10.3390/s20174979 doi: 10.3390/s20174979
![]() |
[60] |
J. Chen, M. Zhou, H. Huang, D. Zhang, Z. Peng, Automated extraction and evaluation of fracture trace maps from rock tunnel face images via deep learning, Int. J. Rock Mech. Min. Sci., 142 (2021), 104745. https://doi.org/10.1016/j.ijrmms.2021.104745 doi: 10.1016/j.ijrmms.2021.104745
![]() |
[61] |
W. Gu, S. Bai, L. Kong, A review on 2D instance segmentation based on deep neural networks, Image Vis. Comput., 120 (2022), 104401. https://doi.org/10.1016/j.imavis.2022.104401 doi: 10.1016/j.imavis.2022.104401
![]() |
[62] |
A. M. Hafiz, G. M. Bhat, A survey on instance segmentation: state of the art, Int. J. Multimed. Inf. Retr., 9 (2020), 171–189. https://doi.org/10.1007/s13735-020-00195-x doi: 10.1007/s13735-020-00195-x
![]() |
[63] | K. He, G. Gkioxari, P. Dollár, R. Girshick, Mask R-CNN, In: 2017 IEEE International Conference on Computer Vision (ICCV), 2017, 2980–2988. https://doi.org/10.1109/ICCV.2017.322 |
[64] | K. He, X. Zhang, S. Ren, J. Sun, Deep residual learning for image recognition, In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016,770–778. https://doi.org/10.1109/CVPR.2016.90 |
[65] | S. Ramesh C., A review on instance segmentation using mask R-CNN, In: Proceedings of the International Conference on Systems, Energy & Environment (ICSEE), 2021. |
[66] | F. Schenk, A. Tscharf, G. Mayer, F. Fraundorfer, Automatic muck pile characterization from UAV images, In: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. IV-2/W5, 2019,163–170. https://doi.org/10.5194/isprs-annals-IV-2-W5-163-2019 |
[67] |
V. Zyuzin, M. Ronkin, S. Porshnev, A. Kalmykov, Automatic asbestos control using deep learning based computer vision system, Appl. Sci., 11 (2021), 10532. https://doi.org/10.3390/app112210532 doi: 10.3390/app112210532
![]() |
[68] |
S. Shrivastava, D. Deb, S. Bhattacharjee, Prediction of particle size distribution curves of dump materials using convolutional neural networks, Rock Mech. Rock Eng., 55 (2022), 471–479. https://doi.org/10.1007/s00603-021-02657-y doi: 10.1007/s00603-021-02657-y
![]() |
[69] | L. Fu, X. Xu, F. Jin, H. Zhou, Evaluation of the particle size distribution of on-site rockfill using mask r-cnn deep learning model, In: 2021 7th International Conference on Hydraulic and Civil Engineering & Smart Water Conservancy and Intelligent Disaster Reduction Forum (ICHCE & SWIDR), 2021,291–297. https://doi.org/10.1109/ICHCESWIDR54323.2021.9656248 |
[70] |
H. Fan, Z. Tian, X. Xu, X. Sun, Y. Ma, H. Liu, et al., Rockfill material segmentation and gradation calculation based on deep learning, Case Stud. Constr. Mater., 17 (2022), e01216. https://doi.org/10.1016/j.cscm.2022.e01216 doi: 10.1016/j.cscm.2022.e01216
![]() |
[71] |
H. Huang, J. Luo, E. Tutumluer, J. M. Hart, A. J. Stolba, Automated segmentation and morphological analyses of stockpile aggregate images using deep convolutional neural networks, Transp. Res. Rec., 2674 (2020), 285–298. https://doi.org/10.1177/0361198120943887 doi: 10.1177/0361198120943887
![]() |
[72] | J. Redmon, S. Divvala, R. Girshick, A. Farhadi, You only look once: Unified, real-time object detection, In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016,779–788. https://doi.org/10.1109/CVPR.2016.91 |
[73] | J. Redmon, A. Farhadi, YOLOv3: An incremental improvement, (2018). https://doi.org/10.48550/arXiv.1804.02767 |
[74] | A. Bochkovskiy, C. Y. Wang, H. Y. M. Liao, YOLOv4: Optimal speed and accuracy of object detection, (2020). https://doi.org/10.48550/arXiv.2004.10934 |
[75] | T. Diwan, G. Anirudh, J. V. Tembhurne, Object detection using YOLO: Challenges, architectural successors, datasets and applications, Multimed. Tools Appl., 82 (2023) 9243–9275. https://doi.org/10.1007/s11042-022-13644-y |
[76] |
P. Jiang, D. Ergu, F. Liu, Y. Cai, B. Ma, A review of Yolo algorithm developments, Procedia Comput. Sci., 199 (2022), 1066–1073. https://doi.org/10.1016/j.procs.2022.01.135 doi: 10.1016/j.procs.2022.01.135
![]() |
[77] |
D. Li, G. Wang, Y. Zhang, S. Wang, Coal gangue detection and recognition algorithm based on deformable convolution YOLOv3, IET Image Process., 16 (2022), 134–144. https://doi.org/10.1049/ipr2.12339 doi: 10.1049/ipr2.12339
![]() |
[78] |
X. Wang, Y. Guo, Y. Yu, An appropriate approach to recognize coke size distribution in a blast furnace, Processes, 11 (2023), 187. https://doi.org/10.3390/pr11010187 doi: 10.3390/pr11010187
![]() |
[79] |
H. Pan, Y. Shi, X. Lei, Z. Wang, F. Xin, Fast identification model for coal and gangue based on the improved tiny YOLO v3, J. Real-Time Image Proc., 19 (2022), 687–701. https://doi.org/10.1007/s11554-022-01215-1 doi: 10.1007/s11554-022-01215-1
![]() |
[80] | J. Terven, D. Cordova-Esparza, A comprehensive review of YOLO: From YOLOv1 and beyond, (2023). https://doi.org/10.48550/arXiv.2304.00501 |
[81] |
Z. Yang, B. He, Y. Liu, D. Wang, G. Zhu, Classification of rock fragments produced by tunnel boring machine using convolutional neural networks, Autom. Constr., 125 (2021), 103612. https://doi.org/10.1016/j.autcon.2021.103612 doi: 10.1016/j.autcon.2021.103612
![]() |
[82] |
L. E. Olivier, M. G. Maritz, I. K. Craig, Estimating ore particle size distribution using a deep convolutional neural network, IFAC-PapersOnLine, 53 (2020), 12038–12043. https://doi.org/10.1016/j.ifacol.2020.12.740 doi: 10.1016/j.ifacol.2020.12.740
![]() |
[83] |
J. Chen, T. Yang, D. Zhang, H. Huang, Y. Tian, Deep learning based classification of rock structure of tunnel face, Geosci. Front., 12 (2021), 395–404. https://doi.org/10.1016/j.gsf.2020.04.003 doi: 10.1016/j.gsf.2020.04.003
![]() |
[84] | D. Bolya, C. Zhou, F. Xiao, Y. J. Lee, Yolact: Real-time instance segmentation, In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 2019, 9156–9165. https://doi.org/10.1109/ICCV.2019.00925 |
[85] | T. Cheng, X. Wang, S. Chen, W. Zhang, Q. Zhang, C. Huang, et al., Sparse instance activation for real-time instance segmentation, In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, 4433–4442. https://doi.org/10.1109/CVPR52688.2022.00439 |
[86] | C. Y. Wang, A. Bochkovskiy, H. Y. M. Liao, Yolov7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors, In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, 7464–7475. |
[87] | M. Tan, Q. Le, EfficientNet: Rethinking model scaling for convolutional neural networks, In: International conference on machine learning, PMLR, 2019, 6105–6114. |
[88] | M. Tan, Q. Le, EfficientNetv2: Smaller models and faster training, In: International Conference on Machine Learning, PMLR, 2021, 10096–10106. |
[89] | A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, et al., MobileNets: Efficient convolutional neural networks for mobile vision applications, (2017). https://doi.org/10.48550/arXiv.1704.04861 |
[90] | M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, L. C. Chen, Mobilenetv2: Inverted residuals and linear bottlenecks, In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, 4510–4520. https://doi.org/10.1109/CVPR.2018.00474 |
[91] | A. Howard, M. Sandler, G. Chu, L. C. Chen, B. Chen, M. Tan, et al., Searching for MobileNetV3, In: Proceedings of the IEEE/CVF international conference on computer vision, 2019, 1314–1324. https://doi.org/10.1109/ICCV.2019.00140 |
[92] | S. Mehta, M. Rastegari, MobileViT: Light-weight, general-purpose, and mobile-friendly vision transformer, (2022). https://doi.org/10.48550/arXiv.2110.02178 |
[93] | K. He, X. Zhang, S. Ren, J. Sun, Identity mappings in deep residual networks, In: European conference on computer vision, Springer, 2016,630–645. https://doi.org/10.1007/978-3-319-46493-0_38 |
[94] | A. Supani, Y. Andriani, H. Indarto, Enhancing deeper layers with residual network on CNN architecture: A review, In: Proceedings of the 6th FIRST 2022 International Conference (FIRST 2022), vol. 14, Springer Nature, 2023,449. https://doi.org/10.2991/978-94-6463-118-0_46 |
[95] | H. Naveed, S. Anwar, M. Hayat, K. Javed, A. Mian, Survey: Image mixing and deleting for data augmentation, (2023). https://doi.org/10.48550/arXiv.2106.07085. |
[96] | J. L. Ba, J. R. Kiros, G. E. Hinton, Layer normalization, (2016). https://doi.org/10.48550/arXiv.1607.06450 |
[97] |
T. M. Hospedales, A. Antoniou, P. Micaelli, A. J. Storkey, Meta-learning in neural networks: A survey, IEEE Trans. Pattern Anal. Mach. Intell., 44 (2022), 5149–5169. https://doi.org/10.1109/TPAMI.2021.3079209 doi: 10.1109/TPAMI.2021.3079209
![]() |
[98] | C. J. Holder, M. Shafique, On efficient real-time semantic segmentation: A survey, (2022). https://doi.org/10.48550/arXiv.2206.08605 |
[99] | J. Xu, Z. Xiong, S. P. Bhattacharyya, PIDNet: A real-time semantic segmentation network inspired by PID controllers, In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, 19529–19539. |
[100] | J. Peng, Y. Liu, S. Tang, Y. Hao, L. Chu, G. Chen, et al., PP-LiteSeg: A superior real-time semantic segmentation model, (2022). https://doi.org/10.48550/arXiv.2204.02681 |
[101] | C. Li, L. Li, H. Jiang, K. Weng, Y. Geng, L. Li, et al., YOLOv6: A single-stage object detection framework for industrial applications, (2022). https://doi.org/10.48550/arXiv.2209.02976 |
[102] | C. Li, L. Li, Y. Geng, H. Jiang, M. Cheng, B. Zhang, et al., YOLOv6 v3.0: A full-scale reloading, (2023). https://doi.org/10.48550/arXiv.2301.05586 |
[103] |
D. Bolya, C. Zhou, F. Xiao, Y. J. Lee, Yolact++ better real-time instance segmentation, IEEE Trans. Pattern Anal. Mach. Intell., 44 (2022), 1108–1121. https://doi.org/10.1109/TPAMI.2020.3014297. doi: 10.1109/TPAMI.2020.3014297
![]() |
[104] | X. Wang, R. Zhang, T. Kong, L. Li, C. Shen, SOLOv2: Dynamic and fast instance segmentation, In: Advances in Neural Information Processing Systems (Eds. H. Larochelle, M. Ranzato, R. Hadsell, M. Balcan and H. Lin), vol. 33, Curran Associates, Inc., 2020, 17721–17732. |
[105] | X. Wang, T. Kong, C. Shen, Y. Jiang, L. Li, Solo: Segmenting objects by locations, In: European Conference on Computer Vision, Springer, 2020,649–665. https://doi.org/10.1007/978-3-030-58523-5_38 |
[106] | J. He, P. Li, Y. Geng, X. Xie, FastInst: A simple query-based model for real-time instance segmentation, In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, 23663–23672. |
[107] | C. Lyu, W. Zhang, H. Huang, Y. Zhou, Y. Wang, Y. Liu, et al., RTMDet: An empirical study of designing real-time object detectors, (2022). https://doi.org/10.48550/arXiv.2212.07784 |
[108] | T. He, Z. Zhang, H. Zhang, Z. Zhang, J. Xie, M. Li, Bag of tricks for image classification with convolutional neural networks, In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019,558–567. https://doi.org/10.1109/CVPR.2019.00065 |
[109] |
B. Bischl, M. Binder, M. Lang, T. Pielok, J. Richter, S. Coors, et al., Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges, WIREs Data Min. Knowl. Discov., 13 (2023), e1484. https://doi.org/10.1002/widm.1484 doi: 10.1002/widm.1484
![]() |
[110] | A. Kirillov, E. Mintun, N. Ravi, H. Mao, C. Rolland, L. Gustafson, et al., Segment Anything, (2023). https://doi.org/10.48550/arXiv.2304.02643 |
[111] | Z. Gu, H. Chen, Z. Xu, J. Lan, C. Meng, W. Wang, DiffusionInst: Diffusion model for instance segmentation, (2022). https://doi.org/10.48550/arXiv.2212.02773 |
[112] | T. Amit, T. Shaharbany, E. Nachmani, L. Wolf, SegDiff: Image segmentation with diffusion probabilistic models, (2022). https://doi.org/10.48550/arXiv.2112.00390 |
[113] | W. Wu, Y. Zhao, M. Z. Shou, H. Zhou, C. Shen, DiffuMask: Synthesizing images with pixel-level annotations for semantic segmentation using diffusion models, (2023). https://doi.org/10.48550/arXiv.2303.11681 |
[114] | A. Gholami, S. Kim, Z. Dong, Z. Yao, M. W. Mahoney, K. Keutzer, A survey of quantization methods for efficient neural network inference, In: Low-Power Computer Vision, Chapman and Hall/CRC, 2022,291–326. |
[115] |
T. Liang, J. Glossner, L. Wang, S. Shi, X. Zhang, Pruning and quantization for deep neural network acceleration: A survey, Neurocomputing, 461 (2021), 370–403. https://doi.org/10.1016/j.neucom.2021.07.045 doi: 10.1016/j.neucom.2021.07.045
![]() |
[116] | M. Rakka, M. E. Fouda, P. Khargonekar, F. Kurdahi, Mixed-precision neural networks: A survey, (2022). https://doi.org/10.48550/arXiv.2208.06064 |
[117] | R. Tian, Z. Zhao, W. Liu, H. Liu, W. Mao, Z. Zhao, SAMP: A toolkit for model inference with self-adaptive mixed-precision, (2022). https://doi.org/10.48550/arXiv.2209.09130 |
[118] | NVIDIA Corporation: A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch, 2022. Available from: https://github.com/nvidia/apex. |
[119] | Linux Foundation: Automatic Mixed Precision package - torch.amp, 2022. Available from: https://pytorch.org/docs/stable/amp.html. |
[120] | T. Honka, Automatic Mixed Precision Quantization of Neural Networks using Iterative Correlation Coefficient Adaptation, PhD thesis, Tampere University, (2021). |
[121] | C. Pham-Quoc, X. Q. Nguyen, T. N. Thinh, Hardware/software co-design for convolutional neural networks acceleration: A survey and open issues, In: Context-Aware Systems and Applications (Eds. P. Cong Vinh, A. Rakib), Springer International Publishing, Cham, 2021,164–178. https://doi.org/10.1007/978-3-030-93179-7_13 |
[122] |
J. Gou, B. Yu, S. J. Maybank, D. Tao, Knowledge distillation: A survey, Int. J. Comput. Vis., 129 (2021), 1789–1819. https://doi.org/10.1007/s11263-021-01453-z doi: 10.1007/s11263-021-01453-z
![]() |
[123] | W. Xu, Y. Zhang, X. Tang, Parallelizing DNN training on GPUs: Challenges and opportunities, In: Companion Proceedings of the Web Conference 2021, WWW '21, Association for Computing Machinery, New York, NY, USA, 2021,174–178. https://doi.org/10.1145/3442442.3452055 |
[124] |
Y. Fu, C. Aldrich, Online particle size analysis on conveyor belts with dense convolutional neural networks, Miner. Eng., 193 (2023), 108019. https://doi.org/10.1016/j.mineng.2023.108019 doi: 10.1016/j.mineng.2023.108019
![]() |
[125] |
H. Li, G. Asbjörnsson, M. Lindqvist, Image process of rock size distribution using dexined-based neural network, Minerals, 11 (2021), 736. https://doi.org/10.3390/min11070736 doi: 10.3390/min11070736
![]() |
[126] | V. Suprunenko, Ore particles segmentation using deep learning methods, In: Journal of Physics: Conference Series, vol. 1679, IOP Publishing, 2020, 042089. https://doi.org/10.1088/1742-6596/1679/4/042089 |
[127] |
X. Ma, P. Zhang, X. Man, L. Ou, A new belt ore image segmentation method based on the convolutional neural network and the image-processing technology, Minerals, 10 (2020), 1115. https://doi.org/10.3390/min10121115 doi: 10.3390/min10121115
![]() |
[128] |
Y. Zhan, G. Zhang, An improved OTSU algorithm using histogram accumulation moment for ore segmentation, Symmetry, 11 (2019), 431. https://doi.org/10.3390/sym11030431 doi: 10.3390/sym11030431
![]() |
[129] | Z. Tungol, Y. Kawamura, I. Kitahara, H. D. Jang, Development of a remote rock fragmentation size distribution measurement system for surface mines using 3D photogrammetry, In: The 10th International Conference on Explosives and Blasting, 2019. |
[130] |
Y. Wang, W. Tu, H. Li, Fragmentation calculation method for blast muck piles in open-pit copper mines based on three-dimensional laser point cloud data, Int. J. Appl. Earth Obs. Geoinf., 100 (2021), 102338. https://doi.org/10.1016/j.jag.2021.102338 doi: 10.1016/j.jag.2021.102338
![]() |
[131] |
F. Bai, M. Fan, H. Yang, L. Dong, Image segmentation method for coal particle size distribution analysis, Particuology, 56 (2021), 163–170. https://doi.org/10.1016/j.partic.2020.10.002 doi: 10.1016/j.partic.2020.10.002
![]() |
[132] |
C. Xie, H. Nguyen, X. N. Bui, Y. Choi, J. Zhou, T. Nguyen-Trang, Predicting rock size distribution in mine blasting using various novel soft computing models based on meta-heuristics and machine learning algorithms, Geosci. Front., 12 (2021), 101108. https://doi.org/10.1016/j.gsf.2020.11.005 doi: 10.1016/j.gsf.2020.11.005
![]() |
[133] | T. Vu, T. Bao, Development of a predictive model of rock fragmentation for Nui Phao open-pit mine in vietnam using multiple-output neural networks and Monte Carlo dropout technique, Research Square, https://doi.org/10.21203/rs.3.rs-171960/v1 |
[134] |
N. Koteleva, S. Khokhlov, I. Frenkel, Digitalization in open-pit mining: A new approach in monitoring and control of rock fragmentation, Appl. Sci., 11 (2021), 10848. https://doi.org/10.3390/app112210848 doi: 10.3390/app112210848
![]() |
[135] |
W. Chen, X. Li, H. He, L. Wang, A review of fine-scale land use and land cover classification in open-pit mining areas by remote sensing techniques, Remote Sens., 10 (2017), 15. https://doi.org/10.3390/rs10010015 doi: 10.3390/rs10010015
![]() |
[136] |
A. Sayadi, M. Monjezi, N. Talebi, M. Khandelwal, A comparative study on the application of various artificial neural networks to simultaneous prediction of rock fragmentation and backbreak, J. Rock Mech. Geotech. Eng., 5 (2013), 318–324. https://doi.org/10.1016/j.jrmge.2013.05.007 doi: 10.1016/j.jrmge.2013.05.007
![]() |
[137] | F. I. Siddiqui, Measurement of size distribution of blasted rock using digital image processing, Eng. Sci., 20 (2009), 81–93. |
[138] |
S. H. Cho, M. Nishi, M. Yamamoto, K. Kaneko, Fragment size distribution in blasting, Mater. Trans., 44 (2003), 951–956. https://doi.org/10.2320/matertrans.44.951 doi: 10.2320/matertrans.44.951
![]() |
[139] | M. J. Thurley, Automated image segmentation and analysis of rock piles in an open-pit mine, In: 2013 International Conference on Digital Image Computing: Techniques and Applications (DICTA), IEEE, 2013, 1–8. https://doi.org/10.1109/DICTA.2013.6691484 |
[140] |
W. D. Lei, K. Li, X. P. Wang, Improved watershed segmentation method in rock fragmentation analysis on digital photos, Adv. Mater. Res., 261 (2011), 1734–1737. https://doi.org/10.4028/www.scientific.net/AMR.261-263.1734 doi: 10.4028/www.scientific.net/AMR.261-263.1734
![]() |
[141] |
W. Wang, Q. Li, D. Zhang, J. Fu, Image segmentation of adhesive ores based on MSBA-Unet and convex-hull defect detection, Eng. Appl. Artif. Intell., 123 (2023), 106185. https://doi.org/10.1016/j.engappai.2023.106185 doi: 10.1016/j.engappai.2023.106185
![]() |
[142] | X. Tang, X. Wang, N. Yan, S. Fu, W. Xiong, Q. Liao, A new ore image segmentation method based on Swin-Unet, In: 2022 China Automation Congress (CAC), IEEE, 2022, 1681–1686. https://doi.org/10.1109/CAC57257.2022.10055952 |
[143] |
W. Wang, C. Su, H. Zhang, Automatic segmentation of concrete aggregate using convolutional neural network, Autom. Constr., 134 (2022), 104106. https://doi.org/10.1016/j.autcon.2021.104106 doi: 10.1016/j.autcon.2021.104106
![]() |
[144] |
R. Amoako, A. Jha, S. Zhong, Rock fragmentation prediction using an artificial neural network and support vector regression hybrid approach, Mining, 2 (2022), 233–247. https://doi.org/10.3390/mining2020013 doi: 10.3390/mining2020013
![]() |
[145] | H. Li, X. Wang, C. Yang, W. Xiong, Ore image segmentation method based on GAN-UNet, Control Theory Appl. |
[146] |
Y. Liu, Z. Zhang, X. Liu, L. Wang, X. Xia, Ore image classification based on small deep learning model: Evaluation and optimization of model depth, model structure and data size, Miner. Eng., 172 (2021), 107020. https://doi.org/10.1016/j.mineng.2021.107020 doi: 10.1016/j.mineng.2021.107020
![]() |
[147] |
J. Duan, X. Liu, X. Wu, C. Mao, Detection and segmentation of iron ore green pellets in images using lightweight u-net deep learning network, Neural Comput. Appl., 32 (2020), 5775–5790. https://doi.org/10.1007/s00521-019-04045-8 doi: 10.1007/s00521-019-04045-8
![]() |
[148] |
F. Sereshki, S. Hoseini, M. Ataei, Blast fragmentation analysis using image processing, Int. J. Min. Geo-Eng., 50 (2016), 211–218. http://dx.doi.org/10.22059/ijmge.2016.59831 doi: 10.22059/ijmge.2016.59831
![]() |
[149] |
H. Yaghoobi, H. Mansouri, M. A. E. Farsangi, H. Nezamabadi-Pour, Determining the fragmented rock size distribution using textural feature extraction of images, Powder Technol., 342 (2019), 630–641. https://doi.org/10.1016/j.powtec.2018.10.006 doi: 10.1016/j.powtec.2018.10.006
![]() |
[150] | M. Firla, P. Lipnicki, D. Lewandowski, Image processing algorithm for the assessment of the ore fragmentation size distribution, In: 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), IEEE, 2019,505–512. https://doi.org/10.1109/ETFA.2019.8869462 |
[151] | M. Liancheng, Y. ZHANG, S. Guoqing, M. Zhen, L. Tianqi, Ore granularity detection and analysis system based on image processing, In: 2019 Chinese Control And Decision Conference (CCDC), IEEE, 2019,359–366. https://doi.org/10.1109/CCDC.2019.8832862 |
[152] |
H. Chen, Y. Jin, G. Li, B. Chu, Automated cement fragment image segmentation and distribution estimation via a holistically-nested convolutional network and morphological analysis, Powder Technol., 339 (2018), 306–313. https://doi.org/10.1016/j.powtec.2018.08.015 doi: 10.1016/j.powtec.2018.08.015
![]() |
[153] | R. Wang, W. Zhang, L. Shao, Research of ore particle size detection based on image processing, In: Proceedings of 2017 Chinese Intelligent Systems Conference: Volume II, Springer, 2018,505–514. https://doi.org/10.1007/978-981-10-6499-9_48 |
[154] |
X. Liu, C. Mao, W. Sun, X. Wu, Image-based method for measuring pellet size distribution in the stable area of disc pelletizer, ISIJ Int., 58 (2018), 2088–2094. https://doi.org/10.2355/isijinternational.ISIJINT-2018-384 doi: 10.2355/isijinternational.ISIJINT-2018-384
![]() |
[155] |
M. Heydari, R. Amirfattahi, B. Nazari, P. Rahimi, An industrial image processing-based approach for estimation of iron ore green pellet size distribution, Powder Technol., 303 (2016), 260–268. https://doi.org/10.1016/j.powtec.2016.09.020 doi: 10.1016/j.powtec.2016.09.020
![]() |
[156] | M. Roy, R. Paswan, M. Sarim, S. Kumar, R. R. Jha, P. Singh, Rock fragmentation by blasting – a review, J. Mines Met. Fuels, 64 (2016), 424–431. |
[157] |
E. Ebrahimi, M. Monjezi, M. R. Khalesi, D. J. Armaghani, Prediction and optimization of back-break and rock fragmentation using an artificial neural network and a bee colony algorithm, Bull. Eng. Geol. Environ., 75 (2016), 27–36. https://doi.org/10.1007/s10064-015-0720-2 doi: 10.1007/s10064-015-0720-2
![]() |
[158] |
I. Enayatollahi, A. Aghajani Bazzazi, A. Asadi, Comparison between neural networks and multiple regression analysis to predict rock fragmentation in open-pit mines, Rock Mech. Rock Eng., 47 (2014), 799–807. https://doi.org/10.1007/s00603-013-0415-6 doi: 10.1007/s00603-013-0415-6
![]() |
[159] |
F. Faramarzi, H. Mansouri, M. E. Farsangi, A rock engineering systems based model to predict rock fragmentation by blasting, Int. J. Rock Mech. Min. Sci., 60 (2013), 82–94. https://doi.org/10.1016/j.ijrmms.2012.12.045 doi: 10.1016/j.ijrmms.2012.12.045
![]() |
[160] |
X. Shi, Z. Jian, B. Wu, D. Huang, W. Wei, Support vector machines approach to mean particle size of rock fragmentation due to bench blasting prediction, Trans. Nonferrous Met. Soc. China, 22 (2012), 432–441. https://doi.org/10.1016/S1003-6326(11)61195-3 doi: 10.1016/S1003-6326(11)61195-3
![]() |
[161] |
M. J. Thurley, Automated online measurement of limestone particle size distributions using 3D range data, J. Process Control, 21 (2011), 254–262. https://doi.org/10.1016/j.jprocont.2010.11.011 doi: 10.1016/j.jprocont.2010.11.011
![]() |
[162] |
G. Zhang, G. Liu, H. Zhu, Segmentation algorithm of complex ore images based on templates transformation and reconstruction, Int. J. Miner. Metall. Mater., 18 (2011), 385. https://doi.org/10.1007/s12613-011-0451-8 doi: 10.1007/s12613-011-0451-8
![]() |
[163] | A. Amankwah, C. Aldrich, Rock image segmentation using watershed with shape markers, In: 2010 IEEE 39th Applied Imagery Pattern Recognition Workshop (AIPR), 2010, 1–7. http://doi.org/10.1109/AIPR.2010.5759719 |
[164] |
D. P. Mukherjee, Y. Potapovich, I. Levner, H. Zhang, Ore image segmentation by learning image and shape features, Pattern Recognit. Lett., 30 (2009), 615–622. https://doi.org/10.1016/j.patrec.2008.12.015 doi: 10.1016/j.patrec.2008.12.015
![]() |
[165] |
M. Monjezi, M. Rezaei, A. Y. Varjani, Prediction of rock fragmentation due to blasting in Gol-E-Gohar iron mine using fuzzy logic, Int. J. Rock Mech. Min. Sci., 46 (2009), 1273–1280. https://doi.org/10.1016/j.ijrmms.2009.05.005 doi: 10.1016/j.ijrmms.2009.05.005
![]() |
[166] | W. Wang, Rock particle image segmentation and systems, In: Pattern recognition techniques, technology and applications, I-Tech Vienna, Austria, 2008,197–226. |
[167] |
M. J. Thurley, K. C. Ng, Identifying, visualizing, and comparing regions in irregularly spaced 3d surface data, Comput. Vis. Image Underst., 98 (2005), 239–270. https://doi.org/10.1016/j.cviu.2003.12.002 doi: 10.1016/j.cviu.2003.12.002
![]() |
[168] | C. Perez, A. Casali, G. Gonzalez, G. Vallebuona, R. Vargas, Lithological composition sensor based on digital image feature extraction, genetic selection of features and neural classification, In: Proceedings 1999 International Conference on Information Intelligence and Systems (Cat. No. PR00446), IEEE, 1999,236–241. https://doi.org/10.1109/ICIIS.1999.810267 |
[169] | N. H. Maerz, Image sampling techniques and requirements for automated image analysis of rock fragmentation, In: Measurement of Blast Fragmentation, Routledge, 2018,115–120. |