Anomaly detection is a binary classification task, which is to determine whether each pixel is abnormal or not. The difficulties are that it is hard to obtain abnormal samples and predict the shape of abnormal regions. Due to these difficulties, traditional supervised segmentation methods fail. The usual weakly supervised segmentation methods will use artificially generate defects to construct training samples. However, the model will be overfitted to artificially generated defects during training, resulting in insufficient generalization ability of the model. In this paper, we presented a novel reconstruction-based weakly supervised method for sparse anomaly detection. We proposed to use generative adversarial networks (GAN) to learn the distribution of positive samples, and reconstructed negative samples which contained the sparse defect into positive ones. Due to the nature of GAN, the training dataset only needs to contain normal samples. Subsequently, the segmentation network performs progressive feature fusion on reconstructed and original samples to complete the anomaly detection. Specifically, we designed the loss function based on kullback-leibler divergence for sparse anomalous defects. The final weakly-supervised segmentation network only assumes a sparsity prior of the defect region; thus, it can circumvent the detailed semantic labels and alleviate the potential overfitting problem. We compared our method with the state of the art generation-based generative anomaly detection methods and observed the average area under the receiver operating characteristic curve increase of 3% on MVTec anomaly detection.
Citation: Kaixuan Wang, Shixiong Zhang, Yang Cao, Lu Yang. Weakly supervised anomaly detection based on sparsity prior[J]. Electronic Research Archive, 2024, 32(6): 3728-3741. doi: 10.3934/era.2024169
Related Papers:
[1]
Müzeyyen Sangurlu Sezen .
Interpolative best proximity point results via γ-contraction with applications. AIMS Mathematics, 2025, 10(1): 1350-1366.
doi: 10.3934/math.2025062
[2]
Naeem Saleem, Hüseyin Işık, Sana Khaleeq, Choonkil Park .
Interpolative Ćirić-Reich-Rus-type best proximity point results with applications. AIMS Mathematics, 2022, 7(6): 9731-9747.
doi: 10.3934/math.2022542
[3]
Khalil Javed, Muhammad Nazam, Fahad Jahangeer, Muhammad Arshad, Manuel De La Sen .
A new approach to generalized interpolative proximal contractions in non archimedean fuzzy metric spaces. AIMS Mathematics, 2023, 8(2): 2891-2909.
doi: 10.3934/math.2023151
[4]
Raju Gopi, Veerasamy Pragadeeswarar, Choonkil Park, Dong Yun Shin .
Coupled common best proximity point theorems for nonlinear contractions in partially ordered metric spaces. AIMS Mathematics, 2020, 5(6): 6913-6928.
doi: 10.3934/math.2020443
[5]
Umar Ishtiaq, Fahad Jahangeer, Doha A. Kattan, Manuel De la Sen .
Generalized common best proximity point results in fuzzy multiplicative metric spaces. AIMS Mathematics, 2023, 8(11): 25454-25476.
doi: 10.3934/math.20231299
[6]
Yao Yu, Chaobo Li, Dong Ji .
Best proximity point of α-η-type generalized F-proximal contractions in modular metric spaces. AIMS Mathematics, 2024, 9(4): 8940-8960.
doi: 10.3934/math.2024436
[7]
A. Sreelakshmi Unni, V. Pragadeeswarar, Manuel De la Sen .
Common best proximity point theorems for proximally weak reciprocal continuous mappings. AIMS Mathematics, 2023, 8(12): 28176-28187.
doi: 10.3934/math.20231442
[8]
Basit Ali, Muzammil Ali, Azhar Hussain, Reny George, Talat Nazir .
Best proximity points in non-Archimedean fuzzy metric spaces with application to domain of words. AIMS Mathematics, 2022, 7(9): 16590-16611.
doi: 10.3934/math.2022909
[9]
Arshad Ali Khan, Basit Ali, Reny George .
On semi best proximity points for multivalued mappings in quasi metric spaces. AIMS Mathematics, 2023, 8(10): 23835-23849.
doi: 10.3934/math.20231215
[10]
Mustafa Aslantas, Hakan Sahin, Raghad Jabbar Sabir Al-Okbi .
Some best proximity point results on best orbitally complete quasi metric spaces. AIMS Mathematics, 2023, 8(4): 7967-7980.
doi: 10.3934/math.2023401
Abstract
Anomaly detection is a binary classification task, which is to determine whether each pixel is abnormal or not. The difficulties are that it is hard to obtain abnormal samples and predict the shape of abnormal regions. Due to these difficulties, traditional supervised segmentation methods fail. The usual weakly supervised segmentation methods will use artificially generate defects to construct training samples. However, the model will be overfitted to artificially generated defects during training, resulting in insufficient generalization ability of the model. In this paper, we presented a novel reconstruction-based weakly supervised method for sparse anomaly detection. We proposed to use generative adversarial networks (GAN) to learn the distribution of positive samples, and reconstructed negative samples which contained the sparse defect into positive ones. Due to the nature of GAN, the training dataset only needs to contain normal samples. Subsequently, the segmentation network performs progressive feature fusion on reconstructed and original samples to complete the anomaly detection. Specifically, we designed the loss function based on kullback-leibler divergence for sparse anomalous defects. The final weakly-supervised segmentation network only assumes a sparsity prior of the defect region; thus, it can circumvent the detailed semantic labels and alleviate the potential overfitting problem. We compared our method with the state of the art generation-based generative anomaly detection methods and observed the average area under the receiver operating characteristic curve increase of 3% on MVTec anomaly detection.
1.
Introduction
Individual neurons are the basic units of the biological nervous system, they process information by working together in neuronal circuits with specific synaptic connectivity. In response to an applied current, the signal can be propagated from one neuron to the next neuron by generating electrical impulses or spikes[1]. Hodgkin and Huxley (HH) firstly proposed the mathematical description of the neural model based on a large number of biological experiments[2], which built a new field of neuronal electrophysiology and laid the foundation for theoretical neuroscience. However, the HH model is a complex nonlinear system, and is difficult to be analyzed theoretically. Subsequently, researchers have successively proposed many simplified neuron models such as the Fitzhugh-Nagumo (FN) model [3], Morris-Lecar (ML) model[4], Hindmarsh-Rose (HR) model[5], and the modified forms of them[6,7,8], to explore the physiological mechanisms of neurons.
Previous studies have shown that many neurological dynamic diseases such as Epilepsy, Parkinson's disease, Alzheimer's disease and Schizophrenia may be induced by bifurcations caused by the changes of the regulatory parameters in the neural system, which leads to the disorders in the firing patterns of nervous systems[9,10,11,12]. In addition, the changes of firing patterns in neuron systems may cause neurons to produce a kind of plasticity, which finally affects learning, memory and other neural activities that rely on neuron-plasticity[13]. Therefore, a method is expected to be proposed to control the bifurcation mechanism of the neuron model, which can change the firing patterns from abnormal to normal under certain conditions.
Bifurcation control has attracted increasing attention due to its potential applications in many fields, such as engineering, biomedicine, and meteorology systems etc[14]. The main idea of bifurcation control is to change the inherent bifurcation characteristics of the original system by designing the controller without changing the parameters, thereby obtaining some desirable bifurcation behaviors. This includes delaying or advancing the onset of the bifurcation points, modifying the shape or type of bifurcations, and so on. Many bifurcation control methods have been provided in previous studies[15,16,17,18,19]. Xie et al. [10] studied the dynamic behaviors of Hopf bifurcation under the control of the washout filter in HH model. The results show that the linear term of the controller can control the position of the Hopf bifurcation point, and the cubic term can change the criticality of the Hopf bifurcation point. The washout filter dynamic feedback controller is introduced into the two-dimensional HR model to change the firing pattern from type I to type II by delaying the location of its inherent Hopf bifurcation[12]. Huang et al. [19] studied the Hopf bifurcation control of the ML model with type I under the control of washout filter-aided dynamic feedback controller. However, the firing pattern cannot be changed from type I to type II by using the washout filter-aided dynamic feedback controller in ML model. Therefore, a new controller should be introduced to address this issue. In addition, the analytical expression for determining the stability index of Hopf bifurcation criticality has not been obtained. Moreover, none of these studies involved the bifurcation control of the ML model with Hc bifurcation type.
Motivated by above analysis, in the present paper, we introduce a new controller proposed by Nguyen et al.[20] into the ML model to study the influence of the controller on the ML model with Hc bifurcation type. In addition, we give the analytical expression of stability index of the system to determine the criticality of Hopf bifurcation.
The structure of the paper is organized as follows. In Sect. 2, we reviewed the bifurcation dynamics and the conditions for the emergence of Hopf bifurcations of the ML model. In Sect. 3, the dynamic state-feedback control law was applied to the ML neuron model with Hc bifurcation type. Also, we derived the analytical expression of the bifurcation stability index for the controlled ML model with Hc bifurcation type. Conclusions are given in Sect. 4.
2.
Reviews of the ML model
2.1. ML model
The ML neuron model is a simplified form of HH model and its mathematical description can be expressed by the following nonlinear differential equations:
where V is the membrane potential, and N is the recovery variable. I is the current stimulation and is treated as the bifurcation parameter. C is the membrane capacitance. Vi(i=K,Ca,L) represent the reversal potential, and gi(i=K,Ca,L) represent the maximum conductance. Vi(i=1,2,3,4) are constant potentials, and ϕ represents the temperature factor. Here, we named system (1) as the original system.
2.2. The bifurcation dynamics of the ML model
There are three types of bifurcations in ML model by choosing different parameter sets, including Hopf bifurcation, saddle node bifurcation on invariant cycle (SNIC) and homoclinic (Hc) bifurcation (see Table 1). In this paper, we mainly focus on the Hopf bifurcation control of the ML model with Hc bifurcation type. The bifurcation diagram of the ML model with Hc bifurcation type is shown in Figure 1. From Figure 1 we can see that as the bifurcation parameter I increases, the ML model with Hc bifurcation type is divided into six types of dynamic regions. In region I (when I<−9.949), the system has only one stable equilibrium point in the lower branch; In region II (when −9.949<I<34.94), the system contains three equilibrium points, the stable equilibrium point in the upper branch, the unstable equilibrium point in the middle branch and the stable equilibrium point in the lower branch; In region III (when 34.94<I<36.32), the system contains a stable limit cycle and three equilibrium points; In region IV (when 36.32<I<39.96), the system contains a stable limit cycle, an unstable limit cycle and three equilibrium points; In region V(when 39.96<I<40.56), the system contains a stable limit cycle, an unstable limit cycle and a stable equilibrium point; In region VI(when I>40.56), the system contains a stable equilibrium point. The corresponding phase diagrams of six typical dynamical behaviors are shown in Figure 2. Compared it with [19], the ML model with Hc bifurcation type has more dynamical behaviors than that with SNIC bifurcation type. In particular, Hc bifurcation occurs in the system when I=34.94, and the corresponding phase diagram is shown in Figure 3.
Table 1.
Parameter setting in the simulation and experiment.
Figure 1.
(a) Bifurcation diagram of the ML model with Hc bifurcation type. (b) The enlarged representation of (a). Here, the red and black lines represent stable equilibrium point and unstable equilibrium point, respectively. The green and blue circles represent stable limit cycle and unstable limit cycle, respectively. SNi(i=1,2) represent saddle node bifurcation points, H represents Hopf bifurcation point, and Hc represents homoclinic bifurcation point. I−VI represent six types of dynamical behavior regions, respectively. SN1: I=−9.949μA/cm2, Hc: I=34.94μA/cm2, H: I=36.32μA/cm2, SN2: I=39.96μA/cm2.
Figure 2.
Six types of phase diagrams of the ML model with Hc bifurcation type. Here, the blue and red curves represent N-nullcline and V-nullcline, respectively. The black solid line and the black dashed line represent stable limit cycle (SLC) and unstable limit cycle (ULC), respectively. The red circle and the black circle represent the stable equilibrium point (SEP) and the unstable equilibrium point (UEP), respectively. (a) I=−30μA/cm2, (b) I=30μA/cm2, (c) I=35.5μA/cm2, (d) I=37.5μA/cm2, (e) I=40μA/cm2, (f) I=45μA/cm2.
Some researchers have proposed that the firing patterns can be determined by the types of bifurcation[21,22]. Specifically, type I firing pattern occurs when the system undergoes SNIC bifurcation or Hc bifurcation, while type II firing pattern occurs when the system undergoes Hopf bifurcation. For type I, the system can fire at any low frequency; for type II, the system fires from a positive minimum frequency. Figure 4 shows the firing patterns of the ML model under the three types of bifurcations. From Figure 4 we can see that the ML model with Hopf bifurcation type shows the type II firing pattern (see Figure 4b), and the corresponding time evolutions are shown in Figure 4a; the ML model with SNIC bifurcation or Hc bifurcation type both show the type I firing pattern (see Figure 4d and 4f), and the corresponding time evolutions are shown in Figure 4c and 4e, respectively.
Figure 4.
(a) (c) (e) Time evolution diagrams of the ML model with Hopf bifurcation, SNIC bifurcation and Hc bifurcation, respectively. (b) (d) (f) Frequency-I curves of the ML model with Hopf bifurcation, SNIC bifurcation and Hc bifurcation, respectively.
2.4. Conditions for the emergence of Hopf bifurcation
Consider the following n-dimensional nonlinear system:
dxdt=f(x,μ),
(3)
where x∈Rn represents the state variables, μ∈R represents the bifurcation parameter. Assume that the system has a fixed point x0 when the bifurcation parameter μ=μ0 and the corresponding eigenvalue λμ0=αμ0+iβμ0. The Hopf bifurcation occurs at μ=μ0 when the system satisfies the following conditions: βμ0≠0, αμ0=0, and ddμ(αμ)∣μ=μ0>0. However, the eigenvalues of the system cannot be obtained easily when the system is a high-dimensional system. Therefore, the following Routh-Hurwitz stability criterion can be used to determine whether the Hopf bifurcation occurs[23]. Assume that the corresponding characteristic polynomial of system (3) is as follows:
Based on the Routh-Hurwitz stability criterion, the Hopf bifurcation occurs at μ=μ0 when the system satisfies the following conditions:
(I) Eigenvalue crossing condition:
pn(μ0)>0,Di(μ0)>0,i=1,⋯,n−2,Dn−1(μ0)=0.
(7)
(II) Transversality condition:
dDn−1(μ)dμ∣μ=μ0≠0.
(8)
3.
Hopf bifurcation control of the ML model
3.1. The dynamic state-feedback controller
In this section, we provide a dynamic state-feedback controller to control the Hopf bifurcation of the original system. Consider the following nonlinear system:
u=u(x,y),˙y=g(x,y).
(9)
where y∈Rm(1≤m≤n) represents the state variables of the controller, u(x,y) represents the feedback control and g(x,y) is a smooth function. In this paper, we utilize the following feedback control law proposed by Nguyen and Hong[20].
ui(xi,yi)=k1ixi+k3i(xi−x0i)3−liyi,˙yi=ui(xi,yi).
(10)
where x0i(i=1,2,...,m) are the equilibrium points of the system at the Hopf bifurcation point, k1i and k3i represent the linear term control gain and the cubic term control gain, respectively. li are constant parameters. Then we obtain the following controlled system:
According to Eq (10), we have ui=0 when ˙y=ui=0. So, if x0 is the equilibrium point of the original system, (x0,y0) is the equilibrium point of the controlled system, where y0=(y01,y02,⋯,y0m) and then y0i=(k1ix0i+k3i(x0i−x01i)3)/li(i=1,2,⋯,m). That is, the equilibrium points of the original system are the equilibrium points of the controlled model. The reason for using state feedback control to conduct the Hopf bifurcation control is that the equilibrium structure of the original system and the controlled system remains unchanged during the control process. In the present paper, we add the controller to the membrane potential V, and then we obtain the following controlled system:
where V0 is the equilibrium membrane potential of the original system at the Hopf bifurcation point.
3.2. Hopf bifurcation control of the ML model with Hc bifurcation type
The Hopf bifurcation control of neuron models has been widely studied, including HH model, HR model, ML model with Hopf bifurcation type or SNIC bifurcation type[10,11,12,19,20]. However, the Hopf bifurcation control of the ML model with Hc bifurcation type has not been studied. In addition, the controllers used in previous researches only studied the system with single Hopf bifurcation point. Therefore, in the present paper, we utilize the dynamic state-feedback control proposed by Nguyen et al. to make the Hopf bifurcation point change from one to two. The parameter values of the model are ϕ=0.23,gCa=4,V3=12,V4=17.4,VCa=120,VK=−84,VL=−60,gK=8,gL=2,V1=−1.2,V2=18,C=20,l=0.1, and I is treated as the bifurcation parameter.
3.2.1. The transition from Hc bifurcation type to SNIC bifurcation type
The Hopf bifurcation point is located at I=36.32 in the original ML model with Hc bifurcation type (Figure 1). To change the model from the Hc bifurcation type to the SNIC bifurcation type, the Hopf bifurcation point needs to be moved forward. Here, we change the Hopf bifurcation point from I=36.32 to I0=70. The equilibrium point of the original system is (V0=6.7697,N0=0.35407). Therefore, the equilibrium point of the controlled system is (V0=6.7697,N0=0.35407,y0=67.697k1), and then we obtain the Jacobian matrix of the controlled system at the equilibrium point:
Solving Eq (16), we have k1=0.0893. Then, we have:
dD2(I)dI∣I=I0=−0.2032×10−4≠0.
(17)
which satisfy the transversal condition (II).
The bifurcation diagram of the controlled system when k1=0.0893,k3=0 is shown in Figure 5a. As expected, the Hopf bifurcation point of the ML model with Hc bifurcation type moves forward from I=36.32 to I=70. Figure 5b shows the two-parameter bifurcation diagram of bifurcation parameter I with respect to k1, which further verifies that Hopf bifurcation occurs at I=70 when k1=0.0893. Now, the model shows a change from the Hc bifurcation type to the SNIC bifurcation type (see Figure 5a), but does not change the firing pattern of the system (see Figure 5c and 5d).
Figure 5.
(a) Bifurcation diagram of the controlled system when k1=0.0893,k3=0,I0=70. (b) Two-parameter diagram of I with respect to k1. (c) Time evolution diagrams of the controlled model with different bifurcation parameter I when k1=0.0893,k3=0. (d) Frequency-I curves of the controlled system when k1=0.0893,k3=0.
The results of this section show that the ML model can be transformed from the Hc bifurcation type to the SNIC bifurcation type by introducing a dynamic state-feedback control. In addition, there is only one Hopf bifurcation point in the system when k1≠0,k3=0 (Figure 5a), that is, k1 can change the location of the Hopf bifurcation point of the ML neuron model with Hc bifurcation type, resulting in the change of bifurcation type from Hc type to SNIC type.
3.2.2. The transition from Hc bifurcation type to Hopf bifurcation type
Previous study has investigated the transition of ML model from SNIC bifurcation type to Hopf bifurcation type[18]. Here, we will study the transition of the ML model from Hc bifurcation type to Hopf bifurcation. First, the inherent Hopf bifurcation point in the Hc bifurcation type needs to be moved forward, and then a new Hopf bifurcation point is constructed in front of the moved inherent Hopf bifurcation point. Here, we expect to change the inherent Hopf bifurcation point from I=36.32 to I1=200, and then a new Hopf bifurcation point is constructed at I2=60.
When I1=200, the equilibrium point of the controlled system is (V0=12.94,N0=0.52697,y0=129.4k1), and then we obtain the Jacobian matrix of the controlled system at the equilibrium point:
Solving Eq (20), we have k1=0.34966383. Then, substituting k1=0.34966383 into the controlled system when I2=60, we obtain the equilibrium point of the controlled system (V0=6.1368,N0=0.33762,y0=21.46+3148.761k3). The Jacobian matrix of the controlled system at the equilibrium point is as follows:
Solving Eq (23), we have k3=−0.00205656. Figure 6 shows the dynamic behaviors of the controlled system when k1=0.34966383,k3=−0.00205656. From Figure 6a we can see that the Hopf bifurcation point of the ML neuron model with Hc bifurcation type is moved forward from I=36.32 to I1=200, and a new Hopf bifurcation point is constructed at I2=60. Figure 6b shows the two-parameter bifurcation diagram of bifurcation parameter I with respect to k1, which further verifies that the model undergoes the Hopf bifurcation at I1=200,I2=60 when k1=0.0893. Figure 6c shows the time evolutions of the controlled system with different bifurcation parameter I. From Figure 6c we can see that the system fires from a positive minimum frequency, which is further verified in Figure 6d. Now, the model shows a change from Hc bifurcation type to Hopf bifurcation type (see Figure 6a), and the firing pattern changes from type I to type II (see Figure 6d).
Figure 6.
(a) Bifurcation diagram of the controlled system with k1=0.34966383 and k3=−0.00205656. (b) Two-parameter diagram of I with respect to k1. (c) Time evolution diagrams of the controlled system with different bifurcation parameter I when k1=0.34966383 and k3=−0.00205656. (d) Frequency-I curves of the controlled system when k1=0.34966383 and k3=−0.00205656.
The results in this section show that the ML model can be transformed from the Hc bifurcation type to the Hopf bifurcation type by introducing dynamic state-feedback control. In addition, the model performs type II firing pattern when k1≠0,k3≠0, that is, the combination of k1 and k3 can change the firing patterns of the ML neuron model with Hc bifurcation type.
3.2.3. Theoretical analysis of the criticality of Hopf bifurcation
As mentioned above, the criticality of the Hopf bifurcation can be changed by a dynamic state-feedback controller. In this section, we derive the stability coefficient β2 of the Hopf bifurcation by utilizing the Poincare Birkhoff (PB) normal form method. The Hopf bifurcation is subcritical when β2>0, resulting in an unstable limit cycle; the Hopf bifurcation is supercritical when β2<0, resulting in a stable limit cycle.
Consider the following controlled system:
˙x=f(x,μ),
(24)
where x=(V,N,y)T, f=(f1,f2,f3)T. The equilibrium point of the system at μ0: x0(μ0)=(V0(μ0),N0(μ0),y0(μ0))T. Rewrite the controlled system as: ˙x=f(x,μ)=Jx+g(x), where J is the Jocabian matrix of the system at the equilibrium point, g(x) is the nonlinear term:
Then, we conduct the linear transformation of the controlled system: x=Py+x0(μ0), where P=[Re(v1),Im(v1),v3], Re(v1) and Im(v1) are the real and imaginary parts of the eigenvector v1 corresponding to eigenvalues λ1, and v3 is the eigenvector corresponding to the eigenvalue λ3. Then, we have:
where λ3 is the real characteristic root of the Jacobian matrix, ω0 is the imaginary part of the pure virtual characteristic root of the Jacobian matrix, and ω0>0. Solving Eqs (39) and (40) we obtain:
Because Ay is the first-order function with respect to y and the second or more derivative of y is required in the following calculations, the derivative of y is omitted. We only calculate the following equation: F=P−1f(Py+x0(μ0)).
Next, we calculate the stability coefficient β2 of the controlled system when k1=0.3497, k3=−0.0021, μ0=I1=200. The equilibrium point of the controlled system is (V0=12.94,N0=0.52697,y0=45.2465), and the corresponding Jacobian matrix is:
J=(0.2122−38.7760−0.10.0066−0.230100.34970−0.1).
(46)
Then, we obtain the eigenvalues and eigenvectors: λ1=0.4938i, λ2=−0.4938i, λ3=−0.1179.
Finally, substituting the parameters into the stability coefficient formula we have β2=−9.9169×10−4<0, that is, the controlled system undergoes the supercritical Hopf bifurcation at (V0,N0)=(12.94,0.52697) when I1=200. The membrane potential curve and phase trajectory of the controlled system at the bifurcation point are shown in Figure 7a and 7b. From Figure 7b we can see that the phase trajectory of the controlled system converges to a stable limit cycle when I1=200. However, the phase trajectory of the original system converges to a stable equilibrium point when I1=200 (see Figure 7c and 7d). The similar results can be obtained when I2=60, so we omit them here.
Figure 7.
Time evolutions and phase diagrams of the controlled system (a-b) and original system (c-d) when I1 = 200μA/cm2.
In this paper, we investigate the Hopf bifurcation control of the ML model with Hc bifurcation type by utilizing the method of dynamic state-feedback control. The results show that (1) the location of the Hopf bifurcation point can be changed by introducing the state-feedback control without changing the model parameters; (2) the control gain k1 transforms the ML model from the Hc bifurcation type to the SNIC bifurcation type, but does not change the firing pattern of the model; (3) the cooperation of control gain k1 and k3 transforms the ML model from the Hc bifurcation type to the Hopf bifurcation type, and the firing pattern shows a change from Type I to Type II. In addition, we find that the criticality of the Hopf bifurcation of the system can be changed by introducing the control gain k3, that is, the criticality of the Hopf bifurcation is changed from the subcritical Hopf bifurcation to the supercritical Hopf bifurcation. Many neurodegenerative diseases are caused by the change of firing patterns. Therefore, the results of this paper may have potential applications for the treatment of these diseases.
Compared to previous studies, the conclusions of this paper further enrich the research results. Some scholars have studied the Hopf bifurcation control based on the ML model with SNIC bifurcation type by introducing a washout filter-aided dynamic feedback controller[19]. In their research, they only studied how the location and criticality of the Hopf bifurcation changed under different control conditions. However, they cannot perform the change of the Hopf bifurcation point from one to two. Therefore, it is impossible to study how to control the firing pattern of the system changes from type I to type II. Here, we utilize a new dynamic state feedback controller to control the Hopf bifurcation of the ML model with Hc bifurcation type. This controller not only reproduces the previous results, but also realizes the control of two Hopf bifurcation points. We further study the effects of the controller on firing patterns, providing potential application value for the treatment of some dynamic diseases. In addition, the stability index to determine the criticality of the Hopf bifurcation is given in our paper. The mutual verification of theoretical analysis and numerical simulation improves the integrity of this research.
Acknowledgments
This work was supported by the national Natural Science Foundation of China under Grant 11972115 and the Fundamental Research Funds for the Central Universities. The authors would like to thank the reviewers for their comments.
Conflict of interest
The authors declare there is no conflicts of interest.
References
[1]
W. Samek, G. Montavon, S. Lapuschkin, C. J. Anders, K. Müller, Explaining deep neural networks and beyond: A review of methods and applications, in Proceedings of the IEEE, 109 (2021), 247–278. https://doi.org/10.1109/JPROC.2021.3060483
[2]
G. Quellec, M. Lamard, M. Cozic, G. Coatrieux, G. Cazuguel, Multiple-instance learning for anomaly detection in digital mammography, IEEE Trans. Med. Imaging, 35 (2016), 1604–1614. https://doi.org/10.1109/TMI.2016.2521442 doi: 10.1109/TMI.2016.2521442
[3]
S. Zhang, J. Li, L. Yang, Survey on low-level controllable image synthesis with deep learning, Electron. Res. Arch., 31 (2023), 7385–7426. https://doi.org/10.3934/era.2023374 doi: 10.3934/era.2023374
[4]
S. Venkataramanan, K. Peng, R. V. Singh, A. Mahalanobis, Attention guided anomaly localization in images, in Computer Vision – ECCV 2020, 12362 (2020), 485–503. https://doi.org/10.1007/978-3-030-58520-4_29
[5]
T. Schlegl, P. Seeböck, S. M. Waldstein, G. Langs, U. Schmidt-Erfurth, f-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks, Med. Image Anal., 54 (2019), 30–44, https://doi.org/10.1016/j.media.2019.01.010 doi: 10.1016/j.media.2019.01.010
[6]
L. Chen, G. Papandreou, F. Schroff, H. Adam, Rethinking atrous convolution for semantic image segmentation, preprint, arXiv: 1706.05587.
[7]
E. Bingham, H. Mannila, Random projection in dimensionality reduction: Applications to image and text data, in Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, (2001), 245–250, https://doi.org/10.1145/502512.502546
[8]
T. Tang, W. Kuo, J. Lan, C. Ding, H. Hsu, H. Young, Anomaly detection neural network with dual auto-encoders gan and its industrial inspection applications, Sensors, 20 (2022), 3336. https://doi.org/10.3390/s20123336 doi: 10.3390/s20123336
[9]
I. J. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, et al., Generative adversarial networks, preprint, arXiv: 1406.2661.
[10]
S. Akcay, A. Atapour-Abarghouei, T. P. Breckon, GANomaly: Semi-supervised anomaly detection via adversarial training, in Computer Vision-ACCV 2018, 11363 (2018), 622–637. https://doi.org/10.1007/978-3-030-20893-6_39
[11]
S. Akçay, A. Atapour-Abarghouei, T. P. Breckon, Skip-GANomaly: Skip connected and adversarially trained encoder-decoder anomaly detection, in 2019 International Joint Conference on Neural Networks (IJCNN), (2019), 1–8. https://doi.org/10.1109/IJCNN.2019.8851808
[12]
U. Sivanesan, L. H. Braga, R. R. Sonnadara, K. Dhindsa, TricycleGAN: Unsupervised image synthesis and segmentation based on shape priors, preprint, arXiv: 2102.02690.
[13]
V. Zavrtanik, M. Kristan, D. Skočaj, Reconstruction by inpainting for visual anomaly detection, Pattern Recognit., 112 (2021), 107706. https://doi.org/10.1016/j.patcog.2020.107706 doi: 10.1016/j.patcog.2020.107706
[14]
M. Salehi, N. Sadjadi, S. Baselizadeh, M. H. Rohban, H. R. Rabiee, Multiresolution knowledge distillation for anomaly detection, in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2021), 14897–14907. https://doi.org/10.1109/CVPR46437.2021.01466
[15]
H. Deng, X. Li, Anomaly detection via reverse distillation from one-class embedding, in 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2022), 9727–9736. https://doi.org/10.1109/CVPR52688.2022.00951
[16]
X. Zhang, M. Xu, X. Zhou, RealNet: A feature selection network with realistic synthetic anomaly for anomaly detection, preprint, arXiv: 2403.05897.
[17]
E. Shelhamer, J. Long, T. Darrell, Fully convolutional networks for semantic segmentation, IEEE Trans. Pattern Anal. Mach. Intell., 39 (2017), 640–651. https://doi.org/10.1109/TPAMI.2016.2572683 doi: 10.1109/TPAMI.2016.2572683
[18]
T. Lin, P. Dollár, R. Girshick, K. He, B. Hariharan, S. Belongie, Feature pyramid networks for object detection, in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (2017), 936–944. https://doi.org/10.1109/CVPR.2017.106
[19]
O. Ronneberger, P. Fischer, T. Brox, U-Net: Convolutional networks for biomedical image segmentation, in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015, 9351 (2015), 234–241. https://doi.org/10.1007/978-3-319-24574-4_28
D. P. Kingma, M. Welling, Auto-encoding variational bayes, preprint, arXiv: 1312.6114.
[22]
Z. Wang, A. C. Bovik, H. R. Sheikh, E. P. Simoncelli, Image quality assessment: from error visibility to structural similarity, IEEE Trans. Image Process., 13 (2004), 600–612. https://doi.org/10.1109/TIP.2003.819861 doi: 10.1109/TIP.2003.819861
[23]
K. He, X. Zhang, S. Ren, J. Sun, Deep residual learning for image recognition, in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (2016), 770–778. https://doi.org/10.1109/CVPR.2016.90
[24]
T. Lin, P. Goyal, R. Girshick, K. He, P. Dollár, Focal loss for dense object detection, in 2017 IEEE International Conference on Computer Vision (ICCV), (2017), 2999–3007. https://doi.org/10.1109/ICCV.2017.324
[25]
O. Cappé, A. Garivier, O. Maillard, R. Munos, G. Stoltz, Kullback-Leibler upper confidence bounds for optimal sequential allocation, Ann. Stat., 41 (2013), 1516–1541, http://doi.org/10.1214/13-AOS1119 doi: 10.1214/13-AOS1119
[26]
P. Bergmann, M. Fauser, D. Sattlegger, C. Steger, MVTec AD-A comprehensive real-world dataset for unsupervised anomaly detection, in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2019), 9584–9592. https://doi.org/10.1109/CVPR.2019.00982
[27]
P. Bergmann, M. Fauser, D. Sattlegger, C. Steger, Uninformed students: Student-teacher anomaly detection with discriminative latent embeddings, in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2020), 4182–4191. https://doi.org/10.1109/CVPR42600.2020.00424
[28]
D. Dehaene, O. Frigo, S. Combrexelle, P. Eline, Iterative energy-based projection on a normal data manifold for anomaly localization, preprint, arXiv: 2002.03734.
[29]
K. Zhou, Y. Xiao, J. Yang, J. Cheng, W. Liu, W. Luo, et al., Encoding structure-texture relation with P-Net for anomaly detection in retinal images, in Computer Vision-ECCV 2020, 12365 (2020), 360–377. https://doi.org/10.1007/978-3-030-58565-5_22
This article has been cited by:
1.
Mi Zhou, Naeem Saleem, Basit Ali, Misha Mohsin, Antonio Francisco Roldán López de Hierro,
Common Best Proximity Points and Completeness of ℱ−Metric Spaces,
2023,
11,
2227-7390,
281,
10.3390/math11020281
2.
Basit Ali, Arshad Ali Khan, Manuel De la Sen,
Optimum Solutions of Systems of Differential Equations via Best Proximity Points in b-Metric Spaces,
2023,
11,
2227-7390,
574,
10.3390/math11030574
3.
Amer Hassan Albargi, Jamshaid Ahmad,
Integral Equations: New Solutions via Generalized Best Proximity Methods,
2024,
13,
2075-1680,
467,
10.3390/axioms13070467
4.
Muzammil Ali, Basit Ali,
Best Proximity Point Results for Fuzzy Proximal Quasi Contractions with Applications,
2024,
12,
2227-7390,
2295,
10.3390/math12142295
Kaixuan Wang, Shixiong Zhang, Yang Cao, Lu Yang. Weakly supervised anomaly detection based on sparsity prior[J]. Electronic Research Archive, 2024, 32(6): 3728-3741. doi: 10.3934/era.2024169
Kaixuan Wang, Shixiong Zhang, Yang Cao, Lu Yang. Weakly supervised anomaly detection based on sparsity prior[J]. Electronic Research Archive, 2024, 32(6): 3728-3741. doi: 10.3934/era.2024169
Figure 3. VAE structure. Where X is inputs, Z is latent variable
Figure 4. Reconstructive subnetwork
Figure 5. Segmentation model structure
Figure 6. Examples of MVTec. Normal images (left), abnormal images (center) and mask images (right) are shown in the figure
Figure 7. Outputs of the method. Input images (first), reconstructed images (second), ground truth images (third) and, output mask images (fourth) are shown in the figure