Research article Special Issues

An improved pix2pix model based on Gabor filter for robust color image rendering


  • In recent years, with the development of deep learning, image color rendering method has become a research hotspot once again. To overcome the detail problems of color overstepping and boundary blurring in the robust image color rendering method, as well as the problems of unstable training based on generative adversarial networks, we propose an color rendering method using Gabor filter based improved pix2pix for robust image. Firstly, the multi-direction/multi-scale selection characteristic of Gabor filter is used to preprocess the image to be rendered, which can retain the detailed features of the image while preprocessing to avoid the loss of features. Moreover, among the Gabor texture feature maps with 6 scales and 4 directions, the texture map with the scale of 7 and the direction of 0° has the comparable rendering performance. Finally, by improving the loss function of pix2pix model and adding the penalty term, not only the training can be stabilized, but also the ideal color image can be obtained. To reflect image color rendering quality of different models more objectively, PSNR and SSIM indexes are adopted to evaluate the rendered images. The experimental results of the proposed method show that the robust image rendered by this method has better visual performance and reduces the influence of light and noise on the image to a certain extent.

    Citation: Hong-an Li, Min Zhang, Zhenhua Yu, Zhanli Li, Na Li. An improved pix2pix model based on Gabor filter for robust color image rendering[J]. Mathematical Biosciences and Engineering, 2022, 19(1): 86-101. doi: 10.3934/mbe.2022004

    Related Papers:

    [1] Xiaoxue Zhao, Zhuchun Li . Synchronization of a Kuramoto-like model for power grids with frustration. Networks and Heterogeneous Media, 2020, 15(3): 543-553. doi: 10.3934/nhm.2020030
    [2] Tingting Zhu . Synchronization of the generalized Kuramoto model with time delay and frustration. Networks and Heterogeneous Media, 2023, 18(4): 1772-1798. doi: 10.3934/nhm.2023077
    [3] Seung-Yeal Ha, Yongduck Kim, Zhuchun Li . Asymptotic synchronous behavior of Kuramoto type models with frustrations. Networks and Heterogeneous Media, 2014, 9(1): 33-64. doi: 10.3934/nhm.2014.9.33
    [4] Tingting Zhu . Emergence of synchronization in Kuramoto model with frustration under general network topology. Networks and Heterogeneous Media, 2022, 17(2): 255-291. doi: 10.3934/nhm.2022005
    [5] Seung-Yeal Ha, Jaeseung Lee, Zhuchun Li . Emergence of local synchronization in an ensemble of heterogeneous Kuramoto oscillators. Networks and Heterogeneous Media, 2017, 12(1): 1-24. doi: 10.3934/nhm.2017001
    [6] Seung-Yeal Ha, Jeongho Kim, Jinyeong Park, Xiongtao Zhang . Uniform stability and mean-field limit for the augmented Kuramoto model. Networks and Heterogeneous Media, 2018, 13(2): 297-322. doi: 10.3934/nhm.2018013
    [7] Seung-Yeal Ha, Hansol Park, Yinglong Zhang . Nonlinear stability of stationary solutions to the Kuramoto-Sakaguchi equation with frustration. Networks and Heterogeneous Media, 2020, 15(3): 427-461. doi: 10.3934/nhm.2020026
    [8] Seung-Yeal Ha, Se Eun Noh, Jinyeong Park . Practical synchronization of generalized Kuramoto systems with an intrinsic dynamics. Networks and Heterogeneous Media, 2015, 10(4): 787-807. doi: 10.3934/nhm.2015.10.787
    [9] Vladimir Jaćimović, Aladin Crnkić . The General Non-Abelian Kuramoto Model on the 3-sphere. Networks and Heterogeneous Media, 2020, 15(1): 111-124. doi: 10.3934/nhm.2020005
    [10] Young-Pil Choi, Seung-Yeal Ha, Seok-Bae Yun . Global existence and asymptotic behavior of measure valued solutions to the kinetic Kuramoto--Daido model with inertia. Networks and Heterogeneous Media, 2013, 8(4): 943-968. doi: 10.3934/nhm.2013.8.943
  • In recent years, with the development of deep learning, image color rendering method has become a research hotspot once again. To overcome the detail problems of color overstepping and boundary blurring in the robust image color rendering method, as well as the problems of unstable training based on generative adversarial networks, we propose an color rendering method using Gabor filter based improved pix2pix for robust image. Firstly, the multi-direction/multi-scale selection characteristic of Gabor filter is used to preprocess the image to be rendered, which can retain the detailed features of the image while preprocessing to avoid the loss of features. Moreover, among the Gabor texture feature maps with 6 scales and 4 directions, the texture map with the scale of 7 and the direction of 0° has the comparable rendering performance. Finally, by improving the loss function of pix2pix model and adding the penalty term, not only the training can be stabilized, but also the ideal color image can be obtained. To reflect image color rendering quality of different models more objectively, PSNR and SSIM indexes are adopted to evaluate the rendered images. The experimental results of the proposed method show that the robust image rendered by this method has better visual performance and reduces the influence of light and noise on the image to a certain extent.



    Synchronization in complex networks has been a focus of interest for researchers from different disciplines[1,2,4,8,15]. In this paper, we investigate synchronous phenomena in an ensemble of Kuramoto-like oscillators which is regarded as a model for power grid. In [9], a mathematical model for power grid is given by

    Pisource=I¨θi˙θi+KD(˙θi)2Nl=1ailsin(θlθi),i=1,2,,N, (1)

    where Pisource>0 is power source (the energy feeding rate) of the ith node, I0 is the moment of inertia, KD>0 is the ratio between the dissipated energy by the turbine and the square of the angular velocity, and ail>0 is the maximum transmitted power between the ith and lth nodes. The phase angle θi of ith node is given by θi(t)=Ωt+˜θi(t) with a standard frequency Ω (50 or 60 Hz) and small deviations ˜θi(t). Power plants in a big connected network should be synchronized to the same frequency. If loads are too strong and unevenly distributed or if some major fault or a lightening occurs, an oscillator (power plant) may lose synchronization. In that situation the synchronization landscape may change drastically and a blackout may occur. The transient stability of power grids can be regarded as a synchronization problem for nonstationary generator rotor angles aiming to restore synchronism subject to local excitations. Therefore, the region of attraction of synchronized states is a central problem for the transient stability.

    By denoting ωi=PisourceKD and assuming ailKD=KN(i,l{1,2,,N}) and I=0 in (1), Choi et. al derived a Kuramoto-like model for the power grid as follows [5]:

    (˙θi)2=ωi+KNNl=1sin(θlθi),˙θi>0,i=1,2,,N. (2)

    Here, the setting ˙θi>0 was made in accordance to the observation in system (1) that the grid is operating at a frequency close to the standard frequency with small deviations. In order to ensure that the right-hand side of (2) is positive, it is reasonable to assume that ωi>K,i=1,2,,N. This model can be used to understand the emergence of synchronization in networks of oscillators. As far as the authors know, there are few analytical results. In [5], the authors considered this model with identical natural frequencies and prove that complete phase synchronization occurs if the initial phases are distributed inside an arc with geodesic length less than π/2.

    If (˙θi)2 in (2) is replaced by ˙θi, the model is the famous Kuramoto model [13]; for its synchronization analysis we refer to [3,6,10], etc. Sakaguchi and Kuramoto [16] proposed a variant of the Kuramoto model to describe richer dynamical phenomena by introducing a phase shift (frustration) in the coupling function, i.e., by replacing sin(θlθi) with sin(θlθi+α). They inferred the need of α from the empirical fact that a pair of oscillators coupled strongly begin to oscillate with a common frequency deviating from the simple average of their natural frequencies. Some physicists also realized via many experiments that the emergence of the phase shift term requires larger coupling strength K and longer relaxation time to exhibit mutual synchronization compared to the zero phase shift case. This is why we call the phase shift a frustration. The effect of frustration has been intensively studied, for example, [11,12,14]. In power grid model using Kuramoto oscillators, people use the phase shift to depict the energy loss due to the transfer conductance [7]. In this paper, we will incorporate the phase shift term in (2) and study the Kuramoto-like model with frustration α(π4,π4):

    (˙θi)2=ωi+KNNl=1sin(θlθi+α),˙θi>0,i=1,2,,N. (3)

    We will find a trapping region such that any nonstationary state located in this region will evolve to a synchronous state.

    The contributions of this paper are twofold: First, for identical oscillators without frustration, we show that the initial phase configurations located in the half circle will converge to complete phase and frequency synchronization. This extends the analytical results in [5] in which the initial phase configuration for synchronization needs to be confined in a quarter of circle. Second, we consider the nonidentical oscillators with frustration and present a framework leading to the boundness of the phase diameter and complete frequency synchronization. To the best of our knowledge, this is the first result for the synchronization of (3) with nonidentical oscillators and frustration.

    The rest of this paper is organized as follows. In Section 2, we recall the definitions for synchronization and summarize our main results. In Section 3, we give synchronization analysis and prove the main results. Finally, Section 4 is devoted to a concluding summary.

    Notations. We use the following simplified notations throughout this paper:

    νi:=˙θi,i=1,2,,N,ω:=(ω1,ω2,,ωN),ˉω:=max1iNωi,ω_:=min1iNωi,D(ω):=ˉωω_,θM:=max1iNθi,θm:=min1iNθi,D(θ):=θMθm,νM:=max1iNνi,νm:=min1iNνi,D(ν):=νMνm,θνM{θj|νj=νM},θνm{θj|νj=νm}.

    In this paper, we consider the system

    (˙θi)2=ωi+KNNl=1sin(θlθi+α),˙θi>0,α(π4,π4),θi(0)=θ0i,i=1,2,,N. (4)

    Next we introduce the concepts of complete synchronization and conclude this introductory section with the main result of this paper.

    Definition 2.1. Let θ:=(θ1,θ2,,θN) be a dynamical solution to the system (4). We say

    1. it exhibits asymptotically complete phase synchronization if

    limt(θi(t)θj(t))=0,ij.

    2. it exhibits asymptotically complete frequency synchronization if

    limt(˙θi(t)˙θj(t))=0,ij.

    For identical oscillators without frustration, we have the following result.

    Theorem 2.2. Let θ:=(θ1,θ2,,θN) be a solution to the coupled system (4) with α=0,ωi=ω0,i=1,2,,N and ω0>K. If the initial configuration

    θ0A:={θ[0,2π)N:D(θ)<π},

    then there exits λ1,λ2>0 and t0>0 such that

    D(θ(t))D(θ0)eλ1t,t0. (5)

    and

    D(ν(t))D(ν(t0))eλ2(tt0),tt0. (6)

    Next we introduce the main result for nonidentical oscillators with frustration. For ˉω<12sin2|α|, we set

    Kc:=D(ω)2ˉω12ˉωsin|α|>0.

    For suitable parameters, we denote by D1 and D the two angles as follows:

    sinD1=sinD:=ˉω+K(D(ω)+Ksin|α|)Kω_K,0<D1<π2<D<π.

    Theorem 2.3. Let θ:=(θ1,θ2,,θN) be a solution to the coupled system (4) with K>Kc and [ω_,ˉω][K+1,12sin2|α|). If

    θ0B:={θ[0,2π)N|D(θ)<D|α|},

    then for any small ε>0 with D1+ε<π2, there exists λ3>0 and T>0 such that

    D(ν(t))D(ν(T))eλ3(tT),tT. (7)

    Remark 1. If the parametric conditions in Theorem 2.3 are fulfilled, the reference angles D1 and D are well-defined. Indeed, because K>Kc and ˉω<12sin2|α|, we have

    D(ω)2ˉω12ˉωsin|α|<K,12ˉωsin|α|>0.

    This implies

    2ˉω(D(ω)+Ksin|α|)K<1.

    Then, by ω_K+1 and Kˉω we obtain

    sinD1=sinD:=ˉω+K(D(ω)+Ksin|α|)Kω_K2ˉω(D(ω)+Ksin|α|)K<1.

    Remark 2. In order to make 1<K+1<12sin2|α|, it is necessary to assume α(π4,π4). This is the reason for the setting α(π4,π4).

    In this subsection we consider the system (4) with identical natural frequencies and zero frustration:

    (˙θi)2=ω0+KNNl=1sin(θlθi),˙θi>0,i=1,2,,N. (8)

    To obtain the complete synchronization, we need to derive a trapping region. We start with two elementary estimates for the transient frequencies.

    Lemma 3.1. Suppose θ:=(θ1,θ2,,θN) be a solution to the coupled system (8), then for any i,j{1,2,,N}, we have

    (˙θi˙θj)(˙θi+˙θj)=2KNNl=1cos(θlθi+θj2)sinθjθi2.

    Proof. It is immediately obtained by (8).

    Lemma 3.2. Suppose θ:=(θ1,θ2,,θN) be a solution to the coupled system (8) and Ω>K, then we have

    ˙θiω0+K.

    Proof. It follows from (8) and ˙θi>0 that we have

    (˙θi)2=ω0+KNNl=1sin(θlθi)ω0+K.

    Next we give an estimate for trapping region and prove Theorem 2.2. For this aim, we will use the time derivative of D(θ(t)) and D(ν(t)). Note that D(θ(t)) is Lipschitz continuous and differentiable except at times of collision between the extremal phases and their neighboring phases. Therefore, for the collision time t at which D(θ(t)) is not differentiable, we can use the so-called Dini derivative to replace the classic derivative. In this manner, we can proceed the analysis with differential inequality for D(θ(t)). For D(ν(t)) we can proceed in the similar way. In the following context, we will always use the notation of classic derivative for D(θ(t)) and D(ν(t)).

    Lemma 3.3. Let θ:=(θ1,θ2,,θN) be a solution to the coupled system (8) and Ω>K. If the initial configuration θ(0)A, then θ(t)A,t0.

    Proof. For any θ0A, there exists D(0,π) such that D(θ0)<D. Let

    T:={T[0,+)|D(θ(t))<D,t[0,T)}.

    Since D(θ0)<D, and D(θ(t)) is a continuous function of t, there exists η>0 such that

    D(θ(t))<D,t[0,η).

    Therefore, the set T is not empty. Let T:=supT. We claim that

    T=. (9)

    Suppose to the contrary that T<. Then from the continuity of D(θ(t)), we have

    D(θ(t))<D,t[0,T),D(θ(T))=D.

    We use Lemma 3.1 and Lemma 3.2 to obtain

    12ddtD(θ(t))2=D(θ(t))ddtD(θ(t))=(θMθm)(˙θM˙θm)=(θMθm)1˙θM+˙θm2KNNl=1cos(θlθM+θm2)sin(θmθM2)(θMθm)1˙θM+˙θm2KNNl=1cosD2sin(θmθM2)(θMθm)1ω0+KKNNl=1cosD2sin(θmθM2)=2KcosD2ω0+KD(θ)2sinD(θ)2KcosD2πω0+KD(θ)2,t[0,T).

    Here we used the relations

    D2<D(θ)2θlθM20θlθm2D(θ)2<D2

    and

    xsinx2πx2,x[π2,π2].

    Therefore, we have

    ddtD(θ)KcosD2πω0+KD(θ),t[0,T), (10)

    which implies that

    D(θ(T))D(θ0)eKcosD2πω0+KT<D(θ0)<D.

    This is contradictory to D(θ(T))=D. The claim (9) is proved, which yields the desired result.

    Now we can give a proof for Theorem 2.2.

    Proof of Theorem 2.2.. According to Lemma 3.3, we substitute T= into (10), then (5) is proved with λ1=KcosD2πω0+K.

    On the other hand, by (5) there exist t0 and δ(0<δ<π2) such that D(θ(t))δ for tt0. Now we differentiate (8) to find

    ˙νi=K2NνiNl=1cos(θlθi)(νlνi).

    Using Lemma 3.2, we now consider the temporal evolution of D(ν(t)):

    ddtD(ν)=˙νM˙νm=K2NνMNl=1cos(θlθνM)(νlνM)K2NνmNl=1cos(θlθνm)(νlνm)Kcosδ2NνMNl=1(νlνM)Kcosδ2NνmNl=1(νlνm)K2Ncosδω0+KNl=1(νlνM)K2Ncosδω0+KNl=1(νlνm)=Kcosδ2Nω0+KNl=1(νlνMνl+νm)=Kcosδ2ω0+KD(ν),tt0.

    This implies that

    D(ν(t))D(ν(t0))eKcosδ2ω0+K(tt0),tt0,

    and proves (6) with λ2=Kcosδ2ω0+K.

    Remark 3. Theorem 2.2 shows, as long as the initial phases are confined inside an arc with geodesic length strictly less than π, complete phase synchronization occurs exponentially fast. This extends the main result in [5] where the initial phases for synchronization need to be confined in an arc with geodesic length less than π/2.

    In this subsection, we prove the main result for nonidentical oscillators with frustration.

    Lemma 3.4. Let θ:=(θ1,θ2,,θN) be a solution to the coupled system (4), then for any i,j{1,2,,N}, we have

    (˙θi˙θj)(˙θi+˙θj)D(ω)+KNNl=1[sin(θlθi+α)sin(θlθj+α)].

    Proof. By (4) and for any i,j{1,2,,N}

    (˙θi˙θj)(˙θi+˙θj)=(˙θi)2(˙θj)2,

    the result is immediately obtained.

    Lemma 3.5. Let θ:=(θ1,θ2,,θN) be a solution to the coupled system (4) and ω_K+1, then we have

    ˙θi[ω_K,ˉω+K],i=1,2,,N.

    Proof. From (4), we have

    ω_K(˙θi)2ˉω+K,i=1,2,,N,

    and also because ˙θi>0. The following lemma gives a trapping region for nonidentical oscillators.

    Lemma 3.6. Let θ:=(θ1,θ2,,θN) be a solution to the coupled system (4) with K>Kc and [ω_,ˉω][K+1,12sin2|α|). If the initial configuration θ0B, then θ(t)B for t0.

    Proof. We define the set T and its supremum:

    T:={T[0,+)|D(θ(t))<D|α|,t[0,T)},T:=supT.

    Since θ0B, and note that D(θ(t)) is a continuous function of t, we see that the set T is not empty and T is well-defined. We now claim that

    T=.

    Suppose to the contrary that T<. Then from the continuity of D(θ(t)), we have

    D(θ(t))<D|α|,t[0,T),D(θ(T))=D|α|.

    We use Lemma 3.4 to obtain

    12ddtD(θ)2=D(θ)ddtD(θ)=D(θ)(˙θM˙θm)D(θ)1˙θM+˙θm[D(ω)+KNNl=1(sin(θlθM+α)sin(θlθm+α))]I.

    For I, we have

    I=D(ω)+KcosαNNl=1[sin(θlθM)sin(θlθm)]+KsinαNNl=1[cos(θlθM)cos(θlθm)].

    We now consider two cases according to the sign of α.

    (1) α[0,π4). In this case, we have

    ID(ω)+KcosαsinD(θ)ND(θ)Nl=1[(θlθM)(θlθm)]+KsinαNNl=1[1cosD(θ)]=D(ω)K[sin(D(θ)+α)sinα]=D(ω)K[sin(D(θ)+|α|)sin|α|].

    (2) α(π4,0). In this case, we have

    ID(ω)+KcosαsinD(θ)ND(θ)Nl=1[(θlθM)(θlθm)]+KsinαNNl=1[cosD(θ)1]=D(ω)K[sin(D(θ)α)+sinα]=D(ω)K[sin(D(θ)+|α|)sin|α|].

    Here we used the relations

    sin(θlθM)θlθM,sin(θlθm)θlθmsinD(θ)D(θ),

    and

    cosD(θ)cos(θlθM),cos(θlθm)1,l=1,2,,N.

    Since D(θ(t))+|α|<D<π for t[0,T), we obtain

    ID(ω)K[sin(D(θ)+|α|)sin|α|] (11)
    D(ω)+Ksin|α|KsinDD(D(θ)+|α|). (12)

    By (12) and Lemma 3.5 we have

    12ddtD(θ)2D(θ)1˙θM+˙θm(D(ω)+Ksin|α|KsinDD(D(θ)+|α|))=D(ω)+Ksin|α|˙θM+˙θmD(θ)KsinDD(˙θM+˙θm)D(θ)(D(θ)+|α|)D(ω)+Ksin|α|2ω_KD(θ)KsinDD2ˉω+KD(θ)(D(θ)+|α|),t[0,T).

    Then we obtain

    ddtD(θ)D(ω)+Ksin|α|2ω_KKsinD2Dˉω+K(D(θ)+|α|),t[0,T),

    i.e.,

    ddt(D(θ)+|α|)D(ω)+Ksin|α|2ω_KKsinD2Dˉω+K(D(θ)+|α|)=KsinD2ˉω+KKsinD2Dˉω+K(D(θ)+|α|),t[0,T).

    Here we used the definition of sinD. By Gronwall's inequality, we obtain

    D(θ(t))+|α|D+(D(θ0)+|α|D)eKsinD2Dˉω+Kt,t[0,T),

    Thus

    D(θ(t))(D(θ0)+|α|D)eKsinD2Dˉω+Kt+D|α|,t[0,T).

    Let tT and we have

    D(θ(T))(D(θ0)+|α|D)eKsinD2Dˉω+KT+D|α|<D|α|,

    which is contradictory to D(θ(T))=D|α|. Therefore, we have

    T=.

    That is,

    D(θ(t))D|α|,t0.

    Lemma 3.7. Let θ:=(θ1,θ2,,θN) be a solution to the coupled system (4) with K>Kc and [ω_,ˉω][K+1,12sin2|α|). If the initial configuration θ(0)B, then

    ddtD(θ(t))D(ω)+Ksin|α|2ω_KK2ˉω+Ksin(D(θ)+|α|),t0.

    Proof. It follows from (11) and Lemma 3.5, Lemma 3.6 and that we have

    12ddtD(θ)2=D(θ)ddtD(θ)D(θ)1˙θM+˙θm[D(ω)K(sin(D(θ)+|α|)sin|α|)]=D(ω)+Ksin|α|˙θM+˙θmD(θ)Ksin(D(θ)+|α|)˙θM+˙θmD(θ)D(ω)+Ksin|α|2ω_KD(θ)Ksin(D(θ)+|α|)2ˉω+KD(θ),t0.

    The proof is completed.

    Lemma 3.8. Let θ:=(θ1,θ2,,θN) be a solution to the coupled system (4) with K>Kc and [ω_,ˉω][K+1,12sin2|α|). If the initial configuration θ(0)B, then for any small ε>0 with D1+ε<π2, there exists some time T>0 such that

    D(θ(t))<D1|α|+ε,tT.

    Proof. Consider the ordinary differential equation:

    ˙y=D(ω)+Ksin|α|2ω_KK2ˉω+Ksiny,y(0)=y0[0,D). (13)

    It is easy to find that y=D1 is a locally stable equilibrium of (13), while y=D is unstable. Therefore, for any initial data y0 with 0<y0<D, the trajectory y(t) monotonically approaches y. Then, for any ε>0 with D1+ε<π2, there exists some time T>0 such that

    |y(t)y|<ε,tT.

    In particular, y(t)<y+ε for tT. By Lemma 3.7 and the comparison principle, we have

    D(θ(t))+|α|<D1+ε,tT,

    which is the desired result.

    Remark 4. Since

    sinD1D(ω)K+sin|α|>sin|α|,

    we have D1>|α|.

    Proof of Theorem 2.3. It follows from Lemma 3.8 that for any small ε>0, there exists some time T>0 such that

    suptTD(θ(t))<D1|α|+ε<π2.

    We differentiate the equation (4) to find

    ˙νi=K2NνiNl=1cos(θlθi+α)(νlνi),νi>0.

    We now consider the temporal evolution of D(ν(t)):

    ddtD(ν)=˙νM˙νm=K2NνMNl=1cos(θlθνM+α)(νlνM)K2NνmNl=1cos(θlθνm+α)(νlνm)K2NνMNl=1cos(D1+ε)(νlνM)K2NνmNl=1cos(D1+ε)(νlνm)Kcos(D1+ε)2Nˉω+KNl=1(νlνMνl+νm)=Kcos(D1+ε)2ˉω+KD(ν),tT,

    where we used

    cos(θlθνM+α),cos(θlθνm+α)cos(D1+ε),andνM,νmˉω+K.

    Thus we obtain

    D(ν(t))D(ν(T))eKcos(D1+ε)2ˉω+K(tT),tT,

    and proves (7) with λ3=Kcos(D1+ε)2ˉω+K.

    In this paper, we presented synchronization estimates for the Kuramoto-like model. We show that for identical oscillators with zero frustration, complete phase synchronization occurs exponentially fast if the initial phases are confined inside an arc with geodesic length strictly less than π. For nonidentical oscillators with frustration, we present a framework to guarantee the emergence of frequency synchronization.

    We would like to thank the anonymous referee for his/her comments which helped us to improve this paper.



    [1] M. Wang, G. W. Yang, S. M. Hu, S. T. Yau, A. Shamir, Write-a-video: Computational video montage from themed text, ACM Trans. Graphics, 38 (2019), 1–13. doi: 10.1145/3355089.3356520. doi: 10.1145/3355089.3356520
    [2] R. Yi, Y. J. Liu, Y. K. Lai, P. L. Rosin, Apdrawinggan: Generating artistic portrait drawings from face photos with hierarchical gans, in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2019), 10743–10752.
    [3] T. Yuan, Y. Wang, K. Xu, R. R. Martin, S. M. Hu, Two-layer qr codes, IEEE Trans. Image Process., 28 (2019), 4413–4428. doi: 10.1109/TIP.2019.2908490.
    [4] H. Li, Q. Zheng, J. Zhang, Z. Du, Z. Li, B. Kang, Pix2pix-based grayscale image coloring method, J. Comput. Aided Comput. Graphics, 33 (2021), 929–938.
    [5] H. Li, M. Zhang, K. Yu, X. Qi, J. Tong, A displacement estimated method for real time tissue ultrasound elastography, Mobile Netw. Appl., 26 (2021), 1–10. doi: 10.1007/s11036-021-01735-3. doi: 10.1007/s11036-021-01735-3
    [6] T. Welsh, M. Ashikhmin, K. Mueller, Transferring color to greyscale images, ACM Trans. Graph., 21 (2002), 277–280. doi: 10.1145/566570.566576. doi: 10.1145/566570.566576
    [7] Y. Jing, Z. J. Chen, Analysis and research of globally matching color transfer algorithms in different color spaces, Comput. Eng. Appl., (2007), 45–54.
    [8] S. F. Yin, C. L. Cao, H. Yang, Q. Tan, Q. He, Y. Ling, et al., Color contrast enhancent method to imprrove target detectability in night vision fusion, J. Infrared Milli. Waves, 28 (2009), 281–284.
    [9] M. W. Xu, Y. F. Li, N. Chen, S. Zhang, P. Xiong, Z. Tang, et al., Coloration of the low light level and infrared image using multi-scale fusion and nonlinear color transfer technique, Infrared Techn., 34 (2012), 722–728.
    [10] Z. P, M. G. Xue, C. C. Liu, Night vision image color fusion method using color transfer and contrast enhancement, J. Graphics, 35 (2014), 864–868.
    [11] R. Zhang, J. Zhu, P. Isola, X. Geng, A. S. Lin, T. Yu, et al., Real-time user-guided image colorization with learned deep priors, preprint, arXiv: 1705.02999.
    [12] Z. Cheng, Q. Yang, B. Sheng, Deep colorization, preprint, arXiv: 1605.00075.
    [13] K. Nazeri, E. Ng, M. Ebrahimi, Image colorization using generative adversarial networks, in International Conference on Articulated Motion and Deformable Objects, (2018), 85–94. doi: 10.1007/978-3-319-94544-69.
    [14] H. Li, Q. Zheng, W. Yan, R. Tao, X. Qi, Z. Wen, Image super-resolution reconstruction for secure data transmission in internet of things environment, Math. Biosci. Eng., 18 (2021), 6652–6671. doi: 10.3934/mbe.2021330. doi: 10.3934/mbe.2021330
    [15] H. A. Li, Q. Zheng, X. Qi, W. Yan, Z. Wen, N. Li, et al., Neural network-based mapping mining of image style transfer in big data systems, Comput. Intell. Neurosci., 21 (2021), 1–11. doi: 10.1155/2021/8387382. doi: 10.1155/2021/8387382
    [16] C. Xiao, C. Han, Z. Zhang, J. Qin, T. Wong, G. Han, et al., Example-based colourization via dense encoding pyramids, Comput. Graph. Forum, 12 (2019), 20–33. doi: 10.1111/cgf.13659. doi: 10.1111/cgf.13659
    [17] S. S. Huang, H. Fu, S. M. Hu, Structure guided interior scene synthesis via graph matching, Graph. Models, 85 (2016), 46–55. doi: 10.1016/j.gmod.2016.03.004. doi: 10.1016/j.gmod.2016.03.004
    [18] Y. Liu, K. Xu, L. Yan, Adaptive brdf mriented multiple importance sampling of many lights, Comput. Graph. Forum, 38 (2019), 123–133. doi: 10.1111/cgf.13776. doi: 10.1111/cgf.13776
    [19] S. S. Huang, H. Fu, L. Wei, S. M. Hu, Support substructures: Support-induced part-level structural representation, 22 (2015), 2024–36. doi: 10.1109/TVCG.2015.2473845.
    [20] G. Larsson, M. Maire, G. Shakhnarovich, Learning representations for automatic colorization, in European Conference on Computer Vision, Springer International Publishing, (2016), 577–593. doi: 10.1007/978-3-319-46493-035.
    [21] I. H. Iizuka S, Simo-Serra E, Let there be color!: Joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification, ACM Trans. Graph., 35 (2016), 577–593. doi: 10.1145/2897824.2925974. doi: 10.1145/2897824.2925974
    [22] R. Zhang, P. Isola, A. A. Efros, Colorful image colorization, Comput. Vision Pattern Recogn., 9907 (2016), 649–666. doi: 10.1007/978-3-319-46487-940. doi: 10.1007/978-3-319-46487-940
    [23] C. Li, J. Guo, C. Guo, Emerging from water: Underwater image color correction based on weakly supervised color transfer, IEEE Signal Proc. Lett., 25 (2018), 323–327. doi: 10.1109/LSP.2018.2792050. doi: 10.1109/LSP.2018.2792050
    [24] R. Zhou, C. Tan, P. Fan, Quantum multidimensional color image scaling using nearest-neighbor interpolation based on the extension of frqi, Mod. Phys. Lett. B, 31 (2017), 175–184. doi: 10.1142/s0217984917501846. doi: 10.1142/s0217984917501846
    [25] E. Reinhard, M. Adhikhmin, B. Gooch, P. Shirley, Color transfer between images, IEEE Comput. Graph. Appl., 21 (2001), 34–41. doi: 10.1109/38.946629. doi: 10.1109/38.946629
    [26] P. Isola, J. Zhu, T. Zhou, A. A. Efro, Image-to-image translation with conditional adversarial networks, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (2016), 1125–1134. doi: arXiv-1611.07004.
    [27] L. Tao, Review on gabor expansion and transform, J. Anhui Univ., 41 (2017), 2–13.
    [28] R. Yi, Y. J. Liu, Y. K. Lai, P. L. Rosin, Unpaired portrait drawing generation via asymmetric cycle mapping, in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2020), 8214–8222. doi: 10.1109/CVPR42600.2020.00824.
    [29] Z. H. Wang, Z. Z. Wang, Robust cell segmentation based on gradient detection, Gabor filtering and morphological erosion, Biomed. Signal Proces. Control, 65 (2021), 1–13. doi: 10.1016/j.bspc.2020.102390. doi: 10.1016/j.bspc.2020.102390
    [30] V. Kouni, H. Rauhut, Star DGT: a robust gabor transform for speech denoising, preprint, arXiv: 2104.14468.
    [31] Y. Chen, L. Zhu, P. Ghamisi, X. Jia, G. Li, L. Tang, Hyperspectral Images Classification With Gabor Filtering and Convolutional Neural Network, IEEE Geosci. Remote Sens. Lett., 14 (2020), 2355–2359. doi: 10.1109/LGRS.2017.2764915. doi: 10.1109/LGRS.2017.2764915
    [32] H. W. Sino, Indrabayu, I. S. Areni, Face recognition of low-resolution video using gabor filter and adaptive histogram equalization, in 2019 International Conference of Artificial Intelligence and Information Technology (ICAIIT), (2019), 417–421. doi: 10.1109/ICAIIT.2019.8834558.
    [33] X. Lin, X. Lin, X. Dai, Design of two-dimensional gabor filters and implementation of iris recognition system, Telev. technol., 35 (2011), 109–112.
    [34] I. J. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, et al., Generative adversarial networks, Adv. Neural Inform. Proc. Sys., 3 (2014), 2672–2680, .
    [35] X. Mao, Q. Li, H. Xie, R. Y. K. Lau, Z. Wang, S. P. Smolley, Least squares generative adversarial networks, in Proceedings of the IEEE International Conference on Computer Vision, (2016), 2813–2821.
    [36] I. Gulrajani, F. Ahmed, M. Arjovsky, V. Dumoulin, A. Courville, Improved training of wasserstein gans, preprint, arXiv: 1704.00028.
    [37] Z. Zhang, M. R. Sabuncu, Generalized cross entropy loss for training deep neural networks with noisy labels, in 32nd Conference on Neural Information Processing Systems (NeurIPS), (2018), 1–14.
    [38] M. Arjovsky, S. Chintala, L. Bottou, Wasserstein gan, preprint, arXiv: 1701.07875.
    [39] F. Duan, S. Yin, P. Song, W. Zhang, H. Yokoi, Automatic welding defect detection of x-ray images by using cascade adaboost with penalty term, IEEE Access, 7 (2019), 125929–125938. doi: 10.1109/ACCESS.2019.2927258. doi: 10.1109/ACCESS.2019.2927258
    [40] CycleGAN/datasets, Summer2winter, 2000. Available from: https://people.eecs.berkeley.edu/taesungpark/CycleGAN/datasets.
    [41] Z. Wang, A. C. Bovik, H. R. Sheikh, E. P. Simoncelli, Image quality assessment : From error visibility to structural similarity, IEEE Trans. Image Process., (2004), 600–612. doi: 10.1109/TIP.2003.819861.
    [42] A. Horé, D. Ziou, Image quality metrics: Psnr vs. ssim, in International Conference on Pattern Recognition, (2010), 2366–2369. doi: 10.1109/ICPR.2010.579.
  • This article has been cited by:

    1. Sha Xu, Xiaoyue Huang, Hua Zhang, 2024, Synchronization of a Kuramoto-like Model with Time Delay and Phase Shift, 978-9-8875-8158-1, 5299, 10.23919/CCC63176.2024.10662837
    2. Sun-Ho Choi, Hyowon Seo, Inertial power balance system with nonlinear time-derivatives and periodic natural frequencies, 2024, 129, 10075704, 107695, 10.1016/j.cnsns.2023.107695
  • Reader Comments
  • © 2022 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(3728) PDF downloads(186) Cited by(20)

Figures and Tables

Figures(9)  /  Tables(10)

Other Articles By Authors

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog