Loading [MathJax]/jax/output/SVG/jax.js
Research article Special Issues

Faster free pseudoinverse greedy block Kaczmarz method for image recovery

  • The greedy block Kaczmarz (GBK) method has been successfully applied in areas such as data mining, image reconstruction, and large-scale image restoration. However, the computation of pseudo-inverses in each iterative step of the GBK method not only complicates the computation and slows down the convergence rate, but it is also ill-suited for distributed implementation. The leverage score sampling free pseudo-inverse GBK algorithm proposed in this paper demonstrated significant potential in the field of image reconstruction. By ingeniously transforming the problem framework, the algorithm not only enhanced the efficiency of processing systems of linear equations with multiple solution vectors but also optimized specifically for applications in image reconstruction. A methodology that combined theoretical and experimental approaches has validated the robustness and practicality of the algorithm, providing valuable insights for technical advancements in related disciplines.

    Citation: Wenya Shi, Xinpeng Yan, Zhan Huan. Faster free pseudoinverse greedy block Kaczmarz method for image recovery[J]. Electronic Research Archive, 2024, 32(6): 3973-3988. doi: 10.3934/era.2024178

    Related Papers:

    [1] Anatoliy Martynyuk, Gani Stamov, Ivanka Stamova, Yulya Martynyuk–Chernienko . On the regularization and matrix Lyapunov functions for fuzzy differential systems with uncertain parameters. Electronic Research Archive, 2023, 31(10): 6089-6119. doi: 10.3934/era.2023310
    [2] Mehmet Ali Özarslan, Ceren Ustaoğlu . Extended incomplete Riemann-Liouville fractional integral operators and related special functions. Electronic Research Archive, 2022, 30(5): 1723-1747. doi: 10.3934/era.2022087
    [3] Yang Song, Beiyan Yang, Jimin Wang . Stability analysis and security control of nonlinear singular semi-Markov jump systems. Electronic Research Archive, 2025, 33(1): 1-25. doi: 10.3934/era.2025001
    [4] Dojin Kim, Sangbeom Park, Jongkyum Kwon . Some identities of degenerate higher-order Daehee polynomials based on $ \lambda $-umbral calculus. Electronic Research Archive, 2023, 31(6): 3064-3085. doi: 10.3934/era.2023155
    [5] Jin Li, Yongling Cheng . Barycentric rational interpolation method for solving time-dependent fractional convection-diffusion equation. Electronic Research Archive, 2023, 31(7): 4034-4056. doi: 10.3934/era.2023205
    [6] Jin Li, Yongling Cheng . Barycentric rational interpolation method for solving fractional cable equation. Electronic Research Archive, 2023, 31(6): 3649-3665. doi: 10.3934/era.2023185
    [7] Waleed Mohamed Abd-Elhameed, Omar Mazen Alqubori, Abdulrahman Khalid Al-Harbi, Mohammed H. Alharbi, Ahmed Gamal Atta . Generalized third-kind Chebyshev tau approach for treating the time fractional cable problem. Electronic Research Archive, 2024, 32(11): 6200-6224. doi: 10.3934/era.2024288
    [8] ShinJa Jeong, Mi-Young Kim . Computational aspects of the multiscale discontinuous Galerkin method for convection-diffusion-reaction problems. Electronic Research Archive, 2021, 29(2): 1991-2006. doi: 10.3934/era.2020101
    [9] Janthip Jaiprasert, Pattrawut Chansangiam . Exact and least-squares solutions of a generalized Sylvester-transpose matrix equation over generalized quaternions. Electronic Research Archive, 2024, 32(4): 2789-2804. doi: 10.3934/era.2024126
    [10] Xing Zhang, Xiaoyu Jiang, Zhaolin Jiang, Heejung Byun . Algorithms for solving a class of real quasi-symmetric Toeplitz linear systems and its applications. Electronic Research Archive, 2023, 31(4): 1966-1981. doi: 10.3934/era.2023101
  • The greedy block Kaczmarz (GBK) method has been successfully applied in areas such as data mining, image reconstruction, and large-scale image restoration. However, the computation of pseudo-inverses in each iterative step of the GBK method not only complicates the computation and slows down the convergence rate, but it is also ill-suited for distributed implementation. The leverage score sampling free pseudo-inverse GBK algorithm proposed in this paper demonstrated significant potential in the field of image reconstruction. By ingeniously transforming the problem framework, the algorithm not only enhanced the efficiency of processing systems of linear equations with multiple solution vectors but also optimized specifically for applications in image reconstruction. A methodology that combined theoretical and experimental approaches has validated the robustness and practicality of the algorithm, providing valuable insights for technical advancements in related disciplines.



    The mathematical modelling of biological problems always gains the interest of many researchers. The birth-death process introduced by Yule [1], Feller [2] and Kendall [3], represents a natural theoretical framework of different biological studies. Such studies have various applications as population dynamics, genome evolution and etc.. In this paper, I am interested in studying the asexual reproduction of like-individual (organisms, cells, genome, etc.). Beginning by the classical branching process that describes a large population that consists initially of Ne like haploid individuals. In each succeeding generation with assuming non-overlapping, the population produces asexually like individuals with number N(t). Each one of them may give birth to 0,1,2,, individuals with corresponding probabilities p0,p1,p2, such that kpk=1. The individuals of any generation are independent identically distributed random (i.i.d.r.) numbers. The number of individuals in the n-th generation is denoted by a random variable (r.v.) of a Markov-Type. Kolmogorov [4] mathematically formulated this model in the form of the Fokker-Planck equation, namely

    u(x,t)t=(b(x)u(x,t))xx(a(x)u(x,t))x=Lfpu(x,t),0<x<,t0, (1.1)

    where the indepenedent random variable x represents the size and u(x,t) is a probability density function being subjected to the initial condition u(x,0)=δ(x), and there is no boundary conditions imposed on it. a(x) is the expected number of individuals and b(x) is its variance. Kolmogorov assumed in his derivation of (1.1) that the only restriction imposed on the number of the population size Ne is that it is fixed at any generation.

    Later, Feller [5], assumed that the density function u(x,t) is independent of on the total population size Ne and formulated his exponential growth equation as

    u(x,t)t=γ(xu(x,t))xxα(xu(x,t))x,0<x<,t0, (1.2)

    where α and γ are initially assumed to be constants. This equation is called by Feller [5], the exponential population growth because its expected population size is obtained as

    M(t)=0xu(x,t)dx=Neeαt. (1.3)

    That means M(t) is growing up exponentially. α represents the actual rate of population increase and can be written as α=1tln(M(t)Ne). The variance could be written as

    σ2=2γαM(t)Ne(M(t)Ne1),Ne0,M(t)>N0. (1.4)

    Then according to Feller, the mean and the variance are necessarily proportional to the instantaneous population size N(t). As α>0 the population average increases, as α<0 the population decreases. Feller stated that the analytic unique solution of Eq (1.2) could be written in terms of the Bessel function I1, see for more details [5]. According to Feller, the probability that the population dies out before time t is

    Δ(t)=exp(αNeγ11e1αt),t>>0, (1.5)

    and on the long run, i.e., as t, the probability that there is no individual exists is given as

    Δ={eαNeγ,α>01,α<<0.

    For more details about the difference views between the pioneers of the population genetics researchers and the modern studies, see Ewens [6]. Dutykh [7], give an approximate solution of the classical Feller's Eq (1.2) after replacing the drift term (a(x)u(x,t))x by ((ax+cu(x,t)))x. The author reformulated the equation by the so called Lagrangian or material variables, to avoid the unbounded of its variable coefficients. Masoliver [8] studied the non-stationary classical Feller process with time-varying coefficients. The author obtained the exact probability distribution and prove as Ross proved that the probability density function approaches the Gamma distribution on the long run. Recently, Giorno et al. [9] studied the time-inhomogeneous Feller-Type diffusion process in the population dynamics. The authors calculated the expectation, the moment generating function and the periodicity of the density function of the classical diffusion of the birth-death process with immigration.

    The discrete birth-death process or the so called M/M/1 exponential model, represents a system in which an individual (customer) joins a system for having a specific service with rate λ and the service (leaving or death) rate is μ with λμ<1. The server is serving only one customer at each time instant. The probability of finding m (customers) at any time n at the system has the same meaning of the asexual production being studied by Fokker-Planck and is mathematically formulated by Eq (1.1).

    In this paper, I am interested in proving that the discrete birth-death process, with random birth rate λ and with random death rate μ is mathematically formulated by the same Eq (1.1) as the birth and death rats are linearly growth. I am interested also in studying the approximate solution of Eq (1.1), for many cases. The first case, is to assume that the number of individuals is fixed at any generation. The second case is to assume that the number of individuals are randomly vary from a generation to generation. Finally is to add the memory effects on the diffusion process Eq (1.1) by extending the first order time derivative to the Caputo time-derivative, namely

    CDβ0tu(x,t)=γ(xu(x,t))xxα(xu(x,t))x,0<x<,t0,0<β<1. (1.6)

    I prefer to call this equation the time-fractional linear population growth equation. This is allowed as Eq (1.1) represents a solution of a stochastic process and u(x,t)0,xnu(x,t)0 as x for all nN0, see reference [12] for more details about the extension of partial differential equation to fractional differential equation.

    For this aim, I implement two numerical methods. The first method is the finite difference method and the second is the fourth order compact finite difference method. The Grünwald-Letnikov scheme is utilized to find the the discrete scheme of the Caputo time-fractional operator. Abdel-Rehim, see for example [10,11,12], has successfully used the Grünwald-Letnikov scheme to simulate many time-fractional diffusion equations. Talib et al. [13] used another numerical method based on the operational matrices to find the numerical solutions of time-fractional differential equations. The authors used the Caputo and the Riemann-Liouville of two-parametric orthogonal shifted Jaccobi polynomials. Talib et al. [14] has recently generalized the existing operational matrix method to operational matrix of mixed partial derivative terms in Caputo sense. In this improvement, the authors used the orthogonal shifted Legendre polynomials.

    It is worth to say that Polito et al.[15] studied a fractional birth-death process. The authors presented in their paper a subordination relationship connected the fractional birth-death process with the classical birth-death process. Later Polito [16] studied the generalized Yule models. Recently, Ascion et al. [17] studied some non-local diffusion-differential equations related to the birth-death processes and are appeared as discrete approximations of Pearson diffusions. The authors in these papers used the branching processes and the stochastic processes tools to discuss theoretically the fractional birth-death process.

    To this aim, the paper is organized as follows. Section 1 is devoted to the introduction. Section 2 is to derive the diffusion equation of the linear birth-death discrete exponential model. Section 3, is to derive the approximate discrete solutions of the classical (Markov) and non-classical (Non-Markov) linear birth-death process by the finite difference method. Section 4, is for driving the approximate solutions by the fourth order compact finite difference method. Finally, section 5, is to present and to discuss the numerical results.

    The birth death process is a stochastic process being defined as {X(t)=n,t0}, where its states X(0)=0,X(1)=1,X(2)=2, represent the number of customers or the number of (similar individuals) exist in the system at any time t, nN0. Now suppose two time instants t,t+τ with τ0 and two non negative integers i,j that represent the number of individuals [18]. Define the continuous time Markov chain's transition probability from the state X(t) with i number of individuals to its neighbour X(t+τ) with j number of individuals as

    P(t+τ)=P{X(t+τ)=j|X(t)=i,X(tτ)=i1,X(t2τ)=i2,,X(1)=in1,X(0)=in}=P{X(t+τ)=j|X(t)=i}, (2.1)

    or in other words, the process in the sate X(t+τ), depends only in the previous state X(t), and not on all the previous states, i.e., the the process has no memory. The Bays formula for the continuous time Markov chain

    P(t+τ)=k=0=P(X(t+τ|X(t)=k)P(X(t)=k).

    The Kolmogorov's forward equation of the discrete Markov chain reads

    Pij(t+τ)=k=0Pik(τ)Pkj(t).

    Subtract Pij from both sides, where for small τ, one can set Pij(t)=(1Pii(τ))Pij(t). So far, one gets

    Pij(t+τ)Pij(t)=kiPik(τ)Pkj(t)(1Pii(τ))Pij(t),

    where Pii0,i0, i.e., there is no absorbing states and jPij=1. If Pii(τ) is the probability that the process is in state i and will stay in i at the time τ, the 1Pii is the probability that the process is no longer in state i. Now divide both sides by τ and take the limit as τ0, to get

    Pij(t)t=kiCiPkj(t)DiPij(t), (2.2)

    where Ci=limτ0Pikτ, and Di=limτ01Piiτ are constants. For the birth-death process with birth rate λi and death rate μi, see [18], and for j=0, i.e. the system is empty, one has

    Pij(t)t=μ1Pi1(t)λ0Pi0(t). (2.3)

    This equation represents also the exponential queueing model M/M/1 in which there is only one customer in the system and is being served and no one joins the queue. The only restriction for the the queueing system is that λμ<1, to ensure that all the customers will be served. For j1, one has

    Pij(t)t=λj1Pij1(t)(λj+μj)Pij(t)+μj+1Pij+1(t), (2.4)

    λj,(1(λj+μj)),μj are the possible transition probabilities from the state Xj at the time instant tn to the sates Xj+1,Xj,Xj1, respectively, at the time instant tn+1, where Xj=jh. This equation represents the M/M/1 queue in which customers arrive according to Poisson process with arrival rate λj and the customer is served with rate μj and the time of serving is an exponential random variable.

    This equation represents also the first order time derivative of the transition probability Pij at any time instant tn, n0. For simplicity write Pij=Pj, i, and the same for the birth and death rates. The solution of Eq (2.4) represents the probability of finding j individuals at the system at any time t. Now suppose the number of customers in the system, the number of individuals exists at the colony, or the queueing system, are very large. or in other words j, and for mathematical convenience replace j by x. Then one can write λj1Pj1=λ(xh)P(xh), with h0, (λj+μj)Pj=(λ(x)+μ(x))P(x), and μj+1Pj+1=μ(x+h)P(x+h), where h is the space instant and h0. Now, Eq (2.4), could be rewritten as

    P(x,t)t=λ(xh)P(xh)+(λ(x)+μ(x))P(x)+μ(x+h)P(x+h), (2.5)

    and now the Taylor's expansion can be used to expand the terms λ(xh)P(xh) and μ(x+h)P(x+h), to get

    P(x,t)t=h222x2(λ(x)p(x)+μ(x)p(x))hx(λ(x)p(x)μ(x)p(x))+O(h3). (2.6)

    The functions λ(x) and μ(x) could be any smooth convergent functions. For linear birth-death process, one has to choose λ(x)=λx and μ(x)=μx, and henceforth Eq (2.6) is rewritten as

    P(x,t)t(x,t)=h22(λ+μ)2x2(xp(x,t))h(λμ)x(xp(x)). (2.7)

    Let R be the number of x steps and put h=1/R, and define the coefficients

    γ=12R2(λ+μ),α=(λμ)R,RN, (2.8)

    then Eq (2.7), with Eq (2.8) is identical with Eq (1.2), and is called the linear birth-death process. The linear birth-death process is a stochastic exponential model with random birth rate, rate of arrivals, λ(0,1) and random death rate μ(0,1), rate of departure or rate of service. The right hand side of Eq (2.7) is a special the form of the Fokker-Planck operator Lfp, see [12]. So far I prefer to write the linear birth-death process as

    P(x,t)t(x,t)=LfpP(x,t). (2.9)

    The waiting time between any two successive arrivals (birth) and departures (death) are exponentially distributed as eλt and eμt, respectively. The values of λ and μ could be fixed random number at all the next generations and could be computed as exponential random variables at each generation. The expected population size Eq (1.3) of Eq (2.7) is obtained as

    M(t)=0xu(x,t)dx=Neexp(t(λμ)R). (2.10)

    As λ>μ, the population increases and as λ<μ, the population decreases. In the next section, I am going to derive the discrete approximate solution of Eq (1.2), with its α and γ are calculated by Eq (2.8), by the explicit finite difference method (fdm).

    I am beginning the discussion of the approximate solution by the common rules of the explicit fdm as the basic of all the numerical methods. Define the nth-time step as

    tn=nτ,τ>0,nN0. (3.1)

    Introduce the clump y(n) as

    y(n)={y(n)1,y(n)2,,y(n)R2,y(n)R1}T, (3.2)

    where y(n)=y(tn) represents the discrete probability column vector to find m individual at the generation tn or at the time instant tn. To solve the partial differential Eq (1.2) and its equivalent Eq (2.7), the initial value y(0) has to satisfy R1j=1y(0)j=1, nN0. The proper choice is u(x,0)=δ(x), hence fourth

    y(0)={0,1,,0}T. (3.3)

    The discrete scheme of Eq (2.7), reads

    yn+1jynjτ=γh2[h(j+1)ynj+12hynj+h(j1)ynj1]α2h[(j+1)hynj+1(j1)hynj1]+O(h2+τ), (3.4)

    where n0. Define the scaling relation η=τh2, and solve for y(n+1)j, to get

    y(n+1)j=η(j1)(γR+α2R2)y(n)j1+(12jηγR)y(n)j+η(j+1)(γRα2R2)y(n)j+1, (3.5)

    where n0 and y(n+1)j represents the discrete probability density function of finding the system at the time instant tn+1 with m individuals. Summing the coefficients of the y(n)j1,y(n)j,y(n)j+1, one can easily find R1j=1y(n+1)j=1. The difference scheme (3.5) is stable and convergent if the scaling relation η satisfies the following condition

    0<ηR2jγ,1jR1, (3.6)

    and for the suitable choice as j=R2, one gets η1γ. The difference scheme (3.5), could be written in a matrix form as

    y(n+1)=PT.y(n),n0, (3.7)

    where the matrix P=Pij is R1×R1 and is defined as

    Pij={P(1)ij=η(j1)(γR+α2R2),i=j1,j=1,,R1P(2)ij=(12jηγR),i=j,j=1,,R1P(3)ij=η(j+1)(γRα2R2),i=j+1,j=1,,R1. (3.8)

    For proving the stability of this approximate solution, define the two column vectors Λ and 0, with length R1 as

    Λ={1,1,,1}T,0={0,0,,0}T.

    The matrix P is stable if it satisfies the two equal conditions

    ||PT||=max{||PT.ΛΛ||,||Λ0||} (3.9)

    or

    ||PT||=max1iR1R1j=1Pij. (3.10)

    Since P is a stochastic matrix, and PT.Λ=Λ, i.e., the sum over all its rows is 1. The matrix P satisfies the both stability conditions. The greatest eigenvalue of P is 1, then its spectral radius being defined as

    ρ(PT)=max1iRζi, (3.11)

    where {ζi} is the set of the eigenvalues of PT. Then for this case ρ(PT)||PT||=1, see [19] for more details about the stability of the explicit difference methods of the diffusion convection equations. Now for the purpose of computation, it is better to take the transpose of Eq (3.7) and rewrite it as

    z(n+1)=z(n).(I+η.H1),n0, (3.12)

    where z(n)=(y(n))T, I is the unit matrix. H1T is the matrix that satisfies H1T.Λ=0, i.e., the sum over all its rows is zero, and being defined as

    H1ij={H1(1)ij=η(j1)(γR+α2R2),i=j1,j=1,,R1H1(2)ij=2jηγR,i=j,j=1,,R1H1(3)ij=η(j+1)(γRα2R2),i=j+1,j=1,,R1. (3.13)

    The transition probabilities at Eq (3.5), constitute a Markov chain. Therefore, the waiting time between every two random events, arrivals of a new individual, is et, i.e., is exponentially distributed. That means this stochastic process at the time instant tn+1, depends only on the time instant tn, and neither nor all its previous history. In Reality, this is not correct and the history of the process has to be considered. In other words the number of individuals at the time instants tn1, tn2, ,t0, should be known.

    Now, to find the approximate solution of the time-fractional linear growth defined in Eq (1.6). The Caputo time fractional operator of order β is defined for a smooth function f(t) as

    CDβ0tf(t)={1Γ(nβ){t0f(n)(τ)Kβ(tτ)dτ}forn1<β<n,dndtnf(t)forβ=n, (3.14)

    where

    Kβ(tτ)=(tτ)β+1nΓ(nβ).

    The kernel Kβ(tτ) represents the memory function, and it reflects the memory effects of many physical, biological and etc. processes, see [22] and [23].

    Before going on our descretization of the Caputo fractional operator, I give a quick review about the advantages of using this operator on modelling the read–world problems. to do so, recall the definition the Riemann-Liouville fractional integral operator, denoted by Jβ, as

    Jβf(t)=1Γ(β)t0f(τ)(tτ)(1β)dτ,t>0,β>0. (3.15)

    For completeness, one sets J0f(t)=f(t). This means J0 is an identity operator. The Riemann-Liouville fractional derivative operator, for a sufficiently smooth function f(t) given in an interval [0,), is defined as (see for example:[25] and [24])

    (Dβf)(t):={1Γ(mβ)dmdtmt0f(τ)(tτ)β+1mdτ,m1<β<m,dmdtmf(t),m=β, (3.16)

    and

    Dβf(t)=D1J1βf(t).

    From the definitions (3.15) and (3.16), we can define the Riemann-Liouville fractional derivative Dβ as the left inverse of Jβ, β0. Therefore some authors prefer to write the Riemann-Liouville fractional integral operator Jβ as Dβ (e.g. [25,26,27]). For completeness, we have D0=I. One can deduce from the two definitions (3.14) and (3.16) that both the operators are non local but both have different kernels. The definition of Caputo is restrictive than Eq (3.16) because it requires that f(m)(t) exists. therefore, Caputo is more convenience for the mathematical manipulations. For completeness, we have D0=I.

    The Riemann-Liouville fractional derivative of the power function tμ, gives

    Dβtμ=Γ(μ+1)Γ(μ+1β)tμβ,β0.

    This means the Riemann-Liouville fractional derivative of a non-zero constant is different from zero. In fact

    Dβ1=Dβt0=Γ(1)Γ(1β)tβ,0<β<1.

    This is the main disadvantage of this operator. But CDβ0tf(t)=I as β=0. The Caputo operator with the Riemann-Liouville satisfies the relation

    CDβ0tf(t)=JmβDmf(t),m1<βm,

    Caputo can also be defined through its image in the Laplace transform domain, which is

    L{Dβf(t);s}=sβ˜f(s)sβ1f(0)ˊf(0)sβ2f(m1)(0)sβm,s>0.

    The Caputo fractional derivative of order, in the special case 0<β1 satisfies also

    CDβ0tf(t)=J1βDf(t)=Dβ(f(t)f(0+)), (3.17)

    and

    Dβ(f(t)f(0))=DJ1β(f(t)f(0))=Dβf(t)f(0)Γ(1β)tβ, (3.18)

    we can deduce that

    CDβ0tf(t)=Dβ(f(t)f(0)),0<β1, (3.19)

    This is the second difference between the Caputo and the Riemann Liouville derivatis. In other words, the Caputo depends on the initial condition of the function f(t). Recently Diethelm [29] stated in his book "The Main Disadvantage of the Riemann-Liouville Fractional Derivative is that it Fails to Model the Real World Phenomena of Fractional Differential Equation.".

    For discretizing the Caputo time-fractional derivative, I utilize the Grünwald- Letnikov scheme being reads

    CDβ0ty(n+1)j=n+1k=0(1)k(βk)y(n+1k)jy(0)jτβ,0<β1. (3.20)

    where

    CD0t1y(n+1)j=1τ(y(n+1)jy(n)j).

    To find the average number of individuals of this memory-dependent process M(t) defined in Eq (1.3), it is important to write Eq (1.6) in terms of the Fokker-Planck operator Lfp and the Riemann-Liouville fractional derivative operator D0tβ, as

    CDβ0tu(x,t)=D0tβ[u(x,t)u(x,0)]=Lfpu(x,t), (3.21)

    See reference [24]. This equation can also be written as

    u(x,t)u(x,0)=D0tβ(Lfpu(x,t)), (3.22)

    where D0tβ=Jβ, is the Riemann-Liouville fractional. Now multiply both sides of Eq (3.22) by x and integrate over x[0,), with regarding the initial condition u(x,0)=δ(x), and by using the natural properties of u(x,t) as probability density function, namely u(x,t)0, xux0 and x2ux20 as x, to get

    CDβ0tM(t)=αM(t). (3.23)

    This equation has the solution

    M(t)=Eβ(αtβ), (3.24)

    which is a special form of the so called Mittag-Leffler function. In the special case as β=1, it is identical to the exponential function eαt, for its simulation see reference [12]. That means the special case as β gives the same exponential average of individuals defined in Eq (2.10) but as 0<β<1, the average M(t) exhibits proportionally as the power function αt(β+1). Abdel-Rehim [38] has recently simulated the asymptotic behaviour of the Mittag-Leffler function and compared the results with the exponential function et and Hypergeometric1F1[1+n,2+n,t] function, for different values of t, β and n. Now the discrete scheme of the time-fractional population growth Eq (1.6) reads

    y(n+1)jβy(n)jn+1k=2(1)k(βk)y(n+1k)jn+1k=0(1)k(βk)y(0)j=γτβh2[h(j+1)ynj+12hynj+h(j1)ynj1]ατβ2h[(j+1)hynj+1(j1)hynj1], (3.25)

    where its error is of order O(h2+τβ). For convenience, recall the following coefficients

    bn=n+1k=0(1)k(βk),n=0,1,2,
    ck=(1)k+1(βk),k=1,2,,

    which are introduced by Gorenflo et al. [28]. These coefficients satisfy that b0=c1=β, all ck0, bn0, k=1ck=1, and finally satisfy the relation

    bn+nk=1ck=1. (3.26)

    Assuming the new scaling relation as η=τβh2, rearranging the terms of Eq (3.25) and solving for y(n+1)j, to get

    y(n+1)j=n+1k=0bny(0)j+n+1k=2cky(n+1k)j+(β2jηγR)y(n)j+η(j1)(γR+α2R2)y(n)j1+η(j+1)(γRα2R2)y(n)j+1, (3.27)

    where n1. For computing y(n+1)j, the values of y(n)j, y(n1)j, y(n2)j, ,y(0)j, should be known. That means the diffusion process for n1, depends on all the history, the process has a memory. That what is called the Non-Markov process. The difference scheme (3.27), is convergent if the coefficient of y(n)j, is positive and that requires that the scaling relation of this non-classical case should satisfy

    0<ηβR2jγ, (3.28)

    and again by choosing j=R/2, one gets a suitable condition for the scaling relation η. The difference scheme (3.27) could be written in the matrix form as

    z(n+1)=n+1k=0bnz(0)j+n+1k=2ckz(n+1k)j+z(n).(βI+η.H1),n1. (3.29)

    Again the difference scheme (3.27) is stable as the matrix (βI+η.H1)T.Λ=βΛ, then ||(βI+η.H1)T||=β with 0<β<1. That satisfies the stability condition (3.9), and hence forth the second condition (3.10) is satisfied. The maximum eigenvalue of the matrix (βI+η.H1)T is β<1, therefore the spectral radius being defined as of this difference scheme is ρ(βI+η.H1)T<1. Then this difference scheme is stable and the scaling relation condition (3.28) ensures its convergence. Abdel-Rehim [20] proved that the waiting time between every two arrivals (events) on the time-fractional diffusion processes is the Mittag-Leffler function, see also [21] and the references therein for more details about the job of the Mittag-Leffler function on the continuous time random walk.

    For n=0, this is the first state after the initial state. By returning back to Eq (3.25), we find that y(1) represents the probability of finding the system at the state X(1). Therefore, the approximate solution as n=0, is computed according to Eq (3.12) as

    z(1)=z(0).(I+η.H1),n0, (3.30)

    and in this case, the transitions could be described as a Markov chain. In the following section, I use the fourth order compact finite difference method (focfd) to derive the stable difference scheme of studied models to be compared with the results obtained by fdm.

    The finite difference method used in the above section has many advantages such as: it is computationally efficiency, requires simple code structures and it maintain the mass conservation. Its only disadvantage is that it is irregular geometric matching. To interpret this sentence suppose that f(x) is a smooth continuous function and its derivative fx=df(x)dx exists. define the truncation error by O. Define also xi=ih, xi+1=x+h, and xi1=xh. Then one deduce

    fx(xi)=f(xi)f(xi1)h,O(h)

    and

    fx(xi)=f(xi+1)f(xi1)2h,O(h2).

    In general

    fx(xi)nj=nαjf(xi+j),O(hn).

    That means to obtain a truncation error of order O(hn), one needs to use 2n+1 values of f(x) to approximate fx(xi). Therefore, the fdm is inconvenience for solving the partial differential equations with variable coefficients near the boundaries.

    The focfd did overcome this trouble by adding more nodes with few grid points smaller mesh sizes, in order to obtain a higher order of truncation error.

    The focfd has been proved and implemented by many authors. It has been proved that the obtained approximate solution is approximately consistent with the exact solution, especially of the advection convection equations, than by using the common fdm rules.

    Turkel and Singer [30], introduced limited grid sizes to make the high-order compact finite difference schemes produce more accurate solutions. Later [33], the focfd is improved by eliminating the convection term to make it more easier to implement the central difference schemes to solve convection-diffusion equations efficiently. For more details about the advantages and the disadvantages of the compact finite difference methods, see [31,32,34,35,36]. One can deduce from these references that the main advantage of the focfd is the high accuracy.

    It is known that the first δxy(n)j and the second δ2xy(n)j classical spatial discrete central finite difference operators are defined as

    δxy(n)j=y(n)j+1y(n)j12h,δ2xy(n)j=y(n)j+12y(n)j+y(n)j1h2, (4.1)

    where the clump y(n), for this method, is defined as

    y(n)={y(n)2,y(n)2,,y(n)R2,y(n)R2}T. (4.2)

    To implement the focfd one has to use 1st derivative operator that is defined as, see references [33,34],

    (yx)(n)j=δxy(n)j2h(1+16δ2x), (4.3)

    and the 2nd derivative operator is defined as

    (2yx2)(n)j=δ2xy(n)jh2(1+112δ2x). (4.4)

    First apply the focfd method on the classical case (2.7), to get

    (1+16δ2x)(1+112δ2x)(yn+1jynj)=γτh2(1+16δ2x)(δ2xxjynj)ατ2h(1+112δ2x)(δxxjynj)+O(h2+τ), (4.5)

    and use the same scaling relation of the classical Markov case η=τh2, one gets after some manipulations

    172y(n+1)j+2+1472y(n+1)j+1+4272y(n+1)j+1472y(n+1)j1+172y(n+1)j2172y(n)j+21472y(n)j+14272y(n)j1472y(n)j1172y(n)j2=η(j2)R(γ+α24R)yj2+η(j1)R(2γ+10α24R)y(n)j16γηjRy(n)j+η(j+1)R(2γ10α24R)y(n)j+1+η(j+2)R(γα24R)y(n)j+2,n0. (4.6)

    As we see from this difference scheme y(n+1)j is the probability of finding m individuals at the time instant tn+1, i.e., at the states while it may be at one of the states Xj2(tn),Xj1(tn),Xj(tn),Xj+1(tn),Xj+2(tn). This difference scheme could be written in the matrix form as

    KT.y(n+1)KT.y(n)=ηHT.y(n), (4.7)

    where the matrix K is defined as

    Kij={K(1)ij=172,i=j2,j=2,,R2K(2)ij=1472,i=j1,j=2,,R2K(3)ij=4272,i=j,j=2,,R2K(4)ij=1472,i=j+1,j=2,,R2K(5)ij=172,i=j+2,j=2,,R2. (4.8)

    It is clear that the sum over all its elements is one. The matrix H has the form

    Hij={H(1)ij=(j2)R(γ+α24R),i=j2,j=2,,R2H(2)ij=(j1)R(2γ+10α24R),i=j1,j=2,,R2H(3)ij=6γjR,i=j,j=2,,R2H(4)ij=(j+1)R(2γ10α24R),i=j1,j=2,,R2H(5)ij=(j+2)R(γα24R),i=j1,j=2,,R2, (4.9)

    where it is easy to prove that the sum over all its elements is zero. Now take the transpose of each sides of Eq (4.7) and multiply each sides by K1, to get

    z(n+1)=z(n).(I+ηH.K1),n0, (4.10)

    where zn is the transpose of the clump defined in Eq (4.2). Again the obtained approximate solution is stable as (I+η.H.K1)T.Λ=Λ, and the two stability conditions (3.9) and (3.10) are satisfied. Again the scheme is also convergent the scaling relation η satisfies the following condition.

    42726γηjR0.

    Now, I seek to find the approximate solution of the time fractional linear birth-death (linear growth) large population Eq (1.6). Therefore apply the 1nd and the 2nd derivative operators, to get

    (1+16δ2x)(1+112δ2x)(y(n+1)jβy(n)jn+1k=2(1)k(βk)y(n+1k)jn+1k=0(1)k(βk)y(0)j)=γτβh2(1+16δ2x)(δ2xxjynj)ατβ2h(1+112δ2x)(δxxjynj)+O(h2+τβ). (4.11)

    Regarding the initial condition u(x,0)=δ(x) and its discrete clump (3.3), one gets after some mathematical manipulations.

    KT.y(n+1)=n+1k=0bny(0)j+n+1k=2ckKT.y(n+1k)j+βKT.y(n)+ηHT.y(n),n1, (4.12)

    where the matrices K and H are defined in Eqs (4.8) and (4.9) respectively. Again this discrete difference scheme is convergent if the scaling relation η=τβh2, satisfies the positivity condition

    42726βγηjR0.

    The stability of the matrix (βI+ηH.K1) has been previously proven. The case as n=0, is calculated similar to the classical Markov case as

    z(1)=z(0).(I+ηH.K1),. (4.13)

    In the next section, the time evolutions of the obtained approximate solutions will be simulated with different values of the fractional order β and t, to show how the memory affects on the randomly number of individuals existing on the birth-death queueing system (the number of asexually like produced individuals at any colony).

    Feller [5], assumed in his paper that γ=1, and α may has one the three values 0,1,1. Galton-Watson assumed that α and γ are proportional to the initial size of individuals Ne, see [37]. The authors at [37], fix the expected population size as M(t)=M(0)=M0Ne, from Eq (1.3) then α=1tlnNeM0, for λ<μ and substitute on the analytic solution derived by Feller. The authors fix also σ2=γ to be one or two.

    In this paper, I give numerical results for the cases corresponding to λ>μ and λ<μ. To grantee the stability of the difference schemes, the scaling relation η, should satisfy the stability relations (3.6) and (3.28). Further more for better approximate solutions, one has to choose 0<η<<R2jγ for the classical case and 0<η<<βR2jγ for the non-classical case.

    The first group of Figures 18 are devoted for the case λ<μ. I choose λ=0.1 and μ=0.3, i.e., α=0.02 and γ=0.002, and λμ=13.

    Figure 1.  The time evolution of the approximate solutions of the classical case β=1, left, and for the non classical case β=0.75, right.
    Figure 2.  The time evolution of the approximate solutions of the classical case β=1, left, and for the non classical case β=0.75, right.
    Figure 3.  The comparison of time evolution of the approximate solutions of the classical and the non classical case for different values β at fixed values of t.
    Figure 4.  The time evolution of the approximate solutions of the classical case β=1 by the fourth order compact FDM.
    Figure 5.  The time evolution of the approximate solutions of the classical case β=1, left, and for the non classical case β=0.75, right.
    Figure 6.  The comparison of time evolution of the approximate solutions of the classical and the non classical case for different values β at fixed values of t.
    Figure 7.  The comparison of time evolution of the approximate solutions of the classical, left, and non classical case as β=0.75, right.
    Figure 8.  The comparison of time evolution of the approximate solutions of the classical, left, and non classical case as β=0.75, right.

    First the numerical results by the finite difference method: Figure 1, represents the time evolution of the approximate solutions of the classical and time-fractional linear birth death equations, for small values of t.

    Figure 2 represents the time evolution of their y(n), for different values of t. The figure shows that the diffusion of the time-fractional growth is slower than the classical one.

    It is worth to say that all the approximate solutions behave likely for small values of t. The difference on the yaxis becomes larger as t increases.

    The comparison of the approximate solutions by the finite difference method are given in Figure 3. The figure shows also that the classical case diffuses faster than the fractional case.

    Second the numerical results by the fourth order compact finite difference:

    Figure 4 shows the time evolution of the classical case. The figure shows the diffusion is much faster as β=1 than by using the fdm for both small and large values of t.

    Figure 5 represents the time evolution of the classical and non-classical for different values of β and t. The fractional growth is more slower than the classical as it diffuses near its initial condition but the classical diffuses far away than its initial value.

    Figure 6 represents the comparison of the approximate solutions of the classical and non classical. The figure shows that the power growth is slower than the exponential growth.

    Now, I compare the results obtained by the finite difference and the fourth order compact finite difference at Figures 7 and 8. The figures show that the difference between the two methods is very big at small values of t as the focfd diffuses faster. But at t increases the difference becomes smaller.

    The focfd has to imitate the exact solution. it has to be more accurate than the fdm. One can that the behavior is different near x=0 and x=1.

    The second group of Figures 912 are for the case λ>μ. I choose λ=0.3 and μ=0.1, i.e., α=0.02 and γ=0.002, and λμ=3.

    Figure 9.  The time evolution of the approximate solutions of the classical case β=1, left, and for the non classical case β=0.75, right.
    Figure 10.  The comparison of time evolution of the approximate solutions of the classical and the non classical case for different values β at fixed values of t.
    Figure 11.  The time evolution of the approximate solutions of the classical case β=1, left, and for the non classical case β=0.75, right.
    Figure 12.  The comparison of time evolution of the approximate solutions of the classical and the non classical case for different values β at fixed values of t.

    I begin this group the approximate solutions by the finite difference method. Figure 9 represents the approximate solutions of the discussed cases for different values of β and t. It is obvious that the growth diffuses faster than the first group of figures, namely as λ<μ.

    Figure 10 shows the comparison of the solutions for fixed time and different values of β. I used here the fourth order compact finite difference method. One can see that power growth is faster than exponential growth.

    Figure 11 represents the time evolution of the discrete schemes for different values of t by using the fdm. The time fractional is also slower than the classical.

    The comparison of the results obtained by the fourth order compact finite difference for different values of β is shown at Figure 12.

    Now, I compare the numerical results of the finite difference and the fourth order compact finite difference methods at the Figures 13 and 14. The results show that the effect of the drift on the diffusion process is obvious as λ>μ. Also the results show that the classical case always diffuses faster than the classical case.

    Figure 13.  The comparison of time evolution of the approximate solutions of the classical and the non classical case as β=1 left, β=0.75 right at fixed t=3.
    Figure 14.  The comparison of time evolution of the approximate solutions of the classical and the non classical case as β=1 left, β=0.65 right at fixed t=3.

    The comparison between the results of fd and focfd shows that the difference is bigger at the earlier time and the difference becomes smaller on the long run. The difference is also bigger in the classical case than the non-classical case.

    In this paper, I derived the classical birth-death equation. This equation represents the exponential growth of large similar population. Then I extent it to the time fractional birth-death equation as a non-classical partial differential equation. It formulates the power growth of the large similar population. I fix the number of individuals and choose suitable values for the rate of birth and the rate of death to be consistent with the international rates of growth and death. I used the finite difference method and the fourth order compact finite difference method to obtain the approximate solutions of the studied equations. I give numerical results for the rate of birth is bigger than the rate of death and vice versa.

    In general the numerical results show that the time-fractional approximate solution diffuses slower than than the classical one. The power and the exponential growth are faster as λ>μ than as λ<μ. Another important note, is that the time-fractional birth-death process diffuses near its initial values more than the classical case which diffuses far away than it. Finally, The behaviours of the plot near the lateral points are different in both methods and this is consistent with main advantage of the focfd, which is it is more accurate more than the fd especially near the boundaries.

    The author declares there is no conflicts of interest.



    [1] A. C. Kak, M. Slaney, Principles of computerized tomographic imaging, Society for Industrial and Applied Mathematics, New York, 2001.
    [2] J. A. Fessler, B. P. Sutton, Nonuniform fast Fourier transforms using min-max interpolation, IEEE T. Signal Proces., 51 (2003), 560–574. https://doi.org/10.1109/TSP.2002.807005 doi: 10.1109/TSP.2002.807005
    [3] S. F. Gull, G. J. Daniell, Image reconstruction from incomplete and noisy data, Nature, 272 (1978), 686–690. https://doi.org/10.1038/272686a0 doi: 10.1038/272686a0
    [4] X. L. Zhao, T. Z. Huang, X. M. Gu, L. J. Deng, Vector extrapolation based Landweber method for discrete ill-posed problems, Math. Probl. Eng., 2017 (2017), 1375716. https://doi.org/10.1155/2017/1375716 doi: 10.1155/2017/1375716
    [5] S. C. Park, M. K. Park, M. G. Kang, Super-resolution image reconstruction: a technical overview, IEEE Signal Proc. Mag., 20 (2003), 21–36. https://doi.org/10.1109/MSP.2003.120320 doi: 10.1109/MSP.2003.120320
    [6] F. Natterer, F. Wübbeling, Mathematical methods in image reconstruction, Society for Industrial and Applied Mathematics, New York, 2001.
    [7] G. L. Zeng, Image reconstruction—a tutorial, Comput. Med. Imag. Grap., 25 (2001), 97–103. https://doi.org/10.1016/S0895-6111(00)00059-8 doi: 10.1016/S0895-6111(00)00059-8
    [8] J. I. Goldstein, D. E. Newbury, J. R. Michael, N. W. M. Ritchie, J. H. J. Scott, D. C. Joy, X-Rays, in Scanning Electron Microscopy and X-Ray Microanalysis, Springer, (2018), 39–63. https://doi.org/10.1007/978-1-4939-6676-9_4
    [9] P. Toft, The Radon Transform-Theory and Implementation, Ph.D thesis, Technical University of Denmark in Copenhagen, 1996.
    [10] A. Rahman, System of linear equations in Computed Tomography (CT), Bachelor's thesis, Brac University in Dacca, 2018.
    [11] G. T. Herman, Fundamentals of Computerized Tomography: Image Reconstruction from Projections, Springer Science & Business Media, Berlin, 2009.
    [12] Y. Censor, G. T. Herman, M. Jiang, A note on the behavior of the randomized Kaczmarz algorithm of Strohmer and Vershynin, J. Fourier Anal. Appl., 15 (2009), 431–436. https://doi.org/10.1007/s00041-009-9077-x doi: 10.1007/s00041-009-9077-x
    [13] O. Axelsson, Iterative Solution Methods, Cambridge University Press, Cambridge, 1996.
    [14] I. Gohberg, I. A. Fel_dman, Convolution Equations and Projection Methods for Their Solution, American Mathematical Soc., Providence, 2005.
    [15] Z. Z. Bai, C. H. Jin, Column-decomposed relaxation methods for the overdetermined systems of linear equations, Int. J. Appl. Mat. Com.-Pol., 13 (2003), 71–82.
    [16] S. Kaczmarz, Angenäherte auflösung von systemen linearer glei-chungen, Bull. Int. Acad. Pol. Sci. Lett. Class. Sci. Math. Nat., (1937), 355–357.
    [17] M. Brooks, A Survey of Algebraic Algorithms in Computerized Tomography, Master's Thesis, University of Ontario Institute of Technology in Oshawa, 2010.
    [18] Y. Censor, Parallel application of block-iterative methods in medical imaging and radiation therapy, Math. Program., 42 (1988), 307–325. https://doi.org/10.1007/BF01589408 doi: 10.1007/BF01589408
    [19] C. Byrne, A unified treatment of some iterative algorithms in signal processing and image reconstruction, Inverse Probl., 20 (20031), 103. https://doi.org/10.1088/0266-5611/20/1/006 doi: 10.1088/0266-5611/20/1/006
    [20] D. A. Lorenz, S. Wenger, F. Schöpfer, M. Magnor, A sparse Kaczmarz solver and a linearized Bregman method for online compressed sensing, in 2014 IEEE International Conference on Image Processing (ICIP), (2014), 1347–1351. https://doi.org/10.1109/ICIP.2014.7025269
    [21] J. D. Moorman, T. K. Tu, D. Molitor, D. Needell, Randomized Kaczmarz with averaging, BIT Numer. Math., 61 (2021), 337–359. https://doi.org/10.1007/s10543-020-00824-1 doi: 10.1007/s10543-020-00824-1
    [22] T. Strohmer, R. Vershynin, A randomized Kaczmarz algorithm with exponential convergence, J. Fourier Anal. Appl., 15 (2009), 262–278. https://doi.org/10.1007/s00041-008-9030-4 doi: 10.1007/s00041-008-9030-4
    [23] A. Zouzias, N. M. Freris, Randomized extended Kaczmarz for solving least squares, SIAM J. Matrix Anal. A., 34 (2013), 773–793.
    [24] K. Du, X. H. Sun, Pseudoinverse-free randomized block iterative algorithms for consistent and inconsistent linear systems, preprint, arXiv: 2011.10353.
    [25] D. Needell, J. A. Tropp, Paved with good intentions: analysis of a randomized block Kaczmarz method, Linear Algebra Appl., 441 (2014), 199–221. https://doi.org/10.1016/j.laa.2012.12.022 doi: 10.1016/j.laa.2012.12.022
    [26] Z Z. Bai, W. T. Wu, On relaxed greedy randomized Kaczmarz methods for solving large sparse linear systems, Appl. Math. Lett., 83 (2018), 21–26. https://doi.org/10.1016/j.aml.2018.03.008 doi: 10.1016/j.aml.2018.03.008
    [27] Z Z. Bai, W. T. Wu, On greedy randomized Kaczmarz method for solving large sparse linear systems, SIAM J. Sci. Comput., 40 (2018), A592–A606. https://doi.org/10.1137/17M1137747 doi: 10.1137/17M1137747
    [28] E. Rebrova, D. Needell, On block Gaussian sketching for the Kaczmarz method, Numer. Algor., 86 (2021), 443–473. https://doi.org/10.1007/s11075-020-00895-9 doi: 10.1007/s11075-020-00895-9
    [29] Y. Q. Niu, B. Zheng, A greedy block Kaczmarz algorithm for solving large-scale linear systems, Appl. Math. Lett., 104 (2020), 106294. https://doi.org/10.1016/j.aml.2020.106294 doi: 10.1016/j.aml.2020.106294
    [30] I. Necoara, Faster randomized block Kaczmarz algorithms, SIAM J. Matrix Anal. A., 40 (2019), 1425–1452. https://doi.org/10.1137/19M1251643 doi: 10.1137/19M1251643
    [31] T. Elfving, Block-iterative methods for consistent and inconsistent linear equations, Numer. Math., 35 (1980), 1–12. https://doi.org/10.1007/BF01396365 doi: 10.1007/BF01396365
    [32] D. P. Woodruff, Sketching as a tool for numerical linear algebra, Found. Trends Theor. Comput. Sci., 10 (2014), 1–157. http://doi.org/10.1561/0400000060 doi: 10.1561/0400000060
    [33] Y. Zhang, H. Li, L. Tang, Greedy randomized sampling nonlinear Kaczmarz methods, Calcolo, 61 (2024). https://doi.org/10.1007/s10092-024-00577-1 doi: 10.1007/s10092-024-00577-1
    [34] J. Zhang, Y. Wang, J. Zhao, On maximum residual nonlinear Kaczmarz-type algorithms for large nonlinear systems of equations, J. Comput. Appl. Math., 425 (2023), 115065. https://doi.org/10.1016/j.cam.2023.115065 doi: 10.1016/j.cam.2023.115065
    [35] T. Li, T. J. Kao, D. Isaacson, J. C. Newell, G. J. Saulnier, Adaptive Kaczmarz method for image reconstruction in electrical impedance tomography, Physiol. Meas., 34 (2013), 595. https://doi.org/10.1088/0967-3334/34/6/595 doi: 10.1088/0967-3334/34/6/595
    [36] M. B. Cohen, C. Musco, C. Musco, Input sparsity time low-rank approximation via ridge leverage score sampling, in Proceedings of the Twenty-Eighth Annual ACM-SIAM Symposium on Discrete Algorithms, (2017), 1758–1777. https://doi.org/10.1137/1.9781611974782.115
    [37] A. Rudi, D. Calandriello, L. Carratino, L. Rosasco, On fast leverage score sampling and optimal learning, Adv. Neural Inform. Process. Syst., 31 (2018).
    [38] Y. Zhang, H. Li, A count sketch maximal weighted residual Kaczmarz method for solving highly overdetermined linear systems, Appl. Math. Comput., 410 (2021), 126486. https://doi.org/10.1016/j.amc.2021.126486 doi: 10.1016/j.amc.2021.126486
    [39] Y. Jiang, G. Wu, L. Jiang, A semi-randomized Kaczmarz method with simple random sampling for large-scale linear systems, Adv. Comput. Math., 49 (2023). https://doi.org/10.1007/s10444-023-10018-2 doi: 10.1007/s10444-023-10018-2
    [40] G. Wu, Q. Chang, A semi-randomized block Kaczmarz method with simple random sampling for large-scale linear systems with multiple right-hand sides, preprint, arXiv: 2212.08797.
  • Reader Comments
  • © 2024 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(938) PDF downloads(45) Cited by(0)

Figures and Tables

Figures(2)  /  Tables(4)

Other Articles By Authors

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog