1.
Introduction
The weighted linear complementarity problem (WLCP) is to find a pair of vectors belonging to the intersection of a manifold with a cone, such that their product equals a given weight vector. Many equilibrium problems can be modeled as a nonlinear complementarity problem (CP) [1] or a WLCP. The latter may lead to some highly efficient algorithms for solving the corresponding equilibrium problems [2]. It is shown that the Fisher market equilibrium problem [3] can be reformulated as a WLCP. What is more, when the weight vector is a zero vector, a WLCP reduces to a linear complementarity problem (LCP). It should be mentioned that the analysis of WLCP becomes more difficult than the theory of LCP. Now, we summarize some versions of WLCP. In 2016, Potra [4] introduced the sufficient WLCP, generalized the characterization of the sufficient LCP to the sufficient WLCP and then presented a corrector-predictor interior point algorithm (IPA) for its numerical solution. Zhang [5] gave a smoothing Newton algorithm [6] for solving monotone WLCP and proved its global and local convergence. In [7], a variant nonmonotone smoothing algorithm was proposed by Tang for solving monotone WLCP. He and Tang [8] introduced a Levenberg-Marquardt method for WLCP. Recently, Chi, Gowda and Tao [9] presented some existence and uniqueness results for weighted horizontal linear complementarity problem (WHLCP) in the setting of Euclidean Jordan algebras.
IPA can be extended for solving WLCP. Since Karmarkar [10] presented the well-known IPA, which becomes one of the most effective algorithms for optimization. Asadi et al. [11] proposed a full-Newton step IPA for monotone weighted linear complementarity problems (MWLCP) and proved that this algorithm has a quadratic rate of convergence to the target point on the central path. In 2021, Chi and Wang [12] presented a full-Newton step infeasible interior-point method (IIPM) for a special WLCP [13] over the nonnegative orthant.
The IPA based on kernel functions is a popular algorithm in optimization. In this IPA, kernel functions are used to define the search directions and measure the distance to the central path. Darvay presented a new technique for finding search directions for LP problems [14], namely the algebraic equivalent transformation (AET). The most frequently used function in AET technology is the identity map. The idea of this method is to apply a continuously differentiable φ on the centering equation of the central path problem. Darvay [14] used the square root function for constructing search directions. Based on a search direction generated by considering the function φ(t)=√t2(1+√t) in the AET, Kheirfam and Haghighi [15] defined IPA for P∗(κ)-LCPs. In 2020, Darvay et al. [16] used the function φ(t)=t−√t for solving P∗(κ)-LCPs in the AET method. Recently, he considered the kernel function φ(t)=t2 in the new AET v2=v and proposed a predictor-corrector (PC) IPA [17] for P∗(κ)-LCP. Based on a simple locally-kernel function, Zhang et al. [18] proposed a full-Newton step infeasible IPA for monotone linear complementarity problems (MLCP), which obtains the same search directions as [14]. In 2012, Mansouri and Pirhaji [19] considered a continuously differentiable kernel function φ(t)=√t based on Darvay's technique [14] for linear optimization (LO), and they proposed an IPA for MLCP.
Motivated by the aforementioned work, in this paper we consider a PC IPA for P∗(κ)-WLCP. We use AET technology for the system of central path based on the function φ(t)=√t. By applying Newton's method to the transformed system, the search directions are obtained. We prove the global convergence of the algorithm and derive the iteration bound. Our algorithm has the following properties: (1) Our algorithm is well-defined and a solution of P∗(κ)-WLCP can be obtained from a sequence of feasible point of the problem. (2) No line-searches are needed at each iteration. (3) It is shown that our algorithm is convergent.
The remainder of this paper is organized as follows. In Sect. 2, we introduce the search directions of the PC IPA for P∗(κ)-WLCP. The convergence analysis and the iteration bound of the algorithm are shown in Sect. 3. In Sect. 4, we present some numerical results. Finally, some conclusions are given in Sect. 5.
The symbols used throughout the paper are as follows. Rn+(Rn++) represents the non-negative (positive) orthant on Rn. The vector of all ones is denoted by e. As usual, ‖⋅‖ and ‖⋅‖∞ denote the Euclidean and the infinity norms for vectors, respectively. For two given vectors x,y∈Rn, the inner product is defined as xTy=n∑i=1xiyi. We shall also use the notation xy=(xiyi)1≤i≤n. Similarly, the coordinate-wise division of vectors x,y is defined as x/y=(xi/yi)1≤i≤n, where yi(1≤i≤n) is non-zero. minv=min{vi:i=1,2,...,n} (maxv=max{vi:i=1,2,...,n}) is the smallest (maximum) element of a vector v.
2.
A PC IPA for P∗(κ)-WLCP
In this section, we give the central path and search directions for P∗(κ)-WLCP. We consider the AET v2=e for defining search directions. We define the proximity measure in order to measure the distance from the iteration point to the central path.
2.1. The central path and search directions for P∗(κ)-WLCP
For a given matrix M∈Rn×n and a vector q∈Rn, the P∗(κ)-WLCP in Rn consists in finding a pair vectors (x,s)∈Rn×Rn such that
where ω∈Rn++ is a given weight vector. For a nonnegative number κ, we call that M is a P∗(κ)-matrix [20] if
where I+(x)={i:xi(Mx)i>0}, I−(x)={i:xi(Mx)i<0}. The handicap of the matrix M is defined as: ˆκ(M):=min{κ:κ≥0,MisP∗(κ)−matrix}. When κ=0, a P∗(0)-WLCP reduces to a MWLCP.
Let F={(x,s)|−Mx+s=q,x≥0,s≥0} denote the set of all feasible solutions of P∗(κ)-WLCP. Define the strictly feasible region of P∗(κ)-WLCP (2.1) as
It is proved in [4] that if WLCP is not only monotone but also strictly feasible, then it has a solution. Choosing a strictly feasible initial point (x0,s0)∈F0 such that x0s0≥ω, we define
where t∈(0,1]. The central path [14] of P∗(κ)-WLCP (2.1) is formed by the unique solution of the system:
System (2.3) has a solution if the interior-point condition (IPC) holds [21], i.e., there exists a strictly feasible solution (x0,s0)∈F0. Furthermore, if t tends to zero, system (2.3) reduces to (2.1). Then we obtain a solution of P∗(κ)-WLCP (2.1).
Now, we present the search directions for P∗(κ)-WLCP. Define the notations
Let us consider the continuously differentiable function φ:Rn→Rn and suppose that the inverse function φ−1 exists. We use the AET:
Therefore, system (2.3) can be written as
For t∈(0,1], consider the following function
We can see that system (2.5) is equivalent to f(x,s)=0. Using Newton's method, we obtain
where Jf(x,s) denotes the Jacobian matrix of f. After some simple calculations, we have the Newton's system:
where Δx and Δs are search directions. Substituting relation (2.4) into system (2.6), we get
where ¯M=√W(t)−1DMD√W(t), D=diag(d), W(t)=diag(ω(t)) and pv=φ(e)−φ(v2)vφ′(v2). By choosing function φ(t) appropriately, the system (2.7) can be used to define a class of search directions. For example:
∙ φ(t)=t gives the classical search directions [21] pv=v−1−v.
∙ φ(t)=√t2(1+√t) gives the search directions pv=e−v2 which used by Kheirfam in [15].
∙ φ(t)=t−√t gives the search directions pv=2(v−v2)2v−e which used by Darvay in [16].
In this paper, we consider the function φ(t)=√t [14]. Thus, from system (2.7), we have pv=2(e−v). We define the distance from the current iteration point (x,s) to the central path as a proximity measure
For (x,s)∈F0, we have
Hence, δ(v) can be considered as a measure from point (x,s) to the central path. Lemma 1 gives a bound for the component of v, which will be used in the proof of the feasibility.
Lemma 1. [22]) For any v∈Rn, we have
2.2. The corrector step and predictor step
In this subsection, we give the search directions for P∗(κ)-WLCP. We compute (Δx,Δs) from (2.7) by using (2.4). The corrector step is x+=x+Δx, s+=s+Δs. To simplify the analysis, we define
Then
Define
The predictor system is
Then we obtain the search directions (Δpx,Δps) from
After a predictor step, the new iterate is
where θ is a update parameter.
Now, we give a PC IPA for P∗(κ)-WLCP in details. For a given weight vector ω>0, we choose a strictly feasible initial point (x0,s0) such that x0s0≥ω. The update parameter is θ∈(0,12). Our PC IPA takes one corrector step and one predictor step in a main iteration. The corrector step stays in the neighbourhood of the central path. In the corrector step, we take a full-Newton step. We apply Newton's method to system (2.7) and then obtain a search direction (Δx,Δs) of the corrector step for P∗(κ)-WLCP from (2.4). The goal of the predictor step is to reach optimality. We can calculate the predictor search directions (Δpx,Δps) from (2.10) and (2.11). In order to determine the new search directions, the presented PC IPA applies the kernel function φ(t)=√t to the equation v2=e. The stopping criterion is ‖xksk−ω‖≤ε, where ε>0 is an accuracy parameter. The framework of our algorithm is described as Algorithm1.
3.
Analysis of PC IPA for P∗(κ)-WLCP
In this section, we analyze that Algorithm1 is well-defined. Then we establish an upper bound for the value of proximity measure after a full-Newton step. We show that Algorithm1 can solve P∗(κ)-WLCP in polynomial complexity.
3.1. Feasibility of algorithm
In the following, Lemma 2 gives the estimates of dTxds and ‖dxds‖∞ which are important for analyzing the feasibility of Algorithm1. After a corrector step, we define the new point as x+=x+△x,s+=s+Δs.
Lemma 2. (c.f. [20,23]) Let δ=δ(x,s;ω(t)) and x0s0≥ω. Then the following inequality holds:
where κ′=(1+4κ)max(x0s0)−minω4minω and κ′ is the handicap of the matrix ¯M.
Lemma 3. Let x0s0≥ω. The iterate (x+,s+) is positive if δ<1√2+4κ′.
Proof. For any α∈[0,1], let x(α)=x+αΔx, s(α)=s+αΔs. By (2.4), we get
From the second equation in (2.7), it follows that
Since pv=2(e−v), we have for any α∈[0,1]
By Lemma 1, we have −v2+2v≥e−δ2e. Now we obtain from (3.2) and Lemma 2
Thus, for 0≤α≤1, none of the entries of x(α) and s(α) vanishes if δ<1√2+4κ′. Since x(α) and s(α) are both linear functions of α and x(0)=x0>0,s(0)=s0>0, this implies that x(α)>0,s(α)>0. Hence, x+=x(1)>0 and s+=s(1)>0. The proof is complete.
Lemma 3 shows that after the predictor step, both x+ and s+ are strictly feasible. The next lemma gives an upper bound on ‖e−v2+‖.
Lemma 4. Let v+=√x+s+ω(t) and x0s0≥ω. If δ=δ(x,s;ω(t))<1√2+4κ′, then
Proof. By (2.7), (2.9) and (3.1), we obtain
It follows from (3.3) and Lemma 2 that
3.2. Convergence of algorithm
In this subsection, we investigate the upper bound of the proximity measure after a corrector step and a predictor step. Then we show the convergence of Algorithm1. First, we give an upper bound for δ(v+) after a full-Newton step when ω(t) is fixed.
Lemma 5. Let δ(v+)=δ(x+,s+;ω(t)) and x0s0≥ω. If δ=δ(x,s;ω(t))<1√2+4κ′, then
Proof. We have by (2.8)
Then, we will provide an upper bound for ‖ee+v+‖∞. From (3.3) and (3.4), we obtain
It follows from (3.6) that
which implies
According to (3.5), (3.7) and Lemma 4, we derive that
This completes the proof of the lemma.
Let vp=√xpspωp(t) with ωp(t)=(1−2θt)ω(t). In the following lemma, we give an upper bound of proximity measure after a predictor step with ω(t) updated.
Lemma 6. ([24]) Let x0s0≥ω. One has
Lemma 7. Let δ<1√2+4κ′ and x0s0≥ω, then
Proof. From (3.2) with α=1, we have
Let g(λ)=−λ2+2λ, then g′(λ)=−2λ+2. When δ<1√2+4κ′, it follows from Lemma 1 that 0<vi<2 and g(λ)≤g(1)=1. By Lemma 2, we get
Using Lemma 6, we obtain the desired result.
Lemma 8. Let x+>0,s+>0, x0s0≥ω and θ<12√2n(1+2κ′) with n≥2. If δ<1√3(1+4κ′), then xp>0,sp>0.
Proof. Let us define
for 0≤α≤1. We have from (2.12)
Therefore, using system (2.10) we obtain
which implies that
Combining (3.6), (3.9) and Lemma 7 yields that
Now we give the strict positivity of h(δ,θ,n). Let n≥2, θ<12√2n(1+2κ′) and δ<1√3(1+4κ′), we have
The second inequality follows from the fact that f(γ)=2γ21−2γ is increasing for 0<γ<12. Then h(δ,θ,n)>0 with κ′≥0 and n≥2. This implies that xp(α)sp(α)>0 for 0≤α≤1 and 0<θ<12√2n(1+2κ′). Hence xp(α)>0 and sp(α)>0 for all 0≤α≤1. Using xp(0)=x+>0 and sp(0)=s+>0, we have xp(1)=xp>0 and sp(1)=sp>0.
In the next lemma, we investigate the value of the proximity measure after a predictor step.
Lemma 9. Let x0s0≥ω, δ<1√3(1+4κ′) and ωp(t)=(1−2θt)ω(t) with θ<12√2n(1+2κ′), then
where h(δ,θ,n)=1−(1+4κ′)δ2−2n(1+2κ′)θ2t21−2θt[1+(1+4κ′)δ2].
Proof. By the definition of δ(v), we get
We first estimate an lower bound on the component of vp. By (3.10), we obtain
which implies
Using (3.8), we have
It follows from Lemma 4, Lemma 7 and (3.10) that
Combining (3.11)–(3.13) yields that
Lemma 10. Let x0s0≥ω, tp=(1−2θ)t and θ≤2−t8(1+4κ′)√n with n≥2. If δ(v)≤t2(1+4κ′), then δ(vp)≤tp2(1+4κ′).
Proof. From Lemma 9, it follows that δ(vp)≤tp2(1+4κ′) holds, if
Then, we have
Since δ(v)≤t2(1+4κ′) and θmax=14(1+4κ′)√n≤14√2, we obtain from (3.14) that
Here the third inequality follows from the fact that −8θ3−4θ2+8θ is increasing for 0<θ≤14√2. Then (3.14) holds, which implies the result.
3.3. Complexity bound
In this subsection, we will give an upper bound of iterations for Algorithm1. We first examine the value of Gap = ‖xs−ω‖.
Lemma 11. Let x0s0≥ω. If δ(v)≤t2(1+4κ′) and θ≤2−t8(1+4κ′)√n with n≥2, then
where t∈(0,1].
Proof. From (2.2), (3.13) and x0s0≥ω, we have
Suppose that δ(v)≤t2(1+4κ′). Due to the fact that θmax=14(1+4κ′)√n≤14√2 and t∈(0,1], we obtain
Here the third inequality holds because 11−12√2<11−12=2 and 1+14(1+4κ′)≤54. This completes the proof of the lemma.
Lemma 12 provides an upper bound for the number of iterations generated by Algorithm1.
Theorem 12. Let (x0,s0)∈F0, x0s0≥ω and θ≤2−t8(1+4κ′)√n with n≥2. Then Algorithm1 provides an ε-optimal solution of the P∗(κ)-WLCP (2.1) after at most
iterations.
Proof. Let t0=1 and t+=(1−2θ)t. From Lemma 11, we obtain
The inequality ‖xksk−ω‖≤ε holds if
Taking logarithms of both sides and using the inequality log(1−ξ)≤−ξ, (3.15) holds if
Then Algorithm1 finds an ε-optimal solution in at most
iterations. Since t∈(0,1] and θmin=18(1+4κ′)√n, the proof is straightforward.
4.
Numerical examples
In this section, we present some numerical results of P∗(κ)-WLCPs to show the effectiveness of Algorithm1. All the experiments were performed on a personal computer with Intel(R) Core(TM) i5-10210U CPU @2.11 GHz 8.00GB memory. The operating system was Windows 10 and the implementations were done in MATLAB (R2018a). In the implementation of Algorithm1, let x0s0≥ω, accuracy parameter ε=10−5 and Gap=‖xs−ω‖.
Example 1. [25] Consider the P∗(κ)-WLCP (2.1) in R4×4, where
The strictly feasible initial point for Algorithm1 is x0=s0=[1111]T. We set the update parameter θ=0.1. The unique solution of Example 1 is
which takes 0.0261 seconds and 52 iterations.
Example 2. [26] Let us consider the P∗(κ)-WLCP (2.1) with
We choose the initial point x0=e,s0=Mx0+q. The value of update parameter is θ=0.05. The running time and iterations of Algorithm1 for solving Example 2 are denoted by 'CPU' and 'Iter'. Gap and δ(v) are the values of ‖xs−ω‖ and ‖e−v‖, respectively. The numerical results with different n are summarized in Table 1.
Example 3. [27] Consider the P∗(κ)-WLCP (2.1), where the matrix M∈Rn×n and the weight vector ω∈Rn are given by
In this example, we take x0=s0=e and q=−Mx0+s0. Set the update parameters as θ∈{0.05,0.10,0.15,0.20,0.25} and dimensions of the example as n∈{100,300,500,700,900}. The numerical results of Example 3 for different θ and n are shown in Table 2.
It is obvious from Table 1 that the running time and the number of iterations are depend on n. The running time and the number of iterations decrease as n reduces. Furthermore, the number of iterations grows slowly as n increases. It can be seen from Table 2 that the larger θ gives the less running time. Obviously, the minimum value of θ leads to the largest number of iterations.
Example 4. [27] We randomly generate five P∗(κ)-WLCPs (2.1) with M=ATA, where A∈Rn×n, rank(A)=n and n∈{20,100,200,400,600}. The initial point is x0=s0=e. Let the weight vector ω=x0s02 and update parameter θ=0.1. In Table 3, we compare the result of Algorithm1 with the algorithm in MLCP [19]. Moreover, we denote by Algorithm2 the algorithm introduced by Mansouri and Pirhaji [19].
Figures 1 and 2 show the Gap of Example 1 and Example 2 are convergent in the iterative process. Besides, based on the value of δ(v) in Figures 1 and 2, δ(v) reduces to 0 as t tends to zero. The values of Gap in Figures 3 and 4 are provided to demonstrate the convergence of Example 3 and Example 4 with different n. Thus, Algorithm1 could efficiently solve P∗(κ)-WLCP.
5.
Conclusions
We propose a PC IPA for P∗(κ)-WLCP based on the kernel function ϕ(t)=√t. Applying this function to the central path, new search directions for P∗(κ)-WLCP are obtained. The analysis of P∗(κ)-WLCP is more complicated than P∗(κ)-LCP because of the nonzero weight vector. We prove the feasibility and convergence of Algorithm1. Numerical results indicate the efficiency of our algorithm.
Acknowledgments
The authors are grateful to the editor and the anonymous referees for their precious suggestions, which have greatly improved this paper. This research is supported by the National Natural Science Foundation of China (No. 11861026), Guangxi Natural Science Foundation (No. 2021GXNSFAA220034), Innovation Project of GUET Graduate Education (No. 2022YCXS148), Guangxi Key Laboratory of Automatic Detection Technology and Instruments Foundation (No. YQ18112).
Conflict of interest
All authors declare no conflicts of interest in this paper.