1.
Introduction
We consider the second-order cone complementarity problem (SOCCP), which is to find (x,y)∈Rn×Rn such that
where F:Rn→Rn is a continuously differentiable function, K⊂Rn is the Cartesian product of second-order cones (SOCs), that is, K=Kn1×⋯×Knr with r,n1,...,nr≥1 and n=∑ri=1ni, where Kni are the ni-dimensional second-order cone defined by
Here and below, ‖⋅‖ denotes the 2-norm. Since K1 is the set of nonnegative real values R+ (the nonnegative orthant in R), the SOCCP includes the well-known nonlinear complementarity problem as a special case, corresponding to ni=1 for all i=1,2,...,r.
In the last few years, the SOCCP has attracted a lot of attention due to its wide applicability in many fields (e.g., [2,3,4,14,16]). A number of numerical methods have been proposed to solve the SOCCP among which the smoothing Newton-type method is one of the most effective methods (e.g., [1,5,7,9,11,12,15,18,20,21,22,23]). The main idea of these smoothing Newton-type methods is to use a smoothing function to reformulate the concerned SOCCP as a system of smooth nonlinear equations H(z)=0 and then solve it by using Newton's method. In these smoothing Newton-type methods, it has been proved that any accumulation point z∗ of the generated iteration sequence {zk} satisfies H(z∗)=0. However, many papers do not analyze whether such an accumulation point exists (e.g., [5,15]). To ensure that such an accumulation point exists, existing smoothing Newton-type methods usually require that the solution set of the SOCCP is nonempty and bounded (e.g., [7,9,11,12,18,20,21,22,23]).
Recently, Huang, Hu and Han [10] presented a nonmonotone smoothing algorithm for solving the symmetric cone complementarity problem for which global convergence is established by just requiring that the solution set of the problem is nonempty. Motivated by their work, in this paper, we give a new convergence analysis of a class of smoothing Newton-type methods for the SOCCP. Specifically, we introduce a special regularized Chen-Harker-Kanzow-Smale (CHKS) smoothing function that is perturbed by μt where μ is the smoothing parameter and t∈(0,1/2] is a constant. By using this smoothing function, we reformulate the SOCCP as a system of smooth nonlinear equations Ht(z)=0 (see, Section 3 below) and propose a class of smoothing Newton-type methods to solve it. We prove that, when the solution set of the SOCCP is only nonempty, the proposed method has the following convergence properties.
(ⅰ) It generates a bounded iteration sequence;
(ⅱ) The value of the merit function converges to zero;
(ⅲ) Any accumulation point of the generated iteration sequence is a solution of the SOCCP;
(ⅳ) It has a local quadratic convergence rate under suitable assumptions.
The paper is organized as follows. In Section 2, we introduce Euclidean Jordan algebras associated with the SOC Kn. In Section 3, based on a special regularized CHKS smoothing function, we reformulate the SOCCP as a family of parameterized smooth nonlinear equations. In Section 4, we give a class of smoothing Newton-type methods for solving the SOCCP. In Section 5, we investigate its global and local convergence properties respectively. The numerical results are reported in Section 6. Some conclusions are given in Section 7.
Throughout the paper, Rn denotes the space of n-dimensional real column vectors. Rn+ (Rn++) denotes the nonnegative (positive) orthant in Rn. For convenience, we write (uT1,...,uTm)T as (u1,...,um) for any vectors ui∈Rni. In represents the n×n dimension identity matrix; ⟨⋅,⋅⟩ denotes the Euclidean inner product. intK denotes the interior of K. For any x,y∈Rn, we write x⪰Ky (x≻Ky) if x−y∈K (x−y∈intK). For any α,β>0, α=O(β) (α=o(β)) means that α/β is uniformly bounded (tends to zero) as β→0.
2.
Euclidean Jordan algebras
For any vectors x=(x1,ˉx)∈R×Rn−1 and y=(y1,ˉy)∈R×Rn−1, their Jordan product associated with the SOC Kn is defined by
The identity element under this product is e:=(1,0,...,0)T∈Rn. A vector x∈Rn is said to be invertible if there exists a unique y∈Rn such that x∘y=e. We shall call this y the inverse of x and denote it by x−1. Moreover, if x∈Kn, then there exists a unique vector in Kn, which we denote by √x, such that √x∘√x=x.
For any x=(x1,ˉx)∈R×Rn−1, its spectral decomposition with respect to the SOC Kn is
where λ1(x),λ2(x) and c1,c2 are the spectral values and associated spectral vectors of x, respectively, that are given by
with any ω∈Rn−1 such that ‖ω‖=1.
For any x=(x1,ˉx)∈R×Rn−1 with spectral values λ1(x),λ2(x) and spectral vectors c1,c2, the following results hold:
(1) x2:=λ1(x)2c1+λ2(x)2c2∈Kn and x2=x∘x.
(2) If x∈Kn, then λ2(x)≥λ1(x)≥0 and √x=√λ1(x)c1+√λ2(x)c2.
(3) If x∈intKn, then λ2(x)≥λ1(x)>0 and x−1=λ1(x)−1c1+λ2(x)−1c2.
Given an element x=(x1,ˉx)∈R×Rn−1, we define the symmetric matrix
It is easy to verify that Lxy=x∘y,∀y∈Rn. Moreover, if x∈intKn, then Lx is invertible with
where det(x):=x21−‖ˉx‖2 denotes the determinant of x.
We can also define the trace of x=(x1,ˉx)∈R×Rn−1 by Tr(x):=λ1(x)+λ2(x)=2x1. Then, for any x,y∈Rn, it holds that Tr(x∘y)=2xTyandTr(e)=2.
3.
Reformulation of the SOCCP
In the following analysis, we assume that K=Kn. This does not result in any loss of generality because our analysis can be easily extended to the general case. Smoothing Newton-type methods are typically designed based on a smoothing function. Up to now, many smoothing functions for the SOCCP have been proposed. Among them, the CHKS smoothing function
is one of the most prominent smoothing functions which satisfies (see, [8,Proposition 4.1])
Chi and Liu [6] proposed a regularized CHKS smoothing function which is denoted as
Based on ϕ, Chi and Liu [6] proposed a non-interior continuation method for solving the SOC optimization problem.
In this paper, we introduce a special regularized CHKS smoothing function which is defined by
where t∈(0,1/2] is a constant. As it will be shown later (see, Theorem 5.1 below), the parameter t∈(0,1/2] plays a key role in proving the boundedness of the generated iteration sequence.
The following theorem gives the continuously differentiable property of the function ϕt, which has a proof that is similar to Theorem 2.4 in [6].
Theorem 3.1. Let ϕt(μ,x,y) be defined by (3.1). Denote w:=√(1−μt)2(x−y)2+4μe. Then ϕt(μ,x,y) is continuously differentiable at any (μ,x,y)∈R++×Rn×Rn with
Moreover, limμ→0ϕt(μ,x,y)=ϕt(0,x,y) and
To reformulate the SOCCP as a family of parameterized smooth equations, we introduce a class of single variable functions as follows.
Assumption 3.1. Assume that h:R→R is a function that satisfiesthe following conditions:
(a) h is continuously differentiable with h′(μ)>0 forany μ>0;
(b) h(μ)=0 implies that μ=0;
(c) −h(μ)h′(μ)∈[−μ,0) for any μ>0;
(d) h(μ)≥μ for any μ≥0;
(e) there exist η1≥0 and η2≥0 such that h′(μ)≤η1h(μ)+η2 for any μ≥0.
Regarding Assumption 3.1, we have the following remarks.
Remark 3.1. (ⅰ) The conditions (a)–(c) were introduced by Jiang [13].
(ⅱ) There are many functions satisfying Assumption 3.1, for example, h(μ)=μ, h(μ)=eμ−1, h(μ)=eμ+μ−1 and so on.
(ⅲ) If h1 and h2 satisfy Assumption 3.1, then αh1+βh2 satisfies Assumption 3.1 for any α,β≥0 with α+β=1.
In the rest of this paper, we let z:=(μ,x,y)∈R×Rn×Rn. We define the function Ht:R×Rn×Rn→R×Rn×Rn as
where ϕt is given in (3.1). Then, by Theorem 3.1 and Assumption 3.1 (b), we can immediately get the following theorem.
Theorem 3.2. (i) (x,y) is the solution of the SOCCP if Ht(z)=0.
(ii) Ht(z) is continuously differentiable at any z=(μ,x,y)∈R++×Rn×Rn with its Jacobian
where (ϕt(z))′μ, (ϕt(z))′x and (ϕt(z))′y are given in Theorem 3.1.
In the case of smoothing Newton-type methods, it is essential that the Jacobian matrix H′t(z) is invertible since the direction of descent should be well defined and unique to solve Ht(z)=0. To establish the nonsingularity of H′t(z), we need the monotonicity of F which has been extensively used in previous studies (e.g., [5,7,9,11,12,15,20,21,22]). The function F is said to be monotone if it satisfies
Under this monotonicity assumption, similarly to the proof of Theorem 5.1 in [12], we can establish the nonsingularity of H′t(z) as follows.
Theorem 3.3. If F is monotone, then H′t(z) is nonsingular for any z∈R++×Rn×Rn.
4.
Class of smoothing Newton-type methods
Let Ht(z) be defined by (3.2). We denote the merit function ft:R1+2n→R+ by
We now give our methods for solving the SOCCP.
Algorithm 4.1. (A class of smoothing Newton-type methods)
Step 0: Choose constants δ,σ∈(0,1) and μ0>0. Choose a function h(μ) satisfying the conditions (a)–(e) in Assumption 3.1. Choose η1≥0 and η2≥0 such that h′(μ)≤η1h(μ)+η2 for any μ≥0. Choose γ∈(0,1) such that γ≤μ0 and γ(η1+η2)<1. Choose (x0,y0)∈Rn×Rn and let z0:=(μ0,x0,y0). Let ˉz:=(1,0,...,0)T∈R1+2n. Set k:=0.
Step 1: If ‖Ht(zk)‖=0, then stop. Otherwise, compute
Step 2: Compute the search direction Δzk:=(Δμk,Δxk,Δyk)∈R1+2n by solving the following system
Step 3: Find a step-size αk:=δlk, where lk is the smallest nonnegative integer l satisfying
Step 4: Set zk+1:=zk+αkΔzk. Set
k:=k+1 and go to Step 1.
Theorem 4.1. If F is monotone, then Algorithm 4.1 is well-defined andcan generate an infinitesequence {zk=(μk,xk,yk)} with μk>0 for any k≥0.
Proof. Suppose that zk=(μk,xk,yk)∈R++×R2n for some k. Then, it follows from Theorem 3.3 that H′t(zk) is nonsingular. Hence, the system (4.3) is solvable. Moreover, by (4.3), we have that
where the first inequality follows from Assumption 3.1(e). By the definition of ζk in (4.2), also notice that min{1,a2}≤a for any a>0; additionally, we have that ζk≤γ and ζk≤γ‖Ht(zk)‖. This together with h(μk)≤‖Ht(zk)‖ gives
By Assumption 3.1(d), we have that ft(zk)≥h(μk)2≥μ2k>0. So, by (4.5) and (4.6), it holds
This implies that Δzk is the direction of descent of ft(z) at zk. Next we show that there exists at least one nonnegative integer l that satisfies (4.4). On the contrary, we suppose that for any nonnegative integer l,
i.e.,
Since μk>0, ft(z) is continuously differentiable at zk. So, by letting l→∞ on both sides of (4.8), we have that f′t(zk)Δzk≥0. This contradicts (4.7). Hence, we can find the step size αk∈(0,1] in Step 3 and get the (k+1)th iteration point zk+1=zk+αkΔzk. Moreover, by the first equation in (4.3), we have that Δμk=−h(μk)h′(μk)+ζk which together with Assumption 3.1(c) gives
Thus, we can conclude that if zk∈R++×R2n for some k, then zk+1 can be generated by Algorithm 4.1 with zk+1∈R++×R2n. Since z0=(μ0,x0,y0)∈R++×R2n, by mathematical induction, we prove the theorem.
5.
Convergence analysis
In this section, we establish the global and local quadratic convergence of Algorithm 4.1 under the assumption that the solution set of the SOCCP is nonempty, without requiring its boundedness.
Lemma 5.1. Let ϕt be defined by (3.1). For any (μ,x,y,c)∈R++×Rn×Rn×Rn, one has
Proof. By Lemma 4.1 in [10], for any (μ,a,b,c)∈R++×Rn×Rn×Rn, we have that
Since ϕt can be rewritten as
we obtain the desired result.
Lemma 5.2. Suppose that F is monotone and {zk=(μk,xk,yk)} is theiteration sequence generated by Algorithm 4.1. Then for all k≥0,
Proof. By Step 0, we have that μ0≥γ≥γmin{1,ft(z0)}. Suppose that μk≥γmin{1,ft(zk)} for some k. Then, from (4.2) and (4.9) it follows that
where the last inequality holds because {ft(zk)} is monotonically decreasing as given by Step 3. So, by mathematical induction, we prove the lemma.
Theorem 5.1. Suppose that F is monotone and the solution set of the SOCCP is nonempty. Then theiteration sequence {zk=(μk,xk,yk)} generated by Algorithm 4.1 is bounded.
Proof. By Theorem 4.1, we have that zk=(μk,xk,yk)∈R++×R2n for all k≥0. Moreover, since the sequence {ft(zk)} is monotonically decreasing, we have that ft(zk)≤ft(z0) for any k≥0. Now we assume ‖zk‖→∞ as k→∞ and we will thus derive a contradiction. Since
where the second inequality holds by Assumption 3.1 (d), we have that ‖(xk,yk)‖→∞ as k→∞. For any t∈(0,1/2], we define
Then, from (4.1), we have the following for any k≥0
For any k≥0, by (5.1), if ft(zk)≥1, then μk≥γ; therefore,
And if ft(zk)<1, then μk≥γft(zk) which gives
By (5.4), (5.5) and (5.6), the sequence {(ak,bk)} is uniformly bounded. Since the solution set of the SOCCP is nonempty, there exists a solution of the SOCCP, denoted by (x∗,y∗)∈Rn×Rn, such that
Now we construct another sequence {(ˆxk,ˆyk)} given
By (5.3), we have that ϕt(μk,xk,yk)=2μtkbk. Thus, from Lemma 5.1 it follows that
By (5.7), (5.8) and (5.9), and also using the fact that ⟨p,q⟩≥0 holds for any p⪰K0 and q⪰K0 (see, [10,Lemma 2.3]), we have that
which together with (5.3), (5.7) and the monotonicity of F gives
where
Furthermore, by (5.2) and (5.10), we have that
which together with ‖(xk,yk)‖→∞ as k→∞ gives
Since {(ak,bk)} is bounded and 0<μk≤√ft(z0) for any k≥0, the sequences {p(μtk,ak,bk)} and {q(μtk,ak,bk)} are all bounded. Also notice that the sequences {xk‖(xk,yk)‖} and {yk‖(xk,yk)‖} are all bounded. Thus, we have that
which is in contradiction to (5.11). The proof is completed.
Remark 5.1. In the proof of Theorem 5.1, the second inequality in (5.6) is essential and it only holds for t∈(0,1/2]. This is why we replace the parameter μ by μt (t∈(0,1/2]) for the CHKS function in (3.1).
Theorem 5.2. Suppose that F is monotone and the solution set of the SOCCP is nonempty. Let {zk=(μk,xk,yk)} be the iteration sequence generated byAlgorithm 4.1. Then
Proof. Since {ft(zk)} is monotonically decreasing, it is convergent. So, there exists a constant f∗≥0 such that
Now we assume f∗>0 and will thus derive a contradiction. Since the sequence {zk=(μk,xk,yk)} is bounded, it has at least one accumulation point, denoted by z∗:=(μ∗,x∗,y∗). Then there exists an infinite subsequence {zk}k∈K⊂{zk} such that limk∈K,k→∞zk=z∗. We now divide the proof into the following two parts.
Part 1. Assume that αk≥c for all k∈K, where c>0 is a fixed constant. Then from Steps 3 and 4, we have the following for all k∈K
By letting k→∞ with k∈K on both sides of the inequality (5.13), we have that f∗≤(1−σc2)f∗ which gives f∗=0. This contradicts the assumption f∗>0.
Part 2. Assume that there exists an infinite subset ˉK⊂K such that limk∈ˉK,k→∞αk=0. Then, by the line search criterion (4.4), we have the following for all k∈ˉK
i.e.,
By (5.1), we have that μ∗≥γmin{1,f∗}>0. Thus, ft(z) is continuously differentiable at z∗. By letting k→∞ with k∈ˉK on both sides of the inequality (5.14), we have that
where Δz∗:=H′t(z∗)−1[−Ht(z∗)+ζ∗h′(μ∗)ˉz]. On the other hand, from Step 3 it follows that
By letting k→∞ with k∈ˉK on both sides of the inequality (5.16), we have that
Hence, we can conclude from (5.15) and (5.17) that f′t(z∗)Δz∗=0. By (4.3), we have the following for all k≥0
By letting k→∞ with k∈ˉK on both sides of the inequality (5.18), and also using f′t(z∗)Δz∗=0, we have that 2[1−γ(η1+η2)]f∗≤0 which together with γ(η1+η2)<1 yields f∗=0. This also contradicts the assumption f∗>0. We complete the proof.
Theorem 5.3. Suppose that F is monotone and the solution set of the SOCCP is nonempty. Then any accumulationpoint of the iteration sequence {zk} generated by Algorithm 4.1 is a solution of ft(z)=0.
Proof. The theorem holds under the conditions of (5.12) and the continuity of ft.
Similar to the proof of Theorem 8 in [19], we obtain the local superlinear and quadratic convergence of Algorithm 4.1 as follows.
Theorem 5.4. Suppose that F is monotone and the solution set of the SOCCP is nonempty. Suppose that z∗ is an accumulationpoint of the infinite sequence {zk} generated by Algorithm 4.1. Suppose that H is semismoothat z∗ and that all V∈∂H(z∗) are nonsingular. Then the whole sequence {zk} converges to z∗ and ‖zk+1−z∗‖=o(‖zk−z∗‖). Furthermore, if H is strongly semismooth at z∗, then ‖zk+1−z∗‖=O(‖zk−z∗‖2).
6.
Numerical experiments
In this section, we discuss how we applied Algorithm 4.1 to solve some SOCCPs. All experiments were performed on a personal computer with 1.96 GB of memory and a Pentium(R) Dual-Core processor 2.93 GHz. The program codes were written in Matlab and run in a Matlab 7.1 environment. For the experiments, we chose h(μ)=eμ−1, μ0=10−2,γ=10−4,σ=10−3,δ=0.8 and t=0.5. We applied ‖Ht(zk)‖≤10−5 as the stopping criterion.
Example 6.1. Consider the following linear SOCCP:
where
Obviously, F is monotone. It is easy to see that x=(α+1,α)T and y=(0,0)T is the solution of the SOCCP for any α≥−0.5. Thus, the solution set of the SOCCP is unbounded. For the experiments, we chose the starting points as follows: (1) x0=rand(2,1),y0=rand(2,1); (2) x0=100×rand(2,1),y0=100×rand(2,1); (3) x0=10×rand(2,1),y0=Mx0+q; (4) x0=−10×rand(2,1),y0=Mx0+q. The numerical results are listed in Table 1 where ST denotes the starting point, IT denotes the number of iterations, HK denotes the value of ‖Ht(z)‖ when Algorithm 4.1 terminates and SOL denotes the solution obtained via Algorithm 4.1.
Example 6.2. Consider the following linear SOCCP:
where
In this example, F is also monotone. It is easy to see that x=(α,α,0) and y=(0,0,0) is the solution of the SOCCP for any α≥0. Thus, the solution set of the SOCCP is also unbounded. A main difference between Example 6.1 and Example 6.2 is that the SOCCP considered in Example 6.2 does not have a strictly complementary solution. For the experiments, the starting points were chosen as follows: (1) x0=y0=(1,1,1); (2) x0=y0=(10,10,10); (3) x0=y0=(1000,1000,1000); (4) x0=(1,1,1),y0=Mx0+q; (5) x0=−(1,1,1),y0=Mx0+q; (6) x0=(10,10,10),y0=Mx0+q; (7) x0=−(10,10,10),y0=Mx0+q. The testing results are listed in Table 2.
Example 6.3. Consider the following nonlinear SOCCP:
where K=K3×K2 and F:R5→R5 is given by
From [9], F is monotone. Via Algorithm 4.1, we obtain one solution x∗≈(0.2324,−0.0731, 0.2206,0.5339,−0.5339)T. We test this problem by implementing the starting point x0=y0 as follows: (1)(0,...,0)T; (2)(1,...,1)T;(3)(−1,...,−1)T;(4)(10,...,10)T; (5)(−10,...,−10)T; (6)(100,...,100)T; (7)(−100, ...,−100)T. For the purpose of comparison, we also implemented the smoothing Newton-type method developed by Narushima, Sagara and Ogasawara [17] to solve this test problem, which has been designed based on the following Fischer-Burmeister smoothing function:
The numerical results are listed in Table 3.
Example 6.4. Consider the following nonlinear SOCCP:
where K=K4 and F:R4→R4 is given by
Via Algorithm 4.1, we obtain one solution x∗≈(0.3278,−0.1893,−0.1893,−0.1893)T. We tested this problem by implementing the starting point x0=y0 as follows: (1)(0,...,0)T;(2)(1,...,1)T;(3)(−1,...,−1)T; (4)(2,...,2)T;(5)(−2,...,−2)T;(6)(4,...,4)T;(7)(−4,...,−4)T; (8)(5,...,5)T;(9)(−5,...,−5)T; (10)(10,...,10)T;(11)(−10,...,−10)T. The numerical results are listed in Table 4, where ∗ denotes that the algorithm fails to get an optimizer in the short CPU time.
From Tables 1 and 2, we can find that Algorithm 4.1 can solve all of the tested problems in very few iterations. Moreover, the numbers of iterations were slightly different for different starting points. From Tables 3 and 4, we may see that our algorithm has some advantages over the smoothing Newton-type algorithm presented in [17]. Although the reported numerical results are preliminary, they demonstrate that the proposed algorithm is promising for solving SOCCPs even though the solution sets of these problems are unbounded.
7.
Concluding remarks
Based on the regularized CHKS smoothing function ϕt in (3.1), we have proposed a class of smoothing Newton-type methods for solving the SOCCP. Unlike many smoothing Newton-type methods, which usually require the boundedness of the solution set, our method is globally and locally superlinearly/quadratically convergent when the solution set of the SOCCP is only nonempty, and it does not require its boundedness.
In the reformulation of the SOCCP, we need a function h that satisfies the conditions (a)–(e) in Assumption 3.1. Some comments on these conditions are explained as follows. The condition (a) ensures that Ht(z) is smooth and h(μ)h′(μ) is well-defined. The condition (b) guarantees that Ht(z)=0 gives μ=0 and that (x,y) is a solution of the SOCCP. The conditions (c) and (d) ensure that the sequence {μk} generated by Algorithm 4.1 is positive and bounded. The condition (e) ensures that the search direction is the direction of descent of the merit function.
Acknowledgements
This work has been supported by the Natural Science Foundation of Henan Province (222300420520) and Key Scientific Research Projects of Higher Education of Henan Province (22A110020). We are very grateful to the referees for their valuable comments and suggestions on the paper as they have considerably improved the paper.
Conflict of interest
The authors declare no conflict of interest.