The present paper is the result of a contemplative study of a multi-time control problem (MCP) by considering its associated equivalent auxiliary control problem (MCP)ς via the exact l1 penalty method. Further study reveals that the solution set of the considered problem and the auxiliary problem exhibits an equivalence under the KT-pseudoinvexity hypothesis. Moreover, the study is extended towards the saddle point defined for (MCP) to establish the relationship between the solution set of multi-time control problem (MCP) and its associated equivalent auxiliary control problem (MCP)ς. Finally, we present an illustrative application to authenticate the results presented in this paper.
Citation: Preeti, Poonam Agarwal, Savin Treanţă, Kamsing Nonlaopon. Penalty approach for KT-pseudoinvex multidimensional variational control problems[J]. AIMS Mathematics, 2023, 8(3): 5687-5702. doi: 10.3934/math.2023286
[1] | Zhuolin Yan, Xiaowei Jiang, Siyao Wang . Objective penalty function method for nonlinear programming with inequality constraints. AIMS Mathematics, 2024, 9(12): 33572-33590. doi: 10.3934/math.20241602 |
[2] | Cagnur Corekli . The SIPG method of Dirichlet boundary optimal control problems with weakly imposed boundary conditions. AIMS Mathematics, 2022, 7(4): 6711-6742. doi: 10.3934/math.2022375 |
[3] | Wei Yang, Lili Pan, Jinhui Wan . Smoothing gradient descent algorithm for the composite sparse optimization. AIMS Mathematics, 2024, 9(12): 33401-33422. doi: 10.3934/math.20241594 |
[4] | Shabir Ahmad, Saud Fahad Aldosary, Meraj Ali Khan . Stochastic solitons of a short-wave intermediate dispersive variable (SIdV) equation. AIMS Mathematics, 2024, 9(5): 10717-10733. doi: 10.3934/math.2024523 |
[5] | Daniel Gerth, Bernd Hofmann . Oversmoothing regularization with $\ell^1$-penalty term. AIMS Mathematics, 2019, 4(4): 1223-1247. doi: 10.3934/math.2019.4.1223 |
[6] | Jia Li, Changchun Bi . Study of weak solutions of variational inequality systems with degenerate parabolic operators and quasilinear terms arising Americian option pricing problems. AIMS Mathematics, 2022, 7(11): 19758-19769. doi: 10.3934/math.20221083 |
[7] | Ana Klobučar Barišić, Antoaneta Klobučar . Double total domination number in certain chemical graphs. AIMS Mathematics, 2022, 7(11): 19629-19640. doi: 10.3934/math.20221076 |
[8] | Jia Li, Changchun Bi . Existence and blowup of solutions for non-divergence polytropic variation-inequality in corn option trading. AIMS Mathematics, 2023, 8(7): 16748-16756. doi: 10.3934/math.2023856 |
[9] | Savin Treanţă, Cristina-Florentina Marghescu, Laura-Gabriela Matei . Efficiency conditions in multiple-objective optimal control models under generalized hypotheses. AIMS Mathematics, 2024, 9(9): 25184-25204. doi: 10.3934/math.20241228 |
[10] | Lijuan Qin . On the controllability results of semilinear delayed evolution systems involving fractional derivatives in Banach spaces. AIMS Mathematics, 2024, 9(7): 17971-17983. doi: 10.3934/math.2024875 |
The present paper is the result of a contemplative study of a multi-time control problem (MCP) by considering its associated equivalent auxiliary control problem (MCP)ς via the exact l1 penalty method. Further study reveals that the solution set of the considered problem and the auxiliary problem exhibits an equivalence under the KT-pseudoinvexity hypothesis. Moreover, the study is extended towards the saddle point defined for (MCP) to establish the relationship between the solution set of multi-time control problem (MCP) and its associated equivalent auxiliary control problem (MCP)ς. Finally, we present an illustrative application to authenticate the results presented in this paper.
The formulation of several methods for solving nonlinear programming problems with the help of transformation into equivalent auxiliary problem techniques has always grabbed the attention of various mathematicians. The class of exact penalty methods has proved to be of great interest as it enables the transformation of a constrained problem into a single unconstrained problem via the penalty parameter that penalizes any violation of the constraints. Zangwill [21], and Erimen [5] laid the foundation for finding solutions for nonlinear constrained problems via the penalty method. Antczak extensively worked on the exact penalty method for different types of mathematical programming problems under various suitable assumptions [2,3,4]. Further, the penalty approach was applied to multi-dimensional control problems in the presence of convexity by Jayswal and Preeti [7,8].
On the other hand, the notion of convexity paved the way for establishing a number of concepts to facilitate real applications with the help of optimization problems. The concept of invexity is one such concept that proved to be a trailblazer since the moment it was introduced by Hanson [6]. Invexity theory has come a long way since its inception for scalar-constrained optimization problems. Due to its varied range of applications in optimization theory, a plethora of mathematicians have worked extensively in this direction, and they have come up with a variety of generalizations of this concept. To name, the concept of pre-invexity was introduced by Weir, and Mond [20]. Strong and weak convexity was introduced by Jeyakumar [9]. Nahak and Nanda [14] extended the duality results of variational problems to pseudo-invex functions. Noor and Noor [15] introduced strongly α-pre-invex functions. Also, they laid the foundation of the relationship among strongly α-preinvex, strongly α-invex and αη-monotonicities under appropriate conditions.
Further, the concept of KT-invexity emerged from that of invexity when Martin maintained the sufficiency of Kuhn-Tucker (KT) conditions. This also led to the result that KT-invexity is a necessary and sufficient condition for a KT-point to be a global minimizer. Then, the notion of KT-pseudoinvexity was established by Treanţă and Arana-Jimˊenez [17] and it was shown that KT-pseudoinvex multi-dimensional control problem is formulated in such a way that KT-point serves as an optimal solution. After that, Treanţă efficiently generalized KT-pseudoinvexity and derived interesting results under various hypotheses for control problem [18,19]. For other but connected points of view, the reader can consult Jiang et al. [10], Lin [11] and Lin et al. [12].
The present work is organized as follows: Section 2 includes some definitions, preliminaries, and notations, which will help to understand the developed results in this paper. Section 3 addresses the unconstrained problem corresponding to (MCP) and demonstrates that the solution set of considered constrained problem and its corresponding unconstrained problem coincide under KT-pseudoinvexity. Further, we furnish the developed results via a non-trivial example in Section 4. Finally, the conclusion of the paper is summarized in Section 5.
Let Rl,Ru and Rv be three Euclidean spaces of dimensions l,u and v, respectively. Let φs0,s1⊂Rl be a hyper-parallelepiped joint by s0=(sϱ0) and s1=(sϱ1),ϱ=¯1,l, where s0=(sϱ0) and s1=(sϱ1) are points situated diagonally opposite to each other. The point s=((sϱ),ϱ=¯1,l)∈φs0,s1⊂Rl is known as multi-time. Let A be the space of state functions (piecewise smooth) a:φs0,s1⊂Rl→Ru, a=(aκ)∈Ru. Let B be the space of control functions (piecewise continuous) b:φs0,s1⊂Rl→Rv, b=(bj)∈Rv. ds=ds1∧⋯∧dsl is the volume element on Rl⊃φs0,s1.
Mathematically, the multi-time control problem is modulated as follows:
(MCP)min(a(⋅),b(⋅))∫φs0,s1ψ(s,a(s),b(s))dssubject toζm(s,a(s),b(s))≤0,m=¯1,r,∂aκ∂sϱ=ηκϱ(s,a(s),b(s)),κ∈¯1,u,ϱ=¯1,l,a(s0)=a0,a(s1)=a1, |
where s∈φs0,s1, ψ:φs0,s1×A×B→R, ζm:φs0,s1×A×B→R,m=¯1,r, ηϱ=(ηκϱ):φs0,s1×A×B→Ru and ϱ=¯1,l represent C∞-class functionals. The function ηϱ fulfils complete integrability conditions (closeness conditions)
Dβηϱ=Dϱηβ,ϱ,β=¯1,l,ϱ≠β, |
where Dβ is the total derivative.
Let
ϑ={(a,b)∈A×B:ζm(s,a(s),b(s))≤0,∂aκ∂sϱ=ηκϱ(s,a(s),b(s)),a(s0)=a0,a(s1)=a1,s∈φs0,s1,m=¯1,r,κ∈¯1,u,ϱ=¯1,l} |
be the feasible set for (MCP).
To simplify the representation of the paper, we signify some notations as: a=a(s),ˉa=ˉa(s),ˆa=ˆa(s),b=b(s),ˉb=ˉb(s),ˆb=ˆb(s), π=(s,a(s),b(s)),ˉπ=(s,ˉa(s),ˉb(s)),ˆπ=(s,ˆa(s),ˆb(s)),ς=ς(s),ˉς=ˉς(s) and φ=φs0,s1.
Definition 2.1. A solution (ˉa,ˉb)∈ϑ is said to be an optimal solution to (MCP), if
∫φψ(ˉπ)ds≤∫φψ(π)ds,∀(a,b)∈ϑ. |
Definition 2.2. [17] The multi-time control problem (MCP) is said to be KT-pseudoinvex at (ˉa,ˉb)∈ϑ if for all Lagrange multipliers (piecewise smooth) ˉνm=(ˉνm(s))∈R+,m=¯1,r,ˉγκϱ=(ˉγκϱ(s))∈R,κ=¯1,u,ϱ=¯1,l, there exist θ:φ×A×B×Rr×Rul→Ru of C1-class with θ|∂ϕ and ξ:φ×A×B×Rr×Rul→Rv of C0-class with ξ|∂ϕ such that for all (a,b)∈A×B
∫φψ(π)ds−∫φψ(ˉπ)ds<0. |
Then, we obtain
∫φ[ψa(ˉπ)+ˉνm(ζm)a(ˉπ)+ˉγκϱ(ηκϱ)a(ˉπ)]θds−∫φˉγκϱDϱθds+∫φ[ψb(ˉπ)+ˉνm(ζm)b(ˉπ)+ˉγκϱ(ηκϱ)b(ˉπ)]ξds<0, |
or equivalently
∫φ[ψa(ˉπ)+ˉνm(ζm)a(ˉπ)+ˉγκϱ(ηκϱ)a(ˉπ)]θds−∫φˉγκϱDϱθds+∫φ[ψb(ˉπ)+ˉνm(ζm)b(ˉπ)+ˉγκϱ(ηκϱ)b(ˉπ)]ξds≥0. |
Therefore, we have
∫φψ(π)ds−∫φψ(ˉπ)ds≥0. |
Definition 2.3. [17] [Necessary Optimality Conditions] A solution (ˉa,ˉb)∈ϑ is said to be a KT-point to (MCP) if there exist Lagrange multipliers (piecewise smooth) ˉνm=(ˉνm(s))∈R+,m=¯1,r,ˉγκϱ=(ˉγκϱ(s))∈R,κ=¯1,u and ϱ=¯1,l such that
∂ψ∂aκ(ˉπ)+ˉνm∂ζm∂aκ(ˉπ)+ˉγκϱ∂ηκϱ∂aκ(ˉπ)+∂ˉγκϱ∂sϱ=0,κ=¯1,u, | (2.1) |
∂ψ∂bj(ˉπ)+ˉνm∂ζm∂bj(ˉπ)+ˉγκϱ∂ηκϱ∂bj(ˉπ)=0,j=¯1,v, | (2.2) |
ˉνmζm(ˉπ)=0,ˉνm≥0 | (2.3) |
for all s∈φ, except at discontinuities.
The theorem mentioned below states that the KT point indeed serves as a necessary optimality condition for being an optimal solution for (MCP).
Theorem 2.1. If (ˉa,ˉb) is a normal optimal solution for (MCP), then (ˉa,ˉb) is a KT-point.
Proof. The proof of this theorem follows in the same manner as in Theorem 1 of [17]. Hence, it is omitted.
Now, we modulate an equivalent unconstrained multi-time control problem associated with (MCP) via an exact l1 penalty method as:
(MCP)ςmin(a(⋅),b(⋅))∫φχ(s,a(s),b(s),ς(s))ds=∫φ{ψ(s,a(s),b(s))+ς(s)[r∑m=1ζ+m(s,a(s),b(s))+u∑κ=1l∑ϱ=1|ηκϱ(s,a(s),b(s))−∂aκ∂sϱ|]}ds, |
where the penalty parameter ς(s)>0 and the penalty function ζ+m(s,a(s),b(s)) is defined as:
ζ+m(s,a(s),b(s))={0,if ζm(s,a(s),b(s))≤0;ζm(s,a(s),b(s)),if ζm(s,a(s),b(s))>0. | (3.1) |
Definition 3.1. A solution (ˉa,ˉb)∈A×B is called a minimizer to (MCP)ς, if
∫φχ(ˉπ,ς)ds≤∫φχ(π,ς)ds,∀(a,b)∈A×B. |
Now, we shall prove the relationship between the solution set of constrained problems and its associated unconstrained problem under KT-pseudoinvexity.
Theorem 3.1. Let (ˉa,ˉb) be an optimal solution to (MCP) and assume that the considered problem (MCP) is KT-pseudoinvex at (ˉa,ˉb) on A×B. If ς≥max{ˉνm,m=¯1,r,|ˉγκϱ|,κ=¯1,u,ϱ=¯1,l}, then (ˉa,ˉb) is also a minimizer of (MCP)ς.
Proof. Let (ˉa,ˉb) be not a minimizer of (MCP)ς. Then, there exists a solution (ˆa,ˆb)∈A×B such that
∫φχ(ˆπ,ς)ds<∫φχ(ˉπ,ς)ds, |
or
∫φ{ψ(ˆπ)+ς[r∑m=1ζ+m(ˆπ)+u∑κ=1l∑ϱ=1|ηκϱ(ˆπ)−∂aκ∂sϱ|]}ds<∫φ{ψ(ˉπ)+ς[r∑m=1ζ+m(ˉπ)+u∑κ=1l∑ϱ=1|ηκϱ(ˉπ)−∂aκ∂sϱ|]}ds. |
The feasibility of (ˉa,ˉb) along with the above inequality and relation (3.1) produces
∫φ{ψ(ˆπ)+ς[r∑m=1ζ+m(ˆπ)+u∑κ=1l∑ϱ=1|ηκϱ(ˆπ)−∂aκ∂sϱ|]}ds<∫φψ(ˉπ)ds. |
Since the penalty parameter ς≥max{ˉνm,m=¯1,r,|ˉγκϱ|,κ=¯1,u,ϱ=¯1,l}>0 and the penalty function is also positive, therefore, it follows that
∫φψ(ˆπ)ds<∫φψ(ˉπ)ds. | (3.2) |
On the other hand, by hypothesis, (MCP) is KT-pseudoinvex at (ˉa,ˉb) on A×B. Therefore, there exist θ:φ×A×B×Rr×Rul→Ru of C1-class with θ|∂φ=0 and ξ:φ×A×B×Rr×Rul→Rv of C0-class with ξ|∂φ=0 such that
∫φ[ψa(ˉπ)+ˉνm(ζm)a(ˉπ)+ˉγκϱ(ηκϱ)a(ˉπ)]θds−∫φˉγκϱDϱθds+∫φ[ψb(ˉπ)+ˉνm(ζm)b(ˉπ)+ˉγκϱ(ηκϱ)b(ˉπ)]ξds<0,∀(a,b)∈A×B. | (3.3) |
By well-established results, we get
Dϱ[θγϱ]=γϱDϱθ+θDϱγϱ,∫φθDϱγϱds=∫φDϱ[θγϱ]ds−∫φγϱDϱθds. |
Using θ|∂φ=0 along with flow-divergence formula, we obtain
∫φDϱ[θγϱ]ds=∫∂φ[θγϱ]→nds=0, |
where →n=(→nϱ),ϱ=¯1,u, is the normal unit vector to the hypersurface ∂φ, hence
∫φθDϱγϱds=−∫φγϱDϱθds. | (3.4) |
By using the condition (3.4), (3.3) is reduced as
∫φ[ψa(ˉπ)+ˉνm(ζm)a(ˉπ)+ˉγκϱ(ηκϱ)a(ˉπ)]θds+∫φ[Dϱˉγκϱ]θds+∫φ[ψb(ˉπ)+ˉνm(ζm)b(ˉπ)+ˉγκϱ(ηκϱ)b(ˉπ)]ξds<0. |
Since, the conditions (2.1)–(2.3) are fulfilled at (ˉa,ˉb), therefore, the above inequality can be written as
∫φ[ψa(ˉπ)+ˉνm(ζm)a(ˉπ)+ˉγκϱ(ηκϱ)a(ˉπ)]θds+∫φ[Dϱˉγκϱ]θds+∫φ[ψb(ˉπ)+ˉνm(ζm)b(ˉπ)+ˉγκϱ(ηκϱ)b(ˉπ)]ξds=0<0, |
which is a contradiction and the proof is completed.
Now, we authenticate Theorem 3.1 with the help of following example.
Example 3.1. Let l=2,u=1 and v=1. φs0,s1 is a rectangle joint by the diagonally opposite points s0=(s10,s20) and s1=(s11,s21) in R2 (in particular cases, φs0,s1 is a square).
Let us formulate a multi-time control problem (MCP) as below:
{(MCP1)}min(a(⋅),b(⋅))∫φ0,4(b2−5b+16)ds1ds2subject to25−a2≤0,∂a∂s1=2−b,∂a∂s2=2−b,a(0,0)=0,a(4,4)=10, |
where s=(s1,s2)∈φ0,4 and the multi-time objective functional represents the mass of φ0,4 with the density (b2−5b+16) that depends on the current point, and the controlled dynamical system ∂a∂s1=∂a∂s2=2−b is a neuron activation system which describes the controlled behavior of an artificial neural system from the initial point a(0,0)=0 to the endpoint a(4,4)=10.
By computation, we find (ˉa,ˉb)=(54(s1+s2),34) is an optimal solution to (MCP1) at which (2.1)–(2.3) are also fulfilled with Lagrange multiplier ˉν=0,ˉγ11=−352 and ˉγ12=−352.
Now, we formulate (MCP1)ς associated to (MCP1) via an exact l1 penalty method as follows:
(MCP1)ςmin(a(⋅),b(⋅))∫φ0,1{(b2−5b+16)+ς[max{0,25−a2}+|∂a∂s1−2+b|+|∂a∂s2−2+b|]}ds1ds2. |
The following inequality
∫φ0,1{(b2−5b+16)+ς[max{0,25−a2}+|∂a∂s1−2+b|+|∂a∂s2−2+b|]}ds1ds2−∫φ0,1{(ˉb2−5ˉb+16)+ς[max{0,25−ˉa2}+|∂a∂s1−2+ˉb|+|∂a∂s2−2+ˉb|]}ds1ds2≥0 |
holds at (ˉa,ˉb)=(54(s1+s2),34) with ς≥352 and for all (a,b)∈A×B. Further, the fact that the problem (MCP1) is a KT- pseudoinvex problem is quite evident at (ˉa,ˉb) on A×B. Thus, all the assumptions of Theorem 3.1 are fulfilled. Hence, we conclude that (ˉa,ˉb)=(54(s1+s2),34) is also a minimizer of (MCP1)ς.
Proposition 3.1. Let (ˉa,ˉb) be a minimizer to (MCP)ˉς. Then
∫φψ(ˉπ)ds≤∫φψ(π)ds,∀(a,b)∈ϑ. |
Proof. Let (ˉa,ˉb) be a minimizer to (MCP)ˉς. Therefore, by Definition 3.1, for all (a,b)∈A×B, we have
∫φχ(ˉπ,ˉς)ds≤∫φχ(π,ˉς)ds, |
or
∫φ{ψ(ˉπ)+ˉς[r∑m=1ζ+m(ˉπ)+u∑κ=1l∑ϱ=1|ηκϱ(ˉπ)−∂aκ∂sϱ|]}ds≤∫φ{ψ(π)+ˉς[r∑m=1ζ+m(π)+u∑κ=1l∑ϱ=1|ηκϱ(π)−∂aκ∂sϱ|]}ds. |
Since ϑ⊆A×B, then, by the relation (3.1), we get the following inequality for all (a,b)∈ϑ
∫φ{ψ(ˉπ)+ˉς[r∑m=1ζ+m(ˉπ)+u∑κ=1l∑ϱ=1|ηκϱ(ˉπ)−∂aκ∂sϱ|]}ds≤∫φψ(π)ds. |
Again, using the relation (3.1), we have
∫φψ(ˉπ)ds≤∫φψ(π)ds,∀(a,b)∈ϑ. |
Theorem 3.2. Let (ˉa,ˉb) be a minimizer to (MCP)ˉς. Considering the fact that the inequality
∫φχ(π,ς)ds≥∫φχ(ˉπ,ς)ds |
holds for any ς≥ˉς and for all (a,b)∈ϑ. Further, assume that the considered problem (MCP) is KT-pseudoinvex on A×B. If ς≥max{ˉνm,m=¯1,r,|ˉγκϱ|,κ=¯1,u,ϱ=¯1,l}, then (ˉa,ˉb) is also an optimal solution to (MCP).
Proof. Since (ˉa,ˉb) is a minimizer to (MCP)ˉς, therefore, by Proposition 3.1, we get
∫φψ(ˉπ)ds≤∫φψ(π)ds,∀(a,b)∈ϑ. | (3.5) |
To prove that (ˉa,ˉb) is an optimal solution to (MCP), first, we prove that (ˉa,ˉb)∈ϑ. By contradiction, we assume that (ˉa,ˉb)∉ϑ. Therefore, by (3.1), we have
∫φ{r∑m=1ζ+m(ˉπ)+u∑κ=1l∑ϱ=1|ηκϱ(ˉπ)−∂aκ∂sϱ|}ds>0. | (3.6) |
Let (a,b) be any feasible solution to (MCP). By assumption, the following inequality
∫φχ(π,ς)ds≥∫φχ(ˉπ,ς)ds |
holds for any ς≥ˉς and for all (a,b)∈ϑ, or
∫φ{ψ(π)+ς[r∑m=1ζ+m(π)+u∑κ=1l∑ϱ=1|ηκϱ(π)−∂aκ∂sϱ|]}ds≥∫φ{ψ(ˉπ)+ς[r∑m=1ζ+m(ˉπ)+u∑κ=1l∑ϱ=1|ηκϱ(ˉπ)−∂aκ∂sϱ|]}ds. | (3.7) |
However, if we set
ς>max{∫φ{ψ(π)−ψ(ˉπ)}ds∫φ{∑rm=1ζ+m(ˉπ)+∑uκ=1∑lϱ=1|ηκϱ(ˉπ)−∂aκ∂sϱ|}ds,ˉς;(a,b)∈ϑ}, |
the inequalities (3.5) and (3.6) conclude that ς is a positive real number. Therefore, we can write the above inequality as:
∫φ{ψ(ˉπ)+ς[r∑m=1ζ+m(ˉπ)+u∑κ=1l∑ϱ=1|ηκϱ(ˉπ)−∂aκ∂sϱ|]}ds>∫φψ(π)ds. |
The above inequality together with the feasibility of (a,b) in (MCP) and the relation (3.1) yields
∫φ{ψ(ˉπ)+ς[r∑m=1ζ+m(ˉπ)+u∑κ=1l∑ϱ=1|ηκϱ(ˉπ)−∂aκ∂sϱ|]}ds>∫φ{ψ(π)+ς[r∑m=1ζ+m(π)+u∑κ=1l∑ϱ=1|ηκϱ(π)−∂aκ∂sϱ|]}ds, |
which contradicts the inequality (3.7). Therefore, (ˉa,ˉb)∈ϑ and its optimality in (MCP) follows directly from (3.5).
In this section, the concept of the saddle point criterion is elaborately discussed with the motive of establishing the relationship between the solution set of (MCP) along with the (MCP)ς.
To begin with, we mention here the definitions of Lagrange functional along with saddle point for an (MCP).
Definition 4.1. The Lagrange functional L(a,b,ν,γ) defined for (MCP) is given as:
L(a,b,ν,γ)=∫φ{ψ(π)+r∑m=1νmζm(π)+u∑κ=1l∑ϱ=1γκϱ(∂aκ∂sϱ−ηκϱ(π))}ds, |
where ν=(νm)∈Rr+ and γ=(γκϱ)∈Rul+.
Definition 4.2. A point (ˉa,ˉb,ˉν,ˉγ)∈ϑ×Rr×Rul is called a saddle point of the Lagrange functional defined for (MCP), if there exist Lagrange multipliers (piecewise smooth functions) ˉν=(ˉνm)∈Rr+ and ˉγ=(ˉγκϱ)∈Rul+ such that the following inequalities hold:
(i) L(ˉa,ˉb,ν,γ)≤L(ˉa,ˉb,ˉν,ˉγ),∀ν∈Rr+,∀γ∈Rul+;
(ii) L(a,b,ˉν,ˉγ)≥L(ˉa,ˉb,ˉν,ˉγ),∀(a,b)∈ϑ.
Next, with the help of the notion of the saddle point, we establish the fact that an equivalence lies in the problems (MCP) and (MCP)ς under KT-psedoinvexity.
Theorem 4.1. Let (ˉa,ˉb,ˉν,ˉγ) be a saddle point of the Lagrange functional defined for (MCP). If we consider the penalty parameter ς to be sufficiently large in the sense that
ς≥max{ˉνm,m=¯1,r,|ˉγκϱ||ϱ=¯1,l,κ=¯1,u}, |
then (ˉa,ˉb) is a minimizer of (MCP)ς.
Proof. Let us prove the result with the help of contradiction and assume that (ˉa,ˉb) is not a minimizer of (MCP)ς. Then, there exists (ˆa,ˆb)∈A×B such that
∫φχ(ˆa,ˆb,ς)ds<∫φχ(ˉa,ˉb,ς)ds. |
From the definition of the penalized problem (MCP)ς, we get
∫φ{ψ(ˆπ)+ς[r∑m=1ζ+m(ˆπ)+u∑κ=1l∑ϱ=1|∂aκ∂sϱ−ηκϱ(ˆπ)|]}ds<∫φ{ψ(ˉπ)+ς[r∑m=1ζ+m(ˉπ)+u∑κ=1l∑ϱ=1|∂aκ∂sϱ−ηκϱ(ˉπ)|]}ds. |
The feasibility of (ˉa,ˉb) in (MCP) and (3.1) imply that
∫φ{ψ(ˆπ)+ς[r∑m=1ζ+m(ˆπ)+u∑κ=1l∑ϱ=1|∂aκ∂sϱ−ηκϱ(ˆπ)|]}ds<∫φψ(ˉπ)ds. |
As, the penalty parameter
ς≥max{ˉνm,|ˉγκϱ||m=¯1,r,ϱ=¯1,l,κ=¯1,u}. |
From the above inequality, we have
∫φ{ψ(ˆπ)+r∑m=1ˉνmζ+m(ˆπ)+u∑κ=1l∑ϱ=1|ˉγκϱ(∂aκ∂sϱ−ηκϱ(ˆπ))|}ds<∫φψ(ˉπ)ds. |
Since (ˆa,ˆb) is not a feasible solution in (MCP), by using (3.1), we get
∫φ{ψ(ˆπ)+r∑m=1ˉνmζm(ˆπ)+u∑κ=1l∑ϱ=1ˉγκϱ(∂aκ∂sϱ−ηκϱ(ˆπ))}ds<∫φψ(ˉπ)ds. | (4.1) |
On the other hand, by assumption, (ˉa,ˉb,ˉν,ˉγ) is a saddle point of the Lagrange functional defined for (MCP). Then, by Definition 4.2(i), we have
L(ˉa,ˉb,ν,γ)≤L(ˉa,ˉb,ˉν,ˉγ),∀ν=(νm)∈Rr+,γ=(γκϱ)∈Rul+. |
By Definition 4.1, we have
∫φ{ψ(ˉπ)+r∑m=1νmζm(ˉπ)+m∑ϱ=1n∑ϱ=1γκϱ(∂aκ∂sϱ−ηκϱ(ˉπ))}ds≤∫φ{ψ(ˉπ)+r∑m=1ˉνmζm(ˉπ)+m∑ϱ=1n∑ϱ=1ˉγκϱ(∂aκ∂sϱ−ηκϱ(ˉπ))}ds. |
Taking νm=0,m=¯1,r for the preceding inequality, we get
∫φr∑m=1ˉνmζm(ˉπ)ds≥0. | (4.2) |
By the feasibility of (ˉa,ˉb) in (MCP), we get
∫φr∑m=1ˉνmζm(ˉπ)ds≤0. | (4.3) |
Thus, the inequalities (4.2) and (4.3) together imply that
∫φr∑m=1ˉνmζm(ˉπ)ds=0. |
Further, from the feasibility of (ˉa,ˉb) in (MCP), we also have
∫φ(ηκϱ(ˉπ)−∂aκ∂sϱ)ds=0. |
Therefore, the inequality (4.1) can be rewritten as
∫φ{ψ(ˆπ)+r∑m=1ˉνmζm(ˆπ)+u∑κ=1l∑ϱ=1ˉγκϱ(∂aκ∂sϱ−ηκϱ(ˆπ))}ds<∫φ{ψ(ˉπ)+r∑m=1ˉνmζm(ˉπ)+u∑κ=1l∑ϱ=1ˉγκϱ(∂aκ∂sϱ−ηκϱ(ˉπ))}ds. |
By Definition 4.1, we get
L(ˆa,ˆb,ˉν,ˉγ)<L(ˉa,ˉb,ˉν,ˉγ),∀(ˆa,ˆb)∈ϑ. |
But, it is contrary to Definition 4.2(ii). This completes the proof.
Next, we construct a non-convex optimization control problem to authenticate the Theorem 4.1 under KT-pseudoinvexity assumptions.
Example 4.1. Let l=2 A=[0,2] and B=[0,2]. φs0,s1 is a rectangle joint by the diagonally opposite points s0=(s10,s20) and s1=(s11,s21) in R2 (in particular cases, φs0,s1 is a square). Let us formulate a multi-time control problem (MCP) as below:
{(MCP2)}min(a(⋅),b(⋅))∫φ0,2(−2b−b3)ds1ds2subject to16−a2≤0,∂a∂s1=2b,∂a∂s2=2b,a(0,0)=0,a(2,2)=16, |
where s=(s1,s2)∈φ0,2 and the multi-time objective functional represents the mass of φ0,2 with the density (−2b−b3) that depends on the current point, and the controlled dynamical system ∂a∂s1=∂a∂s2=2b is a neuron activation system which describes the controlled behavior of an artificial neural system from the initial point a(0,0)=0 to the end point a(2,2)=16. Note that
ϑ={(a,b)∈A×B:−4≤a≤4,∂a∂s1−2b,∂a∂s2−2b,a(0,0)=0,a(2,2)=16} |
is the set of the all feasible solution to (MCP2). By computation, we find (ˉa,ˉb)=(4(s1+s2),2) is an optimal solution to (MCP2) at which (2.1)–(2.3) are also fulfilled with Lagrange multiplier ˉν=0,ˉγ11+ˉγ12=7.
Now, we frame the Lagrange functional for (MCP2) as follows:
L(a,b,μ,γ)=∫φ0,2{(−2b−b3)+ς(16−a2)+γ1[∂a∂s1−2b]+γ2[∂a∂s2−2b]}ds1ds2 |
and it can be observed that the following inequalities:
(i) L(ˉa,ˉb,ν,γ)≤L(ˉa,ˉb,ˉν,ˉγ),∀ν∈R+,∀γ∈R2+;
(ii) L(a,b,ˉν,ˉγ)≥L(ˉa,ˉb,ˉν,ˉγ),∀(a,b)∈ϑ
are satisfied at (ˉa,ˉb)=(4(s1+s2),2) with Lagrange multiplier ˉν=0,ˉγ11+ˉγ12=7.
Next, we formulate (MCP2)ς associated to (MCP2) via an exact l1 penalty method as follows:
(MCP2)ςmin(a(⋅),b(⋅))∫φ0,1{(−2b−b3)+ς[max{0,16−a2}+|∂a∂s1−2b|+|∂a∂s2−2b|]}ds1ds2. |
Further, the fact that the problem (MCP2) is a KT- pseudoinvex problem is quite evident at (ˉa,ˉb) on A×B. Thus, all the assumptions of Theorem 4.1 are fulfilled. Hence, we conclude that (ˉa,ˉb)=(4(s1+s2),2) is also a minimizer of (MCP2)ς.
Theorem 4.2. Let (ˉa,ˉb) be a minimizer of the penalized problem (MCP)ς. Assume that ϑ is a compact subset of Ru×Rv and for any ς>ˉς, the inequality
∫φχ(a,b,ς)ds≮∫φχ(ˉa,ˉb,ς)ds |
is satisfied for all (a,b)∈ϑ. Further, if the considered problem (MCP) is KT-pseudoinvex at (ˉa,ˉb) on A×B, then (ˉa,ˉb,ˉν,ˉγ) is a saddle point of the Lagrange functional defined for (MCP).
Proof. To show that (ˉa,ˉb,ˉν,ˉγ) is a saddle point of the Lagrange functional defined for (MCP), first, we prove that (ˉa,ˉb) is an optimal solution of (MCP). By hypothesis, (ˉa,ˉb) is a minimizer to (MCP)ς, then by Proposition 3.1, we have
∫φψ(ˉπ)ds≤∫φψ(π)ds,∀(a,b)∈ϑ, | (4.4) |
which indicates that, on the set of all feasible solutions, the value of ∫φψ(π)ds is bounded below in a compact set ϑ.
Now, we shall prove that (ˉa,ˉb) is an optimal solution to (MCP). Let us proceed by contradiction and assume that (ˉa,ˉb) is not a feasible solution to (MCP). Then, by (3.1), it follows that
∫φ{r∑m=1ζ+m(ˉπ)+u∑κ=1l∑ϱ=1|∂aκ∂sϱ−ηκϱ(ˉπ)|}ds>0. | (4.5) |
Further, if we consider a point (ˆa,ˆb) as a feasible solution of (MCP) then, for any ς>ˉς, we get
∫φχ(ˆa,ˆb,ς)ds≮∫φχ(ˉa,ˉb,ς)ds. |
According to the definition of the penalized problem (MCP)ς, the above inequality implies that
∫φ{ψ(ˆπ)+ς[r∑m=1ζ+m(ˆπ)+u∑κ=1l∑ϱ=1|∂aκ∂sϱ−ηκϱ(ˆπ)|]}ds≮∫φ{ψ(ˉπ)+ς[r∑m=1ζ+m(ˉπ)+u∑κ=1l∑ϱ=1|∂aκ∂sϱ−ηκϱ(ˉπ)|]}ds. | (4.6) |
Also, on considering
ς>max{∫φψ(ˆπ)ds−∫φψ(ˉπ)ds∫φ{∑rm=1ζ+m(ˉπ)+∑uκ=1∑lϱ=1|∂aκ∂sϱ−ηκϱ(ˉπ)|}ds,ˉς}, | (4.7) |
the inequalities (4.4), (4.5) and (4.7) imply that ς is a finite non-negative real number and we obtain the following inequality
∫φ{ψ(ˉπ)+ς[r∑m=1ζ+m(ˉπ)+u∑κ=1l∑ϱ=1|∂aκ∂sϱ−ηκϱ(ˉπ)|]}ds>∫φψ(ˆπ)ds. | (4.8) |
From the feasibility of (ˆa,ˆb) in (MCP) and (3.1), we have
ς[r∑m=1ζ+m(ˆπ)+u∑κ=1l∑ϱ=1|∂aκ∂sϱ−ηκϱ(ˆπ)|]=0. |
Thus, the inequality (4.8) can be rewritten as
∫φ{ψ(ˉπ)+ς[r∑m=1ζ+m(ˉπ)+u∑κ=1l∑ϱ=1|∂aκ∂sϱ−ηκϱ(ˉπ)|]}ds>∫φ{ψ(ˆπ)+ς[r∑m=1ζ+m(ˆπ)+u∑κ=1l∑ϱ=1|∂aκ∂sϱ−ηκϱ(ˆπ)|]}ds. |
The above expression is in contradiction to inequality (4.6). It leads to the fact that (ˉa,ˉb) is a feasible solution of (MCP). This result in association with (4.4) leads to the conclusion that (MCP) attains its optimal solution at (ˉa,ˉb).
Now, we show that (ˉa,ˉb,ˉν,ˉγ) is a saddle point of the Lagrange functional defined for (MCP). Since (ˉa,ˉb) is an optimal solution to (MCP), there exist Lagrange multipliers ˉν∈Rr and ˉγ∈Rul such that the necessary optimality conditions (2.1)–(2.3) are satisfied at (ˉa,ˉb) on A×B. From the necessary optimality condition (2.3) and the feasibility of (ˉa,ˉb) in (MCP), we have
∫φνmζm(ˉπ)ds≤∫φˉνmζm(ˉπ)ds,∀νm∈Rr+. |
Equivalently,
∫φ{ψ(ˉπ)+r∑m=1νmζm(ˉπ)+u∑κ=1l∑ϱ=1γκϱ(∂aκ∂sϱ−ηκϱ(ˉπ))}ds≤∫φ{ψ(ˉπ)+r∑m=1ˉνmζm(ˉπ)+u∑κ=1l∑ϱ=1ˉγκϱ(∂aκ∂sϱ−ηκϱ(ˉπ))}ds. |
By Definition 4.1, we get
L(ˉa,ˉb,ν,γ)≤L(ˉa,ˉb,ˉν,ˉγ),∀ν∈Rr+,γ∈Rul+. |
Next, we prove the second condition of the saddle point of the Lagrange functional defined for (MCP). On the other hand, by hypothesis, (MCP) is KT-pseudoinvex at (ˉa,ˉb) on A×B. Therefore, we get the following inequality
∫φ[ψa(ˉπ)+ˉνm(ζm)a(ˉπ)+ˉγκϱ(ηκϱ)a(ˉπ)]θds−∫φˉγκϱDϱθds+∫φ[ψb(ˉπ)+ˉνm(ζm)b(ˉπ)+ˉγκϱ(ηκϱ)b(ˉπ)]ξds≥0, |
implies
∫φψ(π)ds−∫φψ(ˉπ)ds≥0,∀(a,b)∈A×B. |
Since ϑ⊂A×B, therefore, the following inequality is also satisfied for all (a,b)∈ϑ,
∫φψ(π)ds−∫φψ(ˉπ)ds≥0, |
or
∫φψ(π)ds≥∫φψ(ˉπ)ds. |
If we set ˉνm=0,∀m=¯1,r then the above inequality can be written as
∫φ{ψ(π)+r∑m=1ˉνmζm(π)+u∑κ=1l∑ϱ=1ˉγκϱ(∂aκ∂sϱ−ηκϱ(π))}ds≥∫φ{ψ(ˉπ)+r∑m=1ˉνmζm(ˉπ)+u∑κ=1l∑ϱ=1ˉγκϱ(∂aκ∂sϱ−ηκϱ(ˉπ))}ds. |
By Definition 4.1, we get
L(a,b,ˉν,ˉγ)≥L(ˉa,ˉb,ˉν,ˉγ),∀(a,b)∈ϑ. |
Therefore, this completes the proof.
Through the study of (MCP), we led to the conclusion that the exact l1 penalty method serves as the best tool for the construction of an equivalent auxiliary control problem (MCP)ς associated with (MCP). Further, a relationship between an optimal solution of (MCP) and a minimizer of (MCP)ς was established under KT-pseudoinvexity assumptions. Furthermore, we discussed the optimality of the considered problem (MCP) with the help of saddle point criteria. Also, we provided a non-trivial example to strengthen the results demonstrated in this paper.
This research was supported by the Fundamental Fund of Khon Kaen University, Thailand.
The authors declare that they have no competing interests.
[1] |
M. Arana-Jimˊenez, G. Ruiz-Garzˊon, A. Rufiˊan-Lizana, R. Osuna-Gˊomez, Weak efficiency in multiobjective variational problems under generalized convexity, J. Global Optim., 52 (2012), 109–121. https://doi.org/10.1007/s10898-011-9689-y doi: 10.1007/s10898-011-9689-y
![]() |
[2] |
T. Antczak, Exact penalty function method for mathematical programming problems involving invex functions, Eur. J. Oper. Res., 198 (2009), 29–36. https://doi.org/10.1016/j.ejor.2008.07.031 doi: 10.1016/j.ejor.2008.07.031
![]() |
[3] |
T. Antczak, The l1 penalty function method for nonconvex differentiable optimization problems with inequality constraints, Asia-Pac. J. Oper. Res., 27 (2010), 1–18. https://doi.org/10.1142/S0217595910002855 doi: 10.1142/S0217595910002855
![]() |
[4] | T. Antczak, The exact l1 penalty function method for nonsmooth invex optimization problems, System Modelling and Optimization, 25th IFIP TC 7 Conference, CSMO 2011 Berlin, Germany, 2011. |
[5] |
I. I. Eremin, The penalty method in convex programming, Doklady Akad. Nauk SSSR, 143 (1967), 748–751. https://doi.org/10.1007/BF01071708 doi: 10.1007/BF01071708
![]() |
[6] |
M. A. Hanson, On sufficiency of the Kuhn-Tucker conditions, J. Math. Anal. Appl., 80 (1981), 545–550. https://doi.org/10.1016/0022-247X(81)90123-2 doi: 10.1016/0022-247X(81)90123-2
![]() |
[7] |
A. Jayswal, Preeti, An exact l1 penalty function method for multi-dimensional first-order PDE constrained control optimisation problem, Eur. J. Control, 52 (2020), 34–41. https://doi.org/10.1016/j.ejcon.2019.07.004 doi: 10.1016/j.ejcon.2019.07.004
![]() |
[8] |
A. Jayswal, Preeti, Saddle point criteria for multi-dimensional control optimisation problem involving first-order PDE constraints Int. J. Control, 94 (2021), 1567–1576. https://doi.org/10.1080/00207179.2019.1661523 doi: 10.1080/00207179.2019.1661523
![]() |
[9] | V. Jeyakumar, Strong and weak invexity in mathematical programming, Math. Oper. Res., 55 (1985), 109–125. |
[10] |
X. Jiang, S. Qin, X. Xue, A subgradient-based continuous-time algorithm for constrained distributed quadratic programming, J. Franklin I., 357 (2020), 5570–5590. https://doi.org/10.1016/j.jfranklin.2020.02.057 doi: 10.1016/j.jfranklin.2020.02.057
![]() |
[11] |
Y. Lin, Linear quadratic open-loop Stackelberg game for stochastic systems with Poisson jumps, J. Franklin I., 358 (2021), 5262–5280. https://doi.org/10.1016/j.jfranklin.2021.04.048 doi: 10.1016/j.jfranklin.2021.04.048
![]() |
[12] |
Y. Lin, W. Zhang, Pareto efficiency in the infinite horizon mean-field type cooperative stochastic differential game, J. Franklin I., 358 (2021), 5532–5551. https://doi.org/10.1016/j.jfranklin.2021.05.013 doi: 10.1016/j.jfranklin.2021.05.013
![]() |
[13] | Ş. Mititelu, Optimality and duality for invex multi-time control problems with mixed constraints, J. Adv. Math. Stud., 2 (2009), 25–35. |
[14] |
C. Nahak, S. Nanda, Duality for variational problems with pseudo-invexity, Optimization, 34 (1995), 365–371. https://doi.org/10.1080/02331939508844120 doi: 10.1080/02331939508844120
![]() |
[15] |
M. A. Noor, K. I. Noor, Some characterizations of strongly preinvex functions, J. Math. Anal. Appl., 316 (2006), 697–706. https://doi.org/10.1016/j.jmaa.2005.05.014 doi: 10.1016/j.jmaa.2005.05.014
![]() |
[16] |
V. A. de Oliveira, L. B. dos Santos, R. Osuna-Gˊomez, M. A. Rojas-Medar, Optimality conditions for nonlinear infinite programming problems, Optim. Lett., 9 (2015), 1131–1147. https://doi.org/10.1007/s11590-014-0808-9 doi: 10.1007/s11590-014-0808-9
![]() |
[17] |
S. Treanţă, M. Arana-Jimˊenez, KT-pseudoinvex multi-time control problem, Optim. Control Appl. Meth., 39 (2018), 1291–1300. https://doi.org/10.1002/oca.2410 doi: 10.1002/oca.2410
![]() |
[18] |
S. Treanţă, M. Arana-Jiménez, On generalized KT-pseudoinvex control problems involving multiple integral functionals, Eur. J. Control, 43 (2018), 39–45. https://doi.org/10.1016/j.ejcon.2018.05.004 doi: 10.1016/j.ejcon.2018.05.004
![]() |
[19] |
S. Treanţă, Efficiency in generalized V-KT-pseudoinvex control problems, Int. J. Control, 93 (2020), 611–618. https://doi.org/10.1080/00207179.2018.1483082 doi: 10.1080/00207179.2018.1483082
![]() |
[20] |
T. Weir, B. Mond, Pre-invex functions in multiple objective optimization, J. Math. Anal. Appl., 136 (1988), 29–38. https://doi.org/10.1016/0022-247X(88)90113-8 doi: 10.1016/0022-247X(88)90113-8
![]() |
[21] | W. I. Zangwill, Nonlinear programming via penalty functions, Manag. Sci., 13 (1967), 344–358. |