Loading [MathJax]/jax/output/SVG/jax.js
Research article Special Issues

A class of constrained optimal control problems arising in an immunotherapy cancer remission process

  • By considering both the single drug dose and the total drug input during the treatment period, we propose a new optimal control problem by maximizing the immune cell levels and minimizing the tumor cell count, as well as the negative effects of the total drug quantity over time. To solve this problem, the control parameterization technique is employed to approximate the control function by a piecewise constant function, which gives rise to a sequence of mathematical programming problems. Then, we derive gradients of the cost function and/or the constraints in the resulting problems. On the basis of this gradient information, we develop a numerical approach to seek the optimal control strategy for a discrete drug administration. Finally, numerical simulations are conducted to assess the impact of the total drug input on the tumor treatment and to evaluate the rationality of the treatment strategy within the anti-cancer cycle. These results provide a theoretical framework that can guide clinical trials in immunotherapy.

    Citation: Yineng Ouyang, Zhaotao Liang, Zhihui Ma, Lei Wang, Zhaohua Gong, Jun Xie, Kuikui Gao. A class of constrained optimal control problems arising in an immunotherapy cancer remission process[J]. Electronic Research Archive, 2024, 32(10): 5868-5888. doi: 10.3934/era.2024271

    Related Papers:

    [1] Jingshi Li, Jiachuan Zhang, Guoliang Ju, Juntao You . A multi-mode expansion method for boundary optimal control problems constrained by random Poisson equations. Electronic Research Archive, 2020, 28(2): 977-1000. doi: 10.3934/era.2020052
    [2] Zuliang Lu, Fei Huang, Xiankui Wu, Lin Li, Shang Liu . Convergence and quasi-optimality of $ L^2- $norms based an adaptive finite element method for nonlinear optimal control problems. Electronic Research Archive, 2020, 28(4): 1459-1486. doi: 10.3934/era.2020077
    [3] Sida Lin, Lixia Meng, Jinlong Yuan, Changzhi Wu, An Li, Chongyang Liu, Jun Xie . Sequential adaptive switching time optimization technique for maximum hands-off control problems. Electronic Research Archive, 2024, 32(4): 2229-2250. doi: 10.3934/era.2024101
    [4] Yan Xie, Rui Zhu, Xiaolong Tan, Yuan Chai . Inhibition of absence seizures in a reduced corticothalamic circuit via closed-loop control. Electronic Research Archive, 2023, 31(5): 2651-2666. doi: 10.3934/era.2023134
    [5] Sida Lin, Dongyao Yang, Jinlong Yuan, Changzhi Wu, Tao Zhou, An Li, Chuanye Gu, Jun Xie, Kuikui Gao . A new computational method for sparse optimal control of cyber-physical systems with varying delay. Electronic Research Archive, 2024, 32(12): 6553-6577. doi: 10.3934/era.2024306
    [6] Wei Ji . Optimal control problems with time inconsistency. Electronic Research Archive, 2023, 31(1): 492-508. doi: 10.3934/era.2023024
    [7] Mingtao Cui, Min Pan, Jie Wang, Pengjie Li . A parameterized level set method for structural topology optimization based on reaction diffusion equation and fuzzy PID control algorithm. Electronic Research Archive, 2022, 30(7): 2568-2599. doi: 10.3934/era.2022132
    [8] Changling Xu, Huilai Li . Two-grid methods of finite element approximation for parabolic integro-differential optimal control problems. Electronic Research Archive, 2023, 31(8): 4818-4842. doi: 10.3934/era.2023247
    [9] Saeedreza Tofighi, Farshad Merrikh-Bayat, Farhad Bayat . Designing and tuning MIMO feedforward controllers using iterated LMI restriction. Electronic Research Archive, 2022, 30(7): 2465-2486. doi: 10.3934/era.2022126
    [10] Dandan Zuo, Wansheng Wang, Lulu Zhang, Jing Han, Ling Chen . Non-fragile sampled-data control for synchronizing Markov jump Lur'e systems with time-variant delay. Electronic Research Archive, 2024, 32(7): 4632-4658. doi: 10.3934/era.2024211
  • By considering both the single drug dose and the total drug input during the treatment period, we propose a new optimal control problem by maximizing the immune cell levels and minimizing the tumor cell count, as well as the negative effects of the total drug quantity over time. To solve this problem, the control parameterization technique is employed to approximate the control function by a piecewise constant function, which gives rise to a sequence of mathematical programming problems. Then, we derive gradients of the cost function and/or the constraints in the resulting problems. On the basis of this gradient information, we develop a numerical approach to seek the optimal control strategy for a discrete drug administration. Finally, numerical simulations are conducted to assess the impact of the total drug input on the tumor treatment and to evaluate the rationality of the treatment strategy within the anti-cancer cycle. These results provide a theoretical framework that can guide clinical trials in immunotherapy.



    Cancer is a global health issue, and treating a tumor poses numerous challenges. The selection of an appropriate treatment scheme, such as surgery and immunotherapy, generally depends on the specific characteristics of the tumor cells, including their aggressiveness and the location of their growth. Immunotherapies are employed to either enhance the body's natural immune defenses or restore the immune system functions that have been compromised. Therefore, it is significant to explore immunotherapeutic approaches to treat tumors.

    In tumor immunotherapies, strategies such as an Adoptive Cellular Immunotherapy (ACI), cytokines, and other antigen-specific and non-specific agents are expolited to stimulate the immune system, eliminate abnormally proliferating cells, and enhance the immune system's ability to defend itself. ACI involves the injection of in vitro-generated immune cells that are sensitive to the tumor antigens into the host's tumorigenic environment. This process strengthens and expands the host's immune response [1]. Interleukin-2 (IL-2) is the primary cytokine responsible for the activation, proliferation, and differentiation of lymphocytes, and is predominantly produced by CD4+T cells. At various stages of disease, IL-2 has been shown to enhance the activity of cytotoxic T lymphocytes (CTLs) [2]. ACI has been shown to reduce the tumor activity in the host and can be combined with high doses of IL-2 to halt the tumor growth until the tumor cells are eliminated [3].

    To explore the interactions among tumor cells, immune cells, and their microenvironment, numerous researchers have conducted mathematical modeling of tumor-immune systems; see, for example, [4,5,6,7]. Nevertheless, the aim of this paper is to investigate tumor-immune cell interactions by applying the control parameterization strategy. Moreover, numerous researchers have investigated the applications of the optimal control theory [8,9,10,11] to cancer dynamics. Murray [12] studied a mathematical model of tumor and normal cells, thereby controlling the rate of treatment administration based on logistic and Gompertzian growth patterns. This approach aimed to minimize the tumor burden at the end of the treatment period, while the normal cell population was maintained above a certain threshold to avoid toxicity. Burden et al. [13] applied the optimal control theory with the goal of maximizing the effector cell and IL-2 concentrations while minimizing the number of tumor cells. Fister and Donnelly [14] explored the dynamics between tumor cells, immune effector cells, and IL-2 using a mathematical model. They identified the conditions under which the tumor could be eliminated and obtained the optimal control strategy by solving the optimality system. DePillis et al. [15] developed a mathematical model to analyze the interaction between tumor immunity and chemotherapy, thereby outlining strategies for an optimal treatment implementation. The dynamics of the model were analyzed, the optimal control strategies were established, and both quadratic and linear cases were solved. The optimal control methods related to the drug treatments were identified, and the numerical results of the optimal strategy were discussed. Based on a tumor palliation model, Chakrabarty and Banerjee [16] applied the classical control theory to determine how optimal external treatments with ACI and IL-2 could more effectively palliate malignant tumors, while minimizing adverse effects on the immune response. Their findings demonstrated that the combination therapy was the most effective in reducing the tumor load. Although these treatments led to a reduction in the tumor cell levels, ACI may be more beneficial than IL-2 if only one treatment option is utilized. Khajanchi and Ghosh [17] developed a system of nonlinear differential equations to model the interactions between cancer cells and the immune system. They formulated an optimal control problem aimed at minimizing the total tumor load and the adverse effects of drugs, while maximizing the total number of effector cells. By utilizing the deterministic optimal control theory, they evaluated the effectiveness of the optimal treatment strategies for both ACI and IL-2 therapies, thereby exploring the synergistic potential of these treatments in cancer dynamics. However, the optimal control of tumor models with constraints has not yet been considered. In particular, analyses and numerical evaluations haven't fully explored the various constraints associated with drug therapy dosages in cancer dynamics. For the optimization control methods of tumor models, most scholars provide time-varying input curves when studying, which consider the time-varying input of continuous nonlinear models. The optimal control solution obtained by this method is the ideal solution under ideal conditions, providing strong data support for practical treatment. However, due to the limitations of practical conditions, the actual input forms are all discrete, which means that in the actual treatment process, the operability is weak and it is impossible to make timely adjustments to changes in the input.

    A set of valid comparison criteria was established to be used for the comparison of local collocation and control parameterization in [18,19]. Then, the numerical mechanisms behind both methods were examined and analyzed according to these criteria. The purpose of [20] was to extend the control parameterization methods to solve problems with both control-dependent and discrete delay arguments. Recently, Teo et al. [21] summarized the latest advancements in the control parameterization technique. They outlined methods to address the optimal control problems, both with and without constraints, and highlighted that these problems could be effectively solved by using MISER3, which is an optimal control software that utilizes control parameterization techniques. Here, the optimal control problems were approximated by the optimal parameter selection problems using control parameterization, which can be regarded as finite-dimensional optimization problems, where the control heights and switching times of the piece-wise constant function were taken as the decision variables [22]. To the best of our knowledge, most researchers have used piecewise continuous functions to approximate the control function in their models, while few have provided the discrete dosage forms for multiple variables. On the contrary, it is notably important to study the optimal control of unconstrained, piecewise continuous tumor models; see, for example [16,17,23,24,25]. Control parameterization discretizes the control and provides the optimal solution for the most effective control problem, leaving a certain buffer time for the next period of control changes, making the control input more accurate [26,27,28,29,30]. In addition, the optimal control problem using this method has the form of continuous state and discrete control. Compared to discrete states, this method obtains better optimal solutions. Compared to continuous control, this method has lower limitations on physical devices and stronger operability when applied in clinical treatment. Based on changes in the number of tumor cells in the body, drug control is more accurate.

    In this paper, we apply the optimal control theory to derive the discrete drug dosing strategies for constrained optimal control problems, thereby focusing on two treatment modalities. Specifically, we aim to minimize the number of tumor cells and the drug's toxicity to the body, maximize the number of effector cells, and consider a variety of realistic scenarios. These include constraints on the quantity of a single drug dose and the total amount of the drug input, thus reflecting the body's tolerance to drug exposure.

    The organization of this paper is as follows: in Section 2, we briefly describe the nonlinear system of ordinary differential equations that model the tumor-immune cell interactions; Section 3 presents the optimal control problem, which includes both equality and inequality constraints; in Section 4, we derive the gradient formulas and develop a numerical approach to seek the optimal control strategies; Section 5 provides numerical simulations, both with and without constraints, thereby illustrating the drug injection doses based on piece-wise constant forms; and finally, we provide the corresponding conclusions in Section 6.

    In this section, we will briefly introduce the interaction model for the initial cancer dynamics as proposed by Kuznetsov et al. [31]. The immune response to tumors is usually dominated by cytotoxic T lymphocytes (CTLs) and natural killer cells (NKs). The interaction between effector cells (EC) and tumor cells (TC) in vitro can be described by a kinetic scheme (Figure 1). where EC, TC, C, EC, and TC are the local concentrations of effector cells, tumor cells, effector cell-tumor cell conjugates, inactivated effector cells, and "lethally hit" TC cells, respectively. The parameters k1, k1, k2, and k3 are nonnegative kinetic constants: k1 and k1 describe the rates of binding of EC to TC and detachment of EC from TC without damaging cells; k2 is the rate at which ECTC interactions irreversibly program TC for lysis; and k3 is the rate at which ECTC interactions inactivate EC.

    Figure 1.  Interaction between tumor cells and effector cells.

    They established a complex nonlinear tumor model that involved a system of ordinary differential equations to describe the tumor-immune cell interactions as follows:

    {dECdt=s+F(C,TC)d1ECk1ECTC+(k1+k2)C,dTCdt=aTC(1bTCtol)Ck1ECTC+(k1+k3)C,dCdt=k1ECTC(k1+k2+k3)C,dECdt=k3Cd2EC,dTCdt=k2Cd3TC, (2.1)

    where EC, TC, and C represent the numbers of unbound EC, unbound TC, and ECTC complexes at the tumor site, respectively; EC and TC indicate the number of inactivated EC and lethally hit TC at the tumor site, respectively. The total number of unhit TC cells at the tumor site is denoted as TCtol=TC+C. The parameter s represents the standard rate at which mature EC cells enter the TC locus, which is independent of any enhancement due to the presence of TCs. The parameters d1, d2 and d3 are positive constants that represent the rates of elimination for the EC, EC, and TC cells, respectively, because of their destruction or migration from the TC locus. It is assumed that the tumor is not metastatic, and therefore, there is no migration of TCs or ECTC complexes from the primary site. The parameter a represents the maximum growth rate of the TC population, which encompasses both proliferation and death of these cells. The parameter b is the maximum carrying capacity of the biological environment for the TC population. The function F(C,TC) characterises the rate at which the cytotoxic effector cells accumulate in the localized region of the TC because of the existence of tumors.

    Based on [16], model (2.1) can be simplified as follows:

    {dEC(t)dt=su1(t)+pEC(t)TC(t)g+TC(t)dEC(t)mEC(t)TC(t),dTC(t)dt=aTC(t)(1bTC(t))nEC(t)TC(t)u2(t)TC(t), (2.2)

    where the function u1(t) serves as an input function for IL-2. The external administration of IL-2 is modeled by the control function u1(t), which facilitates the influx of effector cells and boosts the activity of the immune cells. The function u2(t) acts as an input function for ACI. The external administration of ACI is represented by the control function u2(t), which inhibits tumor production and directly targets the tumor cells at the tumor site. When u1(t)=1 and u2(t)=0, model (2.2) is a simplified model of the tumor without treatment.

    In this section, an objective function is defined for treating a tumor over a fixed treatment cycle. The therapeutic goal is to minimize the number of tumor cells and reduce the drug toxicity in terms of the side effects for the patient, while maximizing the benefit for the immune effector cells. Here, we explore the impact of controlling IL-2 (u1(t)) and ACI (u2(t)) treatments on the dynamics of the state equation (2.2) during tumor treatments.

    Thus, the cost function for the optimal control problem is defined as follows:

    J(u1,u2)=tf0[EC(t)TC(t)12(B1u21(t)+B2u22(t))]dt, (3.1)

    where the constants B1 and B2 represent the costs associated with drug administration, which are also known as the weighting factors of the control. These primarily reflect the level of drug toxicity to the body. Given that drugs such as ACI and IL-2 can exhibit high toxicities, a lower toxicity is preferable. This reasoning underlies the use of a positive coefficient for the quadratic terms of the control in the objective function, as it aims to minimize the negative impact of drug toxicity.

    Now, the following optimal control problem subject to system (2.2) is stated.

    Problem P1: Given system (2.2), choose the optimal controls u1 and u2 such that the cost function (3.1) is minimized.

    In the treatment process, considerations such as the patient's drug tolerance and the severity of the toxicity side effects were not taken into account. In contrast, a study by Goedegebuure et al. [32] involved 16 valuable patients who experienced varying levels of toxicity. This study demonstrated that different drug dosages can lead to a range of side effects, including, but not limited to, flu-like symptoms (fever, nausea, vomiting, and diarrhea), capillary leak syndrome, oliguria, transient confusion, elevated liver and kidney function, thrombocytopenia, headache, hallucinations, erythema rash, and other drug-related side effects. This indicates that even moderate drug concentrations can cause significant side effects in patients undergoing anti-cancer treatments, yet this may be considered a reasonable trade-off. Additionally, the study highlighted that the anti-tumor effects of combination drugs are significant when the dosage of each drug is kept below the maximum tolerated dose (MTD) for either drug [33]. This suggests that limitations on the drug input, including the amount administered per unit of time and the total amount administered during the treatment cycle, should be carefully considered in the patient treatment plans.

    First, we will limit the dosages of the anticancer drugs ACI and IL-2, denoted as u(t):=[u1(t),u2(t)], administered per unit of time, i.e.,

    0u(t)umax,t[0,T], (3.2)

    where umax:=[umax1,umax2] are positive constants, which represent the maximum allowable dosages for each drug in a combination therapy with each maximum value. This ensures that the dosages are within a range that patients can tolerate in terms of the side effects from a single administration of the drugs.

    Second, another measure of drug toxicity considers the product of drug concentration and the duration of administration, which can be mathematically represented as the integral of the drug concentration over a designated period. When this period encompasses either the entire treatment course or a treatment cycle, the primary concern becomes the total cumulative toxicity. This approach accounts for the overlap of side effects experienced by the patient at any given time and the overall bodily mechanisms that may be adversely impacted by a prolonged exposure to side effects. When determining the total dosage of a specific drug administered, we have the following:

    T0u(t)dt=usfixed, (3.3)

    where usfixed are positive constants, which represent the total dosage of the drug inputs over a time period T.

    Thus, the constrained optimal control problem subject to system (2.2) can be defined as follows.

    Problem P2: Given system (2.2), choose the optimal controls u1 and u2 such that the cost function (3.1) is minimized subject to the constraints (3.2) and (3.3).

    As is well-known, optimal control problems can be efficiently solved by the control parameterization technique, in which the control function is approximated by a piece-wise constant or linear functions [21].

    The controls u1(t) and u2(t) can be approximated by the following:

    uk(t)Mj=0hjkχ[tj,tj+1)(t), (4.1)

    where

    χ[tj,tj+1)(t)={1,t[tj,tj+1),0,otherwise.

    and the new decision variables hjk,k{1,2},j{0,1,,M} satisfy the following constraint:

    0hjkumaxk,k{1,2},j{0,1,,M}. (4.2)

    Let t0=0, tM+1=T. The given switching times tj,j{0,1,,M}, satisfy the following:

    0t1t2tMT.

    Let

    h=[(h0),(h1)T,,(hM)T]R2(M+1),

    where

    hj=[hj1,hj2]R2,j{0,1,,M}.

    The corresponding cost function (3.1) becomes the following:

    J(h1,h2)=M1j=0tj+1tj[TC(t)+12(B1(hj1χ[tj,tj+1)(t))2+B2(hj2χ[tj,tj+1)(t))2)EC(t)]dt+TtM[TC(t)+12(B1(hM1(t))2+B2(hM2(t))2)EC(t)]dt. (4.3)

    Furthermore, system (2.2) changes to the following form:

    dECdt=sMj=0hj1χ[tj,tj+1)(t)+pECTCg+TCmECTCdECdTCdt=aTC(1bTC)nECTCMj=0hj2χ[tj,tj+1)(t)TC (4.4)

    with the initial condition

    EC(t)=EC0,TC(t)=TC0. (4.5)

    With these in mind, Problem P1 can be approximated by the following problem.

    Problem PP1: Given system (4.4) with initial condition (4.5), choose an optimal hjk,k{1,2},j{0,1,,M} such that the cost function (4.3) is minimized.

    In essence, problem (PP1) is a mathematical programming problem. It is well known that gradient-based optimization techniques are highly effective in solving such a problem. For this, the gradients of the cost function (4.3) are needed. In this section, we will present these required gradients.

    Define

    f(t,x(t),h)=[dECdtdTCdt],x(t)=[EC(t)TC(t)].

    For t[tl,tl+1),l{j,,M},j{0,1,,M},k{1,2}, consider the following auxiliary dynamic systems

    dψjk(t)dt=nl=1fk(t,x(t),h)xlψjl(t)+δlkfk(t,x(t),h)kjk, (5.1)

    with the initial condition

    ψjk(t)=0,t[0,tj),j{0,1,,M},k{1,2}, (5.2)

    where

    δlk={1,k=l0,otherwise.

    Theorem 1. The gradients of the cost function (4.3) are as follows:

    [J(h1,h2)hj1J(h1,h2)hj2]=M1l=0tl+1tl[ψj1(t)ψj2(t)]dt+TtM[11]dt+{tj+1tj[B1hj1χ[tj,tj+1)(t)B2hj2χ[tj,tj+1)(t)]dt,[tj,tj+1)[0,tM].TtM[B1hj1χ[tj,tj+1)(t)B2hj2χ[tj,tj+1)(t)]dt,[tj,tj+1]=[tM,T]. (5.3)

    Proof. The proof of Theorem 1 is similar to the proof of Theorem 7.2.2 in [21].

    Define

    [g1(h),g2(h)]=T0[Mj=0hj1χ[tj,tj+1)(t),Mj=0hj2χ[tj,tj+1)(t)]dtusfixed=0. (5.4)

    Then, Problem P2 can be approximated by the following problem.

    Problem PP2: Given system (2.2), choose hjk,k{1,2},j{0,1,,M}, such that the cost function (3.1) is minimized subject to the constraints (4.2) and (5.4).

    In addition, the gradients of the constraints in Problem P2 are given as follows.

    Theorem 2. The gradients of the constraints (5.4) are as follows:

    [g1(h)hj1g1(h)hj2g2(h)hj1g2(h)hj2]={tj+1tj[1001]dt,[tj,tj+1][0,tM].TtM[1001]dt,[tj,tj+1]=[tM,T]. (5.5)

    Proof. The proof of Theorem 2 is obtained based on the chain rule.

    Generally, to maintain consistency in the time intervals before and after, we default to using the same time interval as previously mentioned when calculating the gradient of the constraints, based on the time interval of the cost function. This approach yields the gradients of the constraints, which can be solved using a standard nonlinear programming algorithm.

    We will now conduct numerical simulations of { Problems PP1} and PP2 to validate the analytical gradient results presented in the previous sections. To demonstrate the accuracy of our numerical simulations, we have selected parameter sets from both the tumor model and the optimal control problem. These parameters are listed in Table 1.

    Table 1.  Numerical simulation parameter set[17,31].
    Parameters Description Numerical values
    s Entry rate of effector cells 1.3×104
    p Maximum rate of proliferation of effector cells 0.1245
    g Semi-saturated constant cells 2.019×107
    m Effector cell inactivation rate due to tumor cells 3.422×1010
    d Natural mortality of effector cells 0.0412
    a Maximum proliferation rate of tumor cells 0.18
    b b1is the maximum carrying capacity of the cell 2.0×109
    n Tumor cell inactivation rate due to effector cells 1.101×107
    B1 Cost of IL-2 drugs 107
    B2 Cost of ACI drugs 107

     | Show Table
    DownLoad: CSV

    First, we obtain the numerical solution for system (2.2) using the fourth-order Runge-Kutta algorithm. Then, an algorithm based on the control parameterization is developed as follows:

    Step1: Obtain ψjk(t) by solving system (5.1) with the initial constraint (5.2).

    Step2: Compute the solution of systems (4.4) and (4.5) by solving system (4.4) forward in time from t=0 to t=T with the initial condition (4.5).

    Step3: Compute the corresponding value of gi(h) via (5.4) and compute the gradient value of the constraints (5.4) via (5.5).

    Step4: Find the optimal value by using the gradient formulae from Theorems 1 and 2 in conjunction with the nonlinear programming software–Optimization Toolbox in MATLAB.

    Finally, we simulate the tumor treatment process over a specified time period. To gain multiple perspectives on what is actually occurring throughout the process, we present the following simulations of the scenario.

    We simulate a scenario where the effector and tumor cells naturally engage in a conflict without any treatment applied. This simulation provides a geometric visualization that helps us understand the behavior of the tumor system, thus leading to insights into potential optimal control strategies. Figure 2 illustrates the dynamics of this untreated scenario. Within a fixed time horizon from 0 to 200, the effector cells oscillate, and similarly, the tumor cells fluctuate in a pattern of ebb and flow. This demonstrates that the cancer does not remit on its own without intervention.

    Figure 2.  The numerical solution of the untreated state system (1) with the initial conditions used are EC0=1.70811×106, TC0=8.28638×106.

    We now explore the interaction between the effector and tumor cells under the influence of two combined drugs, regardless of the total dosage administered. In the treated scenario, the number of tumor cells reaches a therapeutic plateau around day 50, thus indicating a significant reduction compared to the untreated case. Figure 2 clearly shows that the combination of ACI and IL-2 markedly reduces the tumor cell and effectively suppresses their proliferation, as indicated by the yellow solid line in the first graph of Figure 3, as compared to the second graph of Figure 2. Additionally, the number of effector cells decreases due to the side effects of the drugs, as shown by the blue solid line in the first graph of Figure 3. Furthermore, the tumor cells exhibit a slight increase towards the end of the cycle noted by the upward trend at the end of the yellow solid line in the first graph of Figure 3, suggesting that the initial therapeutic effectiveness diminishes over time without controlling the total drug dosage. This reduction in drug efficacy is primarily attributed to the tumor cells developing resistance to the drugs as the treatment progresses.

    Figure 3.  Numerical solution of the state system and the discrete inputs of the two drugs over 200 days when no limits are placed on the total amount of drugs.

    In this section, we explore the drug toxicity by providing numerical examples from five scenarios to illustrate how the total drug input affects the number of tumor cells and immune effector cells during the treatment when two drugs are combined, thereby highlighting the accumulation of drug toxicity. We focus on the impact of the total drug amount on the tumor treatment, with the dosage of each individual drug contingent upon the constraints set by the total drug input.

    Based on numerical calculations of the total drug amount, we will present a range of corresponding single drug inputs. This approach underscores that individual drug dosages also significantly affect the patient treatment outcomes.

    First case: when total IL-2 and total ACI are the same, both are large

    Consider the following case:

    2000u1(t)dt=100,2000u2(t)dt=100,0u1(t)1, 0u2(t)1.

    We now examine the outcomes when the total dosage of both drugs is maintained at high levels throughout the treatment cycle. The number of tumor cells was significantly reduced when high concentrations of IL-2 and ACI were administered, compared to scenarios where the total drug dosage was unrestricted. Specifically, the number of tumor cells effectively converged to zero from the first day of drug administration until about day 40, as shown by the yellow solid line in the first graph of Figure 4. Simultaneously, the number of state cells bound to tumor cells decreased, thus showing an exposure to drug toxicity, but at a relatively steady rate illustrated by the blue solid line in the first graph of Figure 4.

    Figure 4.  Numerical solution of the state system and the two drug inputs over 200 days when the total IL-2 is 100 and the total ACI is 100.

    In this scenario, the higher single-drug dosages imply that patients with a lower tolerance for side effects can still employ this aggressive treatment strategy to quickly control the tumor progression. Initially, the ACI dosage was high, thus leading to a significant reduction in the number of tumor cell. Then, once effective, the dosage of ACI was adjusted downward, as depicted in the third graph of Figure 4. Meanwhile, the single dosage of IL-2 decreased more gradually, as shown in the second graph of Figure 4. This strategy highlights the tailored adjustment of drug dosages in response to the tumor dynamics and the patient response.

    Second case: when total IL-2 and total ACI are the same, both are small

    Consider the following case:

    2000u1(t)dt=10,2000u2(t)dt=10,0u1(t)0.1, 0u2(t)1.

    We examine a scenario where both drugs are administered at lower total dosages. Compared to the unrestricted drug treatment, administering low levels of IL-2 and ACI initially led to a fluctuation in the tumor cell count, rising and then falling from the first day of drug administration to around day 110, with an overall upward trend during this period. Subsequently, the number of tumor cells linearly decreased from day 110 to day 160 as the concentrations of IL-2 and ACI were increased. However, even at their lowest, the tumor cell counts remained above 100, 000, and a rapid rebound occurred thereafter as seen by the significant curvature at the end of the solid yellow line in the first graph of Figure 5, compared to the end of the solid yellow line in Figure 3.

    Figure 5.  Numerical solution of the state system and the two drug inputs over 200 days when the total IL-2 is 10 and the total ACI is 10.

    In the earlier stages, when the total amount of administered drug was low, the impact on the state cells was minimal, both for the single and the total drug inputs. However, after the single dosage of ACI was increased, the number of state cells significantly declined, which is a side effect that indicates that higher drug concentrations lead to more pronounced adverse effects. Importantly, the extent of these side effects varies from person to person.

    Third case: when the total IL-2 is high and the total ACI is low

    Consider the following case:

    2000u1(t)dt=100,2000u2(t)dt=10,0u1(t)1, 0u2(t)1.

    In this scenario, we examine the effects when the total input of IL-2 is high and that of ACI is low. This scenario displayed a distinctive pattern in a tumor cell count increase, then decrease, then increase upon administering high IL-2 and low ACI. Initially, the number of tumor cells increased alongside the IL-2 input from the first day of drug administration up to about 50 days. After this period, despite the continued high intake of IL-2, the decline in the number of tumor cell was very gradual, thus highlighting a delayed response to the drug treatment and illustrating that the delay effects vary between different drugs.

    Post 100 days, there was a rapid decrease in the number of tumor cells reaching a minimum, which was sustained over approximately 40 days, thus suggesting the combined effectiveness of the drugs, particularly as the ACI therapy was introduced, thereby enhancing the suppression of tumor growth while also resulting in a decrease in the effector cells. However, beyond 180 days, when the drug inputs were reduced to their lowest, the tumor rebounded sharply (as depicted by the distinct curvature at the end of the solid yellow line in the first graph of Figure 6), thereby surpassing the initial tumor count within 20 days. This suggests that the effectiveness of the treatment was compromised by a inadequate drug input, although this point is not the central focus of our current discussion.

    Figure 6.  Numerical solution of the state system and the two drug inputs over 200 days when the total IL-2 is 100 and the total ACI is 10.

    Fourth case: low total IL-2 and high total ACI

    Consider the following case:

    2000u1(t)dt=10,2000u2(t)dt=100,0u1(t)0.1, 0u2(t)1.

    In this scenario, we explored a treatment regimen characterized by a low overall intake of IL-2 and a high overall input of ACI. We observed that the effects of such a treatment were largely similar to those in the first scenario, with a notable difference being a significantly higher count of state cells in this case. Biologically, this can be mainly attributed to the higher input of IL-2 in the second scenario, which was able to boost the number of state cells within the first 40 days when low concentrations of IL-2 and high concentrations of ACI were administered, as depicted in Figure 7.

    Figure 7.  Numerical solution of the state system and the two drug inputs over 200 days when the total IL-2 is 10 and the total ACI is 100.

    This finding suggests that clinically, to minimize drug side effects, the input of IL-2 can be appropriately reduced while using higher concentrations of ACI to achieve an enhanced therapeutic effect. Additionally, it indicates that different drugs have varying tolerance ranges, and exceeding the upper limit of the input, while yielding consistent therapeutic effects, can cause additional harm that may not justify the benefits.

    The primary goal of this scenario is to evaluate the impact of maintaining a fixed concentration of one drug while continuously adjusting the dosage of another on the tumor-immune microenvironment within the patient. The drug can effectively function by administering the correct dose to achieve a peak blood concentration. In this context, the ensuing numerical simulations not only identify the primary and secondary roles of the drugs during the treatment cycle, but also demonstrate the combined effect of both drugs more accurately, as depicted in Figures 8 and 9.

    Figure 8.  State and tumor cells undergo changes over 200 days while maintaining a total ACI of 35 and administering a gradient to IL-2.
    Figure 9.  State and tumor cells over 200 days when keeping the total amount of IL-2 at 15 and administering a gradient to ACI.

    First case: maintaining the concentration of IL-2

    ACI is given in increments of 10, 30, 40, 50 and 100.

    The dynamics of the effector and tumor cells in Figure 8 demonstrate significant variations when the IL-2 concentration is maintained and ACI is administered in a gradient. These figures clearly show that the number of cancer cells significantly vary at different ACI concentrations. Initially, when ACI doses are limited to 30, 40, and 50, there is little variation; however, more variation becomes apparent towards the end of the cycle.

    Second case: maintain the ACI concentration while administering IL-2 at doses of 10, 30, 40, 50 and 100.

    Figure 9 illustrates the changing ratio of effector cells to tumor cells when the ACI concentration is maintained constant and IL-2 is administered in varying doses. Throughout the course of the treatment, there is a gradual decline in the number of effector cell, while the reduction in tumor cells is more pronounced. At this level of ACI, the drug's effectiveness remains relatively stable during the initial phases of treatment. However, with lower doses of IL-2, there is a quicker resurgence in cancer cell proliferation.

    In this study, we addressed the optimal control problem with the goal of maximizing the population of effector immune cells, minimizing the tumor cell counts, and reducing the drug toxicity. The objective of this paper was to deepen our understanding of tumor dynamics by analyzing interactions between immune effector cells, tumor cells, and their microenvironment, given a fixed total drug input. To assess the cumulative toxicity of the treatment, we introduced two external drugs (ACI and IL-2) administered over the total cycle time. The primary contribution of this work includes setting a constraint on the total drug input and establishing a discrete dosing sequence to represent the administration of anti-cancer drugs. Initially, we defined the optimal control problems, with and without constraints, based on a specified tumor model. Theoretically, we enhanced the model's descriptive power by incorporating an auxiliary system that provided gradient information for the state equations using variational and chain rule methods, thereby deriving a gradient formulation for the objective function analyzed in this paper. Subsequently, we converted the equation constraint into a standard form suitable for optimal control problems. Then, we derived the gradient formulation for the specific constraints imposed. Numerically, we explored the dynamics of the tumor system under various scenarios, including the effects of a combined ACI and IL-2 treatment in unconstrained settings and under different constraints, among other considerations.

    Some research directions are outlined as follows:

    1). Given the delay between drug administration and its action within the patient's specific microenvironment, we could explore this by incorporating a time-delay in the state equations.

    2). Stochastic factors will be involved in the tumor-immune system to account for unpredictable scenarios that might emerge during the course of treatment.

    3). Implementing secondary control measures will be considered during the drug treatment, particularly when a drug is well-tolerated or when the patient's internal environment becomes more complex. This involves selecting the optimal timing and appropriate drug for a second round of control treatment.

    The authors declare they have not used Artificial Intelligence (AI) tools in the creation of this article.

    This work was supported in part by the National Natural Science Foundation of China under Grant 12161076 and Grant 12271307; in part by the Shandong Province Natural Science Foundation of China under Grant ZR2023MA054; in part by the Nature Science Foundation of Liaoning Province of China under Grant 2024-MS-015; in part by the Fundamental Research Funds for the Central Universities under Grant 3132024196, and Grant DUT22LAB305; in part by the China Postdoctoral Science Foundation under Grant 2019M661073; in part by the Xinghai Project of Dalian Maritime University.

    The authors declare there is no conflict of interest.



    [1] D. J. Schwartzentruber, In vitro predictors of clinical response in patients receiving interleukin-2-based immunotherapy, Curr. Opin. Oncol., 5 (1993), 1055–1058. https://doi.org/10.1097/00001622-199311000-00018 doi: 10.1097/00001622-199311000-00018
    [2] S. A. Rosenberg, M. T. Lotze, Cancer immunotherapy using interleukin-2 and interleukin-2-activated lymphocytes, Annu. Rev. Immunol., 4 (1986), 681–709. https://doi.org/10.1146/annurev.iy.04.040186.003341 doi: 10.1146/annurev.iy.04.040186.003341
    [3] R. Kaempfer, L. Gerez, H. Farbstein, L. Madar, O. Hirschman, R. Nussinovich, Prediction of response to treatment in superficial bladder carcinoma through pattern of interleukin-2 gene expression, J. Clin. Oncol., 14 (1996), 1778–1786. https://doi.org/10.1200/jco.1996.14.6.1778 doi: 10.1200/jco.1996.14.6.1778
    [4] D. Kirschner, J. C. Panetta, Modeling immunotherapy of the tumor-immune interaction, J. Math. Biol., 37 (1998), 235–252. https://doi.org/10.1007/s002850050127 doi: 10.1007/s002850050127
    [5] N. Bellomo, L. Preziosi, Modelling and mathematical problems related to tumor evolution and its interaction with the immune system, Math. Comput. Modell., 32 (2000), 413–452. https://doi.org/10.1016/S0895-7177(00)00143-6 doi: 10.1016/S0895-7177(00)00143-6
    [6] S. Khajanchi, S. Banerjee, Stability and bifurcation analysis of delay induced tumor immune interaction model, Appl. Math. Comput., 248 (2014), 652–671. https://doi.org/10.1016/j.amc.2014.10.009 doi: 10.1016/j.amc.2014.10.009
    [7] J. Yuan, C. Wu, Z. Liu, S. Zhao, C. Yu, K. L. Teo, et al., Koopman modeling for optimal control of the perimeter of multi-region urban traffic networks, Appl. Math. Modell., 138 (2025), 115742. https://doi.org/10.1016/j.apm.2024.115742 doi: 10.1016/j.apm.2024.115742
    [8] C. Liu, R. Loxton, Q. Lin, K. L. Teo, Dynamic optimization for switched time-delay systems with state-dependent switching conditions, SIAM J. Control Optim., 56 (2018), 3499–3523. https://doi.org/10.1137/16M1070530 doi: 10.1137/16M1070530
    [9] C. Liu, R. Loxton, K. L. Teo, S. Wang, Optimal state-delay control in nonlinear dynamic systems, Automatica, 135 (2022), 109981. https://doi.org/10.1016/j.automatica.2021.109981 doi: 10.1016/j.automatica.2021.109981
    [10] C. Liu, Z. Gong, C. Yu, S. Wang, K. L. Teo, Optimal control computation for nonlinear fractional time-delay systems with state inequality constraints, J. Optim. Theory Appl., 191 (2021), 83–117. https://doi.org/10.1007/s10957-021-01926-8 doi: 10.1007/s10957-021-01926-8
    [11] J. L. Yuan, D. Yang, D. Xun, K. L. Teo, C. Wu, A. Li, et al., Sparse optimal control of cyber-physical systems via PQA approach, Pac. J. Optim., in press.
    [12] J. M. Murray, Optimal control for a cancer chemotheraphy problem with general growth and loss functions, Math. Biosci., 98 (1990), 273–287. https://doi.org/10.1016/0025-5564(90)90129-M doi: 10.1016/0025-5564(90)90129-M
    [13] T. Burden, J. Ernstberger, K. R. Fister, Optimal control applied to immunotherapy, Discrete Contin. Dyn. Syst.-Ser. B, 4 (2003), 135–146. https://doi.org/10.3934/dcdsb.2004.4.135 doi: 10.3934/dcdsb.2004.4.135
    [14] K. R. Fister, J. H. Donnelly, Immunotherapy: an optimal control theory approach, Math. Biosci. Eng., 2 (2005), 499–510. https://doi.org/10.3934/mbe.2005.2.499 doi: 10.3934/mbe.2005.2.499
    [15] L. G. de Pillis, W. Gu, K. R. Fister, T. A. Head, K. Maples, A. Murugan, et al., Chemotherapy for tumors: An analysis of the dynamics and a study of quadratic and linear optimal controls, Math. Biosci., 209 (2007), 292–315. https://doi.org/10.1016/j.mbs.2006.05.003 doi: 10.1016/j.mbs.2006.05.003
    [16] S. P. Chakrabarty, S. Banerjee, A control theory approach to cancer remission aided by an optimal therapy, J. Biol. Syst., 18 (2010), 75–91. https://doi.org/10.1142/S0218339010003226 doi: 10.1142/S0218339010003226
    [17] S. Khajanchi, D. Ghosh, The combined effects of optimal control in cancer remission, Appl. Math. Comput., 271 (2015), 375–388. https://doi.org/10.1016/j.amc.2015.09.012 doi: 10.1016/j.amc.2015.09.012
    [18] S. X. Su, M. Z. Shao, C. J. Yu, K. L. Teo, On the correlation of local collocation and control parameterization methods, J. Ind. Manage. Optim., 20 (2024), 2329–2357. https://doi.org/10.3934/jimo.2024004 doi: 10.3934/jimo.2024004
    [19] B. Zhao, H. Xu, K. L. Teo, A numerical algorithm for constrained optimal control problems, J. Ind. Manage. Optim., 19 (2023), 8602–8616. https://doi.org/10.3934/jimo.2023053 doi: 10.3934/jimo.2023053
    [20] C. J. Yu, K. H. Wong, An enhanced control parameterization technique with variable switching times for constrained optimal control problems with control-dependent time-delayed arguments and discrete time-delayed arguments, J. Comput. Appl. Math., 427 (2023), 115106. https://doi.org/10.1016/j.cam.2023.115106 doi: 10.1016/j.cam.2023.115106
    [21] K. L. Teo, B. Li, C. Yu, V. Rehbock, Applied and Computational Optimal Control, Springer Cham, 2021. https://doi.org/10.1007/978-3-030-69913-0
    [22] D. Wu, Y. Chen, C. Yu, Y. Bai, K. L. Teo, Control parameterization approach to time-delay optimal control problems: a survey, J. Ind. Manage. Optim., 19 (2023), 3750–3783. https://doi.org/10.3934/jimo.2022108 doi: 10.3934/jimo.2022108
    [23] P. Liu, Q. Hu, L. Li, M. Liu, X. Chen, C. Piao, et al., Fast control parameterization optimal control with improved Polak-Ribiere-Polyak conjugate gradient implementation for industrial dynamic processes, ISA Trans., 123 (2022), 188–199. https://doi.org/10.1016/j.isatra.2021.05.020 doi: 10.1016/j.isatra.2021.05.020
    [24] N. Cho, J. Park, Y. Kim, H. S. Shin, Unified control parameterization approach for finite-horizon feedback control with trajectory shaping, IEEE Trans. Aerosp. Electron. Syst., 58 (2022), 4782–4795. https://doi.org/10.1109/TAES.2022.3160990 doi: 10.1109/TAES.2022.3160990
    [25] L. Wang, J. Yuan, C. Wu, X. Wang, Practical algorithm for stochastic optimal control problem about microbial fermentation in batch culture, Optim. Lett., 13 (2019), 527–541. https://doi.org/10.1007/s11590-017-1220-z doi: 10.1007/s11590-017-1220-z
    [26] J. Yuan, S. Lin, S. Zhang, C. Liu, Distributionally robust system identification for continuous fermentation nonlinear switched system under moment uncertainty of experimental data, Appl. Math. Modell., 127 (2024), 679–695. https://doi.org/10.1016/j.apm.2023.12.023 doi: 10.1016/j.apm.2023.12.023
    [27] J. Yuan, S. Zhao, D. Yang, C. Liu, C. Wu, T. Zhou, et al., Koopman modeling and optimal control for microbial fed-batch fermentation with switching operators, Nonlinear Analysis-Hybrid Systems, 52 (2024), 101461. https://doi.org/10.1016/j.nahs.2023.101461 doi: 10.1016/j.nahs.2023.101461
    [28] S. Wang, J. Mei, D. Xia, Z. Yang, J. Hu, Finite-time optimal feedback control mechanism for knowledge transmission in complex networks via model predictive control, Chaos, Solitons Fractals, 164 (2022), 112724. https://doi.org/10.1016/j.chaos.2022.112724 doi: 10.1016/j.chaos.2022.112724
    [29] J. Mei, S. Wang, D. Xia, J. Hu, Global stability and optimal control analysis of a knowledge transmission model in multilayer networks, Chaos, Solitons Fractals, 164 (2022), 112708. https://doi.org/10.1016/j.chaos.2022.112708 doi: 10.1016/j.chaos.2022.112708
    [30] J. Mei, S. Wang, X. Xia, W. Wang, An economic model predictive control for knowledge transmission processes in multilayer complex networks, IEEE Trans. Cybern., 54 (2022), 1442–1455. https://doi.org/10.1109/TCYB.2022.3204568 doi: 10.1109/TCYB.2022.3204568
    [31] V. A. Kuznetsov, I. A. Makalkin, M. A. Taylor, A. S. Perelson, Nonlinear dynamics of immunogenic tumors: parameter estimation and global bifurcation analysis, Bull. Math. Biol., 56 (1994), 295–321. https://doi.org/10.1007/BF02460644 doi: 10.1007/BF02460644
    [32] P. S. Goedegebuure, L. M. Douville, H. Li, G. C. Richmond, D. D. Schoof, M. Scavone, et al., Adoptive immunotherapy with tumor-infiltrating lymphocytes and interleukin-2 in patients with metastatic malignant melanoma and renal cell carcinoma: a pilot study, J. Clin. Oncol., 13 (1995), 1939–1949. https://doi.org/10.1200/JCO.1995.13.8.1939 doi: 10.1200/JCO.1995.13.8.1939
    [33] B. L. Gause, M. Sznol, W. C. Kopp, J. E. Janik, J. W. Smith 2nd, R. G. Steis, et al., Phase I study of subcutaneously administered interleukin-2 in combination with interferon alfa-2a in patients with advanced cancer, J. Clin. Oncol., 14 (1996), 2234–2241. https://doi.org/10.1200/JCO.1996.14.8.2234 doi: 10.1200/JCO.1996.14.8.2234
  • Reader Comments
  • © 2024 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(513) PDF downloads(30) Cited by(0)

Figures and Tables

Figures(9)  /  Tables(1)

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog