
Molecular biological networks are highly nonlinear systems that exhibit limit point singularities. Bifurcation analysis and multiobjective nonlinear model predictive control (MNLMPC) of a molecular network problem represented by the Pettigrew model were performed. The Matlab program MATCONT (Matlab continuation) was used for the bifurcation analysis and the optimization language PYOMO (python optimization modeling objects) was used for performing the multiobjective nonlinear model predictive control. MATCONT identified the limit points, branch points, and Hopf bifurcation points using appropriate test functions. The multiobjective nonlinear model predictive control was performed by first performing single objective optimal control calculations and then minimizing the distance from the Utopia point, which was the coordinate of minimized values of each objective function. The presence of limit points (albeit in an infeasible region) enabled the MNLMPC calculations to result in the Utopia solution. MNLMPC of the partial models also resulted in Utopia solutions.
Citation: Lakshmi N Sridhar. Integration of bifurcation analysis and optimal control of a molecular network[J]. AIMS Bioengineering, 2024, 11(2): 266-280. doi: 10.3934/bioeng.2024014
[1] | Leelakrishna Reddy, Segun Akinola . Transforming healthcare with the synergy of biotechnology and information technology. AIMS Bioengineering, 2023, 10(4): 421-439. doi: 10.3934/bioeng.2023025 |
[2] | Priya Vizzini, Lucilla Iacumin, Giuseppe Comi, Marisa Manzano . Development and application of DNA molecular probes. AIMS Bioengineering, 2017, 4(1): 113-132. doi: 10.3934/bioeng.2017.1.113 |
[3] | Figueroa-Pizano María Dolores, Campa-Mada Alma Consuelo, Canett-Romero Rafael, Paz-Samaniego Rita, Martínez-López Ana Luisa, Carvajal-Millan Elizabeth . Influence of arabinoxylan and crosslinked arabinoxylan consumption on blood serum lipids and glucose levels of Wistar rats. AIMS Bioengineering, 2021, 8(3): 208-220. doi: 10.3934/bioeng.2021018 |
[4] | Thi Thuy Quynh Nguyen, Le Thanh Huyen Trinh, Hoang Bao Vy Pham, Tri Vien Le, Thi Kim Hue Phung, Suk-Ha Lee, Jong-Joo Cheong . Evaluation of proline, soluble sugar and ABA content in soybean Glycine max (L.) under drought stress memory. AIMS Bioengineering, 2020, 7(3): 114-123. doi: 10.3934/bioeng.2020011 |
[5] | Yi Deng, Zhiguo Wang, Xiaohui Li, Yu Lei, Owen Omalley . Advancing biomedical engineering through a multi-modal sensor fusion system for enhanced physical training. AIMS Bioengineering, 2023, 10(4): 364-383. doi: 10.3934/bioeng.2023022 |
[6] | Valeria Miranda-Arizmendi, Diana Fimbres-Olivarria, Anselmo Miranda-Baeza, Agustín Rascón-Chu, Jorge Marquez-Escalante, Jaime Lizardi-Mendoza, Mayra A. Méndez-Encinas, Elizabeth Carvajal-Millan . Sulfated polysaccharides from marine diatoms: Insight into molecular characteristics and biological activity. AIMS Bioengineering, 2024, 11(1): 110-129. doi: 10.3934/bioeng.2024007 |
[7] | Mark Warburton, Hossam Omar Ali, Wai Choon Liong, Arona Martin Othusitse, Amir Zaki Abdullah Zubir, Steve Maddock, Tuck Seng Wong . OneClick: A Program for Designing Focused Mutagenesis Experiments. AIMS Bioengineering, 2015, 2(3): 126-143. doi: 10.3934/bioeng.2015.3.126 |
[8] | Firoz Ahmed . Deciphering the gene regulatory network associated with anti-apoptosis in the pancreatic islets of type 2 diabetes mice using computational approaches. AIMS Bioengineering, 2023, 10(2): 111-140. doi: 10.3934/bioeng.2023009 |
[9] | Moawiah M Naffaa . Innovative therapeutic strategies for traumatic brain injury: integrating regenerative medicine, biomaterials, and neuroengineering. AIMS Bioengineering, 2025, 12(1): 90-144. doi: 10.3934/bioeng.2025005 |
[10] | Daniel Borchert, Diego A. Suarez-Zuluaga, Yvonne E. Thomassen, Christoph Herwig . Risk assessment and integrated process modeling–an improved QbD approach for the development of the bioprocess control strategy. AIMS Bioengineering, 2020, 7(4): 254-271. doi: 10.3934/bioeng.2020022 |
Molecular biological networks are highly nonlinear systems that exhibit limit point singularities. Bifurcation analysis and multiobjective nonlinear model predictive control (MNLMPC) of a molecular network problem represented by the Pettigrew model were performed. The Matlab program MATCONT (Matlab continuation) was used for the bifurcation analysis and the optimization language PYOMO (python optimization modeling objects) was used for performing the multiobjective nonlinear model predictive control. MATCONT identified the limit points, branch points, and Hopf bifurcation points using appropriate test functions. The multiobjective nonlinear model predictive control was performed by first performing single objective optimal control calculations and then minimizing the distance from the Utopia point, which was the coordinate of minimized values of each objective function. The presence of limit points (albeit in an infeasible region) enabled the MNLMPC calculations to result in the Utopia solution. MNLMPC of the partial models also resulted in Utopia solutions.
Molecular biological networks are complex systems with a high degree of nonlinearity [1]–[4]. The presence of singularities in the form of limit points in the Pettigrew model for molecular networks was demonstrated by Song and co-workers [5], Sridhar [6] showed for small-scale problems that the presence of singularities in the form of limit and branch points are beneficial for multiobjective nonlinear model predictive calculations and enable one to obtain the best possible solution (Utopia Point). The aim of this paper is to demonstrate that in the molecular network problem where the Pettigrew model is used, the presence of limit points (albeit in an infeasible region) can benefit the multiobjective nonlinear model predictive calculations, and the result obtained is the Utopia solution. This paper is organized as follows. First, the background section dealing with the work done on molecular network models is described. This is followed by a description of the bifurcation analysis techniques and the strategy for performing the multiobjective nonlinear model predictive control calculations. A section on the interaction between bifurcation analysis and multiobjective nonlinear model predictive control is followed by a description of the Pettigrew model. The results and discussion section are then presented followed by the conclusions.
Several workers did a considerable amount of work on biological networks. Pinsker et al. [7] looked at long-term sensitization of a defensive withdrawal reflex in Aplysia California. Frost et al. [8] studied monosynaptic connections made by the sensory neurons of the gill- and siphon-withdrawal reflex in Aplysia participate in the storage of long-term memory for sensitization. Scholz and Byrne, 1987 investigated long-term sensitization in Aplysia: Biophysical correlates in tail sensory neurons. Walters and co-workers [9],[10] developed a simple model of long-term hyperalgesia and multiple sensory neuronal correlates of site-specific sensitization in Aplysia.
Castellucci et al. [11] 1989 showed that inhibition of protein synthesis blocks long-term behavioral sensitization in the isolated gill-withdrawal reflex of Aplysia. Goldsmith and Byrne [2] discovered that bag cell extract inhibits tail-siphon withdrawal reflex, suppresses long-term but not short-term sensitization, and attenuates sensory-to-motor neuron synapses in Aplysia. Cleary [12] further studied cellular correlates of long-term sensitization in Aplysia. Wright et al. [13] 1scussed the developmental emergence of long-term memory for sensitization in Aplysia. Levenson et al. [14] showed that serotonin levels in the hemolymph of Aplysia are modulated by light/dark cycles and sensitization training. Sutton et al. [15] studied the interaction between the amount and pattern of training in the induction of intermediate and long-term memory for sensitization in Aplysia. Wainwright et al. [16] investigated localized neuronal outgrowth induced by long-term sensitization training in Aplysia. Wainwright et al. [17] studied the dissociation of morphological and physiological changes associated with long-term memory in Aplysia.
Pettigrew and co-workers [18] developed a model that represents short (STF)-, intermediate (ITF)-, and long (LTF)-term phases of protein kinase A (PKA) activation and corresponding phases of facilitation of the Aplysia sensorimotor synapse. This model studies biophysical mechanisms that may be implicated in learning and memory. The model also represents phosphorylation of the transcription factor CREB1 (cyclic adenosine monophosphate responsive element binding protein 1) by PKA and induction of the immediate-early gene Aplysia ubiquitin hydrolase (Ap-uch); Ap-uch is necessary for LTF. PKA and ERK (Extra-cellular Signal Regulated Kinase) activation, CREB1 and CREB2 phosphorylation, and Ap-uch induction are dealt with in this model where biochemical processes in the presynaptic sensory neuron that contribute to STF, ITF, and LTF of the sensorimotor synapse are represented. More details of this model can be found in Pettigrew et al. [18] and Song et al. [19]. Song et al. [19] demonstrates the existence of limit points that cause multiple steady-states for unrealistic parameters of the Pettigrew model. The aim of this paper is to show that the limit points (even if found in the infeasible region) are beneficial in obtaining the Utopia solution when multiobjective nonlinear model predictive calculations are performed.
There has been a lot of work in chemical engineering involving bifurcation analysis throughout the years. The existence of multiple steady-states and oscillatory behavior in chemical processes has led to a lot of computational and analytical work to explain the causes for these nonlinear phenomena. Multiple steady states are caused by the existence of branch and limit points while oscillatory behavior is caused by the existence of Hopf bifurcations points.
In the case of branch points and limit points, the Jacobian matrix of the set of steady-state equations is singular. However, at a branch point, there are 2 distinct tangents at the singular point, while at a limit point, there is only one tangent at the singular point. Singularities in the Jacobian matrix is often indicative of an optimal solution and this motivates the investigation of how the singular points in the Jacobian matrix, indicated by branch and limit points, would affect the multiobjective dynamic optimization.
One of the most commonly used software to locate limit points, branch points, and Hopf bifurcation points is MATCONT (Dhooge et al, [20],[21]). This software detects limit points, branch points, and Hopf bifurcation points. Consider an ODE (ordinary differential equation) system
where
The matrix A can be written in a compact form as
The tangent surface must satisfy the equation
For both limit and branch points, the matrix B must be singular. For a limit point, the n+1th component of the tangent vector vn+1 = 0 and for a branch point the matrix
The MNLMPC method was first proposed by Flores Tlacuahuaz et al. [25] and used by Sridhar [26]–[30]. Similar optimization work was done by Younius and co-workers [31]–[33] and Safari [34]. This method is rigorous and it does not involve the use of weighting functions nor does it impose additional parameters or additional constraints on the problem unlike the weighted function or the epsilon correction method (Miettinen [35]). For a problem that is posed as
The MNLMPC method first solves dynamic optimization problems independently, minimizing/maximizing each xi individually. The minimization/maximization of xi will lead to
It will provide the control values for various times. The first obtained control value is implemented and the remaining are discarded. This procedure is repeated until the implemented and the first obtained control value are the same. The optimization package in Python, Pyomo, Hart, et al. [36], is commonly used and is where the differential equations are automatically converted to a nonlinear program (Biegler [37]. The state-of-the-art solvers like IPOPT (interior point optimizer), Wachter and Biegler [38] and BARON (branch-and-reduce optimization navigator), Tawaralmani and Sahinidis [39] are normally used in conjunction with PYOMO (python optimization modeling objects)).
The steps of the algorithm are as follows:
1. Minimize/maximize xi subject to the differential and algebraic equations that govern the process using PYOMO and Baron. This will lead to
2. Minimize
3. Implement the first obtained control values and discard the remaining.
4. Repeat steps 1 to 3 until there is an insignificant difference between the implemented and the first obtained value of the control variables.
Let the minimization be of the variable p1 lead to the value M1 and the minimization of function p2 lead to the value M2. This is equivalent to minimizing (p1 − M1)2 and (p2 − M2)2. The subsequent multiobjective minimization will be of the function (p1 − M1)2 + (p2 − M2)2.
The multiobjective optimal control problem is
For all i,
At the Utopia point both (p1 − M1) and (p2 − M2) are zero. Hence,
Now let us look at the co-state equation
The first term in this equation is 0 and hence
If the set of ODE
Hence there are two different vectors-values for
The variables in this model are the following:
(1) PKA
(2) Ap-uch
(3) cAMP
(4) C (Catalytic subunit)
(5) R (Regulatory subunit)
(6) RC PKA (holoenzyme)
(7) REG (hypothetical protein)
(8) PREG (phosphorylated REG)
(9) mRNAREG REG mRNA (proteins)
(10) RAF, MAPKK, ERK (proteins)
(11) MAPKK (mitogen-activated protein kinases kinases)
(12) ERK (extracellular signal-regulated kinases)
(13) MAPKKp (phosphorylated MAPPK)
(14) MAKKpp (phosphorylated MAPPKp)
(15) ERKp (phosphorylated ERK)
(16) PERK (fraction of CREB2 sites phosphorylated by ERK)
(17) PPKA (fraction of available CREB1 sites phosphorylated by PKA)
The model parameter values are
Vsyn = 0.002, Kfpka = 105, Kkp-uch = 0.007, AP-uchbasal = 0.1, Kfdka = 0.00048,τ = 250, Kbaskpa = 12, Kreg = 0.00064, Ktranslation = 4, νrphos = 1, Krhos = 1.5, Vdreg = 0.16, Kdreg = 0.0015, ,Kdsm = 0.02, Vmreg = 0.00002, Kb, raf = 0.001, Kb, mapkk = 0.12, Kb, erk = 0.12, Raftot = 0.5, MAPKKtot = 0.5, ERKtot = 0.5, KMK = 0.08, ERKbasal = 0.0015, Kphos1 = 0.1, Kdephos1 = 1.5, PPhos = 0.1, Kphos2 = 0.005, Kdephos2 = 0.5, Kapsyn = 0.02, Kapsynbasal = 0.0009, Kpka = 0.2, Kerk = 0.004, Kdeg = 0.01.
The model equations are
The bifurcation analysis was performed using MATCONT and reveals the presence of 2 limit points as shown in Figure 1. Although these limit points are in an infeasible region with 5-HT having negative values, their presence results in the Utopia solution when the MNLMPC calculations are performed.
The full model represented by Eqs 12–24 were considered and C, MAPKK, RAF, ERK, REG and PREG are clubbed together as
The Eqs 12–16 are considered. Here,
The Eqs 17–19 are considered. Both
Eqs 22–24 are considered.
The full model exhibits limit points and the presence of the limit points guarantees that the Utopia solution would be obtained in a MNLMPC calculation. Similar to the MNLMPC calculations for the full model that results in the Utopia point, the MNLMPC calculations for the partial models also result in the Utopia point. A comparison of Figures 2c and 3c show that the MNLMPC of the full model is better than that of the partial model as the value of C (PKAact) is higher when the MNLMPC of the full model is performed. The lower limit for these values is 0.
Bifurcation analysis and nonlinear model predictive control was performed for the Pettigrew model. The bifurcation analysis revealed the existence of limit points (albeit in the infeasible region). The MNLMPC calculations (for both the partial and full models) resulted in the Utopia solution. An integration of the bifurcation analysis and MNLMPC revealed that the existence of the limit points was beneficial and enabled the MNLMPC calculations to result in the Utopia solution.
The authors declare they have not used Artificial Intelligence (AI) tools in the creation of this article.
[1] | Smolen P, Baxter DA, Byrne JH (2000) Mathematical modelling of gene networks. Neuron 26: 567-580. https://doi.org/10.1016/S0896-6273(00)81194-0 |
[2] | Goldsmith JR, Byrne JH (1993) Bag cell extract inhibits tail-siphon withdrawal reflex, suppresses long-term but not short-term sensitization, and attenuates sensory-to-motor neuron synapses in Aplysia. J Neurosci 13: 1688-1700. https://doi.org/10.1523/JNEUROSCI.13-04-01688.1993 |
[3] | Goldbeter A (2002) Computational approaches to cellular rhythms. Nature 420: 238-245. https://doi.org/10.1038/nature01259 |
[4] | Kitano H (2002) Systems biology: A brief overview. Science 295: 1662-1664. https://doi.org/10.1126/science.1069492 |
[5] | Song H, Smolen P, Av-Ron E, et al. (2006) Bifurcation and singularity analysis of a molecular network for the induction of long-term memory. Biophys J 90: 2309-2325. https://doi.org/10.1529/biophysj.105.074500 |
[6] | Sridhar LN (2023) Multi objective nonlinear model predictive control of diabetes models considering the effects of insulin and exercise. Archives Clin Med Microbiol 2: 60-69. https://doi.org/10.33140/ACMMJ |
[7] | Pinsker H, Carew TJ, Hening W, et al. (1973) Long-term sensitization of a defensive withdrawal reflex in Aplysia californica. Science 182: 1039-1042. https://doi.org/10.1126/science.182.4116.1039 |
[8] | Frost WN, Castelluci VF, Hawkins RD, et al. (1985) Monosynaptic connections made by the sensory neurons of the gill and siphon-withdrawal reflex in Aplysia participate in the storage of long-term memory for sensitization. Proc Natl Acad Sci 82: 8266-8269. https://doi.org/10.1073/pnas.82.23.8266 |
[9] | Walters ET (1987) Site-specific sensitization of defensive reflexes in Aplysia: A simple model of long-term hyperalgesia. J Neurosci 7: 400-407. https://doi.org/10.1523/jneurosci.07-02-00400.1987 |
[10] | Walters ET (1987) Multiple sensory neuronal correlates of site-specific sensitization in Aplysia. J Neurosci 7: 408-417. https://doi.org/10.1523/jneurosci.07-02-00400.1987 |
[11] | Castellucci VF, Blumenfeld H, Goelet P, et al. (1989) Inhibitor of protein synthesis blocks long-term behavioral sensitization in the isolated gill-withdrawal reflex of Aplysia. J Neurobiol 20: 1-9. https://doi.org/10.1002/neu.480200102 |
[12] | Cleary LJ, Lee WL, Byrne JH (1998) Cellular correlates of long-term sensitization in Aplysia. J Neurosci 18: 5988-5998. https://doi.org/10.1101/lm.045450.117 |
[13] | Wright WG, McCance EF, Carew TJ (1996) Developmental emergence of long-term memory for sensitization in Aplysia. Neurobiol Learn Mem 65: 261-268. https://doi.org/10.1006/Nlme.1996.0031 |
[14] | Levenson J, Byrne JH, Eskin A (1999) Levels of serotonin in the hemolymph of Aplysia are modulated by light/dark cycles and sensitization training. J Neurosci 19: 8094-8103. https://doi.org/10.1523/JNEUROSCI.19-18-08094.1999 |
[15] | Sutton MA, Ide J, Masters SE, et al. (2002) Interaction between amount and pattern of training in the induction of intermediate- and long-term memory for sensitization in Aplysia. Learn Mem 9: 29-40. https://doi.org/10.1101/lm.44802 |
[16] | Wainwright ML, Byrne JH, Cleary LJ (2004) Dissociation of morphological and physiological changes associated with long-term memory in Aplysia. J Neurophysiol 92: 2628-2632. https://doi.org/10.1152/jn.00335.2004 |
[17] | Wainwright ML, Zhang H, Byrne JH, et al. (2002) Localized neuronal outgrowth induced by long-term sensitization training in Aplysia. J Neurosci 22: 4132-4141. https://doi.org/10.1523/JNEUROSCI.22-10-04132.2002 |
[18] | Pettigrew D, Smolen P, Baxter DA, et al. (2005) Dynamic properties of regulatory motifs associated with induction of three temporal domains of memory in Aplysia. J Comput Neurosci 18: 163-181. https://doi.org/10.1007/s10827-005-6557-0 |
[19] | Song H, Smolen P, Av-Ron E, et al. (2006) Bifurcation and singularity analysis of a molecular network for the induction of long-term memory. Biophys J 90: 2309-2325. https://doi.org/10.1529/biophysj.105.074500 |
[20] | Dhooge A, Govearts W, Kuznetsov AY (2003) MATCONT: A MATLAB package for numerical bifurcation analysis of ODEs. ACM T Math Software 29: 141-164. https://doi.org/10.1145/779359.779362 |
[21] | Dhooge A, Govaerts W, Kuznetsov YA, et al. (2003) CL_MATCONT: A continuation toolbox in Matlab. Proceedings of the 2003 ACM Symposium on Applied Computing : 161-166. https://doi.org/10.1145/952532.952567 |
[22] | Kuznetsov YA (1998) Elements of Applied Bifurcation Theory. New York: Springer. |
[23] | Kuznetsov YA (2009) Five Lectures on Numerical Bifurcation Analysis.Utrecht University NL. |
[24] | Govaerts WJF (2000) Numerical Methods for Bifurcations of Dynamical Equilibria.Society for Industrial and Applied Mathematics. |
[25] | Flores-Tlacuahuac A, Morales P, Riveral-Toledo M Multiobjective nonlinear model predictive control of a class of chemical reactors. Ind Eng Chem Res 51: 5891-5899. https://doi.org/10.1021/ie201742e |
[26] | Sridhar LN (2021) Single and multiobjective optimal control of epidemic models involving vaccination and treatment. J Biostat Epidemiol 7: 25-35. https://doi.org/10.18502/jbe.v7i1.6292 |
[27] | Sridhar LN (2023) Bifurcation analysis and optimal control of the Crowley Martin phytoplankton-zooplankton model that considers the impact of nanoparticles. Explo Mater Sci Res 5: 54-60. https://dx.doi.org/10.47204/EMSR.5.1.2023.054-060 |
[28] | Sridhar LN (2020) Multiobjective nonlinear model predictive control of pharmaceutical batch crystallizers. Drug Dev Ind Pharm 46: 2089-2097. https://doi.org/10.1080/03639045.2020.1847135 |
[29] | Sridhar LN (2019) Multiobjective optimization and nonlinear model predictive control of the continuous fermentation process involving Saccharomyces Cerevisiae. Biofuels 13: 249-264. https://doi.org/10.1080/17597269.2019.1674000 |
[30] | Sridhar LN (2022) Single and multiobjective optimal control of the wastewater treatment process. Trans Indian Natl Acad Eng 7: 1339-1346. https://doi.org/10.1007/s41403-022-00368-6 |
[31] | Younis A, Dong Z (2023) Adaptive surrogate assisted multi-objective optimization approach for highly nonlinear and complex engineering design problems. Appl Soft Comput 150: 111065. https://doi.org/10.1016/j.asoc.2023.111065 |
[32] | Younis A, Dong Z (2022) High-fidelity surrogate based multi-objective optimization algorithm. Algorithms 15: 279. https://doi.org/10.3390/a15080279 |
[33] | Younis A, Dong Z (2010) Trends, features, and tests of common and recently introduced global optimization methods. Eng Optimiz 42: 691-718. https://doi.org/10.1080/03052150903386674 |
[34] | Safari A, Younis A, Wang G, et al. (2015) Development of a metamodel-assisted sampling approach to aerodynamic shape optimization problems. J Mech Sci Technol 29: 2013-2024. https://doi.org/10.1007/s12206-015-0422-5 |
[35] | Miettinen K (1999) Nonlinear Multiobjective Optimization. Berlin: Springer Science & Business Media. |
[36] | Hart WE, Laird CD, Watson JP, et al. (2017) Pyomo–Optimization Modeling in Python. Berlin: Springer. |
[37] | Biegler LT (2007) An overview of simultaneous strategies for dynamic optimization. Chem Eng Process 46: 1043-1053. https://doi.org/10.1016/j.cep.2006.06.021 |
[38] | Wächter A, Biegler L (2006) On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming. Math Program 106: 25-57. https://doi.org/10.1007/s10107-004-0559-y |
[39] | Tawarmalani M, Sahinidis NV (2005) A polyhedral branch-and-cut approach to global optimization. Math Program 103: 225-249. https://doi.org/10.1007/s10107-005-0581-8 |