A coral reef benthic system with grazing intensity and immigrated macroalgae in deterministic and stochastic environments

Shengnan Zhao; Sanling Yuan; Shengnan Zhao; Sanling Yuan

doi:10.3934/mbe.2022159

Mathematical Biosciences and Engineering

2022, Volume 19, Issue 4: 3449-3471. doi: 10.3934/mbe.2022159

Previous Article Next Article

Research article

A coral reef benthic system with grazing intensity and immigrated macroalgae in deterministic and stochastic environments

Shengnan Zhao ,
Sanling Yuan ^,

University of Shanghai for Science and Technology, Shanghai 200093, China

Academic Editor:Yuan Lou

Received: 20 November 2021 Revised: 07 January 2022 Accepted: 18 January 2022 Published: 26 January 2022

As the most diverse, productive but vulnerable marine habitats in the world, coral reefs are easily affected by the ubiquitous environmental fluctuations, which could change the population dynamics and induce phase shifts of the ecosystem. In this paper, we consider a coral reef benthic system, where macroalgae, corals and algal turfs compete for the available space on a given region of the seabed with grazing intensity and immigrated macroalgae in both deterministic and stochastic environments. For the deterministic system, we analyze the existence and stability of equilibria, as well as the existence of bifurcations. For the stochastic system, sufficient conditions for the existence of the unique ergodic stationary distribution as well as the extinction of corals are obtained, by choosing suitable Lyapunov functions. Moreover, for the scenario that the system exhibits bistability between a macroalgal-coral coexistence equilibrium and a coral-free equilibrium in the absence of environmental fluctuation, we further investigate the irreversible noise-induced transition from macroalgal-coral coexistence to coral extirpation, and numerically estimate the critical values of noise intensity for the occurrence of such transition with the aids of the technique of stochastic sensitivity functions.

Keywords:

Citation: Shengnan Zhao, Sanling Yuan. A coral reef benthic system with grazing intensity and immigrated macroalgae in deterministic and stochastic environments[J]. Mathematical Biosciences and Engineering, 2022, 19(4): 3449-3471. doi: 10.3934/mbe.2022159

Related Papers:

[1]	Lu Yuan, Yuming Ma, Yihui Liu . Protein secondary structure prediction based on Wasserstein generative adversarial networks and temporal convolutional networks with convolutional block attention modules. Mathematical Biosciences and Engineering, 2023, 20(2): 2203-2218. doi: 10.3934/mbe.2023102
[2]	Xing Hu, Minghui Yao, Dawei Zhang . Road crack segmentation using an attention residual U-Net with generative adversarial learning. Mathematical Biosciences and Engineering, 2021, 18(6): 9669-9684. doi: 10.3934/mbe.2021473
[3]	Boyang Wang, Wenyu Zhang . ACRnet: Adaptive Cross-transfer Residual neural network for chest X-ray images discrimination of the cardiothoracic diseases. Mathematical Biosciences and Engineering, 2022, 19(7): 6841-6859. doi: 10.3934/mbe.2022322
[4]	Ying Xu, Jinyong Cheng . Secondary structure prediction of protein based on multi scale convolutional attention neural networks. Mathematical Biosciences and Engineering, 2021, 18(4): 3404-3422. doi: 10.3934/mbe.2021170
[5]	Jiajia Jiao, Xiao Xiao, Zhiyu Li . dm-GAN: Distributed multi-latent code inversion enhanced GAN for fast and accurate breast X-ray image automatic generation. Mathematical Biosciences and Engineering, 2023, 20(11): 19485-19503. doi: 10.3934/mbe.2023863
[6]	Shuaiyu Bu, Yuanyuan Li, Wenting Ren, Guoqiang Liu . ARU-DGAN: A dual generative adversarial network based on attention residual U-Net for magneto-acousto-electrical image denoising. Mathematical Biosciences and Engineering, 2023, 20(11): 19661-19685. doi: 10.3934/mbe.2023871
[7]	Binjie Hou, Gang Chen . A new imbalanced data oversampling method based on Bootstrap method and Wasserstein Generative Adversarial Network. Mathematical Biosciences and Engineering, 2024, 21(3): 4309-4327. doi: 10.3934/mbe.2024190
[8]	Jiyun Shen, Yiyi Xia, Yiming Lu, Weizhong Lu, Meiling Qian, Hongjie Wu, Qiming Fu, Jing Chen . Identification of membrane protein types via deep residual hypergraph neural network. Mathematical Biosciences and Engineering, 2023, 20(11): 20188-20212. doi: 10.3934/mbe.2023894
[9]	Hui Yao, Yuhan Wu, Shuo Liu, Yanhao Liu, Hua Xie . A pavement crack synthesis method based on conditional generative adversarial networks. Mathematical Biosciences and Engineering, 2024, 21(1): 903-923. doi: 10.3934/mbe.2024038
[10]	Hong'an Li, Man Liu, Jiangwen Fan, Qingfang Liu . Biomedical image segmentation algorithm based on dense atrous convolution. Mathematical Biosciences and Engineering, 2024, 21(3): 4351-4369. doi: 10.3934/mbe.2024192

Abstract

1. Introduction

Proteins play an extremely important role in our daily activities, with functions such as immunity and cell signaling. Their different functions are due to their different structures. Therefore, to fully understand the functions of proteins and related research, it is necessary to predict their structure. Although the advent of AlphaFold2 ^[1] has changed the protein prediction landscape, it has achieved very reliable results for the prediction of protein tertiary structure ^[2], as the prediction of secondary structure is still of great significance, because the secondary structure will improve the alignment of the tertiary structure, thereby affecting the spatial morphology of the protein, so this paper proposes a method based on deep learning to predict the secondary structure of proteins.

Protein secondary structure is the local spatial conformation of amino acid residues in protein polypeptide chains, mainly in the form of 3-states (helix (H), chain (E), coil (C)), which can be divided into 8-states, namely α-helix (H), helix (G), π-helix (I), β-bridge (B), β-sheet (E), bend (S), turn (T) and coil (C) ^[3,4,5]. This study was devoted to the 8-state prediction of proteins, which can be more informative and more challenging.

In the 1990s, Burkhard Rost and Chris Sander first used neural networks to predict the secondary structure of proteins ^[6]. In addition to achieving excellent results, this method was pioneered in the field of protein structure prediction. Early protein secondary structure prediction used statistical methods and heuristic rules ^[7], such as Support Vector Machine ^[8], Bayesian classification algorithm, Markov model ^[9], and Feedforward neural network ^[10,11] that have been applied in the prediction of protein secondary structure. With the advent of the post-genomic era, the amount of protein data has increased. Owing to the high cost and difficulty of experiments, traditional experimental determination methods have been unable to meet the growing demand for protein and structural data analyses. Therefore, methods for protein structure prediction have become a hot issue in bioinformatics. In the last few years, as deep learning has made tremendous progress in natural language processing, machine vision and speech recognition, bioinformatics has also begun to extensively use deep learning methods.

In recent years, many scholars and researchers have achieved excellent results in the field of 8-state research on protein secondary structure. Busia et al. proposed a protein sequence prediction technique, which combined the successful experience of using convolutional neural networks in the past and language modeling, and achieved good results ^[12]. Using the combined synergy of a convolutional neural network, residual network and bidirectional recurrent neural network prediction, Zhang et al. ^[13] designed a local block composed of convolutional filters and raw input to capture local Sequence Features. Krieger et al. determined estimated class membership probabilities of residues in proteins using the nearest neighbor search, which is then fed into another dynamic programming algorithm, showing good results on the CASP dataset ^[14]. Uddin et al. proposed to combine the self-attention mechanism with the Deep Inception-Inside-Inception (Deep3I) network to track residues between amino acids at different distances through interaction ^[15]. Kotowski et al. proposed a single-sequence-based method called ProteinUnet, which effectively shortens the inference time, and improves the training speed ^[16]. Sonsare and Gunavathi proposed a model consisting of a 1D-Convnet and an improved recurrent neural network with an improved sequential coin toss optimizer, achieving good prediction accuracy on CB513 and CullPDB ^[17].

This paper proposes an 8-state protein secondary structure prediction method named WG-ICRN, as it based on WGAN and ResNet with Inception. WG-ICRN extracts the feature information of the protein use WGAN, and then combines this information with PSSM ^[18] to enhance the features, and the combined feature matrix is named WG-data. The increased length and width of WG-data makes its feature maps larger in area and richer in feature information, since WG-data was input into the ICRN module as input data. ICRN was a transformation of the residual network. Inception was introduced into the residual network to replace the convolution layer, and the width of the input data feature map was increased through multi-scale convolution to further enrich the features.

The main contributions of this study are: (1) We use WGAN to extract protein information in sliding window processed PSSM, and combine PSSM to build a new feature set with rich protein features. (2) The ICRN model combines Inception and the residual network, increasing the width of the network through Inception, while the residual network guarantees the depth of the network, improving the performance of the network from two aspects. (3) ICRN reduces the number of training parameters by using multiple smaller filters to reduce the dimension of the data, so the training time is shorter than the residual network, saving system resources. (4) Experimental results show that WG-ICRN is superior to other popular models in prediction accuracy.

2. Model structure and related theories

2.1. Wasserstein generative adversarial network

Generative adversarial network (GAN) ^[19] was proposed by Ian Goodfellow in 2014, and consists of two parts: generator (G) and discriminator (D). G can generate similar fake data by learning the distribution characteristics of real data, while D judges and scores the authenticity of the data. GAN has been applied to image denoising and feature extraction ^[20,21,22], and has been proved to have good properties. GAN also has the problem that the model is difficult to optimize, as the tedious problem of G and D parameter optimization is difficult to solve. In recent years, a lot of optimization algorithms ^{[23,24,25,26]}, such as Aquila optimizer ^[27] and the Gazelle optimization algorithm ^[28], provide a direction to solve this difficult problem. But the more critical issue for GAN is this: Owing to the approximate optimal D of GAN, the G loss faces the problem of gradient disappearance. The WGAN uses the Wasserstein distance, which can alleviate this critical problem, and has the advantage of reflecting the distance between two distributions even if they do not have any overlap ^[29].

The specific training process of WGAN is the constant game and confrontation between G and D. When training D, the data generated by the previous round of G and real data are directly spliced together as x, the fake data corresponded to 0, and the real data corresponds to 1. Then, a score (a number from 0 to 1) can be generated through D, x input, and through the loss function composed of the score and y, gradient backpropagation can be performed. The training process of D is shown in Figure 1(a). When training G, G and D need to be treated as a whole, which is named "D_on_G". The output of this whole system (referred to as the DG system) is still the score. Entering a set of random vectors z, we can generate a set of random data in G, and score the generated set of data through D to obtain the score, which is the forward process of the DG system. The training process is presented in Figure 1(b).

Figure 1. The training process WGAN.

DownLoad: Full-Size Img PowerPoint

The GAN objective function is as formula (1), where, x and z represent the input real and random data, G(z) represents the data generated after G processes the random data z, and D(x) represents the probability that the data is the real data. In the most ideal case, G can generate data G(z) that is very similar to the real protein data, and it is difficult for D to judge the authenticity of these data, that is, D(G(z)) = 0.5.

${{\mathrm{m}\mathrm{i}\mathrm{n}}_{G}{\mathrm{m}\mathrm{a}\mathrm{x}}_{D}\left(\mathrm{D}, \mathrm{G}\right) = \mathrm{E}}_{x \sim {P}_{\mathrm{d}\mathrm{a}\mathrm{t}a}\left(x\right)}\left[\mathrm{l}\mathrm{o}\mathrm{g}\mathrm{D}\left(x\right)\right]+{\mathrm{E}}_{z \sim {P}_{z}\left(x\right)}\left[\mathrm{l}\mathrm{o}\mathrm{g}\left(1-\mathrm{D}\left(\mathrm{G}\left(z\right)\right)\right)\right]$

(1)

Objective function (1) to be optimized by the GAN can be divided into 2 parts: Part 1, fix the G and optimize the D, then (1) can be rewritten as formula (2), convert it to minimized form as formula (3). Part 2, fix the D, optimize the G, which is equivalent to minimizing, as formula (4), so that the argument of D does not exceed a fixed constant, just maximize the formula (5).

${\mathrm{m}\mathrm{a}\mathrm{x}}_{D}{\mathrm{E}}_{x \sim {P}_{r}}\left[\mathrm{l}\mathrm{o}\mathrm{g}\mathrm{D}\left(x\right)\right]+{\mathrm{E}}_{x\sim {P}_{g}}\left[\mathrm{l}\mathrm{o}\mathrm{g}\left(1-\mathrm{D}\left(x\right)\right)\right]$

(2)

${\mathrm{m}\mathrm{i}\mathrm{n}}_{D}{-\mathrm{E}}_{x\sim {P}_{r}}\left[\mathrm{l}\mathrm{o}\mathrm{g}\mathrm{D}\left(x\right)\right]-{\mathrm{E}}_{x\sim {P}_{g}}\left[\mathrm{l}\mathrm{o}\mathrm{g}\left(1-\mathrm{D}\left(x\right)\right)\right]$

(3)

${\mathrm{m}\mathrm{i}\mathrm{n}}_{G}{\mathrm{E}}_{x\sim {P}_{g}}\left[\mathrm{l}\mathrm{o}\mathrm{g}\left(1-\mathrm{D}\left(x\right)\right)\right]$

(4)

$L = {\mathrm{E}}_{x\sim {P}_{r}}\left[\mathrm{D}\left(x\right)\right]-{\mathrm{E}}_{x\sim {P}_{g}}\left[\mathrm{l}\mathrm{o}\mathrm{g}\left(\mathrm{D}\left(x\right)\right)\right]$

(5)

In this experiment, we introduced CNN in WGAN to assist in feature extraction. Local receptive fields and weight sharing operations in CNN can realize displacement, scaling and distortion invariance. We use ReLU as the activation function of the CNN, which is calculated as Eq. (6).

${F}_{k}^{i} = f\left(\sum _{h}{P}_{h}^{i-1}\mathrm{*}{W}_{k}^{i}+b\right)$

(6)

Here, $f$ is ReLU, which ${\mathrm{P}}_{h}^{i-1}$ represents the feature map obtained from the input protein data and the convolution kernel of the previous layer, ${W}_{k}^{i}$ is the convolution kernel of the No. i layer, k is the number of convolution kernel, and b is the bias parameter. At the same time, we use gradient punishment to improve the stability of the network during WGAN training. The network structure of WGAN used in the experiment is shown in Figure 2.

Figure 2. WGAN model diagram.

DownLoad: Full-Size Img PowerPoint

2.2. Residual networks (ResNet)

The network depth is very important for the performance of the model, but, in fact, the deep network will face degradation problems, and the accuracy will also decrease. Studies have shown that this deep network has the problem of gradient explosion or disappearance, and Residual Networks (ResNet) ^[30] introduces the residual learning to alleviate this problem. Nowadays, ResNet is used in computer vision and medical analysis ^[31,32].

The specific process is that for a block structure, where the learned characteristics from when the input is X are recorded as H(X), and we hope that the residual F(X) = H(X) － X can be learned, when the original characteristics are F(X) + X. Because residual learning is easier than the original feature direct learning, when the residual is 0, the block only makes the constant mapping, which makes the network performance not decline, but in fact the residual will not be 0, which will also make the block learn the new feature on the basis of the input feature, so that it has better performance. Residual learning is similar to short-circuit connections, and is structured as shown in Figure 3.

Figure 3. Structure of residual learning.

DownLoad: Full-Size Img PowerPoint

The origin of the residual block structure consists of convolution and pooling before residual learning. The origin residual connection method is shown in Figure 4(a). The article ^[33] has conducted a more detailed analysis experiment on the residual structure and obtained the optimal residual learning structure, that is, batch normalization and ReLU were performed before convolutional layers, and the structure is shown in Figure 4(b).

Figure 4. The residual block structure.

DownLoad: Full-Size Img PowerPoint

2.3. Inception

In 2014, Szegedy et al. proposed the Inception structure for the first time ^[34]. Inception performs convolution operations on the feature map at a certain moment by using convolution kernels of different sizes, so as to obtain a new feature map, and then samples the size of the input feature according to the feature map of different sizes. It is worth noting that Inception does not change the size of the original features, but only enriches the characteristic information of the protein through different convolution kernels, making the characteristics diversified. The network structure of InceptionV2 is shown in Figure 5.

Figure 5. The network structure of InceptionV2.

DownLoad: Full-Size Img PowerPoint

2.4. The proposed ICRN model

In this experiment, we use the improved Inception module instead of the first convolutional layer and maxpooling layer in the ResNet model, and the improved Inception module informs the WG-data to extract learning at different scales through convolutional kernels of different sizes, which enriches the feature information and improves the prediction accuracy of protein secondary structure prediction. Improved Inception module structure is shown in Figure 6.

Figure 6. The improved Inception module structure.

DownLoad: Full-Size Img PowerPoint

In this paper, we use ICRN-N to represent the improved ResNet of different depths, and N refers to the number of network layers with privileged values, that is, only convolutional layers, as fully connected layers and pooled layers are included. We set the number of layers with weights of 10, 18 and 34 as the experimental model, and the structures of ICRN-10, ICRN-18, and ICRN-34 are shown in Table 1, respectively.

Table 1. ICRN structure at different depths.

Layer name	ICRN-10	ICRN-18	ICRN-34
Inception Block	$\left[\begin{array}{c}1\times 1\\ 3\times 3\\ 3\times 3\\ 3\times 3\end{array}\right]\left[\begin{array}{c}1\times 1\\ 3\times 3\\ 3\times 3\end{array}\right]\left[\begin{array}{c}Max pool\\ 1\times 1\end{array}\right]$
Residuals-Block-1	$\left[\begin{array}{c}3\times \mathrm{3, 64}\\ 3\times \mathrm{3, 64}\end{array}\right]\times 2$	$\left[\begin{array}{c}3\times \mathrm{3, 64}\\ 3\times \mathrm{3, 64}\end{array}\right]\times 2$	$\left[\begin{array}{c}3\times \mathrm{3, 64}\\ 3\times \mathrm{3, 64}\end{array}\right]\times 3$
Residuals-Block-2	$\left[\begin{array}{c}3\times \mathrm{3,128}\\ 3\times \mathrm{3,128}\end{array}\right]\times 2$	$\left[\begin{array}{c}3\times \mathrm{3,128}\\ 3\times \mathrm{3,128}\end{array}\right]\times 2$	$\left[\begin{array}{c}3\times \mathrm{3,128}\\ 3\times \mathrm{3,128}\end{array}\right]\times 4$
Residuals-Block-3	/	$\left[\begin{array}{c}3\times \mathrm{3,256}\\ 3\times \mathrm{3,256}\end{array}\right]\times 2$	$\left[\begin{array}{c}3\times \mathrm{3,256}\\ 3\times \mathrm{3,256}\end{array}\right]\times 6$
Residuals-Block-4	/	$\left[\begin{array}{c}3\times \mathrm{3,512}\\ 3\times \mathrm{3,512}\end{array}\right]\times 2$	$\left[\begin{array}{c}3\times \mathrm{3,512}\\ 3\times \mathrm{3,512}\end{array}\right]\times 3$
Average pool, fully connected, softmax

| Show Table

DownLoad: CSV

2.5. WG-ICRN networks structure

The structure of WG-ICRN is shown in Figure 7, and it can be seen that our network model is mainly divided into the WGAN and ICRN modules. Firstly, a protein was processed into PSSMS with size of 20 × L, where 20 is the feature dimension, and L represents the protein length. Since the lengths of different proteins were different, sliding Windows (The length is W) were used to cut PSSMS. The processed data would be used as the learning model of WGAN, and key features would be extracted through the confrontation of G and D. We use several convolutional layers to assist G and D networks; G networks use Leaky ReLU as the activation function, due to the large number of iterations, and to prevent overfitting, we use Dropout in G networks. We Concatenated the final data (Si-data) generated by D and the PSSM processed by sliding window into a matrix of 40 × W, named WG-data.

Figure 7. WG-ICRN networks structure.

DownLoad: Full-Size Img PowerPoint

The ICRN module consists of two parts, namely Inception block and residual block. The improved Inception will replace the first convolution layer with a size of 7 × 7, and the max pooling layer with a size of 3 × 3 in this model. The improved Inception can achieve the same convolution effect by using three layers of 3 × 3 convolution layers with fewer training parameters, which will save training time. At the same time, the multi-scale convolution model in Inception can extract feature maps of different sizes, which, when combined together, will increase the richness of features to some extent.

After two feature enhancements, the residual block in ICRN will conduct the final training on the data. We respectively use the residual network of different depths to test the data. At the end of the network, we adopt an average pooling layer to replace the flattening of the matrix features, which reduces the number of parameters.

Finally, in the output layer of the model, we use the fully connected layer and softmax layer to output the final prediction results and calculate the prediction accuracy through the evaluation criteria.

3. Experiment results

3.1. Datasets and features

The main public datasets used in this study are the CullPDB ^[35] dataset and the datasets ^{[36,37,38,39,40,41]} CASP10, CASP11, CASP12, CASP13, CASP14 and CB513. The CullPDB dataset contains 12,288 proteins. These datasets show that the similarity of the data was less than 25%. In this study, the repeated protein dataset CullPDB was removed as the training set, with a total of 11650 proteins. For the CASP10-14, and CB513 datasets, there were 99, 81, 19, 22, 24 and 513 protein chains, respectively. The number of protein sequences in datasets is listed in Table 2.

Table 2. Statistical data in datasets.

Datasets	Number of proteins
CullPDB	11650
CASP10	99
CASP11	81
CASP12	19
CASP13	22
CASP14	24
CB513	513

| Show Table

DownLoad: CSV

Position-Specific Scoring Matrix (PSSM) is rich in biological evolution information, which greatly improves the accuracy of protein secondary structure prediction. It is a widely used feature for information. The PSSM of this experiment was generated by multiple sequence alignment of proteins in the NR database, setting the PSI-BLAST ^[42] parameter threshold to 0.001 and 3 iterations.

3.2. Evaluation criteria

Q8 and SOV are evaluation criteria for evaluating protein prediction performance from different perspectives. Q8 is the ratio of the number of correctly predicted amino acids to all amino acids. It can be expressed by formula (7), and S is the total number of amino acids.

$Q8 = \frac{{S}_{H}+{S}_{E}+{S}_{G}+{S}_{B}+{S}_{I}+{S}_{S}+{S}_{T}+{S}_{C}}{S}\times 100$

(7)

Among them, S_H, S_E, S_G, S_B, S_I, S_S, S_T and S_C are the numbers of correctly predicted α-helices, beta-sheets, β bridges, 310 helices, π helices, turns, β-turns and random coils, respectively, and S is the total number of amino acids. The secondary structure accuracy of a state is calculated as formula (8).

${Q}_{j} = \frac{{S}_{j}}{{N}_{j}}, j\in \left\{H, E, G, B, I, S, T, C\right\}$

(8)

SOV ^[43] is a measure based on the ratio of overlapping segments. Assuming that all observed structural fragments are labeled S_ob, all predicted fragments are labeled S_pr, and S_o is a fragment with the same state as S_ob and S_pr, and for any pair of fragments in S_o, the actual length is minov (S_ob, S_pr), where at least one residue has a total length of maxov (S_ob, S_pr). The SOV calculation formula as formula (9).

$SOV = \frac{100}{{N}_{SOV}}\sum _{{S}_{o}}\left[\frac{minov\left({S}_{ob}, {S}_{pr}\right)+\sigma \left({S}_{ob}, {S}_{pr}\right)}{maxov\left({S}_{ob}, {S}_{pr}\right)}length\left({S}_{ob}\right)\right]$

(9)

Among them, $\sigma \left({S}_{ob}, {S}_{pr}\right)$ allows the change of the observed fragment boundary in the protein structure, which is defined by the formula (10).

$\sigma \left({S}_{ob}, {S}_{pr}\right) = min\left\{\begin{array}{c}\left(maxov\right({S}_{ob}, {S}_{pr})-minov({S}_{ob}, {S}_{pr}\left)\right)\\ minov({S}_{ob}, {S}_{pr})\\ int\left[len\left({S}_{ob}\right)\right]/2\\ int\left[len\left({S}_{pr}\right)\right]/2\end{array}\right\}$

(10)

3.3. Experimental results and parameter influence

The experiment in this paper was done with the processor Intel(R) Xeon(R) Glod 5118, and the graphics card RTX2080Ti and the system Linux. Firstly, we tested the influence of the number of CNN convolutional layers on the WGAN feature extraction ability. The size of the convolution kernel was set to 3 × 3 × 64, and different convolutional layers were set to 1, 2, 3, 4 and 5, and tested on CASP11-14. As can be seen from Table 3, when the number of convolutional layers is 3, the data generated by G are closer to the real data.

Table 3. Effect of the number of convolutional layers on Q8.

Layers	CASP11	CASP12	CASP13	CASP14
1	68.26	68.85	67.21	68.36
2	71.27	70.63	67.76	69.41
3	72.55	71.81	69.88	70.29
4	71.71	71.23	68.73	68.22
5	70.33	69.46	67.24	67.61

| Show Table

DownLoad: CSV

Because the number of iterations of the generator and discriminator will also affect the feature extraction ability of the WGAN, this study tested the influence of different iterations on the experiment, in which 3 convolutional layers are set, and the parameters of the convolution kernel are set to 3 × 3 × 64, 3 × 3 × 128 and 3 × 3 × 256, and the experimental results under different iterations are shown in Figure 8.

Figure 8. Q8 accuracy with different iterations.

DownLoad: Full-Size Img PowerPoint

As shown in Figure 7, the best effect is achieved when the number of iterations is 20,000, that is, the features extracted by G are the most realistic and effective. After more than 20,000 iterations, D's ability to judge the authenticity of the generated data decreases to the point where there is a large error between the simulated and real features.

To test the influence of the length of sliding window on the experimental results, we selected 13, 15, 17, 19 and 21 for Q8 prediction. The experimental results are shown in Table 4, which shows that when the sliding window is 19, the experimental results are the best.

Table 4. Q8 accuracy under different length of sliding windows.

Sliding window	CASP11	CASP12	CASP13	CASP14
13	67.47	68.16	65.88	65.20
15	68.09	69.27	66.67	67.41
17	70.66	70.24	68.18	69.13
19	71.55	70.81	68.88	69.29
21	70.29	70.41	68.42	68.94

| Show Table

DownLoad: CSV

Using different depths of ResNet, we tested CASP11-14, and obtained the experimental results shown in Figure 9. It can be seen that WG-ICRN-18 has the highest accuracy, because the dimension of WG-data is not high, and when the number of layers is too deep, part of the data will be lost, which causes a decrease in accuracy. In addition, we calculate the SOV and Qj ( $j\in \left\{\mathrm{H}, \mathrm{E}, \mathrm{G}, \mathrm{B}, \mathrm{I}, \mathrm{S}, \mathrm{T}, \mathrm{C}\right\}$ ) of each test set under the WG-ICRN method, and the results are shown in Table 5.

Figure 9. Q8 accuracy under WG-ICRN at different depths.

DownLoad: Full-Size Img PowerPoint

Table 5. Q8 and SOV accuracy in the datasets.

Dataset	CASP10	CASP11	CASP12	CASP13	CASP14	CB513
SOV	70.98	69.37	68.83	67.41	66.39	73.91
Q8	73.32	71.55	70.81	68.88	69.29	75.56
Q_G	52.72	55.32	47.90	36.56	33.51	37.71
Q_H	92.66	85, 74	87.43	93.2	89.75	92.25
Q_I	0	0	0	0	0	0
Q_T	62.21	49.47	56.78	57.31	45.29	53.67
Q_B	9.81	19.30	7.25	8.30	3.88	7.68
Q_E	88.80	82.15	77.76	84.37	76.79	80.44
Q_S	53.88	43.68	48.90	34.74	13.33	25.39
Q_C	68.12	62.91	67.38	70.71	68.54	71.37

| Show Table

DownLoad: CSV

This paper divides CullPDB into five parts for five-fold cross-validation, four as training sets and one as test, and the results of cross-validation are shown in Table 6.

Table 6. Q8 under five-fold cross-validation.

	1	2	3	4	5	Average
Q8	72.72	73.18	73.43	72.61	71.36	72.66

| Show Table

DownLoad: CSV

We did ablation experiments to demonstrate the importance of each structure. We used five network models to test CASP11-14, and the experimental results are presented in Table 7. Thus, WG-ICRN is the model proposed in this paper, WG-Res is combining WGAN and ResNet and WG-CNN is a network model combining WGAN and CNN, where the three methods input data adopts WG-data, and the network model structure of CNN uses 3 convolutional layers: 3 × 3 × 64, 3 × 3 × 128 and 3 × 3 × 256. ResNet is a residual network model based on the best ResNet-18, CNN is using a 3-layer convolutional neural network, a structure is 3 × 3 × 64, 3 × 3 × 128, and 3 × 3 × 256. The input data for ResNet and CNN were PSSM. In addition, we calculated the average training time of each of the 11650 proteins in the CullPDB dataset for the 5 methods. These results are shown in Table 7.

Table 7. Comparison of results from ablation experiments.

	CASP11	CASP12	CASP13	CASP14	Training time (s)
WG-ICRN	71.55	70.81	68.88	69.29	21.9
WG-Res	71.43	70.67	68.83	69.17	22.4
WG-CNN	70.47	68.79	67.33	68.24	21.7
ResNet	68.76	67.84	65.57	66.19	9.8
CNN	66.62	65.29	63.69	64.71	9.6

| Show Table

DownLoad: CSV

By comparing the experimental results of the five methods in the table, it can be seen that, when the input data is the same PSSM, the prediction accuracy of ResNet is higher than that of CNN, because the deeper number of network layers makes training more adequate and increases training time, but the efficiency of ResNet is still better than that of CNN. WGAN extracted features significantly improves the prediction accuracy of Q8, and greatly increases the training time because of the increased size of the training data. Our proposed ICRN model reduces the time complexity by introducing Inception and extracts horizontal multi-scale feature fusion, which reduces the training time and improves the prediction accuracy compared with ResNet.

3.4. Comparison with other methods

Furthermore, we compared other models with our proposed method. Common with WG-ICRN is that these methods are improvements or hybrid models of CNN, and among them is, DeepACLSTM ^[44], which combines asymmetric convolution (ACNN) and bidirectional long short-term memory neural network (BiLSTM), 1D-Inception ^[45] Taking inspiration from InceptionV3 to extract features from 1D sequences using several parallel convolutions, DCRNN ^[46] uses an end-to-end model with multi-scale CNN and stacked bidirectional GRU. CNN_BIGRU ^[47] used CNN and bidirectional gated recurrent units to prediction. We re-run the code of the above method on the same computer, and the training set uses the same as WG-Res, which has been screened by data, and contains a total of 11,650 proteins. The experimental results are shown in Table 8. By comparison, it can be seen that WG-ICRN has excellent performance in predicting the secondary structure of protein 8 states, because of the deep layers advantages of ResNet, and, in addition, the matrix will contain richer feature information than the one-dimensional sequence, so the experimental results as input data will be better.

Table 8. Q8 accuracy comparison of five methods.

Method	CASP10	CASP11	CASP12	CASP13	CASP14	CB513
DeepACLSTM	73.09	71.49	70.35	68.91	68.81	75.51
1D-Inception	71.86	70.07	69.78	67.51	68.3	74.68
DCRNN	72.11	70.50	69.41	68.05	68.87	74.85
CNN_BIGRU	71.87	70.94	69.67	67.83	68.69	75.54
WG-ICRN	73.32	71.55	70.81	68.88	69.29	75.56

| Show Table

DownLoad: CSV

4. Conclusions and future works

The prediction of protein secondary structure is important work to comprehensively understand and explore the diverse functions and spatial structure of proteins. This paper combines WGAN and ICRN, for the first time, to propose a novel protein 8-state secondary structure prediction method, WG-ICRN. In WG-ICRN, WGAN can extract protein features in amino acid sequences, and then we combine PSSM with the extracted features into a new feature matrix WG-data that contains more protein feature information. We also use ICRN to further extract the residue interactions in WG-data and complete the prediction. We introduced the improved Inception module into ResNet and proposed the ICRN model, which cannot only reduce parameter calculation and improve efficiency, but also increase network width to improve network performance. We evaluate the proposed model on six datasets CASP10-14 and CB513. Experimental results show that the prediction performance of WG-ICRN is better than the four other popular methods. In addition, this paper also proves that WGAN has a powerful feature extraction ability, and the ICRN model can handle protein data more comprehensively, and the combination of the two has achieved remarkable results. However, it is difficult for WGAN to achieve the balance between generator and discriminator, which also makes training more tedious and time-consuming. In addition, secondary structure prediction is also slightly affected by residues in the global range, but WG-ICRN mainly focuses on local features and ignores long-range features. In future work, we will continue to optimize the feature extraction technique and fully utilize different feature information of protein sequences to improve prediction performance.

Availability

The codes and datasets for this work are at https://github.com/ShunLi999/WG-ICRN.git

Acknowledgments

This work was supported by the National Natural Science Foundation of China (grant number 61375013) and the Natural Science Foundation of Shandong Province (grant number ZR2013FM020).

Conflict of interest

The authors declare there are no conflicts of interest.

References

[1]	L. Carvajal, Impacts of Climate Change on Human Development, 2007. Available from: https://EconPapers.repec.org/RePEc:hdr:hdocpa:hdocpa-2007-18.
[2]	J. L. Munro, The scope of tropical reef fisheries and their management, reef fisheries, in Reef Fisheries, Springer, (1996), 1–14. https://doi.org/10.1007/978-94-015-8779-2_1
[3]	UNEP, Marine and Coastal Ecosystems And Human Well-Being: A Synthesis Report Based On The Findings Of The Millennium Ecosystem Assessment, 2006. Available from: https://www.millenniumassessment.org/documents/Document.799.aspx.pdf.
[4]	N. A. J. Graham, S. K. Wilson, S. Jennings, N. V. C. Polunin, J. P. Bijoux, J. Robinson, Dynamic fragility of oceanic coral reef ecosystems, Proc. Natl. Acad. Sci. USA, 103 (2006), 8425–8429. https://doi.org/10.1073/pnas.0600693103 doi: 10.1073/pnas.0600693103
[5]	J. C. Blackwood, A. Hastings, P. J. Mumby, The effect of fishing on hysteresis in caribbean coral reefs, Theor. Ecol., 5 (2012), 105–114. https://doi.org/10.1007/s12080-010-0102-0 doi: 10.1007/s12080-010-0102-0
[6]	S. Pal, J. Bhattacharyya, Resilience and dynamics of coral reefs impacted by chemically rich seaweeds and unsustainable fishing, in Mathematical Modelling, Optimization, Analytic and Numerical Solutions, 2020. https://doi.org/10.1007/978-981-15-0928-5_12
[7]	T. Elmhirst, S. R. Connolly, T. P. Hughes, Connectivity, regime shifts and the resilience of coral reefs, Coral Reefs, 28 (2009), 949–957. https://doi.org/10.1007/s00338-009-0530-8 doi: 10.1007/s00338-009-0530-8
[8]	P. J. Mumby, N. L. Foster, E. A. G. Fahy, Patch dynamics of coral reef macroalgae under chronic and acute disturbance, Coral Reefs, 24 (2005), 681–692. https://doi.org/10.1007/s00338-005-0058-5 doi: 10.1007/s00338-005-0058-5
[9]	J. Bhattacharyya, S. Pal, Hysteresis in coral reefs under macroalgal toxicity and overfishing, J. Biol. Phys., 41 (2015), 151–172. https://doi.org/10.1007/s10867-014-9371-y doi: 10.1007/s10867-014-9371-y
[10]	S. J. Box, P. J. Mumby, The effect of macroalgal competition on the growth and survival of juvenile caribbean corals, Mar. Ecol. Prog. Ser., 342 (2007), 139–149. https://doi.org/10.3354/meps342139 doi: 10.3354/meps342139
[11]	D. R. Bellwood, T. P. Hughes, C. Folke, M. Nyström, Confronting the coral reef crisis, Nature, 429 (2004), 827–833. https://doi.org/10.1038/nature02691 doi: 10.1038/nature02691
[12]	J. Jompa, L. J. McCook, Effects of competition and herbivory on interactions between a hard coral and a brown alga, J. Exp. Mar. Biol. Ecol., 271 (2002), 25–39. https://doi.org/10.1016/S0022-0981(02)00040-0 doi: 10.1016/S0022-0981(02)00040-0
[13]	A. J. Cheal, M. A. MacNeil, E. Cripps, M. J. Emslie, M. Jonker, B. Schaffelke, et al., Coral-macroalgal phase shifts or reef resilience: links with diversity and functional roles of herbivorous fishes on the great barrier reef, Coral Reefs, 29 (2010), 1005–1015. https://doi.org/10.1007/s00338-010-0661-y doi: 10.1007/s00338-010-0661-y
[14]	C. L. Birrell, L. J. Mccook, B. L. Willis G. A. Diaz-Pulido, Effects of benthic algae on the replenishment of corals and the implications for the resilience of coral reefs, in Oceanography and Marine Biology, CRC Press, (2008), 25–63.
[15]	N. Knowlton, Thresholds and multiple stable states in coral reef community dynamics, Am. Zool., 32 (1992), 674–682. https://doi.org/10.1093/icb/32.6.674 doi: 10.1093/icb/32.6.674
[16]	R. Cropp, J. Norbury, The potential for coral reefs to adapt to a changing climate-an eco-evolutionary modelling perspective, Ecol. Model., 426 (2020), 109038. https://doi.org/10.1016/j.ecolmodel.2020.109038 doi: 10.1016/j.ecolmodel.2020.109038
[17]	P. J. Mumby, A. Hastings, H. J. Edwards, Thresholds and the resilience of caribbean coral reefs, Nature, 450 (2007), 98–101. https://doi.org/10.1038/nature06252 doi: 10.1038/nature06252
[18]	J. Yang, S. Yuan, Dynamics of a toxic producing phytoplankton-zooplankton model with three-dimensional patch, Appl. Math. Lett., 118 (2021), 107146. https://doi.org/10.1016/j.aml.2021.107146 doi: 10.1016/j.aml.2021.107146
[19]	A. Majumder, D. Adak, N. Bairagi, Phytoplankton-zooplankton interaction under environmental stochasticity: survival, extinction and stability, Appl. Math. Model., 89 (2020), 1382–1404. https://doi.org/10.1016/j.apm.2020.06.076 doi: 10.1016/j.apm.2020.06.076
[20]	H. Wang, M. Liu, Stationary distribution of a stochastic hybrid phytoplankton-zooplankton model with toxin-producing phytoplankton, Appl. Math. Lett., 101 (2020), 106077. https://doi.org/10.1016/j.aml.2019.106077 doi: 10.1016/j.aml.2019.106077
[21]	D. Jiang, N. Shi, A note on nonautonomous logistic equation with random perturbation, J. Math. Anal. Appl., 303 (2005), 164–172. https://doi.org/10.1016/j.jmaa.2004.08.027 doi: 10.1016/j.jmaa.2004.08.027
[22]	X. Yu, S. Yuan, T. Zhang, Asymptotic properties of stochastic nutrient-plankton food chain models with nutrient recycling, Nonlinear Anal. Hybri. Syst., 34 (2019), 209–225. https://doi.org/10.1016/j.nahs.2019.06.005 doi: 10.1016/j.nahs.2019.06.005
[23]	D. Valenti, G. Denaro, B. Spagnolo, S. Mazzola, G. Basilone, F. Conversano, et al., Stochastic models for phytoplankton dynamics in mediterranean sea, Ecol. Complex., 27 (2016), 84–103. https://doi.org/10.1016/j.ecocom.2015.06.001 doi: 10.1016/j.ecocom.2015.06.001
[24]	D. Song, M. Fan, S. Yan, M. Liu, Dynamics of a nutrient-phytoplankton model with random phytoplankton mortality, J. Theor. Biol., 488 (2019), 110119. https://doi.org/10.1016/j.jtbi.2019.110119 doi: 10.1016/j.jtbi.2019.110119
[25]	S. Pan, Q. Zhang, A. Meyer-Baese, Stationary distribution of a stochastic vegetation-water system with reaction-diffusion, Appl. Math. Lett., 123 2022, 107589. https://doi.org/10.1016/j.aml.2021.107589 doi: 10.1016/j.aml.2021.107589
[26]	S. Zhang, S. Yuan, T. Zhang, A predator-prey model with different response functions to juvenile and adult prey in deterministic and stochastic environments, Appl. Math. Comput., 413 (2022), 126598. https://doi.org/10.1016/j.amc.2021.126598 doi: 10.1016/j.amc.2021.126598
[27]	H. Qi, X. Meng, Threshold behavior of a stochastic predator-prey system with prey refuge and fear effect, Appl. Math. Lett., 113 (2021), 106846. https://doi.org/10.1016/j.aml.2020.106846 doi: 10.1016/j.aml.2020.106846
[28]	S. Zhang, T. Zhang, S. Yuan, Dynamics of a stochastic predator-prey model with habitat complexity and prey aggregation, Ecol. Complexity, 45 (2021), 100889. https://doi.org/10.1016/j.ecocom.2020.100889 doi: 10.1016/j.ecocom.2020.100889
[29]	C. Xu, S. Yuan, T. Zhang, Competitive exclusion in a general multi-species chemostat model with stochastic perturbations, Bull. Math. Biol., 83 (2021), 1–17. https://doi.org/10.1007/s11538-020-00843-7 doi: 10.1007/s11538-020-00843-7
[30]	X. Yu, S. Yuan, Asymptotic properties of a stochastic chemostat model with two distributed delays and nonlinear perturbation, Discrete Cont. Dyn. Syst. B, 25 (2020), 2273–2290. http://dx.doi.org/10.3934/dcdsb.2020014 doi: 10.3934/dcdsb.2020014
[31]	L. Perko, Differential Equations And Dynamical Systems, Springer, 2001. https://doi.org/10.1007/978-1-4613-0003-8
[32]	X. Mao, Stochastic Differential Equations And Applications, Chichester, Horwood, 1997.
[33]	R. Khasminskii, Stochastic Stability Of Differential Equations, Springer-Verlag Berlin Heidelberg, 2012. https://doi.org/10.1007/978-3-642-23280-0
[34]	I. Bashkirtseva, T. Ryazanova, L. Ryashko, Confidence domains in the analysis of noise-induced transition to chaos for Goodwin model of business cycles, Int. J. Bifurcat. Chaos, 24 (2014), 1440020. https://doi.org/10.1142/S0218127414400203 doi: 10.1142/S0218127414400203
[35]	S. Yuan, D. Wu, G. Lan, H. Wang, Noise-induced transitions in a nonsmooth producer-grazer model with stoichiometric constraints, Bull. Math. Biol., 82 (2020), 55. https://doi.org/10.1007/s11538-020-00733-y doi: 10.1007/s11538-020-00733-y
[36]	J. Bao, C. Yuan, Stochastic population dynamics driven by l $\acute{\mathrm{e}}$ vy noise, J. Math. Anal. Appl., 391 (2012), 363–375. https://doi.org/10.1016/j.jmaa.2012.02.043 doi: 10.1016/j.jmaa.2012.02.043
[37]	T. Ma, X. Meng, Z. Chang, Dynamics and optimal harvesting control for a stochastic one-predator-two-prey time delay system with jumps, Complexity, 2019 (2019), 1–19. https://doi.org/10.1155/2019/5342031 doi: 10.1155/2019/5342031
[38]	C. D. Lefevre, D. R. Bellwood, Seasonality and dynamics in coral reef macroalgae: variation in condition and susceptibility to herbivory, Mar. Biol., 157 (2010), 955–965. https://doi.org/10.1007/s00227-009-1376-x doi: 10.1007/s00227-009-1376-x
[39]	G. Diaz-Pulido, J Garzn-Ferreira, Seasonality in algal assemblages on upwelling-influenced coral reefs in the colombian caribbean, Bot. Mar., 45 (2002), 284–292. https://doi.org/10.1515/BOT.2002.028 doi: 10.1515/BOT.2002.028

This article has been cited by:

1.	佳轩崔, 基于机器学习和深度学习的蛋白质结构预测研究进展, 2024, 1, 3007-7486, 32, 10.52810/FAAI.2024.003
2.	Jian Zhang, Jingjing Qian, Quan Zou, Feng Zhou, Lukasz Kurgan, 2025, Chapter 1, 978-1-0716-4212-2, 1, 10.1007/978-1-0716-4213-9_1

Reader Comments

Your name:*

Email:*
© 2022 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142

Mathematical Biosciences and Engineering

3.9

Metrics

Article views(1972) PDF downloads(128) Cited by(3)

Preview PDF

Download XML

Export Citation

Article outline

Show full outline

Figures and Tables

Figures(7) / Tables(2)

Mathematical Biosciences and Engineering

A coral reef benthic system with grazing intensity and immigrated macroalgae in deterministic and stochastic environments

Related Papers:

Abstract

1. Introduction

2. Model structure and related theories

2.1. Wasserstein generative adversarial network

2.2. Residual networks (ResNet)

2.3. Inception

2.4. The proposed ICRN model

2.5. WG-ICRN networks structure

3. Experiment results

3.1. Datasets and features

3.2. Evaluation criteria

3.3. Experimental results and parameter influence

3.4. Comparison with other methods

4. Conclusions and future works

Availability

Acknowledgments

Conflict of interest

References

This article has been cited by:

Reader Comments

通讯作者: 陈斌, bchen63@163.com

Metrics

Figures and Tables

Other Articles By Authors

Catalog

Mathematical Biosciences and Engineering

A coral reef benthic system with grazing intensity and immigrated macroalgae in deterministic and stochastic environments

Related Papers:

Abstract

1. Introduction

2. Model structure and related theories

2.1. Wasserstein generative adversarial network

2.2. Residual networks (ResNet)

2.3. Inception

2.4. The proposed ICRN model

2.5. WG-ICRN networks structure

3. Experiment results

3.1. Datasets and features

3.2. Evaluation criteria

3.3. Experimental results and parameter influence

3.4. Comparison with other methods

4. Conclusions and future works

Availability

Acknowledgments

Conflict of interest

References

This article has been cited by:

Reader Comments

通讯作者: 陈斌, bchen63@163.com

Metrics

Figures and Tables

Other Articles By Authors

Related pages

Tools

Export File

Citation

Format

Content

Catalog