Research article

Prediction of dissolved oxygen concentration in aquaculture based on attention mechanism and combined neural network


  • Received: 30 June 2022 Revised: 25 August 2022 Accepted: 07 October 2022 Published: 21 October 2022
  • As an essential water quality parameter in aquaculture ponds, dissolved oxygen (DO) affects the growth and development of aquatic animals and their feeding and absorption. However, DO is easily influenced by external factors. It is not easy to make scientific and accurate predictions of DO concentration trends, especially in long-term predictions. This paper uses a one-dimensional convolutional neural network to extract the features of multidimensional input data. Bidirectional long and short-term memory neural network propagated forward and backward twice and thoroughly mined the before and after attribute relationship of each data of dissolved oxygen sequence. The attention mechanism focuses the model on the time series prediction step to improve long-term prediction accuracy. Finally, we built an integrated prediction model based on convolutional neural network (CNN), bidirectional long and short-term memory neural network (BiLSTM) and attention mechanism (AM), which is called CNN-BiLSTM-AM model. To determine the accuracy of the CNN-BiLSTM-AM model, we conducted short-term (30 minutes, one hour) and long-term (6 hours, 12 hours) experimental validation on real datasets monitored at two aquaculture farms in Yantai City, Shandong Province, China. Meanwhile, the performance was compared and visualized with support vector regression, recurrent neural network, long short-term memory neural network, CNN-LSTM model and CNN-BiLSTM model. The results show that compared with other comparative models, the proposed CNN-BiLSTM-AM model has an excellent performance in mean absolute error, root means square error, mean absolute percentage error and determination coefficient.

    Citation: Wenbo Yang, Wei Liu, Qun Gao. Prediction of dissolved oxygen concentration in aquaculture based on attention mechanism and combined neural network[J]. Mathematical Biosciences and Engineering, 2023, 20(1): 998-1017. doi: 10.3934/mbe.2023046

    Related Papers:

    [1] António M. Cunha, Ricardo Loureiro . Housing price dynamics and elasticities: Portugal's conundrum. National Accounting Review, 2024, 6(1): 75-94. doi: 10.3934/NAR.2024004
    [2] David Gray . Medium-term cycles in affordability: what does the house price to income ratio indicate?. National Accounting Review, 2021, 3(2): 204-217. doi: 10.3934/NAR.2021010
    [3] Alejandro Almeida, Julia Feria, Antonio Golpe, José Carlos Vides . Financial assets against inflation: Capturing the hedging properties of gold, housing prices, and equities. National Accounting Review, 2024, 6(3): 314-332. doi: 10.3934/NAR.2024014
    [4] Nuraddeen Umar Sambo, Ibrahim Sambo Farouq, Mukhtar Tijjani Isma'il . Asymmetric effect of exchange rate volatility on trade balance in Nigeria. National Accounting Review, 2021, 3(3): 342-359. doi: 10.3934/NAR.2021018
    [5] Jawad Saleemi . In COVID-19 outbreak, correlating the cost-based market liquidity risk to microblogging sentiment indicators. National Accounting Review, 2020, 2(3): 249-262. doi: 10.3934/NAR.2020014
    [6] Luccas Assis Attílio . Impact of Chinese financial shocks: A GVAR approach. National Accounting Review, 2024, 6(1): 27-49. doi: 10.3934/NAR.2024002
    [7] Irena Honková, Renáta Myšková . Techniques, objectives and motivations of creative accounting: evidence from the Czech Republic. National Accounting Review, 2024, 6(3): 333-351. doi: 10.3934/NAR.2024015
    [8] Jinhui Zhu, Zhenghui Li . Can digital financial inclusion effectively stimulate technological Innovation of agricultural enterprises?—A case study on China. National Accounting Review, 2021, 3(4): 398-421. doi: 10.3934/NAR.2021021
    [9] Mohammad Reza Abbaszadeh, Mehdi Jabbari Nooghabi, Mohammad Mahdi Rounaghi . Using Lyapunov's method for analysing of chaotic behaviour on financial time series data: a case study on Tehran stock exchange. National Accounting Review, 2020, 2(3): 297-308. doi: 10.3934/NAR.2020017
    [10] Changqing Luo, Zijing Li, Lan Liu . Does investor sentiment affect stock pricing? Evidence from seasoned equity offerings in China. National Accounting Review, 2021, 3(1): 115-136. doi: 10.3934/NAR.2021006
  • As an essential water quality parameter in aquaculture ponds, dissolved oxygen (DO) affects the growth and development of aquatic animals and their feeding and absorption. However, DO is easily influenced by external factors. It is not easy to make scientific and accurate predictions of DO concentration trends, especially in long-term predictions. This paper uses a one-dimensional convolutional neural network to extract the features of multidimensional input data. Bidirectional long and short-term memory neural network propagated forward and backward twice and thoroughly mined the before and after attribute relationship of each data of dissolved oxygen sequence. The attention mechanism focuses the model on the time series prediction step to improve long-term prediction accuracy. Finally, we built an integrated prediction model based on convolutional neural network (CNN), bidirectional long and short-term memory neural network (BiLSTM) and attention mechanism (AM), which is called CNN-BiLSTM-AM model. To determine the accuracy of the CNN-BiLSTM-AM model, we conducted short-term (30 minutes, one hour) and long-term (6 hours, 12 hours) experimental validation on real datasets monitored at two aquaculture farms in Yantai City, Shandong Province, China. Meanwhile, the performance was compared and visualized with support vector regression, recurrent neural network, long short-term memory neural network, CNN-LSTM model and CNN-BiLSTM model. The results show that compared with other comparative models, the proposed CNN-BiLSTM-AM model has an excellent performance in mean absolute error, root means square error, mean absolute percentage error and determination coefficient.



    The primary sensory neurons that transmit information from muscle spindles in skeletal muscles of the limbs and trunk to spinal cord are clustered together in the dorsal root ganglion (DRG) located adjacent to spinal cord. The DRGs contain sensory neurons with central and peripheral branches projecting towards either terminate within spinal gray matter or ascends through gracile or cuneate funiculus along dorsal column and ends at the junctions of spinal cord with the medulla. The peripheral branches connect to motor neurons located in ventral grey matter. The central branches from hind limbs run a long way along gracile fasciculus and terminate in gracile nucleus, while those from fore limbs and upper trunk run in cuneate fasciculus and terminate in cuneate nucleus. The gracile and cuneate sensory tract is bundled up travel side by side within dorsal column of spinal cord (see a schematic view in Figure 1a) [1]. This review describes a mutant mouse showing abnormal behaviors due to severe sensory and motor neurological disorders.

    In January 1984, abnormally suffering gaits were found in three 80-day-old mice, two females and one male, in the Laboratory of Genetics, Nagoya University [2]. The clinical and pathological examinations were made promptly in the National Institute of Neuroscience in NCNP, Tokyo. The homozygous mice were not identified from normal controls until 30-day-old. The first sign of abnormal behavior was confirmed when they were suspended by tail. Although normal mice extend their limbs out from the trunk, the hind limbs of homozygotes are initially stretched spasmodically and then become flexed and folded tightly towards the trunk (sensory ataxia stage), By about 80-day-old, the hindlimb weakness and tremor, muscle atrophy became apparent (motor paresis stage). The neurological signs were progressively severe, and most of death occur by about 5 to 6 months of age. The inheritance followed autosomal recessive mode. Linkage tests showed that the genetic mutation located on chromosome 5 linking to Pgm-1 and W [3].

    Figure 1.  (a) Schematic view of nervous pathways shown on a series of spinal cord slices. The DRG axons have two branches, one projecting to the PNS (muscle spindle), and one projecting to the CNS (gracile nucleus). Axonal degeneration (*) begins retrogradely from axonal terminals of both CNS and PNS sides (arrows) along proprioceptive sensory neurons to parent cell bodies in DRG [1]. (b) Eosinophilic spheroids (arrowheads) in gracile nucleus at 78-day old gad mouse. H-E staining. Bar = 100 µm [4]. (c) Annulo-spiral structures at the sensory endings (Ia and II) of a muscle spindle are dissolved and their distal tips show partial swelling in EDL muscle of gad mouse aged 30-days. AchE-silver staining. Bar = 40 µm [5].

    This mutant mouse was named originally “gracile axonal dystrophy (GAD)”, but, since etiology became clear, a gene symbol (gad) came to be used widely. The earliest pathological sign was detected as early as 40-day-old in gracile nucleus at the junction of spinal cord with medulla oblongata. The swollen eosinophilic axons called “spheroid” scatter over this nucleus (Figure 1b). The spheroids are also called “dystrophic axons” showing enormous enlargement most striking in the terminal segment of affected axons that appear just distal to the normal termination of the myelin sheath [6],[7]. They are often filled a number of neurofilaments, dense bodies, mitochondria with dark matrix, and multiple-vesicles which often surround a whirlpool towards the center. Abundant astrocytic processes are often seen around spheroids in lesioned sites [4],[8].

    The ultrastructural observations revealed the first signs of spheroids in gad mice at 10 to 20-day-old after birth. Spheroids varying in size are identified by slight presynaptic boutons which are facing to secondary neurons contact to and ascend to thalamus, or by thin myelin sheath surrounding them. They maintain a synapse-complexes containing electron dense bodies, mitochondria at their axonal ends. With progress of axonal degeneration, the cytoplasmic neurofilaments and thicker filament-like structures with 40 nm gathered intensely, moreover, few lysosomes contained amorphous substances seen in some places which make electron density in cytoplasm darker than usual, and finally loose presynaptic boutons. The filament-like structures gather keeping in line complicatedly and rarely branched off [4].

    The anterograde transports from DRGs are often very long-distance. Many intracellular proteins and organelles have to be transported down them after synthesis in neuron body. The retrograde transport from axonal ends to neuron body is also necessary to degrade proteins, clear useless aggregates, and provide a signaling mechanism from the synapse side to the cell body [9]. The kinesin and dynein families move along tracks of cytoskeletal filaments, termed microtubules [10]. Any disturbance of axonal transport may have severe consequences for neuronal function causing generally known as axonal traffic jams that are the consequence of an aberrant axonal transport, and usually lead to local swellings and accumulations of needless organelles [10]. However, it is not clear enough what mechanism(s) and substances do cause the deficits in axonal transportation in long axons derived far away from the neuron cell body.

    The incidence of spheroids shifts from gracile nucleus to fasciculus with the disease progress, suggesting that the degenerating axonal terminals of DRG neurons back from the distal presynaptic parts in the gracile nucleus, toward the cell bodies in the DRGs. These results indicate that axonal degeneration is age dependent and follows a “dying-back” process of the primary sensory axons [4],[5].

    Axonal dystrophy, which shows the unique pathological feature including axonal swelling (spheroids) localized throughout the central nervous system (CNS) and peripheral nervous systems (PNS), occurs under many pathological and physiological conditions. It has been observed in the infantile neuroaxonal dystrophy in mutant mouse [11] and Hallervorden-Spatz disease [12], and in the vitamin E deficiency in rats [13],[14]. In addition, physiological ageing is known to accompany the formation of spheroids in dorsal column nuclei in humans [15],[16]. The swelling axons occur at preterminal or presynaptic portions of sensory axons in a progress of axonal dystrophy. However, why these axons in ascending spinal tract are vulnerable still remain enigmatic [17].

    During the course of our study on gad mice, it was speculated that a similar lesion seen in CNS may also occur in the opposite PNS derived from DRG neurons which have sensory axon ending in muscle spindle, and motor endplates on every muscle fiber. The axonal pathology was studied by using a method of combining acetylcholine-esterase and silver impregnation method [5],[18]. The sensory axons in gad mice show axonal degeneration and swelling at their distal ends in muscle spindles as early as around 20-day-old (Figure 1c). Similar degeneration occurs in the distal motor ends little later than that in sensory endings [18]. The progressive degeneration of motor nerves was recently confirmed in UCH-L1 knockout mouse model [19],[20]. There are several differences in spheroid formation in gad mice between CNS and PNS. Axonal dystrophy in ascending gracile tract are accompanied by marked swollen axons, whereas sensory and motor axons in PNS swell only slightly (Figure 1c) [5],[18]. The DRG neurons are morphologically intact until later stages as far as examined [5],[21]. Although motor neurons in the spinal ventral horn are morphologically normal even at advanced stages, the dying-back degeneration is seen at nerve terminals in the distal endplate zone. In pathological concepts, the distal spheroids with myelin loss develops first in the most distal parts of the axons, and, if abnormality persisted, the formation of spheroids is mostly limited at the tip of axons retained other parts intact and continue dying-back degeneration [22],[23]. The dying-back axonopathy seen in CNS of gad mice resembles Wallerian degeneration which shows spheroids and myelin loss [24]. It is important to understand mechanisms underlying axonal dystrophy in gad mice which may be caused by impaired axonal transport resulting inability to keep up with the metabolic demands of axon.

    The enhancement of substance P (SP)-like immunoreactivity was observed in axonal profiles of gracile nucleus and fasciculus in 13-month-old normal mice [25] and ageing rat [16], but no SP-positive axons were detected in gracile ascending tract of young 3- and 5-month-old mice. Although partial arrest of axonal transport of SP and/or enhanced SP-synthesis in DRG neurons are ascribable, the true reason is still unclear [26]. It was reported that some of spheroids in gracile nucleus contain cholecystokinin (CCK) which is one of neuropeptides thought to be a somatosensory neurotransmitter or neuromodulator [27]. Authors suggested that CCK may be partly involved in the formation of dystrophic axons in this region. Since axonal dystrophy of gracile sensory neurons in gad mice are likely to those in aged mice mentioned earlier [4],[20], it was expected that SP reactivity is enhanced in lesioned sites of gad mice.

    The SP reaction in gad mice is more intense throughout gracile tract, and is already visible by earlier stages than in normal aged mice (Figure 2a and 2b). As mentioned in chronic pain, reactive astrocytes are involved in the regulation of chronic pain [28]. Interestingly, the astrocytes in lesioned sites of gad mice are stained with both GFAP and SP, and are characterized by astrocytic hypertrophy and proliferation [29],[30]. Dacil N, et al. (2015) reported recently that, although SP detected within cytoplasm of astrocytes is taken in through SP-receptors, the preprotachykinin mRNA (precursor of SP) and SP are shown to be localized in reactive astrocytes around senile plaques, moreover, SP expression increases angiogenesis of brain vessels associated with β-amyloid plaques [31]. Application of SP prevents β-amyloid-induced impairment of cognitive processes through inhibition of β-amyloid-induced overexpression of potassium channel subunits [32]. It seems likely that astrocytes are stimulated to proliferate and grow rapidly by unknown factor(s) released from axons and/or other cells degenerating in nearby tissues to prevent triggering a perivascular inflammation. Noguchi et al. (1995) reported that the peripheral nerve axotomy of primary afferent neurons results in de novo expression of preprotchykinin mRNA in rat DRG neurons, and, after 2 weeks, an increase of SP immunoreactivity is observed in axons and their terminals of large myelinated fibers in gracile nucleus [33].

    From these reports, we postulated that the loss of peripheral nerve endings of gad mice may lead to abnormal pain sensations and other sensory abnormalities as with in peripheral nerve axotomy. The SP has both neuroprotective and neurodegenerative properties which are related to proper development of CNS and changes in progressive neurodegenerative diseases [34]. In this context, we remark a report that SP induces α-secretase-mediated amyloid precursor protein (APP) cleavage and to protect cerebellar granule neurons from attenuating amyloid-β protein (AβP) production, without modifying the steady state level of its precursor APP [35],[36]. Kowall et al. (1991) added a fact that SP prevents β-amyloid induced neuronal loss when coadministered it into cerebral cortex [37]. Moreover, the cognitive impairment of rat by AβP brain infusion was prevented by SP administration [38].

    Figure 2.  SP-like immunoreactivity in cervical spinal cord of normal (a and b) and gad (c and d) mice aged 122-day old. The (b) and (d) enlarged parts of gracile fasciculus (arrow) in normal and gad mice, respectively. In normal spinal cord, SP activity is more prominent in dorsal horn than in other parts (a). SP positive cells are rarely found in normal gracile fasciculus (b). By contrast, the dense networks of SP positive cells are seen not only in gracile fasciculus but also along marginal zone of lateral and ventral funiculi in gad mouse (c). Fine and dense networks of SP positive cells in the gracile fasciculus are shown in (d). Bar = 100 µm (a and c); 50 µm (b and d). The source is from [26].

    From several pathological features in gad mice, we thought that abnormal expression of APP may be involved in axonal dystrophy along the gracile tract, following an accumulation of AβP which appears to be generated by aberrant proteolytic cleavage of APP, and deposits as an insoluble form mainly in the extracellular matrix surrounded by activated astrocytes [39],[40]. Yamaguchi et al. (1990) proposed a “diffuse plaque” as a pathological term to define the early and immature stage of the senile plaque formation, and demonstrated that the majority of senile plaques in AD brain are diffuse rather than the classic-core plaques [40]. A striking feature of APP-IR and AβP-IR in gad mouse is a diffuse and intracellular distribution of the immunoreacted products, suggesting that there is an intracellular deficit to accumulate these proteins within the cytoplasm (Figure 3a and 3b) [41],[42]. It was also reported that APP accumulates within the swollen axons in the human brain lesions [43] and in ageing rat brain [44]. The APP synthesized in DRG neurons moves along axon by the fast-anterograde transport to the distal ends [45] and distributes in almost all neuron cytoplasm and some glial cells in the nervous system [46]. The astrocytes are known to express APP and AβP following experimentally induced neuronal damage [47][49] and in cell cultures [50]. The distribution and expression of SP in transgenic mice overexpressing human APP indicated that SP-immunoreactive β-amyloid plaques dramatically increased after 12 months, thereafter SP was expressed in a number of reactive astrocytes [51]. Furthermore, the morphological abnormalities at synapses in the cerebral cortices of aged macaques preceded the accumulation of APP within neurites and reactive astrocytes and microglia [52]. Indeed, aberrant processing of APP into AβP by these cells is implicated as the initiating factor in the formation of senile plaques [53]. Another finding that astrocytic cells are immunoreacted with both APP and AβP, leads to an idea that similar mechanism may function along the gracile tract of the gad mouse.

    The Ubiquitin (Ub) is a 76 amino acid polypeptide involved in an ATP-dependent and non-lysosomal degradation of abnormal and short-lived normal proteins [54], and in the pathogenesis of cellular inclusions, many of which have a fibrillar structure and contain cytoskeletal proteins [55]. The Ub also plays an important role in the proteolysis of abnormal proteins in aberrant cells [56].

    The gracile axonal dystrophy in gad mice is mainly represented by swelling of axonal ends and “dying-back” degeneration of afferent neurons [57], and by an accumulation of APP and AβP along gracile ascending tract [41],[42]. These abnormalities are first observed at the most distal ends of afferent axons in gracile nucleus as early as 20-day-old [4]. Despite a modest filamentous accumulation in swollen axons, Ub-positive products are not found in the cytoplasm by 4 weeks of age. This raises the possibility that there may not be enough abnormal filaments for their selective degradation by cytoplasmic Ub and/or a lysosomal proteolysis may already be activated to function cooperatively with Ub-proteolysis. The axonal terminals are not always Ub-positive in the earliest stages, even if they reveal an initial sign of the structural alterations due to axonal degeneration. Thereafter, when axons are filled with an excess amount of aberrant neurofilaments, the Ub immunoreactivity increases and becomes to be detected in these axonal terminals (Figure 3c and 3d) [58],[59].

    The distribution of ubiquitinated deposits in gracile tract of gad mice is closely related to the severity of axonal degeneration progressing retrogradely from distal ends of primary sensory neurons, followed by axonal dystrophy in the nervous tracts of the secondary sensory neurons in Clarke's nucleus and gracile nucleus [30]. Similar Ub distribution extents further throughout the thalamus to the sensory areas in cerebral cortex [59]. In contrast, The Ub deposits in the descending motor neuron system are seen in the grey matter surrounding motor neurons in the ventral horn of spinal cord, followed by an increase in the order of lumbar, thoracic, and cervical spinal cord. The axonal degeneration in the motor neuron system in gad mice starts from the distal axonal ends toward the upper cerebral cortex, especially in cortex motor areas [59]. Together, the transneuronal degeneration beyond PNS to the lower CNS extends further to the upper CNS [58],[59].

    Figure 3.  (a) APP and (b) AβP immunoreactivity in gracile nucleus (gr) at cervical spinal cord of gad mice aged 32-weeks old. Astrocytes are positive in AβP immunoreactivity (arrowheads) [42]. Ubiquitin immunoreactivity in gracile (Gr) nucleus of normal (c) and gad (d) mice aged 18-weeks old. A large number of ubiquitinated dot-like structures (arrow) are seen throughout the gracile tract. High magnification of Ubiquitin dot-like structures is shown in an inset in (d) [59]. Bars = 25 µm in (c) and (d) for (a) and (b). Bar = 5 µm in an inset of (d).

    In eleven years after the first report on gad mice, Saigoh et al. (1999) revealed gad mutation which is caused by an in-frame deletion including exons 7 and 8 of Uchl1 gene, encoding ubiquitin carboxy-terminal hydrolase (UCH) isozyme L1 (UCH-L1) selectively expressed in nervous system and testis/ovary. UCH-L1 is a 24.8 kDa, consisting of 223 amino acids and encoded by 9 exons with a transcript of 1172 bps in length, and located on human chromosome 4(4p14) [60]. UCH-L1 (originally known as PGP 9.5 or PARK5) plays a key role in ubiquitin turnover through its C-terminal hydrolase activity. Several functions of UCH-L1 were proposed including ubiquitin hydrolyze activity, ubiquitin ligase activity and stabilization of the mono-ubiquitin. Mutations in human UCH-L1 gene are associated with PD and other neurodegenerative disorders [62]. The gad mutation with approximately 3.5 Kb deletion exists at genomic DNA level, encoding a truncated Uch-L1 gene lacking a segment of 42 amino acids containing a catalytic residue.

    The UCH-L1 is, as mentioned above, a member of deubiquitinating enzymes which functions as a Ub ligase and also a role in stabilizing Ub monomers in vivo [61]. As a deubiquitinating enzyme activity, UCH-L1 facilitates Ub recycling and regulates the cellular pool of available Ub, giving the capacity to modulate many ubiquitin-dependent cellular processes. Thus, the lack of UCH-L1 expression in mice results in gad phenotype. Down-regulation and extensive oxidative modification of this enzyme are observed in the brains of AD patients as well as PD patients [63]. It is unclear which human diseases are related to the pathogenesis of gad mice.

    An isoleucine 93 to methionine amino acid mutation (I93M) of UCH-L1 was identified as a cause of autosomal dominant PD [64]. To make sure whether this I93M mutation occurs due to a gain of toxic function in vivo, a transgenic mice (Tg) expressing human UCH-L1I93M were cleated [65]. The midbrains of Tg mice contain increased amounts of insoluble UCH-L1 as compared with those of non-Tg mice, perhaps due to a toxic gain of function. Authors also revealed one of typical pathological phenotypes of human PD, namely “dopaminergic neuron loss” in the substantia nigra, but did not detect α-synuclein in dystrophic spheroids [65],[66] and a sign of “Lewy body formation” [62]. These observations suggest that the molecular mechanism of β- and γ-synuclein accumulation in gad spheroids is different from that in Lewy bodies. Alzheimer's disease (AD) is characterized by amyloid plaques (Senile plaques) composed of β-amyloid (Aβ) peptide surrounded by swollen presynaptic dystrophic neurites consisting of dysfunctional axons and terminals that accumulate the amyloid precursor protein (APP) required for Aβ generation. The primary lesions observed in gracile nucleus of gad mice, are characterized by dystrophic swollen axons, and surrounded by the projections of astrocytes. As mentioned earlier, swollen axonal dystrophy with a dying back-type degeneration occurs from both central and peripheral distal ends of DRG neurons.

    Leaving secondary neurons in gracile nuclei behind, axonal dystrophy gradually retreats towards parent DRG neurons. The secondary neurons then continue to ascend the midline of medulla and cross to the other side and ascend to thalamus. Since Ubiquitin accumulation is often seen in thalamus neurons in advanced stages, the functional and metabolic deficits in secondary neurons occur already to some extent, resulting in partial synaptic loss of 3rd order neurons in thalamus. The 3rd neurons project their axons to somatosensory cerebral cortex, where somatosensory stimuli are processed.

    On the other hand, the motor nerve fibers descend through corticospinal tract to motor neurons in spinal grey matter. The UCH-L1 in maintaining corticospinal motor neurons keeps viability and cellular integrity. Such motor neurons with a long distance from cortex, show early, selective, progressive, and profound cell loss in the absence of UCH-L1 [67],[68]. From the results that maintenance of memory in a passive avoidance test and exploratory behavior in an open field test is reduced, and the long-term potentiation (LTP) of field synaptic responses from Schaffer collaterals to CA1 pyramidal cells in hippocampal slices is also impaired in gad mice [69],[70], a collapse of the synapse-axon circulation around CNS from PNS seems to take place. Thus, the true mechanism(s) and functions to cause axonal dystrophy in gad mice should be clarified more.



    [1] Agriculture Organization of the United Nations, Fisheries Department, The State of World Fisheries and Aquaculture, Food & Agriculture Org, 2000.
    [2] X. Li, J. Li, Y. Wang, L. Fu, Y. Fu, B. Li, et al., Aquaculture industry in china: Current state, challenges, and outlook, Rev. Fish. Sci., 19 (2011), 187–200. https://doi.org/10.1080/10641262.2011.573597 doi: 10.1080/10641262.2011.573597
    [3] J. Huan, H. Li, M. Li, B. Chen, Prediction of dissolved oxygen in aquaculture based on gradient boosting decision tree and long short-term memory network: A study of Chang Zhou fishery demonstration base, China, Comput. Electron. Agric., 175 (2020), 105530. https://doi.org/10.1016/j.compag.2020.105530 doi: 10.1016/j.compag.2020.105530
    [4] S. Midilli, D. Çoban, M. Güler, S. Küçük, Gas bubble disease in nile tilapia and hybrid red tilapia (cichlidae, oreochromis spp.) under culture conditions, J. Fish. Aquat. Sci., 36 (2019), 285–291. http://dx.doi.org/10.12714/egejfas.2019.36.3.09 doi: 10.12714/egejfas.2019.36.3.09
    [5] C. E. Boyd, E. L. Torrans, C. S. Tucker, Dissolved oxygen and aeration in ictalurid catfish aquaculture, J. World Aquacult. Soc., 49 (2018), 7–70. https://doi.org/10.1111/jwas.12469 doi: 10.1111/jwas.12469
    [6] A. Sentas, L. Karamoutsou, N. Charizopoulos, T. Psilovikos, A. Psilovikos, A. Loukas, The use of stochastic models for short-term prediction of water parameters of the thesaurus dam, River Nestos, Greece, Proceedings, 2 (2018), 634. https://doi.org/10.3390/proceedings2110634 doi: 10.3390/proceedings2110634
    [7] M. Valera, R. K. Walter, B. A. Bailey, J. E. Castillo, Machine learning based predictions of dissolved oxygen in a small coastal embayment, J. Mar. Sci. Eng., 8 (2020), 1007. https://doi.org/10.3390/jmse8121007 doi: 10.3390/jmse8121007
    [8] C. Xu, X. Chen, L. Zhang, Predicting river dissolved oxygen time series based on stand-alone models and hybrid wavelet-based models, J. Environ. Manage., 295 (2021), 113085. https://doi.org/10.1016/j.jenvman.2021.113085 doi: 10.1016/j.jenvman.2021.113085
    [9] A. Sorjamaa, J. Hao, N. Reyhani, Y. Ji, A. Lendasse, Methodology for long-term prediction of time series, Neurocomputing, 70 (2007), 2861–2869. https://doi.org/10.1016/j.neucom.2006.06.015 doi: 10.1016/j.neucom.2006.06.015
    [10] M. Längkvist, L. Karlsson, A. Loutfi, A review of unsupervised feature learning and deep learning for time-series modeling, Pattern Recognit. Lett., 42 (2014), 11–24. https://doi.org/10.1016/j.patrec.2014.01.008 doi: 10.1016/j.patrec.2014.01.008
    [11] L. Karamoutsou, A. Psilovikos, Deep learning in water resources management: The case study of Kastoria lake in Greece, Water, 13 (2021), 3364. https://doi.org/10.3390/w13233364 doi: 10.3390/w13233364
    [12] Q. Ye, X. Yang, C. Chen, J. Wang, River water quality parameters prediction method based on LSTM-RNN model, in 2019 Chinese Control And Decision Conference (CCDC), (2019), 3024–3028. https://doi.org/10.1109/CCDC.2019.8832885
    [13] J. Yan, Y. Gao, Y. Yu, H. Xu, Z. Xu, A prediction model based on deep belief network and least squares svr applied to cross-section water quality, Water, 12 (2020), 1929. https://doi.org/10.3390/w12071929 doi: 10.3390/w12071929
    [14] L. Sheng, J. Zhou, X. Li, Y. Pan, L. Liu, Water quality prediction method based on preferred classification, IET Cyber-Phys. Syst. Theory Appl., 5 (2020), 176–180. https://doi.org/10.1049/iet-cps.2019.0062 doi: 10.1049/iet-cps.2019.0062
    [15] J. Wu, Z. Wang, A hybrid model for water quality prediction based on an artificial neural network, wavelet transform, and long short-term memory, Water, 14 (2022), 610. https://doi.org/10.3390/w14040610 doi: 10.3390/w14040610
    [16] B. Lim, S. Zohren, Time-series forecasting with deep learning: A survey, Philos. Trans. A Math. Phys. Eng. Sci., 379 (2021), 20200209. https://doi.org/10.1098/rsta.2020.0209 doi: 10.1098/rsta.2020.0209
    [17] H. Ismail Fawaz, G. Forestier, J. Weber, L. Idoumghar, P. A. Muller, Deep learning for time series classification: A review, Data Min. Knowl. Discovery, 33 (2019), 917–963. https://doi.org/10.1007/s10618-019-00619-1 doi: 10.1007/s10618-019-00619-1
    [18] P. Shi, G. Li, Y. Yuan, G. Huang, L. Kuang, Prediction of dissolved oxygen content in aquaculture using clustering-based softplus extreme learning machine, Comput. Electron. Agric., 157 (2019), 329–338. https://doi.org/10.1016/j.compag.2019.01.004 doi: 10.1016/j.compag.2019.01.004
    [19] W. Li, H. Wu, N. Zhu, Y. Jiang, J. Tan, Y. Guo, Prediction of dissolved oxygen in a fishery pond based on gated recurrent unit (GRU), Inf. Process. Agric., 8 (2021), 185–193. https://doi.org/10.1016/j.inpa.2020.02.002 doi: 10.1016/j.inpa.2020.02.002
    [20] C. Li, Z. Li, J. Wu, L. Zhu, J. Yue, A hybrid model for dissolved oxygen prediction in aquaculture based on multi-scale features, Inf. Process. Agric., 5 (2018), 11–20. https://doi.org/10.1016/j.inpa.2017.11.002 doi: 10.1016/j.inpa.2017.11.002
    [21] Q. Ren, X. Wang, W. Li, Y. Wei, D. An, Research of dissolved oxygen prediction in recirculating aquaculture systems based on deep belief network, Aquacult. Eng., 90 (2020), 102085.
    [22] J. Huang, S. Liu, S. G. Hassan, L. Xu, C. Huang, A hybrid model for short-term dissolved oxygen content prediction, Comput. Electron. Agric., 186 (2021), 106216. https://doi.org/10.1016/j.compag.2021.106216 doi: 10.1016/j.compag.2021.106216
    [23] H. Liu, R. Yang, Z. Duan, Wind speed forecasting using a new multi-factor fusion and multi-resolution ensemble model with real-time decomposition and adaptive error correction, Energy Convers. Manage., 217 (2020), 112995. https://doi.org/10.1016/j.enconman.2020.112995 doi: 10.1016/j.enconman.2020.112995
    [24] J. Bi, Y. Lin, Q. Dong, H. Yuan, M. Zhou, An improved attention-based lstm for multi-step dissolved oxygen prediction in water environment, in 2020 IEEE International Conference on Networking, Sensing and Control (ICNSC), (2020), 1–6. https://doi.org/10.1109/ICNSC48988.2020.9238097
    [25] Y. Liu, Q. Zhang, L. Song, Y. Chen, Attention-based recurrent neural networks for accurate short-term and long-term dissolved oxygen prediction, Comput. Electron. Agric., 165 (2019), 104964. https://doi.org/10.1016/j.compag.2019.104964 doi: 10.1016/j.compag.2019.104964
    [26] X. Yang, B. Liu, Uncertain time series analysis with imprecise observations, Fuzzy Optim. Decis. Making, 18 (2018), 263–278. https://doi.org/10.1007/s10700-018-9298-z doi: 10.1007/s10700-018-9298-z
    [27] T. Wang, M. Wang, Communication network time series prediction algorithm based on big data method, Wireless Pers. Commun., 102 (2017), 1041–1056. https://doi.org/10.1007/s11277-017-5138-7 doi: 10.1007/s11277-017-5138-7
    [28] Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, et al., Backpropagation applied to handwritten zip code recognition, Neural Comput., 1 (1989), 541–551. https://doi.org/10.1162/neco.1989.1.4.541 doi: 10.1162/neco.1989.1.4.541
    [29] Á. Zarándy, C. Rekeczky, P. Szolgay, L. O. Chua, Overview of cnn research: 25 years history and the current trends, in 2015 IEEE International Symposium on Circuits and Systems (ISCAS), (2015), 401–404. https://doi.org/10.1109/ISCAS.2015.7168655
    [30] L. Alzubaidi, J. Zhang, A. J. Humaidi, A. Al-Dujaili, Y. Duan, O. Al-Shamma, et al., Review of deep learning: concepts, cnn architectures, challenges, applications, future directions, J. Big Data, 8 (2021), 53. https://doi.org/10.1186/s40537-021-00444-8 doi: 10.1186/s40537-021-00444-8
    [31] M. Sahu, R. Dash, A survey on deep learning: convolution neural network (CNN), in Intelligent and Cloud Computing, Springer, (2021), 317–325.
    [32] G. Ortac, G. Ozcan, Comparative study of hyperspectral image classification by multidimensional convolutional neural network approaches to improve accuracy, Expert Syst. Appl., 182 (2021), 115280. https://doi.org/10.1016/j.eswa.2021.115280 doi: 10.1016/j.eswa.2021.115280
    [33] X. Song, Y. Liu, L. Xue, J. Wang, J. Zhang, J. Wang, et al., Time-series well performance prediction based on long short-term memory (LSTM) neural network model, J. Pet. Sci. Eng., 186 (2020), 106682. https://doi.org/10.1016/j.petrol.2019.106682 doi: 10.1016/j.petrol.2019.106682
    [34] S. Hochreiter, J. Schmidhuber, Long short-term memory, Neural Comput., 9 (1997), 1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735 doi: 10.1162/neco.1997.9.8.1735
    [35] R. Yu, J. Gao, M. Yu, W. Lu, T. Xu, M. Zhao, et al., LSTM-EFG for wind power forecasting based on sequential correlation features, Future Gener. Comput. Syst., 93 (2019), 33–42. https://doi.org/10.1016/j.future.2018.09.054 doi: 10.1016/j.future.2018.09.054
    [36] X. Wu, J. Li, Y. Jin, S. Zheng, Modeling and analysis of tool wear prediction based on SVD and BiLSTM, Int. J. Adv. Manuf. Technol., 106 (2020), 4391–4399. https://doi.org/10.1007/s00170-019-04916-3 doi: 10.1007/s00170-019-04916-3
    [37] M. Schuster, K. K. Paliwal, Bidirectional recurrent neural networks, IEEE Trans. Signal Process., 45 (1997), 2673–2681. https://doi.org/10.1109/78.650093 doi: 10.1109/78.650093
    [38] S. Siami-Namini, N. Tavakoli, A. S. Namin, The performance of LSTM and BiLSTM in forecasting time series, in 2019 IEEE International Conference on Big Data (Big Data), (2019), 3285–3292. https://doi.org/10.1109/BigData47090.2019.9005997
    [39] Z. Niu, G. Zhong, H. Yu, A review on the attention mechanism of deep learning, Neurocomputing, 452 (2021), 48–62. https://doi.org/10.1016/j.neucom.2021.03.091 doi: 10.1016/j.neucom.2021.03.091
    [40] A. De Santana Correia, E. L. Colombini, Attention, please! A survey of neural attention models in deep learning, Artif. Intell. Rev., 2022 (2022), 1–88. https://doi.org/10.1007/s10462-022-10148-x doi: 10.1007/s10462-022-10148-x
  • This article has been cited by:

    1. Suyan Tan, Yilin Guo, A study of the impact of scientific collaboration on the application of Large Language Model, 2024, 9, 2473-6988, 19737, 10.3934/math.2024963
    2. Tekin Tuncer, Küresel Ticaret Yolları ve Çin Doğu Türkistan'a Etkileri, 2024, 9, 2149-9535, 2370, 10.24186/vakanuvis.1567429
    3. Mumtaz Ahmed, Liviu Marian Matac, Naureen Maqbool, Asma Salman, Muthanna G. Abdul Razzaq, Lara Al-Haddad, Codruta Daniela Pavel, Bubbles Identification in an Emerging Economy and Within Stock Markets of its Trading Partners: Evidence from a GSADF Approach, 2025, 2010-4952, 10.1142/S2010495224500179
  • Reader Comments
  • © 2023 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(2661) PDF downloads(210) Cited by(9)

Figures and Tables

Figures(9)  /  Tables(6)

Other Articles By Authors

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog