Processing math: 100%
Research article Special Issues

Restored texture segmentation using Markov random fields

  • Received: 16 November 2022 Revised: 27 February 2023 Accepted: 07 March 2023 Published: 29 March 2023
  • Texture segmentation plays a crucial role in the domain of image analysis and its recognition. Noise is inextricably linked to images, just like it is with every signal received by sensing, which has an impact on how well the segmentation process performs in general. Recent literature reveals that the research community has started recognizing the domain of noisy texture segmentation for its work towards solutions for the automated quality inspection of objects, decision support for biomedical images, facial expressions identification, retrieving image data from a huge dataset and many others. Motivated by the latest work on noisy textures, during our work being presented here, Brodatz and Prague texture images are contaminated with Gaussian and salt-n-pepper noise. A three-phase approach is developed for the segmentation of textures contaminated by noise. In the first phase, these contaminated images are restored using techniques with excellent performance as per the recent literature. In the remaining two phases, segmentation of the restored textures is carried out by a novel technique developed using Markov Random Fields (MRF) and objective customization of the Median Filter based on segmentation performance metrics. When the proposed approach is evaluated on Brodatz textures, an improvement of up to 16% segmentation accuracy for salt-n-pepper noise with 70% noise density and 15.1% accuracy for Gaussian noise (with a variance of 50) has been made in comparison with the benchmark approaches. On Prague textures, accuracy is improved by 4.08% for Gaussian noise (with variance 10) and by 2.47% for salt-n-pepper noise with 20% noise density. The approach in the present study can be applied to a diversified class of image analysis applications spanning a wide spectrum such as satellite images, medical images, industrial inspection, geo-informatics, etc.

    Citation: Sanjaykumar Kinge, B. Sheela Rani, Mukul Sutaone. Restored texture segmentation using Markov random fields[J]. Mathematical Biosciences and Engineering, 2023, 20(6): 10063-10089. doi: 10.3934/mbe.2023442

    Related Papers:

    [1] Jucheng Zhang, Minwen Ma, Huajun Li, Zhaoxia Pu, Haipeng Liu, Tianhai Huang, Huan Cheng, Yinglan Gong, Yonghua Chu, Zhikang Wang, Jun Jiang, Ling Xia . Early diagnosis of coronary microvascular dysfunction by myocardial contrast stress echocardiography. Mathematical Biosciences and Engineering, 2023, 20(5): 7845-7858. doi: 10.3934/mbe.2023339
    [2] Li Cai, Qian Zhong, Juan Xu, Yuan Huang, Hao Gao . A lumped parameter model for evaluating coronary artery blood supply capacity. Mathematical Biosciences and Engineering, 2024, 21(4): 5838-5862. doi: 10.3934/mbe.2024258
    [3] Xintong Wu, Yingyi Geng, Xinhong Wang, Jucheng Zhang, Ling Xia . Continuous extraction of coronary artery centerline from cardiac CTA images using a regression-based method. Mathematical Biosciences and Engineering, 2023, 20(3): 4988-5003. doi: 10.3934/mbe.2023231
    [4] Keyue Yan, Tengyue Li, João Alexandre Lobo Marques, Juntao Gao, Simon James Fong . A review on multimodal machine learning in medical diagnostics. Mathematical Biosciences and Engineering, 2023, 20(5): 8708-8726. doi: 10.3934/mbe.2023382
    [5] Honghui Zhang, Jun Xia, Yinlong Yang, Qingqing Yang, Hongfang Song, Jinjie Xie, Yue Ma, Yang Hou, Aike Qiao . Branch flow distribution approach and its application in the calculation of fractional flow reserve in stenotic coronary artery. Mathematical Biosciences and Engineering, 2021, 18(5): 5978-5994. doi: 10.3934/mbe.2021299
    [6] Huan Cheng, Jucheng Zhang, Yinglan Gong, Zhaoxia Pu, Jun Jiang, Yonghua Chu, Ling Xia . Semantic segmentation method for myocardial contrast echocardiogram based on DeepLabV3+ deep learning architecture. Mathematical Biosciences and Engineering, 2023, 20(2): 2081-2093. doi: 10.3934/mbe.2023096
    [7] Ziyu Jin, Ning Li . Diagnosis of each main coronary artery stenosis based on whale optimization algorithm and stacking model. Mathematical Biosciences and Engineering, 2022, 19(5): 4568-4591. doi: 10.3934/mbe.2022211
    [8] Yajing Zeng, Siyu Yang, Xiongkai Yu, Wenting Lin, Wei Wang, Jijun Tong, Shudong Xia . A multimodal parallel method for left ventricular dysfunction identification based on phonocardiogram and electrocardiogram signals synchronous analysis. Mathematical Biosciences and Engineering, 2022, 19(9): 9612-9635. doi: 10.3934/mbe.2022447
    [9] Ya'nan Wang, Sen Liu, Haijun Jia, Xintao Deng, Chunpu Li, Aiguo Wang, Cuiwei Yang . A two-step method for paroxysmal atrial fibrillation event detection based on machine learning. Mathematical Biosciences and Engineering, 2022, 19(10): 9877-9894. doi: 10.3934/mbe.2022460
    [10] Lili Jiang, Sirong Chen, Yuanhui Wu, Da Zhou, Lihua Duan . Prediction of coronary heart disease in gout patients using machine learning models. Mathematical Biosciences and Engineering, 2023, 20(3): 4574-4591. doi: 10.3934/mbe.2023212
  • Texture segmentation plays a crucial role in the domain of image analysis and its recognition. Noise is inextricably linked to images, just like it is with every signal received by sensing, which has an impact on how well the segmentation process performs in general. Recent literature reveals that the research community has started recognizing the domain of noisy texture segmentation for its work towards solutions for the automated quality inspection of objects, decision support for biomedical images, facial expressions identification, retrieving image data from a huge dataset and many others. Motivated by the latest work on noisy textures, during our work being presented here, Brodatz and Prague texture images are contaminated with Gaussian and salt-n-pepper noise. A three-phase approach is developed for the segmentation of textures contaminated by noise. In the first phase, these contaminated images are restored using techniques with excellent performance as per the recent literature. In the remaining two phases, segmentation of the restored textures is carried out by a novel technique developed using Markov Random Fields (MRF) and objective customization of the Median Filter based on segmentation performance metrics. When the proposed approach is evaluated on Brodatz textures, an improvement of up to 16% segmentation accuracy for salt-n-pepper noise with 70% noise density and 15.1% accuracy for Gaussian noise (with a variance of 50) has been made in comparison with the benchmark approaches. On Prague textures, accuracy is improved by 4.08% for Gaussian noise (with variance 10) and by 2.47% for salt-n-pepper noise with 20% noise density. The approach in the present study can be applied to a diversified class of image analysis applications spanning a wide spectrum such as satellite images, medical images, industrial inspection, geo-informatics, etc.



    Clinically, myocardial ischemia refers to a condition in which the perfusion of heart muscle is insufficient, resulting in the reduction of oxygen supply to the heart, abnormal myocardial energy metabolism, and abnormal work of the heart [1]. It can increase cardiovascular events including sudden cardiac death and acute myocardial infarction [2,3,4], contributes 16% to the world's total deaths, and has been considered as the leading cause of mortality. Obstructive coronary artery disease (CAD), defined as severe stenosis in any epicardial coronary arteries (diameter ~ 5 mm) determined via coronary angiography (CAG, diameter severity [DS] ≥ 50%) or a fractional flow reserve (FFR < 0.8) [5], had been quantitatively investigated and well established as a main etiology of myocardial ischemia. However, up to 70% of patients undergoing CAG do not have obstructive CAD [6]. Patients with symptoms and signs of ischemic heart disease (IHD) but found to have nonobstructive coronary arteries (INOCA) are increasingly recognized [7]. Coronary microvascular dysfunction (CMD) has been recognized as a major cause of INOCA by the latest European Society of Cardiology guidelines [8,9]. Since the coronary microvasculature (diameter < 500 μm) has remained elusive to conventional medical images [10], the clinical significance of CMD has not been fully understood [11].

    CMD refers to impaired blood flow in the coronary microcirculation [11,12]. CMD can be caused by structural or functional abnormalities in the coronary microcirculation, resulting in an inefficacy increase of myocardial blood supply in response to an increased myocardial oxygen demand or coronary microvascular spasm [8,13] and eventually leading to myocardial ischemia. Patients with CMD have higher risks of poor prognosis, re-hospitalization, adverse cardiovascular events, and mortality [9,14]. Recently, the functional assessment or detection of CMD has gained much popularity due to the substantial proportion of patients developing symptoms and signs of myocardial ischemia, in spite of the absence of obstructive CAD, or after the well-established treatment of obstructive CAD [5]. The prevalence of CMD has reported to be 50 to 65% of angina patients with INOCA [14], and more than 50% in patients with obstructive CAD [15]. CMD is common but easy to be ignored [16]. Therefore, making an early and accurate diagnosis of CMD plays an increasingly critical role in clinical practice. However, the natural course of CMD tends to be relatively long and asymptomatic, making early diagnosis difficult [17], and there is no reliable noninvasive test available.

    Currently, the gold standard of diagnostic criteria for CMD is the invasive measurement of index of microcirculatory resistance (IMR) and FFR [6,18,19,20]. They are not applicable for the early detection of CMD, given that only a minority of inpatient with acute chest pain meets the clinical threshold that requires invasive testing. Besides the invasive measurement of IMR, methods have been developed for the non-invasive evaluation of cardiac microcirculation, including Doppler echocardiography, stress cardiac magnetic resonance imaging, and computational fluid simulation [13]. However, these techniques are not applied as an accessible tool for early detection of CMD in daily clinical practice due to their radiation, high cost, invasiveness, and complicated operation [21]. Since the 2010s, coronary microcirculatory dysfunction has been focused on as a main etiology of myocardial ischemia [20]. There is an increasing clinical demand for a non-invasive, accessible, and cost-efficient tool to recognize patients with a high likelihood of CMD who may subsequently be referred for invasive detection and further diagnosis [22].

    In comparison, electrocardiogram (ECG)-based analysis is easy-to-use, low-cost, without the requirement of expertise or expensive devices. CMD can lead to ischemic ECG changes [22,23], which provides the possibility of ECG-based non-invasive detection of CMD. Specially, standard deviation of normal R-R intervals (SDNN) < 100 ms [24], ischemic ST-segment changes [25,26], the prolongation of the heart rate-corrected QT interval [27,28], and variations in T wave [22,27] have been validated as indicators of CMD in patients with INOCA. Sara et al. extracted three features from T wave and developed a linear discriminant classifier which yielded the sensitivity and specificity of 65.9 and 67.7% in detecting CMD [22]. These studies preliminarily validated the effectiveness of ECG-based features in detecting CMD, which provides the possibility of computer-aided CMD detection method using machine learning algorithm. Nevertheless, there are very few computer-aided diagnostic algorithms based on ECG-based features for CMD detection, given that previous studies mainly focused on detecting obstructive CAD [29].

    Entropy is a common measure of complexity of time series [30]. Myocardial ischemia-induced variations in waveform and frequency components at certain ECG segments can be reflected in the changes of its entropy. Sample entropy (SampEn), approximate entropy (ApEn), and multiscale entropy (MSE) have been extracted from heart rate variability [31], ST-segments [32], or filtered 12-lead ECGs [33] for evaluating the changes of complexity in ECGs from patients with obstructive CAD [34]. However, the performances of these entropies in detecting CMD are yet to be explored. Therefore, we aim to investigate whether SampEn, ApEn, and MSE extracted from beat-to-beat ST-T segments of each lead in ECG and vectorcardiography (VCG) could reliably detect CMD, and develop an ECG-based CMD detection algorithm which will lay the groundwork for patient-specific, early, and non-invasive detection of CMD by comparing different entropy subsets and machine learning models.

    Our work contains five parts: data collection, signal preprocessing, feature extraction, feature selection, and model evaluation and testing, as shown in Figure 1. Firstly, 12-lead ECGs from CMD patients and healthy controls were collected and these from healthy controls were split into 10-second (10 s) segments. After 10 s ECGs were cleansed and denoised, VCGs were synthesized from 12-lead ECGs mathematically. The ST-wave onset and T-wave offset were located on VCGs and ECGs employing a squeeze and regional approach respectively. Three entropy features, i.e., SampEn, ApEn, and MSE-derived complexity index (CI), were extracted from the time series obtained by splicing ST-T segments of each lead in ECGs and VCGs beat by beat. Subsequently, the most effective subset of each entropy feature for each model was determined using the sequential backward selection (SBS) algorithm under the intra-patient and inter-patient schemes. Under each scheme, eight different machine learning models for each entropy feature were comprehensively evaluated on a five-fold cross-validation method on the training-validation datasets at the very first place, and then tested on the corresponding testing datasets for every scenario. Finally, the best model for CMD detection was investigated from the three entropy-based models (i.e., SampEn-based, ApEn-based, and CI-based) under each scheme.

    Figure 1.  The schematic diagram of our proposed algorithms.

    In our study, ECGs and the clinical characteristics of 177 subjects in two cohorts were collected. Regard to positive samples, 99 10 s, 12-lead resting ECG recordings of 70 patients with CMD were obtained from the Second Affiliated Hospital of Zhejiang University, Zhejiang, China, from June 2019 to September 2022 with approval from the local ethics committee for sharing and analyzing retrospective anonymised patient data with informed consent form waived.

    Inclusion criteria were described as follows: 1) existence of stable or chronic symptoms of myocardial ischemia; 2) presence of coronary stenosis assessed by CAG but a FFR > 0.8; 3) presence of symptoms of chest pain or tightness but no obvious evidence of myocardial ischemia; 4) presence of objective evidence of myocardial ischemia.

    Exclusion criteria applied to the study population were given by: 1) existence of unsuccessful measurement of FFR or IMR; 2) presence of myocardial infarction in the target vessel within 72 hours; 3) existence of isotonic creatinine > 150 µmol/L, glomerular filtration rate < 45 mL/kg/m2, or left ventricular ejection fraction < 30%; 4) existence of the following diseases: bundle branch blocks, atrial fibrillation, left ventricular hypertrophy, congestive heart failure, pulmonary arterial hypertension, or heart valve disease.

    CMD was diagnosed according to the standardized diagnostic criteria proposed by COVADIS (Coronary Vasomotor Disorders International Study Group): IMR ≥ 25 in the absence of overt obstructive CAD (FFR  >  0.80) [12,35], as illustrated in Figure 3. FFR and IMR were measured in the usual fashion by employing a coronary guidewire (St. Jude Medical Inc., PressureWireCertus, C12008) placed in target artery during CAG [35].

    Figure 2.  The flowchart of diagnosing CMD.
    Figure 3.  Comparison of CAG between two patients with CAD and CMD. (A) A patient with CAD. There is a coronary stenosis 60% in distal left circumflex artery with FFR < 0.8 and IMR < 25. (B) A patient with CMD. There is a coronary stenosis 40% in left anterior descending artery with IMR > 25 and FFR > 0.8.

    Finally, patients with CMD were selected whilst patients with CAD were ruled out, as shown in Figure 3. Totally, 99 10 s, 12-lead ECGs (sampling rate: 500 Hz; resolution: 16-bit with 4 μV/LSB) were recorded utilizing a commercially available electrocardiograph (Netherlands Philips Electronics Co. LTD, PageWriter TC30). The clinical characteristics of CMD patients are listed in Table 1.

    Table 1.  Clinical characteristics of patients with CMD.
    Characteristics Value*
    Age, years 67.29 ± 9.23
    Female, n (%) 26/70
    Hypertension, n (%) 32/70
    Diabetes mellitus, n (%) 22/70
    Heart rate, bpm 70.24 ± 12.87
    Systolic blood pressure, mmHg 130.82 ± 15.34
    Diastolic blood Pressure, mmHg 73.43 ± 10.45
    Smoking history, n (%) 12/70
    Family history of CAD, n (%) 12/70
    *The categorical data are provided as numbers and percentages, and all of numerical variables are afforded in the form mean ± standard deviation for normally distributed data.

     | Show Table
    DownLoad: CSV

    Regarding negative samples, 107 12-lead ECGs (duration: 10 seconds; sampling rate: 500 Hz; resolution: 16-bit with 1 mV/LSB) were collected from 107 healthy controls (age: 36.3 ± 15.1 years, 73 females and 34 males) of China Physiological Signal Challenge in 2018 database [36].

    After ECGs from healthy controls were segmented into 10 s ones, data cleansing was implemented to guarantee the quality of ECG signals. Low-quality ECGs resulted from the shedding of the leads or/and poor attachment between the lead and body surface were eliminated, as illustrated in Figure 4. After data cleansing, in total, 301 10 s, 12-lead ECGs (99 CMD, 202 controls) were finally selected for further analysis.

    Figure 4.  Examples of low-quality ECGs. (A) Leads V1 and V2 have poor attachment to the body surface. (B) The lead avF is shed.

    Then, the baseline drift and low-frequency fluctuations were removed using two moving median filters connected in cascade (with length 1.2 and 0.6 seconds respectively) to maximally avoid the deformation of ST segment in comparison with the classical high-pass filter. The output of first median filter was fed into the second one. High-frequency power-line interference and electromyogram noise were eliminated employing discrete wavelet transform (DWT). In detail, Coif4 determined as a wavelet basis function was adopted to decompose noise-containing ECGs up to four levels [37]. After the elimination of noise by an adaptive threshold, the processed signals were transformed back by utilizing the inverse of DWT [37].

    Subsequently, all 10 s, 12-lead ECGs were standardized utilizing the clinical standard gain [37,38] and then transformed into VCGs [39], as shown in Figure 5(C−F).

    Figure 5.  ECG, ST-T segment, and VCG. (A) ECG for a healthy control. (B) ST-T segment for a healthy control. (C) VCG for a healthy control. (D) ECG for a patient with CMD. (E) ST-T segment for a patient with CMD. (F) VCG for a patient with CMD.
    [VxVyVz]=DFT (1)

    where D=[0.380.070.130.050.010.140.060.540.070.930.060.020.050.060.170.130.110.230.430.060.140.200.110.31],

    F=[IIIV1V2V3V4V5V6]; I, II, V1, V2, V3, V4, V5, and V6 are leads of ECG; Vx, Vy, and Vz are leads of VCG.

    Ultimately, the ST-segment onset and T-wave offset were simultaneously marked on the VCGs and ECGs employing a hybrid approach [40] to obtain ST-T segments for calculating entropies, as shown in Figure 5(B−E). ST-wave onsets were located using a squeeze algorithm, and T-wave offsets using a regional approach [40].

    Sample entropy (SampEn), approximate entropy (ApEn), and multiscale entropy (MSE) have been demonstrated to be electrocardiographic indictors for evaluating the changes of complexity in ECGs from patients with obstructive CAD [33,34]. Similarly, SampEn, ApEn, and MSE-derived CI were calculated from ST-T segments of each VCG and ECG lead to assess the changes of complexity in ECGs induced by CMD.

    For each lead in VCGs or ECGs, its time series, i.e., {t(l)}=t(1),t(2),...,t(L) was obtained by splicing ST-T segments beat by beat and standardized as follows:

    t(l)=t(l)μσ (2)

    where L presents the length of the time series; σ and μ are the standard deviation and mean value of the time series.

    SampEn is defined as the negative natural logarithm of a conditional probability [30] and calculated to measure the complexity of beat-to-beat ST-T segment in this work. For each VCG and ECG lead, SampEn (Si,i=Vx,Vy,Vz,I,II,III,avR,avL,avF,V1,V2,V3,V4,V5,V6) was calculated from the time series, i.e., {t(l)}=t(1),t(2),...,t(L) as follows [37,41]:

    SampEn(L,m,ε)=lnψm+1(ε)ψm(ε) (3)

    where ψm(ε) and ψm+1(ε) are the average probability that two vectors coincide for m and m+1 points, respectively; ε denotes the tolerance for accepting matches, and m refers to embedded dimension [30].

    In this work, the value of ε was set to 0.1, and that of m was set to 2 [30,37].

    In our work, ApEn (Ai,i=Vx,Vy,Vz,I,II,III,avR,avL,avF,V1,V2,V3,V4,V5,V6) of time series {t(l)}=t(1),t(2),...,t(L) of each lead in ECGs and VCGs were calculated [30,41].

    Firstly, the vectors Tm(1),...,Tm(Lm+1) and Tm+1(1),...,Tm+1(Lm) with a dimension of m and m+1 were formed to be Tm(z)={t(z),t(z+1),...,t(z+m1)},1zLm+1 and Tm+1(z)={t(z),t(z+1),...,t(z+m)},1zLm.

    Then, the distances between any Tm(z) and Tm(p), and between any Tm+1(z) and Tm+1(p) were defined as:

    D[Tm(z),Tm(p)]=max0qm1(|t(z+q)t(p+q)|),1z,pLm+1 (4)
    D[Tm+1(z),Tm+1(p)]=max0qm(|t(z+q)t(p+q)|),1z,pLm (5)

    Subsequently, Cmj(ε) and Cm+1j(ε) were given by:

    Cmz(ε)=umz(ε)Lm+1,z=1,,Lm+1 (6)
    Cm+1z(ε)=um+1z(ε)Lm,z=1,,Lm (7)

    where umz(ε) denotes the number that the distance between any vector Tm(z) and vector Tm(p) is within ε, and similarly um+1z(ε) is the number that the distance between any vector Tm+1(z) and vector Tm+1(p) is within ε. ε denotes the tolerance for accepting matches [30].

    θm(ε)=Lm+1z=1logCmz(ε)Lm+1 (8)
    θm+1(ε)=Lmz=1logCm+1z(ε)Lm (9)

    where θm(ε) is the average probability that two any vectors coincide for m+1 points, and θm+1(ε) is the average probability that two any vectors coincide for m+1 points.

    Ultimately, ApEn was calculated as follows:

    ApEn(ε,m)=θm(ε)θm+1(ε) (10)

    In this work, the value of ε was set to 0.1 and that of m was set to 2 [30,37].

    MSE builds on SampEn algorithm by integrating a coarse-graining procedure and provides insight into the point-to-point fluctuation across multiple time scales [42]. The kth coarse-grained time series for each time scale of τ, y(τ)={y(τ)1,y(τ)2,,y(τ)p}, was defined as [42]:

    y(τ)k=1τkτ1l=(k1)τ+1t(l),1kLτ (11)

    where p=Lτ, τ is the time scale of interest, L is the length of the time series, and t(k) is a data point in the time series, i.e., {t(l)}=t(1),t(2),...,t(L), of each ECG and VCG lead.

    SampEn algorithm was employed to obtain an entropy value at each time scale.

    MSE(τ,m,ε)=SampEn(y(τ),m,ε),1τM (12)

    where M is the maximum time scale; the value of ε was set to 0.1 and that of m set to 2 [30,37].

    A major concern when employing MSE algorithm is to guarantee that the data length of the coarse-grained time series is long enough at the maximum time scale for the reason that too short time series at any time scale associates with inconsistent probabilities from SampEn. More than 200 data points per time scale has been recommended to elicit consistent SampEn values [43]. Since the data length of time series is between 900 and 1200, the maximum time scale was set to 3. The values of τ were set to 1, 2, 3 [30,43].

    Once all parameters and MSE have been determined, the area under the MSE vs. time scale curve, entitled as CI [42] of ECGs' and VCGs' ST-T segments were calculated as follows:

    CI=Mτ=1MSE(τ) (13)

    where MSE(τ) is the MSE value at time scale factor of τ.

    Eight common machine learning models [29] i.e., support vector machine (SVM), multilayer perceptron (MLP), gradient boosting [44], bagging ensemble (Bagging), random forest, ada boost, decision tree, and K-nearest neighbors (KNN) were conducted to distinguish between healthy controls and patients with CMD in this work. All machine learning models were implemented in Python 3.7 employing open-source libraries: Scikit-learn (0.20.1, http://scikit-learn.org/stable).

    The entropy subsets selected by utilizing the SBS algorithm were fed into each framework to identify the subjects (i.e., CMD patients vs. healthy controls). Regard to the model design, SampEn-based model denoted each framework fed with VCGs' and ECGs' SampEn only. Similarly, ApEn-based and CI-based models presented respectively the frameworks utilizing ApEn and CI only.

    Feature selection is widely implemented to determine the optimal feature subset from a large initial set of features thus improving generalization of the machine learning model and reducing the computational demand. To achieve the most effective entropy subset, SBS algorithm [45,46] has been conducted, as presented in Figure 6.

    Figure 6.  The flowchart of the SBS algorithm for determining the optimal entropy feature subset. (A) The entropy elimination technique. (B) The selection of the optimal entropy subset. The SBS algorithm was conducted on SampEn, ApEn, and CI separately; where the initial entropies consist of all the features from 12 ECG and 3 VCG leads. In each iteration step, the candidate subset (each with n-1 elements) was selected from n subsets of the parent set with n elements. The selected candidate subset was the parent set in the next iteration.

    First, a collection of candidate entropy subset for each model was created on the training-validation dataset, as illustrated in Figure 6A. For each algorithm, a baseline model was constructed using each entropy feature separately, i.e., 15 SampEn, 15 ApEn, or 15 CI calculated from ST-T segments of 3-lead VCGs and 12-lead ECGs. The iteration variable n was initially set as 15. Each subset with n-1 entropies was trained and evaluated by employing a five-fold cross-validation to select the one with the highest average F1 score, which takes into account precision and recall, and is not sensitive to the class-imbalance [47] into next iteration where subsets with n-2 entropies derived from the selected n-1 element subset were evaluated and compared similarly. The iteration continued until n = 1. Finally, 15 candidate subsets with different numbers of entropies (i.e., 1, 2, …, 15) were selected by the iterative SBS algorithm.

    Second, the optimal entropy subset, which had maximal five-fold cross-validation average F1 score, was identified from the SBS-generated collection of the candidate entropy subsets achieved above, as illustrated in Figure 6B.

    Finally, the optimal entropy subset was separately determined from the total 15 SampEn for each SampEn-based model. Similarly, optimal entropy subsets for ApEn-based and CI-based models were determined.

    The utility of the constructed models was evaluated by accuracy, specificity, sensitivity, and F1 score [37]. Additionally, the geometric mean (G-mean) and an area under the curve for precision/recall (PR-AUC) were considered as evaluation metrics. The geometric mean (G-mean) is the geometric mean of sensitivity and specificity [48]. PR-AUC is a metric commonly used in highly imbalanced datasets [49].

    Both intra-patient and inter-patient schemes were implemented to verify the effectiveness of our proposed modes. Under the intra-patient scheme, positive and negative ECGs were randomly split in 80% for training and validation, and 20% for testing at the same time. Regarding the inter-patient scheme, patients were randomly separated in the proportion of 4:1 for training-validation and testing, and the corresponding ECGs formed the training-validation and testing datasets. Under both scheme, a five-fold cross-validation approach was adopted in the training-validation dataset to optimize model parameters and check evaluation metrics (i.e., sensitivity, accuracy, specificity, F1 score, G-mean, and PR-AUC) on the training-validation dataset for each model at the very first place. Then, each trained model was tested on the testing dataset to check whether the selected model always performed best under each scheme for every scenario.

    In this work, the signal preprocessing and feature extraction were developed utilizing MATLAB (R2021; The MathWorks Inc. Natick, USA). All machine learning models were established, evaluated, and tested in Python 3.7 as well as feature selection.

    The evaluation metrics of SampEn-based, ApEn-based, and CI-based models on the validation dataset are illustrated in first, second, and third columns of Figure 7 respectively. It can be observed from the first column that SVM model outperforms other ApEn-based models in response to the major evaluation metrics. Therefore, SVM was determined as the candidate one for SampEn-based model. Similarly, MLP and SVM models were selected as the candidates for SampEn-based and CI-based models respectively. As listed in Table 2, the testing evaluation metrics of ApEn-based SVM model are higher than those of other ApEn-based models. Similarly, SampEn-based MLP and CI-based SVM models provide the highest the testing evaluation metrics across all SampEn-based and CI-based ones respectively.

    Figure 7.  The comparison of the classification performance between different models under the intra-patient scheme. (A) Accuracy of ApEn-based models. (B) Specificity of ApEn-based models. (C) Sensitivity of ApEn-based models. (D) F1 score of ApEn-based models. (E) PR-AUC of ApEn-based models. (F) G-mean of ApEn-based models. (G) Accuracy of SampEn-based models. (H) Specificity of SampEn -based models. (I) Sensitivity of SampEn -based models. (J) F1 score of SampEn-based models. (K) PR-AUC of SampEn-based models. (L) G-mean of SampEn -based models. (M) Accuracy of CI-based models. (N) Specificity of CI-based models. (O) Sensitivity of CI-based models. (P) F1 score of CI-based models. (Q) PR-AUC of CI-based models. (S) G-mean of CI-based models. GB: Gradient Boost; Bag: Bagging; RF: Random Forest; Ab: Ada boost; DT: Decision Tree. G-mean: geometric mean; PR-AUC: an area under the curve for precision/recall.
    Table 2.  Comparisons of the testing evaluation metrics of ApEn-based, SampEn-based, and CI-based models under the intra-patient scheme.
    Models Accuracy Specificity Sensitivity F1 score PR-AUC G-mean
    ApEn-based SVM 0.898 0.925 0.842 0.842 0.868 0.883
    ApEn-based MLP 0.881 0.925 0.789 0.811 0.845 0.855
    ApEn-based Gradient Boost 0.729 0.750 0.684 0.619 0.676 0.716
    ApEn-based Bagging 0.881 0.950 0.737 0.800 0.848 0.837
    ApEn-based Random Forest 0.847 0.950 0.632 0.727 0.804 0.775
    ApEn-based Ada Boost 0.814 0.900 0.632 0.686 0.750 0.754
    ApEn-based Decision Tree 0.847 0.900 0.737 0.757 0.800 0.814
    ApEn-based KNN 0.831 0.925 0.632 0.706 0.775 0.764
    SampEn-based SVM 0.831 0.825 0.842 0.762 0.794 0.833
    SampEn-based MLP 0.881 0.925 0.789 0.811 0.845 0.855
    SampEn-based Gradient Boost 0.814 0.850 0.737 0.718 0.761 0.791
    SampEn-based Bagging 0.847 0.900 0.737 0.757 0.800 0.814
    SampEn-based Random Forest 0.814 0.875 0.684 0.703 0.754 0.774
    SampEn-based Ada Boost 0.847 0.900 0.737 0.757 0.800 0.814
    SampEn-based Decision Tree 0.746 0.750 0.737 0.651 0.702 0.743
    SampEn-based KNN 0.712 0.825 0.476 0.514 0.603 0.625
    CI-based SVM 0.847 0.875 0.789 0.769 0.804 0.831
    CI-based MLP 0.831 0.875 0.737 0.737 0.779 0.803
    CI-based Gradient Boost 0.746 0.775 0.684 0.634 0.688 0.728
    CI-based Bagging 0.780 0.825 0.684 0.667 0.718 0.751
    CI-based Random Forest 0.814 0.875 0.684 0.703 0.754 0.773
    CI-based Ada Boost 0.746 0.800 0.632 0.615 0.675 0.711
    CI-based Decision Tree 0.746 0.750 0.737 0.651 0.702 0.743
    CI-based KNN 0.712 0.825 0.474 0.514 0.603 0.625
    Note: Best performance for ApEn-based, SampEn-based, and CI-based models is highlighted in bold.

     | Show Table
    DownLoad: CSV

    Subsequently, the comparisons among the three candidate models (i.e., ApEn-based SVM, SampEn-based MLP, and CI-based SVM models) show that ApEn-based SVM model affords the highest evaluation metrics on the validation dataset, as shown in Figure 7. Furthermore, the classification performances of the three candidate models on the testing dataset present that ApEn-based SVM model is superior to the other two models (i.e., SampEn-based MLP and CI-based SVM models) with all evaluation metrics higher than 0.8, as listed in Table 2. Thus, ApEn-based SVM model was validated as the optimal one in detecting CMD under the intra-patient scheme.

    Figure 8 illustrates the comparisons of evaluation metrics among ApEn-based, SampEn-based, and CI-based models on the validation dataset for detecting CMD. From the first column, SVM model yields the highest classification performance across all ApEn-based models. Therefore, it was verified as the candidate one for ApEn-based model. Similarly, Bagging and SVM models were determined as the candidates for ApEn-based and CI-based models respectively. Regard to the classification performances on the testing dataset, ApEn-based SVM model outperforms other ApEn-based ones, as listed in Table 3. Similarly, SampEn-based Bagging and CI-based SVM models perform best across all SampEn-based and CI-based ones respectively.

    Figure 8.  The comparison of classification capability between different models under the inter-patient scheme. (A) Accuracy of ApEn-based models. (B) Specificity of ApEn-based models. (C) Sensitivity of ApEn-based models. (D) F1 score of ApEn-based models. (E) PR-AUC of ApEn-based models. (F) G-mean of ApEn-based models. (G) Accuracy of SampEn-based models. (H) Specificity of SampEn -based models. (I) Sensitivity of SampEn -based models. (J) F1 score of SampEn-based models. (K) PR-AUC of SampEn-based models. (L) G-mean of SampEn -based models. (M) Accuracy of CI-based models. (N) Specificity of CI-based models. (O) Sensitivity of CI-based models. (P) F1 score of CI-based models. (Q) PR-AUC of CI-based models. (S) G-mean of CI-based models. GB: Gradient Boost; Bag: Bagging; RF: Random Forest; Ab: Ada boost; DT: Decision Tree. G-mean: geometric mean; PR-AUC: an area under the curve for precision/recall.
    Table 3.  Comparisons of the testing evaluation metrics of ApEn-based, SampEn-based, and CI-based models under the inter-patient scheme.
    Models Accuracy Specificity Sensitivity F1 score PR-AUC G-mean
    ApEn-based SVM 0.881 0.925 0.789 0.811 0.845 0.855
    ApEn-based MLP 0.814 0.775 0.895 0.756 0.791 0.833
    ApEn-based Gradient Boost 0.797 0.850 0.684 0.684 0.735 0.763
    ApEn-based Bagging 0.864 0.925 0.737 0.778 0.823 0.826
    ApEn-based Random Forest 0.847 0.925 0.684 0.743 0.799 0.796
    ApEn-based Ada Boost 0.847 0.925 0.684 0.743 0.799 0.796
    ApEn-based Decision Tree 0.847 0.925 0.684 0.743 0.799 0.796
    ApEn-based KNN 0.831 0.925 0.632 0.706 0.775 0.764
    SampEn-based SVM 0.847 0.900 0.737 0.757 0.800 0.814
    SampEn-based MLP 0.814 0.850 0.737 0.718 0.761 0.791
    SampEn-based Gradient Boost 0.864 0.900 0.789 0.789 0.823 0.843
    SampEn-based Bagging 0.864 0.925 0.737 0.778 0.823 0.826
    SampEn-based Random Forest 0.864 0.925 0.737 0.778 0.823 0.826
    SampEn-based Ada Boost 0.831 0.925 0.632 0.706 0.775 0.764
    SampEn-based Decision Tree 0.797 0.850 0.684 0.684 0.735 0.763
    SampEn-based KNN 0.814 0.900 0.632 0.686 0.750 0.754
    CI-based SVM 0.831 0.875 0.737 0.737 0.779 0.803
    CI-based MLP 0.729 0.750 0.684 0.619 0.676 0.716
    CI-based Gradient Boost 0.763 0.825 0.632 0.632 0.691 0.722
    CI-based Bagging 0.763 0.825 0.632 0.632 0.691 0.722
    CI-based Random Forest 0.729 0.825 0.526 0.556 0.633 0.659
    CI-based Ada Boost 0.695 0.750 0.579 0.550 0.619 0.659
    CI-based Decision Tree 0.678 0.675 0.684 0.578 0.643 0.680
    CI-based KNN 0.780 0.950 0.421 0.552 0.704 0.632
    Note: Best performance for ApEn-based, SampEn-based, and CI-based models is highlighted in bold.

     | Show Table
    DownLoad: CSV

    Then, the classification performances of SampEn-based Bagging, ApEn-based SVM, and CI-based SVM models were compared to select the optimal one. It can be observed from Figure 8 that ApEn-based SVM model has superiority to the other two models except the sensitivity for SampEn-based Bagging model. Moreover, the comparisons of the three candidate models on the testing dataset demonstrate that ApEn-based SVM model has all testing evaluation metrics higher than SampEn-based Bagging and CI-based SVM models, as listed in Table 3. Hence, ApEn-based SVM model was verified as the optimal one for CMD detection under the inter-patient scheme.

    The ApEn-based SVM models were verified to be the optimal ones for CMD detection, with all and major testing evaluation metrics over 0.8 under the intra-patient and inter-patient schemes respectively, indicating the feasibility of entropy-based early detection of CMD using machine learning algorithm.

    Obstructive CAD and CMD are recognized as two major causes of myocardial ischemia. Since obstructive CAD had been considered as the leading cause of myocardial ischemia, previous studies of ECG-based machine learning algorithms mainly focused on obstructive CAD detection [29,50], with a lack of in-depth investigation in patients with CMD. An advantage of the ECG-based method is its interpretability. Some mathematical models disclosed the pathology of CMD from cell levels. Some critical electrophysiological phenomena and parameters, e.g., T wave alternans, can be directly reflected on ECG and VCG, providing the possibility of fine-grained classification and stratification of CMD [51,52]. To detect CMD non-invasively, electrocardiographic indictors., i.e., SDNN < 100 ms [24], ischemic ST-T segment changes [22,25,26,27], and the prolongation of the heart rate-corrected QT interval [27,28] have been investigated. Specially, SARA et al. combined three features, i.e., T-wave area, T Peak-T end, and Y-center of gravity as inputs of a linear discriminant analysis and recognized the existence presence of an abnormal coronary flow reserve (CFR) with the highest accuracy of 66.5 ± 0.3% and 74 ± 2% for females and males [22]. Since CFR assesses the entire coronary bed including both epicardial and microvascular districts, the authors utilized an abnormal CFR and DS < 50% as the standard for selecting CMD patients to exclude the influence of obstructive CAD. In contrast, IMR used in our work is not influenced by epicardial artery stenosis and can accurately reflect the microvascular flow resistance [18,21].

    As far as we known, this is the first machine learning model employing entropy features of ECG and VCG to detect CMD based on reliable clinical diagnosis derived from patient specific FFR and IMR values.

    CMD is believed to result from inadequate relaxation of vascular smooth muscle, which mediates myocardial ischemia [1]. During myocardial ischemia, the decrease of conduction velocity and the duration of action potential lead to the heterogeneous repolarization process [53]. Further, ischemia-induced repolarization dispersion causes ischemic changes in ECG and VCG signals. Regarding ECG, the variations in ST segment include ST-segment depression or elevation, and those in T wave include high-tip T wave, biphasic T wave or inverted T wave [51,52], as illustrated in Figure 1. As for VCG, the changes exist in the QRS loop, the spatial orientations and magnitude of ST vectors [51,54], the T-loop morphology, and the T-vector angle [55]. The beat-to-beat variations in T-loop roundness present intrinsic measures of beat-to-beat repolarization ability [55]. Therefore, the variations in ST-T segments of VCGs and ECGs can be considered as indicators of myocardial ischemia [37,51,55].

    The ischemic variations have been demonstrated to afford detectable morphology variability in beat-to-beat ST-T segments, while the morphology shows a consistent pattern in normal subjects [56]. CMD can lead to changes in ST segment or/and T wave [22]. The complexity resulting from the morphology variations can be measured by entropy.

    For the first time, we observed that CMD-induced complexity changes of beat-to-beat ST-T segments can be reliably detected by SampEn, ApEn, and MSE-derived CI (Tables 2 and 3), which provided reference for other ECG-based CMD detection algorithms. Specially, ApEn outperforms SampEn and CI in detecting CMD under both intra-patient and inter-patient schemes. ApEn values extracted from pathologic time series are different from those obtained from free running physiologic systems under healthy condition [57]. In this work, ApEn could be used to effectively measure the changed of the complexity induced by CMD.

    An SVM model has been widely applied in the detection of myocardial ischemia location and multiclass myocardial infraction classification [50]. The other seven models also have been applied for CAD detection and yield excellent classification performance [29].

    We evaluated and tested these common machine learning models to determine the optimal one for CMD detection. Our results present that an SVM model yields the best classification performance across all models under both schemes. Moreover, compared with MLP, gradient boosting, Bagging, and Ada boost models, an SVM model does not require extensive computational resources to determine the classification results. Therefore, it is more accomplishable on wearable devices, given that their computational resources are restricted.

    We observed a difference between entropy features in the performance of SVM algorithm in detecting CMD. Under the intra-patient scheme, ApEn-based SVM model employing (AI, AII, AavR, AavL, AavF, AV4, AV5, AV6, AVx, AVz) was demonstrated to surpass the other models. Under the inter-patient scheme, ApEn-based SVM model utilizing (AI, AII, AIII, AV4, AV5, AV6, AVx, AVy) provided the best performance across all models. The patient-specific algorithm optimization deserves further investigation.

    The results in this work have demonstrated that SampEn, ApEn, and CI calculated from ST-T segments of ECGs and VCGs could be useful features to recognize a patient with CMD for the first time. Furthermore, our proposed models afford the possibility of noninvasive and cost-effective detection of CMD. It could be easily deployed on conventional ECG acquisition equipment, given that VCG can be calculated from 12-lead ECG by employing a Kors transformation matrix [39]. Additionally, it is based on the 10 s ECG which has been widely accepted as the first-line diagnostic technique in assessing patients with suspected myocardial ischemia due to its non-invasiveness, non-radiation, and low cost [58]. The data length of the time series consisting of beat-to-beat ST-T segments in each lead is between 900 and 1200 and longer than 200 which is suggested for calculating ApEn and SampEn [43]. The minimum data length is more than 300 with the maximal time scale factor of τ = 3 regarding MSE. The commonly used 10 s ECG is available for calculating reliably the three entropy features. Our algorithm meets the clinical needs with no extra workload for operators, given that our algorithms are fully automatic. Hence, our results open a new pathway towards non-invasive, low-cost, and operator-friendly detection of CMD in various application scenarios using wearable ECG sensors. Therefore, the proposed method may provide an approach for large-scale screening of CMD in populations, especially in low-resource areas.

    However, some limitations exist in our work. First, the sample size is small, especially the positive cases. The sample size is limited by the number of patients diagnosed with CMD who underwent full examination. The scarce of CMD patients' data is a common limitation of existing studies (e.g., 41 in [24]; 20, in [59]). Especially, the in vivo measurement of IMR is performed invasively by using an intravascular guide wire with the injection of saline into coronary artery multiple times and is expensive. Therefore, it is not widely used in clinical practice and only performed for the patients with obvious symptoms of CMD, which limited the data size to develop highly reliable algorithms that suit different cohorts. Secondly, the positive (i.e., CMD patients) and negative (i.e., healthy controls) samples were collected from different cohorts. Hence, the difference in physiological characteristics may influence the classification performance. Finally, only ECG-based features were selected as inputs, whereas clinical characteristic and other medical images were not integrated in our algorithms.

    In future studies, multicenter large-scale studies can extend the positive sample size and further verify our results, optimize the algorithm, and improve the classification performance by considering the difference in physiological features among different cohorts. Based on large datasets, the combination between ECG-based features and clinic-characteristics could be considered to boost the improvement in the classification performance. The fine-grained classification of CMD based on ECG-VCG features also deserves further exploration.

    In conclusion, SampEn, ApEn, and CI extracted from the beat-to-beat ST-T segment of ECGs and VCGs could be useful entropy features to recognize electrocardiographic signatures of CMD under both intra-patient and inter-patient schemes. Our proposed models may provide the possibility of an ECG-based tool for non-invasive detection of CMD.

    The authors would like to appreciate all participants for data collection and providing constructive comments. This word was funded by the Natural Science Foundation of Ningxia Province (No. 2022AAC03242), the North Minzu University Scientific Research Projects (No. 2021JCYJ10), the Natural Science Foundation of China (NSFC) (No. 62171408), the Major Scientific Project of Zhejiang Lab (No. 2020ND8AD01), the Key Research and Development Program of Zhejiang Province (No. 2020C03016), Ningxia First-Class Discipline and Scientific Research Projects (Electronic Science and Technology) (No. NXYLXK2017A07), Innovation Team of Lidar Atmosphere Remote Sensing of Ningxia Province, the high level talent selection and training plan of North Minzu University, and Plan for Leading Talents of the State Ethnic Affairs Commission of the People's Republic of China.

    The authors declare there is no conflict of interest.



    [1] H. Liu, G. Huo, Q. Li, X. Guan, M. L. Tseng, Multiscale lightweight 3D segmentation algorithm with attention mechanism: Brain tumor image segmentation, Expert Syst. Appl., 214 (2023), 119166. https://doi.org/10.1016/j.eswa.2022.119166 doi: 10.1016/j.eswa.2022.119166
    [2] X. Li, S. Chen, J. Wu, J. Li, T. Wang, J. Tang, et al., Satellite cloud image segmentation based on lightweight convolutional neural network, Plos One, 18 (2023), e0280408. https://doi.org/10.1371/journal.pone.0280408 doi: 10.1371/journal.pone.0280408
    [3] L. Guo, P. Shi, L. Chen, C. Chen, W. Ding, Pixel and region level information fusion in membership regularized fuzzy clustering for image segmentation, Inf. Fusion, 92 (2023), 479–497. https://doi.org/10.1016/j.inffus.2022.12.008 doi: 10.1016/j.inffus.2022.12.008
    [4] R. M. Haralick, K. Shanmugan, I. Dinstein, Textural features for image classification, IEEE Trans. Syst. Man Cybern., 3 (1973), 610–621. https://doi.org/10.1109/TSMC.1973.4309314 doi: 10.1109/TSMC.1973.4309314
    [5] J. Chaki, N. Dey, Texture Feature Extraction Techniques for Image Recognition, Springer, Singapore, (2020).
    [6] A. Distante, C. Distante, Handbook of Image Processing and Computer Vision: Volume 3: From Pattern to Object, Springer International Publishing, Basel, Switzerland, (2020).
    [7] C. C. Hung, E. Song, Y. Lan, Image Texture Analysis. Foundations, Models and Algorithms, Springer International Publishing, Basel, Switzerland, (2019).
    [8] Y. Chen, E. R. Dougherty, Gray-scale morphological granulometric texture classification, Opt. Eng., 33 (1994), 2713–2722. https://doi.org/10.1117/12.173552 doi: 10.1117/12.173552
    [9] B. B. Chaudhuri, N. Sarkar, Texture segmentation using fractal dimension, IEEE Trans. Pattern Anal. Mach. Intell., 17 (1995), 72–77. https://doi.org/10.1109/34.368149 doi: 10.1109/34.368149
    [10] J. M. Keller, S. Chen, R. M. Crownover, Texture description and segmentation through fractal geometry, Comput. Vis. Graph. Image Process., 45 (1989), 150–166. https://doi.org/10.1016/0734-189X(89)90130-8 doi: 10.1016/0734-189X(89)90130-8
    [11] R. Chellappa, S. Chatterjee, Classification of textures using Gaussian Markov random fields, IEEE Trans. Acoust. Speech Signal Process., 33 (1985), 959–963. https://doi.org/10.1109/TASSP.1985.1164641 doi: 10.1109/TASSP.1985.1164641
    [12] G. R.Cross, A. K. Jain, Markov random field texture models, IEEE Trans. Pattern Anal. Mach. Intell., (1983), 25–39. https://doi.org/10.1109/tpami.1983.4767341. doi: 10.1109/tpami.1983.4767341
    [13] L. Alparone, F. Argenti, G. Benelli, Fast calculation of co-occurrence matrix parameters for image segmentation, Electron. Lett., 26 (1990), 23–24.
    [14] R. Davarzani, S. Mozaffari, K. Yaghmaie, Scale-and rotation-invariant texture description with improved local binary pattern features, Signal Process., 111 (2015), 274–293. https://doi.org/10.1016/j.sigpro.2014.11.005. doi: 10.1016/j.sigpro.2014.11.005
    [15] C. C. Gotlieb, H. E. Kreyszig, Texture descriptors based on co-occurrence matrices, Comput. Vis. Graph. Image Process., 51 (1990), 70–86. https://doi.org/10.1016/S0734-189X(05)80063-5 doi: 10.1016/S0734-189X(05)80063-5
    [16] M. Topi, O. Timo, P. Matti, S. Maricor, Robust texture classification by subsets of local binary patterns, in Proceedings of the 15th International Conference on Pattern Recognition ICPR-2000, Barcelona, Spain, 3 (2000), 935–938. https://doi.org/10.1109/ICPR.2000.903698
    [17] V. Durgamahanthi, R. Rangaswami, C. Gomathy, A. C. J. Victor, Texture analysis using wavelet-based multiresolution autoregressive model: Application to brain cancer histopathology, J. Med. Imaging Health Inf., 7 (2017), 1188–1195.
    [18] L. D. Jacobson, H. Wechsler, Joint Spatial/Spatial frequency representations, Signal Process., 14 (1988), 37–68. https://doi.org/10.1016/0165-1684(88)90043-6 doi: 10.1016/0165-1684(88)90043-6
    [19] C. S. Lu, P. C. Chung, C. F. Chen, Unsupervised texture segmentation via wavelet transform, Pattern Recognit., 30 (1997), 729–742. https://doi.org/10.1016/S0031-3203(96)00116-1 doi: 10.1016/S0031-3203(96)00116-1
    [20] T. Randen, J. H. Husoy, Filtering for texture classification:A comparative study, IEEE Trans. Pattern Anal. Mach. Intell., 21 (1999), 291–310. https://doi.org/10.1109/34.761261 doi: 10.1109/34.761261
    [21] K. J. Laws, Textured image segmentation, in University of Southern California Los Angeles Image Processing INST, (1980).
    [22] D. A. Clausi, K-means Iterative Fisher (KIF) unsupervised clustering algorithm applied to image texture segmentation, Pattern Recognit., 35 (2002), 1959–1972. https://doi.org/10.1016/S0031-3203(01)00138-8 doi: 10.1016/S0031-3203(01)00138-8
    [23] A. K. Jain, F. Farrokhnia, Unsupervised texture segmentation using Gabor filters, Pattern Recognit., 24 (1991), 1167–1186. https://doi.org/10.1016/0031-3203(91)90143-S doi: 10.1016/0031-3203(91)90143-S
    [24] S. Kinge, B. S. Rani, Mukul Sutaone, A multi-class fisher linear discriminant approach for the improvement in the accuracy of complex texture discrimination, Helix, 9 (2019), 5108–5121. https://doi.org/10.29042/2019-5108-5121 doi: 10.29042/2019-5108-5121
    [25] N. Senin, R. K. Leach, S. Pini, L. A. Blunt, Texture-based segmentation with Gabor filters, wavelet and pyramid decompositions for extracting individual surface features from areal surface topography maps, Meas. Sci. Technol., 26 (2015), 095405. https://doi.org/10.1088/0957-0233/26/9/095405 doi: 10.1088/0957-0233/26/9/095405
    [26] M. Tuceryan, A. K. Jain, Texture Segmentation using voronoi polygons, IEEE Trans. Pattern Anal. Mach. Intell., 12 (1990), 211–216. https://doi.org/10.1109/34.44407 doi: 10.1109/34.44407
    [27] G. Matheron, Random Sets and Integral Geometry, Wiley Publications, New York, (1975).
    [28] H. Deng, D. A. Clausi, Unsupervised image segmentation using a simple MRF model with a new implementation scheme, Pattern Recognit., 37 (2004), 2323–2335. https://doi.org/10.1016/j.patcog.2004.04.015 doi: 10.1016/j.patcog.2004.04.015
    [29] A. K. Qin, D. A. Clausi, Multivariate image segmentation using semantic region growing with adaptive edge penalty, IEEE Trans. Image Process., 19 (2010), 2157–2170. https://doi.org/10.1109/TIP.2010.2045708 doi: 10.1109/TIP.2010.2045708
    [30] Z. Kato, H. T. C. Pong, A Markov random field image segmentation model for color textured images, Image Vision Comput., 24 (2006), 1103–1114. https://doi.org/10.1016/j.imavis.2006.03.005 doi: 10.1016/j.imavis.2006.03.005
    [31] M. Kiechle, M. Storath, A. Weinmann, M. Kleinsteuber, Model-based learning of local image features for unsupervised texture segmentation, IEEE Trans. Image Process., 27 (2018), 1994–2007. https://doi.org/10.1109/TIP.2018.2792904 doi: 10.1109/TIP.2018.2792904
    [32] M. Pereyra, S. McLaughlin, Fast unsupervised Bayesian image segmentation with adaptive spatial regularisation, IEEE Trans. Image Process., 26 (2017), 2577–2587. https://doi.org/10.1109/TIP.2017.2675165 doi: 10.1109/TIP.2017.2675165
    [33] L. Gatys, A. S. Ecker, M. Bethge, Texture synthesis using convolutional neural networks, Adv. Neural Inf. Process. Syst., (2015), 262–270.
    [34] X. Snelgrove, High-resolution multi-scale neural texture synthesis, in SIGGRAPH Asia Technical Briefs, (2017), 1–4. https://doi.org/10.1145/3145749.3149449
    [35] Y. Zhou, Z. Zhu, X. Bai, D. Lischinski, D. Cohen-Or, H. Huang, Non-stationary texture synthesis by adversarial expansion, preprint, arXiv: 1805.04487.
    [36] V. Andrearczyk, P. F. Whelan, Using filter banks in convolutional neural networks for texture classification, Pattern Recognit. Lett., 84 (2016), 63–69. https://doi.org/10.1016/j.patrec.2016.08.016 doi: 10.1016/j.patrec.2016.08.016
    [37] X. Bu, Y. Wu, Z. Gao, Y. Jia, Deep convolutional network with locality and sparsity constraints for texture classification, Pattern Recognit., 91 (2019), 34–46. https://doi.org/10.1016/j.patcog.2019.02.003 doi: 10.1016/j.patcog.2019.02.003
    [38] M. Cimpoi, S. Maji, I. Kokkinos, A. Vedaldi, Deep filter banks for texture recognition, description, and segmentation, Int. J. Comput. Vis., 118 (2016), 65–94. https://doi.org/10.1007/s11263-015-0872-3 doi: 10.1007/s11263-015-0872-3
    [39] U. Dixit, A. Mishra, A. Shukla, R. Tiwari, Texture classification using convolutional neural network optimized with whale optimization algorithm, SN Appl. Sci., 1 (2019). https://doi.org/10.1007/s42452-019-0678-y doi: 10.1007/s42452-019-0678-y
    [40] T. Y. Lin, S. Maji, Visualizing and understanding deep texture representations, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, LasVegas, USA, (2016), 2791–2799.
    [41] L. Liu, J. Chen, G. Zhao, P. Fieguth, X. Chen, M. Pietikä inen, Texture classification in extreme scale variations using GANet, IEEE Trans. Image Process., 28 (2019), 3910–3922. https://doi.org/10.1109/TIP.2019.2903300 doi: 10.1109/TIP.2019.2903300
    [42] A. Shahriari, Parametric learning of texture filters by stacked fisher autoencoders, in Proceedings of the 2016 International Conference on Digital Image Computing: Technique and Applications (DICTA), Gold Coast, Australia, (2016), 1–8.
    [43] Y. Song, F. Zhang, Q. Li, H. Huang, L. J. O'Donnell, W. Cai, Locally-transferred fisher vectors for texture classification, in Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, (2017), 4912–4920.
    [44] H. Zhang, J. Xue, K. Dana, Deep ten: Texture encoding network, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, (2017), 708–717.
    [45] V. Andrearczyk, P. F. Whelan, Texture segmentation with fully convolutional networks, preprint, arXiv: 1703.05230.
    [46] C. Karabag, J. Verhoeven, N. Miller, C. Reyes-Aldasoro, Texture segmentation: an objective comparison between five traditional algorithms and a deep-learning U-Net architecture, Appl. Sci., 9 (2019), 3900. https://doi.org/10.3390/app9183900 doi: 10.3390/app9183900
    [47] Y. Huang, F. Zhou, J. Gilles, Empirical curvelet based fully convolutional network for supervised texture image segmentation, Neurocomputing, 349 (2019), 31–43. https://doi.org/10.1016/j.neucom.2019.04.021 doi: 10.1016/j.neucom.2019.04.021
    [48] R. Yamada, H. Ide, N. Yudistira, T. Kurita, Texture segmentation using Siamese network and hierarchical region merging, in Proceedings of the 2018 24th International Conference on Pattern Recognition (ICPR), Beijing, China, (2018), 2735–2740. https://doi.org/10.1109/ICPR.2018.8545348
    [49] S. Mikes, M. Haindl, Texture segmentation benchmark, IEEE Trans. Pattern Anal. Mach. Intell., 41 (2021), 1–16. https://doi.org/10.1109/TPAMI.2021.3075916 doi: 10.1109/TPAMI.2021.3075916
    [50] A. Awad, Denoising images corrupted with impulse, Gaussian, or a mixture of impulse and Gaussian noise, Eng. Sci. Technol. Int. J., 22 (2019), 746–753. https://doi.org/10.1016/j.jestch.2019.01.012 doi: 10.1016/j.jestch.2019.01.012
    [51] R. C. Gonzalez, R. E. Woods, Digital Image Processing, Third Edition Pearson Education, 2009.
    [52] S. Walid, B. Xi, A neighborhood regression approach for removing multiple types of noises, EURASIP J. Image Video Process., 2018 (2018). https://doi.org/10.1186/s13640-018-0259-9
    [53] M. Alkhatib, A. Hafiane, Robust adaptive median binary pattern for noisy texture classification and retrieval, IEEE Trans. Image Process., 28 (2019), 5407–5418. https://doi.org/10.1109/TIP.2019.2916742 doi: 10.1109/TIP.2019.2916742
    [54] S. Dash, M. R. Senapati, Noise robust Law's filters based on fuzzy filters for texture classification, Egypt. Inf. J., 21 (2020), 37–49. https://doi.org/10.1016/j.eij.2019.10.003 doi: 10.1016/j.eij.2019.10.003
    [55] C. Vacar, J. Giovannelli, Unsupervised joint deconvolution and segmentation method for textured images:a Bayesian approach and an advanced sampling algorithm, EURASIP J. Image Video Process., 2019 (2019), 1–17. https://doi.org/10.1186/s13634-018-0597-x doi: 10.1186/s13634-018-0597-x
    [56] H. A. Nugroho, E. L. Frannita, I. Ardiyanto, L. Choridah, Computer aided diagnosis for thyroid cancer system based on internal and external characteristics, J. King Saud Univ. Comput. Inf. Sci., 33 (2021), 329–339. https://doi.org/10.1016/j.jksuci.2019.01.007 doi: 10.1016/j.jksuci.2019.01.007
    [57] A. Bhargava, A. Bansal, Fruits and vegetables quality evaluation using computer vision: A review, J. King Saud Univ. Comput. Inf. Sci., 33 (2021), 243–257. https://doi.org/10.1016/j.jksuci.2018.06.002 doi: 10.1016/j.jksuci.2018.06.002
    [58] S. Hossain, S. Serikawa, Texture databases—A comprehensive survey, Pattern Recognit. Lett., 34 (2013), 2007–2022. https://doi.org/10.1016/j.patrec.2013.02.009 doi: 10.1016/j.patrec.2013.02.009
    [59] K. Dabov, A. Foi, V. Katkovnik, K. Egiazarian, Color image denoising via sparse 3D collaborative filtering with grouping constraint in luminance-chrominance space, in Proceeding of IEEE International Conference on Image Processing, (2007), 313–316. https://doi.org/10.1109/ICIP.2007.4378954
    [60] K. Dabov, A. Foi, V. Katkovnik, K. Egiazarian, Image denoising by sparse 3D transform-domain collaborative filtering, IEEE Trans. Image process., 16 (2007), 2080–2095. https://doi.org/10.1109/TIP.2007.901238 doi: 10.1109/TIP.2007.901238
    [61] L. Fan, Z. Fan, H. Fan, C. Zhang, Brief review of image denoising techniques, Visual Comput. Ind., Biomed., Art, 2 (2019), 1–12. https://doi.org/10.1186/s42492-019-0016-7 doi: 10.1186/s42492-019-0016-7
    [62] S. Kinge, B. S. Rani, Mukul sutaone, quantitative restoration of noisy colour texture segmentation benchmark images using state-of-the-art algorithm, in 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS), IEEE, (2020), 37–42. https://doi.org/10.1109/ICICCS48265.2020.9120927
    [63] R. R. Nair, E. David, S. Rajagopal, A robust anisotropic diffusion filter with low arithmetic complexity for images, EURASIP J. Image Video Process., 2019 (2019), 1–14. https://doi.org/10.1186/s13640-019-0444-5 doi: 10.1186/s13640-019-0444-5
    [64] D. Tourtounis, N. Mitianoudis, G. C. Sirakoulis, Salt-n-pepper noise filtering using cellular automata, preprint, arXiv: 1708.05019.
    [65] Z. Haliche, K. Hammouche, O. Losson, L. Macaire, Fuzzy color aura matrices for texture image segmentation, J. Imaging, 8 (2022), 1–20. https://doi.org/10.3390/jimaging8090244 doi: 10.3390/jimaging8090244
    [66] C. Bontozoglou, P. Xiao, Applications of capacitive imaging in human skin texture and hair analysis, Appl. Sci., 10 (2020), 256. https://doi.org/10.3390/app10010256 doi: 10.3390/app10010256
    [67] Y. Liu, K. Xu, J. Xu, An improved MB-LBP defect recognition approach for the surface of steel plates, Appl. Sci., 9 (2020), 4222. https://doi.org/10.3390/app9204222 doi: 10.3390/app9204222
    [68] Z. Jeelani, F. Qadir, Cellular automata-based approach for salt-and-pepper noise filtration, J. King Saud Univ. Comput. Inf. Sci., 2018 (2018). https://doi.org/10.1016/j.jksuci.2018.12.006
    [69] S. Z. Li, Markov Random Field Modeling in Image Analysis, 2nd edition, Springer-Verlag, New York, 2009.
    [70] Z. Wang, A. C. Bovik, H. R. Sheikh, E. P. Simoncelli, Image quality assessment: From error visibility to structural similarity, IEEE Trans. Image Process., 13 (2004), 600–612. https://doi.org/10.1109/TIP.2003.819861 doi: 10.1109/TIP.2003.819861
    [71] A. Hoover, G. J. Baptiste, X. Jiang, P. J. Flynn, H. Bunke, D. B. Goldgof, et al., An experimental comparison of range image segmentation algorithms, IEEE Trans. Pattern Anal. Mach. Intell., 18 (1996), 673–689. https://doi.org/10.1109/34.506791 doi: 10.1109/34.506791
    [72] Z. Hu, Z. Wu, Q. Zhang, Q. Fan, J. Xu, A spatially-constrained color-texture model for hierarchical VHR image segmentation, IEEE Geosci. Remote Sens. Lett., 10 (2013), 120–124. https://doi.org/10.1109/LGRS.2012.2194693 doi: 10.1109/LGRS.2012.2194693
    [73] S. Sangwine, R. Horne, The Colour Image Processing Handbook, Chapman and Hall, 1998.
  • This article has been cited by:

    1. Xiaoye Zhao, Yinglan Gong, Jucheng Zhang, Haipeng Liu, Tianhai Huang, Haicheng Wei, Ling Xia, Jiandong Mao, Prognostic significance of global electrical heterogeneity (GEH) parameters between coronary microvascular dysfunction (CMD) and obstructive coronary artery disease (OCAD): a retrospective cohort study, 2025, 100, 17468094, 106952, 10.1016/j.bspc.2024.106952
    2. Xiaoye Zhao, Yinglan Gong, Jucheng Zhang, Haipeng Liu, Tianhai Huang, Jun Jiang, Ling Xia, Jiandong Mao, 2024, A Multiplayer Perceptron Algorithm Based on Global Electrical Heterogeneity and Cardiodynamicsgram for Non-Invasive Detection of Coronary Microvascular Dysfunction, 979-8-3503-5359-4, 504, 10.1109/EEI63073.2024.10696636
    3. Visweswar Sirish Parupudi, Amit Kumar Panda, Rajesh Kumar Tripathy, A Smartphone-Enabled Deep Learning Approach for Myocardial Infarction Detection Using ECG Traces for IoT-Based Healthcare Applications, 2023, 7, 2475-1472, 1, 10.1109/LSENS.2023.3328593
    4. Yun Tang, Xuan Ma, Zhixiang Dong, Xingrui Chen, Shujuan Yang, Xiuyu Chen, Kai Yang, Shihua Zhao, Cardiac Magnetic Resonance Visualization of the Myocardial Microstructure in Non-Ischemic Cardiomyopathies, 2024, 9, 2009-8618, 10.15212/CVIA.2024.0042
  • Reader Comments
  • © 2023 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(1924) PDF downloads(125) Cited by(1)

Figures and Tables

Figures(14)  /  Tables(5)

Other Articles By Authors

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog