Dynamic graph Conv-LSTM model with dynamic positional encoding for the large-scale traveling salesman problem

Yang Wang; Zhibin Chen; Yang Wang; Zhibin Chen

doi:10.3934/mbe.2022452

Mathematical Biosciences and Engineering

2022, Volume 19, Issue 10: 9730-9748. doi: 10.3934/mbe.2022452

Previous Article Next Article

Research article

Dynamic graph Conv-LSTM model with dynamic positional encoding for the large-scale traveling salesman problem

Yang Wang ,
Zhibin Chen ^,

Department of Mathematics, Kunming University of Science and Technology, Kunming 650093, China

Academic Editor: Runzhang Xu

Received: 19 May 2022 Revised: 20 June 2022 Accepted: 23 June 2022 Published: 04 July 2022

Recent research has showen that deep reinforcement learning (DRL) can be used to design better heuristics for the traveling salesman problem (TSP) on the small scale, but does not do well when generalized to large instances. In order to improve the generalization ability of the model when the nodes change from small to large, we propose a dynamic graph Conv-LSTM model (DGCM) to the solve large-scale TSP. The noted feature of our model is the use of a dynamic encoder-decoder architecture and a convolution long short-term memory network, which enable the model to capture the topological structure of the graph dynamically, as well as the potential relationships between nodes. In addition, we propose a dynamic positional encoding layer in the DGCM, which can improve the quality of solutions by providing more location information. The experimental results show that the performance of the DGCM on the large-scale TSP surpasses the state-of-the-art DRL-based methods and yields good performance when generalized to real-world datasets. Moreover, our model compares favorably to heuristic algorithms and professional solvers in terms of computational time.

Keywords:

Citation: Yang Wang, Zhibin Chen. Dynamic graph Conv-LSTM model with dynamic positional encoding for the large-scale traveling salesman problem[J]. Mathematical Biosciences and Engineering, 2022, 19(10): 9730-9748. doi: 10.3934/mbe.2022452

Related Papers:

[1]	Abhishek Mallick, Atanu Mondal, Somnath Bhattacharjee, Arijit Roy . Application of nature inspired optimization algorithms in bioimpedance spectroscopy: simulation and experiment. AIMS Biophysics, 2023, 10(2): 132-172. doi: 10.3934/biophy.2023010
[2]	Arijit Roy, Abhishek Mallick, Surajit Das, Abhijit Aich . An experimental method of bioimpedance measurement and analysis for discriminating tissues of fruit or vegetable. AIMS Biophysics, 2020, 7(1): 41-53. doi: 10.3934/biophy.2020004
[3]	Svetlana Kashina, Andrea Monserrat del Rayo Cervantes-Guerrero, Francisco Miguel Vargas-Luna, Gonzalo Paez, Jose Marco Balleza-Ordaz . Tissue-specific bioimpedance changes induced by graphene oxide ex vivo: a step toward contrast media development. AIMS Biophysics, 2025, 12(1): 54-68. doi: 10.3934/biophy.2025005
[4]	Tomasz Rok, Artur Kacprzyk, Eugeniusz Rokita, Dorota Kantor, Grzegorz Tatoń . Quantitative assessment of thermal effects on the auricle region caused by mobile phones operating in different modes. AIMS Biophysics, 2024, 11(4): 427-444. doi: 10.3934/biophy.2024023
[5]	Takayuki Yoshida, Hiroyuki Kojima . Subcutaneous sustained-release drug delivery system for antibodies and proteins. AIMS Biophysics, 2025, 12(1): 69-100. doi: 10.3934/biophy.2025006
[6]	Riyaz A. Mir, Jeff Lovelace, Nicholas P. Schafer, Peter D. Simone, Admir Kellezi, Carol Kolar, Gaelle Spagnol, Paul L. Sorgen, Hamid Band, Vimla Band, Gloria E. O. Borgstahl . Biophysical characterization and modeling of human Ecdysoneless (ECD) protein supports a scaffolding function. AIMS Biophysics, 2016, 3(1): 195-210. doi: 10.3934/biophy.2016.1.195
[7]	Neelabh Datta . A review of molecular biology detection methods for human adenovirus. AIMS Biophysics, 2023, 10(1): 95-120. doi: 10.3934/biophy.2023008
[8]	Min Zhang, Shijun Lin, Wendi Xiao, Danhua Chen, Dongxia Yang, Youming Zhang . Applications of single-cell sequencing for human lung cancer: the progress and the future perspective. AIMS Biophysics, 2017, 4(2): 210-221. doi: 10.3934/biophy.2017.2.210
[9]	Mohamed A. Elblbesy . The refractive index of human blood measured at the visible spectral region by single-fiber reflectance spectroscopy. AIMS Biophysics, 2021, 8(1): 57-65. doi: 10.3934/biophy.2021004
[10]	Shivakumar Keerthikumar . A catalogue of human secreted proteins and its implications. AIMS Biophysics, 2016, 3(4): 563-570. doi: 10.3934/biophy.2016.4.563

Abstract

1. Introduction

The prime interest of measuring bioimpedance is to assess the physiological condition of the biological body under question. In the field of electrical bioimpedance measurement, the Cole impedance model [1] is widely used in the characterization of biological tissue. Due to the tremendous applicability of bioimpedance in medical sciences, bioimpedance measurement remains an attractive area of research in the past couple of decades. Research on biological bodies using Cole model includes: assessment of human body composition [2],[3], estimation of the thickness of human skin [4], monitoring of thoracic fluid content [4], characterization of breast and prostate cancer [5],[6], characterization of liver tissue [7], assessment of muscle injury and porcine spleen tissue [8],[9] etc. and many more which can be found in recently published review articles [10]–[13].

In Cole model, a lump tissue is represented by its equivalent circuit and is studied as a single dispersion material in the frequency domain. Cole model is basically a modified Debye model by the replacement of an ideal capacitor with a more general Constant Phase Element (CPE) and Cole model provides better fitting to the experimental data, especially for biological tissue. Therefore, for effective characterization of skin [14], we have considered Cole bioimpedance model in this work.

On the other hand, the effect of moisturizing cream on human skin is studied from various perspectives, such as effectiveness, improvement of skin barrier and its repair, maintaining the integrity and appearance of skin by acting as occlusive, emollients and humectants, each with its own mechanism of actions [15]. Basically, the function of a moisturizer is to improve hydration and water content of the stratum corneum. By moisturizing the skin, a cover of small skin fissures is formed which provides a soothing protection film and protects the skin from friction. Skin care products such as a moisturizing cream do not stay inactive on the upper layer of the skin, instead it penetrates the upper layer and reaches the underlying layer thereby influencing the structure of the skin and its function [16]. In the market, different kinds (difference in chemical composition) of skin moisturizers are available. Similarly, as there are differences among the variety of skin types, a certain structure of a given activity may be ideal for one skin but unsuitable for another [17]. Electrical susceptance-based measurement on human skin is also studied to obtain the effect of moisturizer cream [18]. These studies are clinical in nature and are neither cost effective nor time efficient. Therefore, bioimpedance appeals as a promising tool for characterizing the effect of moisturizing cream on human skin. To apply bioimpedance as a characterization tool for human skin, it is essential that it should be capable to distinguish treated and untreated types of skin. The method of bioimpedance with the discrimination capability of living tissue using Cole bioimpedance model is an established method [1] and recently this discrimination method for biological tissues is described by Roy et al. [19]. Similar procedure of discrimination capability is indeed necessary to study the bioimpedance of human skin and such a procedure is presented in this paper.

The effect of moisturizing cream on the human skin by means of non-invasive bioimpedance measurement is studied here. A novel electrode-pair is fabricated and an LCR meter is used to measure the bioimpedance as a function of frequency. The discrimination capability of our measurement process to distinguish various skins is verified through experiments. The bioimpedance is measured for before treatment, during treatment and post-treatment period of skin. From these measurements, the Cole parameters are extracted and the relaxation-time of the tissues under investigation is estimated. Moisturizing cream is applied on the skin of a particular area with the dosage of twice a day for 22 days and the measurement is conducted at regular intervals. After 22 days, the application of cream is stopped but the measurement is continued to see the changes in relaxation-time. In addition to this, measurement on skin at untreated area is also performed for comparison. Two different types of moisturizing cream with study duration of 47 days are considered. Skin of both male and female are considered in this study.

2. Theory and model

In this work, human skin is modeled according to Cole bioimpedance model. The model and its equivalent circuit are schematically shown in Figure 1. Basically, Cole model considers the tissue under investigation as a dielectric material and provides an equivalent electrical circuit of that dielectric material. To characterize a particular tissue using the Cole model, it is essential to determine the four parameters, namely: R₀, R_∞, C, and α (see Figure 1 for details). These parameters are not dimension independent. Therefore, each of these parameters is expected to vary depending on various parameters of the measurement method. For example, variation in R₀ is obvious if the length of the tissue (gap between the electrodes) changes. This simply shows that uniqueness in the measurement process is desirable. A high degree of repeatability in measuring these parameters is required. The relaxation-time (τ) is a fundamental property of dielectric material and the Cole model also enables us to estimate the relaxation-time in terms of these four parameters. When an identical process of measurement is imposed to estimate the four Cole parameters, a slight variation in fixing the electrode would result in variability in these parameters and these variabilities cancel out in such a way that τ remains invariant. This is indeed found true experimentally [19]. To extract R₀ and R_∞, the tissue impedance is measured by the LCR meter. The other two parameters (namely C and α) are determined by fitting the experimental data with the theoretical Cole impedance model [19].

The Cole bioimpedance is given by [19],

$Z = R_{\infty} + \frac{(R_{0} - R_{\infty})}{1 + {(jωτ)}^{α}}$ (1)

Let, $j^{α} = (j \sin \frac{απ}{2} + \cos \frac{απ}{2})$

Therefore, $Z = R_{\infty} + \frac{(R_{0} - R_{\infty})}{1 + ω^{α} τ^{α} (j \sin \frac{απ}{2} + \cos \frac{απ}{2})}$

Or, $Z = R_{\infty} + \frac{(R_{0} - R_{\infty})}{(1 + ω^{α} τ^{α} \cos \frac{απ}{2}) + j (ω^{α} τ^{α} \sin \frac{απ}{2})}$

Finally,

$| Z | = \sqrt{{(R_{\infty} + \frac{(R_{0} - R_{\infty}) (1 + ω^{α} τ^{α} \cos \frac{απ}{2})}{{(1 + ω^{α} τ^{α} \cos \frac{απ}{2})}^{2} + {(ω^{α} τ^{α} \sin \frac{απ}{2})}^{2}})}^{2} + {(\frac{(R_{0} - R_{\infty}) (ω^{α} τ^{α} \sin \frac{απ}{2})}{{(1 + ω^{α} τ^{α} \cos \frac{απ}{2})}^{2} + {(ω^{α} τ^{α} \sin \frac{απ}{2})}^{2}})}^{2}}$ (2)

The expression for the relaxation-time is given by,

$τ = ([(R_{0} - R_{\infty}) C]^{1 / α})$ (3)

Where, Z = Complex impedance

R₀ = Resistance at very low frequency

R_∞ = Resistance at very high frequency

α = A dimensionless exponent (0 < α < 1 for biological tissue)

τ = Relaxation-time

ω = Angular frequency

C = Capacitance of skin tissue

Experimentally |Z| is measured as a function of frequency in the range of 1 Hz to 5 kHz. The parameters R₀ and R_∞ are the measured impedance of the tissue under investigation at the lowest frequency (1 Hz here) and at the highest frequency (5 kHz) respectively [19]. The other two parameters (namely C and α) are determined by fitting the experimental data with the theoretical Cole impedance expressed by Equation 2 [19].

The dielectric property of human skin depends on various factors which include its physical and chemical characteristics, the composition of intra- and extra-cellular fluids [20], psychological condition and physiological changes occurring in the subject and the condition of health or disease of the skin. When suitable parameters are chosen, a great amount of information can be obtained for Dermatological and Cosmetological purposes from dielectrics or bioimpedance measurements.

Figure 1. Schematic of human skin and its equivalent electrical circuit known as Cole bioimpedance model..

DownLoad: Full-Size Img PowerPoint

The skin impedance variation is quite complex and depends on a variety of factors. First of all, Galvanic Skin Reflex (GSR) [21] plays a significant role in the determination of skin impedance. GSR is the sudden variations of skin impedance due to internal or psychological factors. Secondly, we have noticed that for a calmly seated person who suffers no pain or stress, the value of impedance remains fairly the same and can be assessed for physiological purposes. Nevertheless, statistical analysis of bioimpedance data is essential to understand the actual variation if any with certainty. In order to improve the effectiveness of measurement, both the separation between the electrodes and the electrode width (contact area) are to be kept small compared to the thickness of the stratum corneum [22].

3. Experimental protocol

3.1. Electrode setup

Choice of material for the electrodes and the shape of the electrodes are important factors in bioimpedance measurement, because the success of the investigation is highly dependent on these factors. Various electrode configurations are being used in the measurement of bioimpedance. Among the two-, three-, four- and five-electrode configurations, the two-electrode configuration is more attractive because of its simplicity and effectiveness [19],[23].

Human skin near the wrist is investigated in this study. A pair of electrodes is fabricated, then attached to a holder and then the holder is stitched to a glove. The electrode-pair system with the glove is shown in Figure 2. The electrode holder is made of a piece of PCB (2.3 cm × 1.0 cm × 0.1 cm in dimension) stitched to the gloves by using micro-screws. The screws (2.5 mm × 1.4 mm × 8.0 mm in dimension and are made of stainless steel) which are used to tighten the PCB to the gloves also serve as electrodes. The distance between the electrodes is 0.7 mm, which is much greater than 100 µm and because of this difference, more subtle changes are easily accessible in the deeper sections of the stratum corneum [24],[25]. When the hand is placed into the glove and its belt is strapped, the head of the screws are pressed on the skin near the wrist.

Figure 2. Schematic representation of the two-electrode circuit (left) and electrode setup used in bioimpedance measurement (right)..

DownLoad: Full-Size Img PowerPoint

The gloves have a pre-curved form fit design with palm grip for a stable fit on the hand. The glove comes with a cuff wrist strap with hook-and-loop wrist closure for a secure fit. The tail portion of the screws are connected to LCR meter through ordinary multi strand wire.

3.2. Instruments and materials

Electrical impedance is measured using a 1 MHz precision LCR meter (Model: 8101G, GWINSTEK). Before any measurements, the LCR meter is calibrated by the usual open- and short-circuit method. Calibration eliminates stray capacitance and series impedance from the testing fixture. Each time, before measurement, the electrode-pair is cleaned by medicated spirit and dried properly. The meter is set to 2 V ac and frequency sweep from 1 Hz to 5 kHz with a total of 200 steps. The meter is controlled by a PC using dedicated software through an RS-232C serial port. The measured data is transferred to the PC for further analysis. The entire bioimpedance measurement system is shown in Figure 3. After each measurement, the strap of the glove containing the electrode-pair is released and after one minute, the strap is tightened again to repeat the measurement. In this way, the measurement is repeated five times. There is a possibility of slight change in position of electrode-pair in repeating the measurement. This factor may cause a variation in the measured parameters. To reduce this effect, each time five measurement is conducted and using ANOVA, it is found that the variation of estimated relaxation-time due to this factor is negligible. Therefore, average relaxation-time from five replicas is considered for subsequent ANOVA procedures.

Two varieties of cream are used in this investigation. The Cream-1 used is a refreshing soft cream with jojoba oil and vitamin E for invigorated and smooth skin. According to the manufacturer, it provides substantial moisturization. It also contains denatured alcohol which has a drying effect on the skin. The Cream-2 used is a herbal cream. The manufacturer of this cream claims that the cream is made from multiple fruit extracts that act as quality elements to achieve smoother, brighter and well-protected skin. It is enriched with rare fruit and potent plant extracts that penetrate deep into the skin to provide enduring action. It results in fairer, flawless and radiant skin. It is free from harsh chemicals that generally does not have side effects. The ingredients of these two creams are listed in Table 1. Both the moisturizing creams are commercial products and are purchased from the local market.

Table 1. Data of the ingredients of the creams used in the experiment.

Cream Number	Ingredients
Cream-1	Water, Myristyl Alcohol, Mineral Oil, Glycerin, Butylene Glycol, Alcohol Denatured, Stearic Acid, Petrolatum, Myristyl Myristate, Glyceryl Stearate, Hydrogenated Coco Glycerides, Di methicone, Simmondsia Chinensis Seed Oil, Tocopheryl Acetate, Polyglyceryl 2 Caprate, Phenoxyethanol, Lanolin Alcohol, Fragrance, Carbomer, Sodium Hydroxide, Cetyl Phosphate, Methylparaben, Ethylparaben, Propylparaben, Butylparaben and Isobutylparaben.
Cream-2	Water, Almond Oil, Octyl Methoxy Cinnamate, Glyceryl Mono Hydroxy Stearate, Triticum Vulgare (Wheat Germ) oil, Light Liquid Paraffin, Butyl Methoxydibenzoylmethane, Arctostaphylos Uva-Ursi (Bearberry) Extract, Camellia Sinensis (Green Tea) Extract, Lactic Acid, Glycerin, Stearic Acid, Milk Enzymes, Sodium Lactate, Propylene Glycol, Titanium Dioxide, Ceto Stearyl Alcohol, Cetyl Alcohol, Triethanolamine, Triter Penoids, Phenyl Flavones (Mulberry) Extract, Epigallocathechin (Saxifraga) Extract, Vitis Vinifera (Grape) Extract, 2-Phenoxyethanol, Tocopheryl Acetate, Methyl Paraben, Alpha-Arbutin, Fragrance.

Remarks: All the above data are claimed by the manufacturer.

| Show Table

DownLoad: CSV

Figure 3. Schematic representation of the measurement setup..

DownLoad: Full-Size Img PowerPoint

A total of three volunteers are considered for this study, which includes two males and one female, ageing 22 (mean) years. In this report, we label the two male volunteers as M1 (weight = 81 kg; height = 180 cm) and M2 (weight = 70 kg; height = 177.8 cm), whereas the female volunteer is labelled as F (weight = 60.5 kg; height = 157.48 cm). It is to be noted here that this kind of experiment tends to divert from the desired outcome if the experiment is not conducted in a controlled environment [21]. As a preventive measure to this issue, we have conducted all the measurements in an air-conditioned room with fixed temperature (at 25 °C) and humidity (around 63%–64%).

The cream is applied twice a day (once at 9 am and again at 9 pm), every day for 22 days near the wrist of the right arm (treated wrist). Personal care products which include shampoo, soaps or any other beauty products are not used by the volunteers till the last day of this study. In case of Cream-1, bioimpedance is measured six times during the treatment period and seven times during the post-treatment period. The measurement matrix for Cream-1 is schematically shown in Figure 4.

Figure 4. Period of application and measurement matrix for Cream-1..

DownLoad: Full-Size Img PowerPoint

Similar to Cream-1, the effect of Cream-2 is also investigated. The study matrix for Cream-2 is shown in Figure 5. In order to understand the effect of the application of the moisturizing cream on the skin, whenever bioimpedance is measured for the treated wrist, measurement is also conducted for the untreated wrist.

Figure 5. Period of application and measurement matrix for Cream-2..

DownLoad: Full-Size Img PowerPoint

The impedance as a function of frequency is measured for the skin near the wrist in the range of 1 Hz-5 kHz. For a particular measurement, R₀ and R_∞ are taken along with the measured impedance at 1 Hz and 5 kHz respectively [19]. The other two parameters i.e. C and α are extracted from the fitting of experimental data.

The Cole impedance parameters are usually extracted by using the direct method which has its own limitations [26]. In fact, the lower and higher frequency gain measurements used for fitting affect the accuracy of the direct method. Nonlinear least-square fit (NLSF) is used to overcome the limitations of direct method [27]. In NLSF, every datapoint is used for optimization in order to extract the parameters for the best fit. In order to fit the experimental data with Equation 2, NLSF is performed using commercial software package MS-Excel 2016 version. From the curve fitting, the other two parameters i.e. C and α are determined. In this way, all the Cole parameters are experimentally measured. The relaxation-time, τ is then estimated using Equation 3. The entire measurement is then repeated four times and thus in this study, each measurement contains five repetitions. Analysis of variance (ANOVA) is performed on the average value of τ using the same software package. More specifically, two-factor ANOVA without replication is a data analysis tool which is extensively used to check if there is any significant difference in the parameters of a given set of data.

Typical measured impedance data as a function of frequency is fitted with Equation 2 and is shown in Figure 6. Here the curve shows the data for Day-0 (before treatment of Cream-1) to Day-22 (treatment period of Cream-1). This experimental data justifies the suitability of adopting the Cole impedance model to describe the frequency-dependent behavior of skin tissues.

In this study, the frequency dependent impedance is measured 250 times for each volunteer. Therefore, a total of 750 measurement is conducted. Each measurement contains 200 data points. Here, a large number of data is analyzed by using ANOVA to obtain experimental results.

Figure 6. Measured impedance is fitted as a function of frequency (for M2)..

DownLoad: Full-Size Img PowerPoint

4. Results and discussion

The moisturizing cream is applied on the upper layer of the skin known as stratum corneum. Stratum corneum is composed of dead cells called keratinocytes. The three main functions of the stratum corneum are to defend against dehydration, toxins and bacteria. The main function of a moisturizer is to prevent the skin from drying out and to hold moisture inside the skin. The electrical parameters of biological tissues [20],[22] are partially related to the water content in them. Thus, change in the water content in the tissue results in a little change in its electrical parameters. However, with the advancement of measurement equipment, little change in the electrical parameters that yields due to the change in moisture content in tissues can be captured. It is observed that as the moisture level increases, the cell size [11] increases correspondingly which implies that a longer path is to be traversed by the charged particles (ions), so there is a gross increase in impedance of the skin [28]. Conversely, the water content increases the relaxation-time τ.

The variation of relaxation-time as a function of time (in the unit of days) for all the three volunteers and for both the creams is shown in Figure 7. From this figure, it is observed that at Day-0 (before treatment), the relaxation-time is minimum, then it increases sharply during the application period of the cream and decreases during the period when the application of cream is stopped. In order to understand the effect of a cream, say Cream-1 on an individual volunteer, the finer details are shown in Figures 8, 9 and 10. In these figures, the mean of each dataset is used to construct the respective curves. Note that the variation of relaxation-time is very similar for all the three volunteers. The nature of variation of relaxation-time is found to be very similar to that of skin susceptance [18].

Figure 7. Variation of τ with the days of the experiment for all volunteers..

DownLoad: Full-Size Img PowerPoint

Figure 8. Boxplot of relaxation-time throughout the experiment (for Cream-1)..

DownLoad: Full-Size Img PowerPoint

Figure 9. Boxplot of relaxation-time throughout the experiment (for Cream-1)..

DownLoad: Full-Size Img PowerPoint

Figure 10. Boxplot of relaxation-time throughout the experiment (for Cream-1)..

DownLoad: Full-Size Img PowerPoint

In order to find the effectiveness of the creams, the variation of relaxation-time for treated and untreated skin for each moisturizing cream are shown in Figures 11, 12 and 13 for the three volunteers. It can be seen that Cream-2 is more effective than the Cream-1 as the relaxation-time is higher for Cream-2 for all the volunteers. Further, Cream-1 takes time more time than Cream-2 in the increment of relaxation-time, or in other words, Cream-2 is more effective in moisturization than Cream-1. After the treatment period, the relaxation-time drops and Cream-2 takes longer time than Cream-1 in the decrement of relaxation-time. Thus, Cream-2 is more effective as a moisturizer. Note that the relaxation-time for untreated skin remains almost constant. On treating the skin by a moisturizing cream, the relaxation-time of the skin can be increased to as high as 7 times.

Figure 11. Variation of τ with respect to time for Volunteer-M1..

DownLoad: Full-Size Img PowerPoint

Figure 12. Variation of τ with respect to time for Volunteer-F..

DownLoad: Full-Size Img PowerPoint

Figure 13. Variation of τ with respect to time for Volunteer-M2..

DownLoad: Full-Size Img PowerPoint

The ANOVA analysis (based on τ) before starting the treatment is shown in Table 2. From the Table 2, it is observed that the value of F_critical is greater than the value of F. Thus, we can conclude that the volunteers are indistinguishable and hence the skin of every volunteer cannot be identified statistically.

Table 2. ANOVA results before the treatment period of cream.

Case	F value	F_critical value	P value	Conclusion
Case-1 (M1 vs F)	0.13303787	7.70864742	0.73376864	Indistinguishable
Case-2 (F vs M2)	1.00507646	7.70864742	0.372814	Indistinguishable
Case-3 (M1 vs M2)	0.08096312	7.70864742	0.79011956	Indistinguishable

| Show Table

DownLoad: CSV

In order to understand the effect of moisturizing cream on the skin, ANOVA is performed extensively for the data obtained throughout the experiment. From ANOVA, we also can determine the gender distinguishability for a given cream with a certain level of confidence. The changes in human skin with the treatment of the above moisturizer is clearly visible as shown in Figures 11, 12 and 13. Table 3 shows the ANOVA results of Day-7 vs Day-22 for each volunteer. From Table 3, it can be seen that the skin of individual volunteer is distinguishable at a confidence level of 95% or more. Table 4 shows ANOVA considering gender as a factor. From this table, it can be seen that gender is distinguishable during the treatment period while the same was indistinguishable before the treatment of the skin (see Table 2). This fact clearly indicates that the degree of changes in the skin due to the moisturizing cream is different for male and female. Table 3 depicts the gender distinguishability during the treatment period of Cream-1. It shows that the Day-7 vs Day-22 skin for female volunteer is distinguishable at confidence level more than 95% while the same the for male volunteers is more than 99%. This fact indicates that the Cream-1 is more effective for male during Day-7 to Day-22. When the effectiveness of Cream-2 is tested in a similar manner, it is found that Cream-2 is more effective for female.

Table 3. ANOVA results for the treatment period of the Cream-1.

Period	Volunteer	F value	F_critical value	P value	Conclusion	Confidence Level
Application Period	Volunteer-M1 (Day-7 vs Day-22)	27.7221976	25.9735903	0.00623248	Distinguishable	99.3%
	Volunteer-F (Day-7 vs Day-22)	8.25093556	8.17090943	0.0453568	Distinguishable	95.4%
	Volunteer-M2 (Day-7 vs Day-22)	49.2440205	41.4072734	0.00217182	Distinguishable	99.7%

| Show Table

DownLoad: CSV

The ANOVA result for gender sensitivity is shown in Table 4. From the Table 4, it is observed that F value is greater than the value of F_critical. Therefore, the volunteers of different gender are distinguishable statistically and hence the effect of moisturizing cream is clearly visible. On the other hand, volunteers of same gender are not distinguishable in treatment period. These facts clearly indicate that the effect of treatment is gender sensitive.

Table 4. ANOVA results of the application period of the Cream-1 for different genders.

Case	F value	F_critical value	P value	Conclusion	Confidence Level
Case-1 (M1 vs F)	1.56176403	1.55824737	0.27953649	Distinguishable	72.0%
Case-2 (F vs M2)	4.20154543	4.1923271	0.1097193	Distinguishable	89.0%
Case-3 (M1 vs M2)	2.01251907	2.01834673	0.52844496	Indistinguishable	-

| Show Table

DownLoad: CSV

Post-treatment ANOVA is also performed and that for Cream-1 is shown in Table 5. From Table 5, it is observed that F value is greater than the value of F_critical and p value is less than the value of α (this α should not be confused with the Cole parameter designated by α) in statistical analysis. Thus, we can state that the volunteers are distinguishable. So, the effect of moisturizing cream on different gender in the post-treatment period too.

Table 5. ANOVA results of the Cream-1 after stopping its use.

Period	Volunteer	F value	F_critical value	P value	Conclusion	Level of Confidence
Decay Period	Volunteer-M1 (Day-24 vs Day-45)	8.99191252	8.99116941	0.03999511	Distinguishable	96%
	Volunteer-F (Day-24 vs Day-45)	10.5203056	10.427692	0.03156914	Distinguishable	96.8%
	Volunteer-M2 (Day-24 vs Day-45)	8.17493833	8.1790943	0.04596729	Distinguishable	95.4%

| Show Table

DownLoad: CSV

Among the four Cole parameters, interestingly, significant variation of skin impedance at low frequencies as an effect of moisturizing cream is noticed. The skin impedance at very low frequency (1 Hz in our study) increases rapidly [29] with the application of the cream on each successive day. The variation of the parameter R₀ with the period of the experiment is shown in Figure 14.

Figure 14. Variation of resistance at low frequency (R₀) during experiment period..

DownLoad: Full-Size Img PowerPoint

From Figure 14, it can be seen that the low frequency impedance increases monotonically, shows a peak and then decreases monotonically. The variation in R₀ is found to be as high as 500% in contrast to the variation of α and C (less than 1% and 40% respectively). This fact suggests that the DC resistance of skin can be a good indicator for characterizing the moisturizing study. A systemic investigation is needed to establish a DC resistance-based characterization.

5. Conclusion

The bioimpedance of human skin is measured and the effect of moisturizing cream on skin is studied in this paper. An efficient electrode-pair is fabricated and an experimental setup is demonstrated for measuring human skin impedance of a small area. Experimental study for a long period of time (47 days) is presented here. A large number of measurements is conducted and ANOVA is performed for statistical relevance. It is observed that relaxation-time increases due to the treatment by moisturizing cream and decreases during the post-treatment period. This is confirmed by measuring the relaxation-time of the untreated area of skin. The method demonstrated here is very efficient in comparing the effectiveness of various moisturizing creams. The gender distinguishability during the treatment of the skin with a moisturizer also can be assessed. In short, an entire experimental setup with measurement procedure and data extraction to study the effect of moisturizing cream on human skin (of a small area) is demonstrated.

References

[1]	M. Bellmore, G. L. Nemhauser, The traveling salesman problem: A survey, Oper. Res., 16 (1968), 538–558. https://doi.org/10.1007/978-3-642-51565-1 doi: 10.1007/978-3-642-51565-1
[2]	C. H. Papadimitriou, The euclidean travelling salesman problem is np-complete, Oper. Res., 4 (1977), 237–244. https://doi.org/10.1016/0304-3975(77)90012-3 doi: 10.1016/0304-3975(77)90012-3
[3]	C. William, World TSP, 2021. Available from: http://www.sars-expertcom.gov.hk/english/reports/reports.html.
[4]	R. Bellman, Dynamic programming treatment of the travelling salesman problem, J. ACM, 9 (1962), 61–63. https://doi.org/10.1145/321105.321111 doi: 10.1145/321105.321111
[5]	V. V. Vazirani, Approximation Algorithms, Springer Science & Business Media Press, 2013. https://doi.org/10.1007/978-3-662-04565-7
[6]	Y. Hu, Q. Duan, Solving the TSP by the AALHNN algorithm, Math. Biosci. Eng., 19 (2022), 3427–3488. https://doi.org/10.3934/mbe.2022158 doi: 10.3934/mbe.2022158
[7]	J. J. Hopfield, D. W. Tank, "Neural" computation of decisions in optimization problems, Biol. Cyber., 52 (1985), 141–152. https://doi.org/10.1007/BF00339943 doi: 10.1007/BF00339943
[8]	K. Panwar, K. Deep, Transformation operators based grey wolf optimizer for travelling salesman problem, J. Comput. Sci., 55 (2021), 101454. https://doi.org/10.1016/j.jocs.2021.101454 doi: 10.1016/j.jocs.2021.101454
[9]	Z. Wu, S. Pan, F. Chen, G. Long, C. Zhang, S. Y. Philip, A comprehensive survey on graph neural networks, IEEE Trans. Neural Networks Learn. Syst., 32 (2020), 4–24. https://doi.org/10.1109/TNNLS.2020.2978386 doi: 10.1109/TNNLS.2020.2978386
[10]	Q. Wang, C. Tang, Deep reinforcement learning for transportation network combinatorial optimization: A survey, Knowl. Based Syst., 233 (2021), 107526. https://doi.org/10.1016/j.knosys.2021.107526 doi: 10.1016/j.knosys.2021.107526
[11]	Y. Bengio, A. Lodi, A. Prouvost, Machine learning for combinatorial optimization: A methodological tour d'horizon, Eur. J. Oper. Res., 290 (2021), 405–421. https://doi.org/10.1016/j.ejor.2020.07.063 doi: 10.1016/j.ejor.2020.07.063
[12]	Q. Ma, S. Ge, D. He, D. Thaker, I. Drori, Combinatorial optimization by graph pointer networks and hierarchical reinforcement learning, preprint, arXiv: 1911.04936. https://doi.org/10.48550/arXiv.1911.04936
[13]	O. Vinyals, M. Fortunato, N. Jaitly, Pointer networks, in Proceedings of the 29th Concerence on Neural Information Processing System (NIPS), 28 (2015), 2692–2700.
[14]	I. Sutskever, O. Vinyals, Q. V. Le, Sequence to sequence learning with neural networks, in Proceedings of the 28th Concerence on Neural Information Processing System (NIPS), 27 (2014), 3104–3112.
[15]	I. Bello, H. Pham, Q. V. Le, M. Norouzi, S. Bengio, Neural combinatorial optimization with reinforcement learning, in Proceedings of the 5th International Conference on Learning Representations, 2017.
[16]	H. Dai, E. B. Khalil, Y. Zhang, B. Dilkina, L. Song, Learning combinatorial optimization algorithms over graphs, in Proceedings of the 31th Concerence on Neural Information Processing System (NIPS), 30 (2017), 6351–6361.
[17]	C. K. Joshi, Q. Cappart, L. M. Rousseau, T. Laurent, X. Bresson, Learning tsp requires rethinking generalization, preprint, arXiv: 2006.07054. https://doi.org/10.48550/arXiv.2006.07054
[18]	W. Kool, H. van Hoof, M. Welling, Attention, learn to solve routing problems, in Proceedings of the 7th International Conference on Learning Representations (ICLR), 2019.
[19]	Y. Wu, W. Song, Z. Cao, J. Zhang, A. Lim, Learning improvement heuristics for solving routing problems, in IEEE Transactions on Neural Networks and Learning Systems, (2021), 1–13. https: //doi.org/10.1109/TNNLS.2021.3068828
[20]	L. Xin, W. Song, Z. Cao, J. Zhang, Multi-decoder attention model with embedding glimpse for solving vehicle routing problems, in Proceedings of the 35th Conference on Artificial Intelligence (AAAI), (2021), 12042–12049.
[21]	Y. D. Kwon, J. Choo, B. Kim, I. Yoon, Y. Gwon, S. Min, Pomo: Policy optimization with multiple optima for reinforcement learning, in Proceedings of the 34th Concerence on Neural Information Processing System (NIPS), 33 (2020), 21188–21198.
[22]	Y. Ma, J. Li, Z. Cao, W. Song, L. Zhang, Z. Chen, J. Tang, Learning to iteratively solve routing problems with dual-aspect collaborative transformer, in Proceedings of the 35th Concerence on Neural Information Processing System (NIPS), 34 (2021), 11096–11107.
[23]	W. Kool, H. van Hoof, J. Gromicho, M. Welling, Deep policy dynamic programming for vehicle routing problems, in International Conference on Integration of Constraint Programming, Artificial Intelligence, and Operations Research, Springer, (2022), 190–213. https://doi.org/10.1007/978-3-031-08011-1_14
[24]	X. Bresson, T. Laurent, The transformer network for the traveling salesman problem, preprint, arXiv: 2103.03012.
[25]	B. Hudson, Q. Li, M. Malencia, A. Prorok, Graph neural network guided local search for the traveling salesperson problem, preprint, arXiv: 2110.05291.
[26]	L. Xin, W. Song, Z. Cao, J. Zhang, NeuroLKH: Combining deep learning model with lin-kernighan-helsgaun heuristic for solving the traveling salesman problem, in Proceedings of the 35th Concerence on Neural Information Processing System (NIPS), 34 (2021), 7472–7483.
[27]	W. Chen, Z. Li, C. Liu, Y. Ai, A deep learning model with conv-LSTM networks for subway passenger congestion delay prediction, J. Adv. Trans., 2021 (2021). https://doi.org/10.1155/2021/6645214 doi: 10.1155/2021/6645214
[28]	T. N. Kipf, M. Welling, Semi-supervised classification with graph convolutional networks, in Proceedings of the 4th International Conference on Learning Representations (ICLR), 2016.
[29]	R. J. Williams, Simple statistical gradient-following algorithms for connectionist reinforcement learning, Mach. Learn., 8 (1992), 229–256. https://doi.org/10.1007/978-1-4615-3618-5_2 doi: 10.1007/978-1-4615-3618-5_2
[30]	D. L. Applegate, R. E. Bixby, V. Chvátal, W. Cook, D. G. Espinoza, M. Goycoolea, t al., Certification of an optimal TSP tour through 85,900 cities, Oper. Res. Lett., 37 (2009), 11–15. https://doi.org/10.1016/j.orl.2008.09.006 doi: 10.1016/j.orl.2008.09.006
[31]	K. Helsgaun, An extension of the Lin-Kernighan-Helsgaun TSP solver for constrained traveling salesman and vehicle routing problems, Roskilde Univ., 2017 (2017), 24–50.
[32]	Gurobi Optimization, Gurobi optimizer reference manual, 2016. Available from: http://www.gurobi.com.
[33]	Google, OR-Tools, 2018. Available from: https://developers.google.com.
[34]	G. Reinelt, Tspliba traveling salesman problem library, ORSA J. Comput., 3 (1991), 376–384. https://doi.org/10.1287/ijoc.3.4.376 doi: 10.1287/ijoc.3.4.376

This article has been cited by:

1.	Lucian Pîslaru-Dănescu, George-Claudiu Zărnescu, Gabriela Telipan, Victor Stoica, Design and Manufacturing of Equipment for Investigation of Low Frequency Bioimpedance, 2022, 13, 2072-666X, 1858, 10.3390/mi13111858
2.	Jiawen Chen, Seyed Mohammad Mir, Maria R. Hudock, Meghan R. Pinezich, Panpan Chen, Matthew Bacchetta, Gordana Vunjak-Novakovic, Jinho Kim, Opto-electromechanical quantification of epithelial barrier function in injured and healthy airway tissues, 2023, 7, 2473-2877, 016104, 10.1063/5.0123127
3.	Nour Ammar, Cherif Ouni, Ahmed Yahia Kallel, Ahmed Fakhfakh, Nabil Derbel, Olfa Kanoun, 2024, Parameters Estimation of Cole-Cole Bio-Impedance Model with a Minimum Number of Frequencies, 979-8-3503-8090-3, 1, 10.1109/I2MTC60896.2024.10561098
4.	Ana Arché-Núñez, Peter Krebsbach, Bara Levit, Daniel Possti, Aaron Gerston, Thorsten Knoll, Thomas Velten, Chen Bar-Haim, Shani Oz, Shira Klorfeld-Auslender, Gerardo Hernandez-Sosa, Anat Mirelman, Yael Hanein, Bio-potential noise of dry printed electrodes: physiology versus the skin-electrode impedance, 2023, 44, 0967-3334, 095006, 10.1088/1361-6579/acf2e7
5.	Merwa Al‐Rasheed, Emily Lam, Mohammad Jambar, Jean Paul Ilogon, Sandra Gardner, Ladan Eskandarian, Amirali Toossi, Industry‐Scalable Reusable Textile Electrodes for Neurostimulation Applications, 2024, 2192-2640, 10.1002/adhm.202401642
6.	Pablo Dutra da Silva, Pedro Bertemes Filho, Switched CMOS current source compared to enhanced Howland circuit for bio-impedance applications, 2024, 15, 1891-5469, 145, 10.2478/joeb-2024-0017
7.	Nour Ammar, Cherif Ouni, Ahmed Yahia Kallel, Hanen Nouri, Bilel Ben Atitallah, Nabil Derbel, Olfa Kanoun, 2023, Cole-Cole Bio-Impedance Parameters Estimation From Sinewave Excitation Signal with a Minimum Number of Frequencies, 979-8-3503-5895-7, 22, 10.1109/IWIS61214.2023.10302771

Reader Comments

Your name:*

Email:*
© 2022 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)