Figure 1.
The model of the proposed method.
Citation: Christian Carpéné, Jean Galitzky, Jean Sébastien Saulnier-Blache. Short-term and rapid effects of lysophosphatidic acid on human adipose cell lipolytic and glucose uptake activities[J]. AIMS Molecular Science, 2016, 3(2): 222-237. doi: 10.3934/molsci.2016.2.222
| [1] | Ting-Huai Ma, Xin Yu, Huan Rong . A comprehensive transfer news headline generation method based on semantic prototype transduction. Mathematical Biosciences and Engineering, 2023, 20(1): 1195-1228. doi: 10.3934/mbe.2023055 |
| [2] | Wu Zeng, Zheng-ying Xiao . Few-shot learning based on deep learning: A survey. Mathematical Biosciences and Engineering, 2024, 21(1): 679-711. doi: 10.3934/mbe.2024029 |
| [3] | Hao Zhang, Lina Ge, Guifen Zhang, Jingwei Fan, Denghui Li, Chenyang Xu . A two-stage intrusion detection method based on light gradient boosting machine and autoencoder. Mathematical Biosciences and Engineering, 2023, 20(4): 6966-6992. doi: 10.3934/mbe.2023301 |
| [4] | Depei Wang, Lianglun Cheng, Tao Wang . Fairness-aware genetic-algorithm-based few-shot classification. Mathematical Biosciences and Engineering, 2023, 20(2): 3624-3637. doi: 10.3934/mbe.2023169 |
| [5] | Guoli Wang, Pingping Wang, Jinyu Cong, Benzheng Wei . MRChexNet: Multi-modal bridge and relational learning for thoracic disease recognition in chest X-rays. Mathematical Biosciences and Engineering, 2023, 20(12): 21292-21314. doi: 10.3934/mbe.2023942 |
| [6] | Yevgeniy Bodyanskiy, Olha Chala, Natalia Kasatkina, Iryna Pliss . Modified generalized neo-fuzzy system with combined online fast learning in medical diagnostic task for situations of information deficit. Mathematical Biosciences and Engineering, 2022, 19(8): 8003-8018. doi: 10.3934/mbe.2022374 |
| [7] | Jia Yu, Huiling Peng, Guoqiang Wang, Nianfeng Shi . A topical VAEGAN-IHMM approach for automatic story segmentation. Mathematical Biosciences and Engineering, 2024, 21(7): 6608-6630. doi: 10.3934/mbe.2024289 |
| [8] | Hanjiang Wu, Jie Huang, Kehan Wu, António M. Lopes, Liping Chen . Precise tracking control via iterative learning for one-sided Lipschitz Caputo fractional-order systems. Mathematical Biosciences and Engineering, 2024, 21(2): 3095-3109. doi: 10.3934/mbe.2024137 |
| [9] | Peng Wang, Shiyi Zou, Jiajun Liu, Wenjun Ke . Matching biomedical ontologies with GCN-based feature propagation. Mathematical Biosciences and Engineering, 2022, 19(8): 8479-8504. doi: 10.3934/mbe.2022394 |
| [10] | Shi Liu, Kaiyang Li, Yaoying Wang, Tianyou Zhu, Jiwei Li, Zhenyu Chen . Knowledge graph embedding by fusing multimodal content via cross-modal learning. Mathematical Biosciences and Engineering, 2023, 20(8): 14180-14200. doi: 10.3934/mbe.2023634 |
Deep learning has significantly succeeded in image recognition, image segmentation and target detection. However, deep learning models often require a large amount of labeled data to train, and labeling the data will take more time. Some scholars propose zero-shot learning. Zero-shot learning uses the model obtained from the seen classes to infer the unseen class of samples, which can largely reduce the labeling of samples [1,2]. Zero-shot learning mimics the process of human cognition of new things. For example, a person knows an animal, like a horse, through pictures and their linguistic descriptions; when knowing about the linguistic description of zebras, zebras look like horses and have black and white stripes on its body, then the person can still recognize zebras by this linguistic description when seeing zebras even though he or she has never seen a zebra [3]. In zero-shot learning, semantic features are needed in addition to using sample features. Semantic features are linguistic descriptions of the samples, such as the color, size and other characteristics. Word vectors extracted by Word2Vec [4] are usually used as semantic features. In zero-shot learning, the model is trained by the seen class samples with semantic features to find the relationship between semantic features and the seen class samples, and then transfers the model to unseen class samples to infer the categories of the unseen class samples.
There are two categories of zero-shot learning: generalized zero-shot learning and conventional zero-shot learning. The test set contains only the unseen class samples for conventional zero-shot learning. While for generalized zero-shot learning, the test set contains not only the unseen class samples but also the seen class samples. In zero-shot learning, there are many approaches devoted to finding the relationship between the training set samples and the training set semantic features, such as mapping the training set samples to the semantic feature space, mapping the semantic features to the sample space [5], mapping the semantic features and samples to the common space [6,7] and mapping the semantic features and samples to each other's space [8]. However, the training set contains only the seen class samples, and the classes in the training set are not the same as those in the unseen class, which can lead to the inaccurate classification of the unseen class samples when the classification models are used in the test set.
To address these problems, some scholars use generative models, such as Variational Autoencoder (VAE) [9] and Generative Adversarial Network (GAN) [10], to generate the unseen class pseudo samples, and input them to the classifier for training, which can alleviate the problem of inaccurate classification of samples in the unseen classes. It has been proposed in the literature [11,12] that the use of VAE and GAN leads to the problems of posterior collapse and training instability, and the use of Wasserstein Auto-Encoder (WAE) and Wasserstein Generative Adversarial Network (WGAN) to generate pseudo samples can alleviate this problem. However, the unseen class samples generated by these methods are easily biased to the features of the seen class samples, leading to inaccurate classification results when classifying the real unseen class samples. To address these problems, we propose the following methods:
1) Different from the above generation models, we use autoencoder to generate the unseen class samples. To make the sample features in the latent space more distinguishable and representative, a classifier is used for the sample features in the latent space.
2) In order to reduce the unseen class pseudo sample features that are biased to the seen class sample features, we propose new sample features and use them together with unseen class semantic features for cross-reconstruction loss function.
3) The proposed method is validated for three datasets, AWA1, AWA2 and aPY and have good results.
The structure of this paper is organized as follows. First, we thoroughly review the related works in Section 2. The proposed method is illustrated in Section 3. In Section 4, we discuss the experiments, and we conclude the paper in Section 5.
For zero-shot learning, embedding-based zero-shot learning is a common approach. However, embedding-based zero-shot learning can produce domain shift problems and misclassification in unseen class samples [13].
There are three solutions to alleviate the unseen class samples that are easily misclassified into the seen classes in zero-shot learning: calibrated stacking, generative models and detection of the unseen class samples. Calibrated stacking [14] added a calibrated term to the classifier so that the score of the seen class is reduced during classification, and the score of the unseen class samples can be increased. The calibrated stacking equation is as follows:
| $ \widehat{y} = \underset{c\in \mathcal{T}}{\mathrm{argmax}}{f}_{c}\left(x\right)-\gamma \mathbb{I}[c\in S] $ |
where $ \gamma $ is the calibrated factor and the indicator function. $ \mathbb{I}[\cdot ] $ indicates whether $ c $ belongs to a seen class, if $ c $ is a seen class, the value of the indicator function is 1, otherwise the value of the indicator function is 0. The classifier of APN [15] used class embedding and added calibrated stacking in the classifier to alleviate misclassification of the unseen class samples.
The method of generative models is to use generative models to generate pseudo samples substitute real unseen class samples [16]. The training set and pseudo samples are used in training the classifier, so that the unseen class samples can avoid bias to the seen classes. Multi-modal Feature Fusion algorithm (MFF) [17] used visual principal component features to compensate for the lack of descriptive information using only semantic features, and then combined GAN and VAE to generate high-quality pseudo-samples. Cross- and Distribution Aligned VAE (CADA-VAE) [18] was the VAE method. The latent space distributional alignment and cross-alignment were used to ensure the alignment between the two different modalities of sample features and semantic features. To make the generated samples close to the real samples, Over-Complete Distribution using Conditional Variational Autoencoder (OCD-CVAE) [19] used over-complete distribution to generate pseudo samples. Chen et al. [12] proposed to use WAE to generate pseudo samples and used an aggregated posterior distribution in the latent space to align the manifold structure of the sample features and the semantic features. f-CLSWGAN [20] used WGAN to generate pseudo samples and used a classifier to make the generated pseudo samples more discriminative. Based on f-CLSWGAN, Adaptive Bias-Aware GAN (ABA-GAN) [21] proposed adaptive adversarial loss and domain loss functions to make the generated pseudo samples more meaningful and to distinguish the seen classes from the unseen classes. Li et al. [11] used WGAN to generate pseudo samples and used multimodal cyclic loss function and bi-directional autoencoder. In response to the fact that GAN is not easy to train, and the pseudo samples generated by VAE are of low quality, Dual VAEGAN [22] used a combination of GAN and VAE.
Detection of samples of the unseen class. This method first distinguishes whether the samples belong to the seen classes or the unseen classes and then classifies the samples into specific class. GatingAE [3] first used the latent space and the cross-reconstruction space to detect samples belonging to the unseen class, and then used a linear classifier to classify the samples in the seen classes and a nearest neighbor classifier for the samples belonging to the unseen classes. Chen et al. [23] proposed determining whether a sample belongs to the seen class or the unseen class by calculating the cosine similarity between the latent space features of the samples and the mean value of each class. However, the models in these methods are obtained by training the samples from the seen classes; when migrating to the samples from the unseen classes, the classification results of the samples from the unseen classes are still biased to the seen classes.
Cao et al. [24] achieved recognition of zero shot traffic signs using autoencoder. Different from the literature [24], we use autoencoder to generate the unseen samples to alleviate the misclassification of the unseen class samples. To prevent the generated unseen class samples biased towards the features of seen class samples and improve the classification accuracy of the unseen class samples, we add the information of both unseen class semantic features and the proposed sample features.
In zero-shot learning, the training set can be denoted as $ S = \{{X}_{S}, {A}_{S}, {Y}_{S}\} $, and the unseen class can be denoted as $ U = \{{X}_{U}, {A}_{U}, {Y}_{U}\} $, where $ X $ denotes sample features, $ A $ denotes semantic features and $ Y $ denotes labels. For conventional zero-shot learning, the class of $ {X}_{U} $ is predicted by the classifier: $ {X}_{U}\to {Y}_{U} $; for generalized zero-shot learning, the class of $ X $ is predicted by the classifier: $ X\to {Y}_{S}\cup {Y}_{U} $.
In this study, we use autoencoder to generate the pseudo samples of unseen classes, and the model is shown in Figure 1. In the Figure 1, E1 and E2 represent the encoder, D1 and D2 represent the decoder. The sample features and semantic features are encoded to obtain the same dimensional latent space features.
According to the autoencoder, for the training set, the generated sample features $ \widetilde {{X}_{S}} $ and the semantic features of the seen classes $ \widetilde {{A}_{S}} $ need to approximate the input features $ {X}_{S} $ and $ {A}_{S} $.Assuming that there are $ m $ samples, the reconstruction loss function can be written as:
| $ {L}_{recon1} = \frac{1}{m}\sum _{i = 1}^{m}\left|{x}_{si}-\widetilde {{x}_{si}}\right|+\frac{1}{m}\sum _{i = 1}^{m}\left|{a}_{si}-\widetilde {{a}_{si}}\right| $ | (1) |
We use the lowercase $ {x}_{si} $, $ \widetilde {{x}_{si}} $, $ {a}_{si} $ and $ {a}_{si} $ to denote one sample feature in $ {X}_{S} $, one generate sample feature in $ \widetilde {{X}_{S}} $, one semantic feature in $ {A}_{S} $ and one generated semantic feature in $ \widetilde {{A}_{S}} $ respectively. We want these two modality features to be aligned in the latent space. We use $ {Z}_{S} $ to represent the sample features of the latent space and $ {Z}_{AS} $ to represent the seen class semantic features of the latent space.
| $ {L}_{latent-recon} = \frac{1}{m}\sum _{i = 1}^{m}\left|{z}_{Si}-{z}_{ASi}\right| $ | (2) |
In Eq (2), we use the lowercase $ {z}_{Si} $ to denote one sample feature in $ {Z}_{S} $, and use the $ {z}_{ASi} $ to denote one seen class semantic feature in $ {Z}_{AS} $. In addition to the reconstruction loss function shown in Eq (1), zero-shot learning contains two different modalities, sample features and semantic features. Aligning different modalities can reduce the domain shift problem [25]. Inspired by GatingAE [3], Chen et al. [12], CADA-VAE [18] and Discriminative Cross-Aligned Variational Autoencoder(DCA-VAE) [25], we use the cross-reconstruction loss function. The features $ \overline {{X}_{S}} $ and $ \overline {{A}_{S}} $ are obtained by passing the semantic features and sample features of the latent space through D2 and D1 decoders, respectively, the cross-reconstruction loss function is as follows:
| $ {L}_{cross-recon1} = \frac{1}{m}\sum _{i = 1}^{m}\left|{x}_{si}-\overline {{x}_{si}}\right|+\frac{1}{m}\sum _{i = 1}^{m}\left|{a}_{si}-\overline {{a}_{si}}\right| $ | (3) |
Here, $ \overline {{x}_{si}} $ denotes one feature in $ \overline {{X}_{S}} $, and $ \overline {{a}_{si}} $ denotes one feature in $ \overline {{A}_{S}} $. Although we can use Eqs (1), (2) and (3) to train the model and then to generate samples of the unseen classes, Eqs (1), (2) and (3) only contains samples of the seen classes and semantic features, which will lead to the pseudo samples being biased to the seen classes. To address this problem, we add the unseen class semantic features $ {A}_{US} $ to the model and propose new sample features $ \widehat{X} $.
The unseen class semantic features $ {A}_{US} $ can be obtained by the following method. The sample features of the training set are mapped to the semantic feature space using the following equation:
| $ \underset{W}{\mathrm{min}}{||{X}_{S}-{{W}^{T}A}_{S}||}_{F}^{2}+\alpha {||W||}_{F}^{2} $ | (4) |
$ {||\cdot ||}_{F} $ in Eq (4) denotes Frobenius norm. The mapping matrix $ W $ is obtained as follows:
| $ W = {X}_{S}^{T}{A}_{S}{\left({A}_{S}^{T}{A}_{S}+\alpha I\right)}^{-1} $ | (5) |
where $ I $ in Eq (5) represents the unit matrix and $ \alpha $ denotes an adjustable parameter. The sample features in the training set are then mapped to the semantic feature space through the mapping matrix $ W $ and find the nearest unseen class semantic features, which constitute $ {A}_{US} $.
After obtaining $ {A}_{US} $, we input $ {A}_{US} $ to the autoencoder to obtain the generated unseen class semantic features $ \widetilde {{A}_{US}} $, and the reconstruction loss between $ \widetilde {{A}_{US}} $ and $ {A}_{US} $ is:
| $ {L}_{recon2} = \frac{1}{m}\sum _{i = 1}^{m}\left|{a}_{usi}-\widetilde {{a}_{usi}}\right| $ | (6) |
Here, we use $ {a}_{usi} $ to denote one unseen class semantic feature in $ {A}_{US} $ and $ \widetilde {{a}_{usi}} $ to denote one generated unseen class semantic feature in $ \widetilde {{A}_{US}} $. Except the reconstruction loss for $ {A}_{US} $. We also want to align different modalities between the unseen class semantic features and sample features, but there is a lack of unseen class samples in the training set. In this paper, we take the following approach to get the cross-reconstruction loss function: Find the difference between the unseen class semantic features and the seen class sample features in the latent space, the difference represents the relationship between the unseen class semantic features and the seen class sample features in the latent space. Then, pass the difference through the decoder D1 to get $ \mathrm{\theta } $. We use $ {Z}_{S} $ and $ {Z}_{AU} $ to represent the latent features of the seen class sample features and the latent features of the unseen class semantic features. The formula is as follows:
| $ \mathrm{\theta } = D1({Z}_{S}-{Z}_{AU}) $ | (7) |
Then subtract $ \theta $ from the sample features of the training set to obtain the feature $ \widehat{X} $:
| $ \widehat{X} = {X}_{S}-\theta $ | (8) |
The cross-reconstruction loss function for unseen class semantic features can be written as:
| $ {L}_{cross-recon2} = \frac{1}{m}\sum _{i = 1}^{m}\left|\widehat{{x}_{i}}-\overline {{x}_{usi}}\right|+\beta \frac{1}{m}\sum _{i = 1}^{m}\left|{a}_{usi}-\overline {{a}_{si}}\right| $ | (9) |
$ \beta $ in the above equation is an adjustable parameter. $ \widehat{{x}_{i}} $ denotes one feature in $ \widehat{X} $, $ \overline {{x}_{usi}} $ denotes one feature obtained by passing one unseen class semantic feature through the decoder D1. The reason for using the feature $ \widehat{X} $ instead of $ {X}_{S} $ is that $ \widehat{X} $ can reduce the information of the seen class samples in the loss function, which can alleviate the similarity between the unseen class pseudo samples and the seen class samples.
To better find the relationship between the semantic features of unseen classes and the training set samples in Eq (7), and also make the sample features in the latent space distinguishable and representative, the sample features of the latent space are classified using the cross-entropy loss function:
| $ {L}_{classifier} = -\sum _{i = 1}^{m}{y}_{si}\mathrm{l}\mathrm{o}\mathrm{g}\widetilde {{y}_{si}} $ | (10) |
$ \widetilde {{y}_{si}} $ in Eq (10) is the predicted label and $ {y}_{si} $ is the true label of the sample features of the latent space.
Combining Eqs (1), (2), (3), (6), (9) and (10), the objective function is:
| $ L = {L}_{recon1}+{L}_{latent-recon}+{L}_{recon2}+{L}_{cross-recon1}+{L}_{cross-recon2}+{L}_{classifier} $ | (11) |
After the model is trained according to Eq (11), the samples are generated with the sample features $ {X}_{S} $ and semantic features $ {A}_{US} $. For generalized zero-shot classification, all the generated seen class samples and unseen class samples need to be input to the classifier for training. For conventional zero-shot classification, only the generated unseen class samples need to be input to the classifier for training.
Three datasets, AWA1, AWA2 and aPY, are used in our study.
1) AWA1 [26]: The seen class contains 40 categories, and the unseen class contains 10 categories. The number of samples in the seen class is 19832, the number of samples in the unseen class is 5685 and the dimension of the semantic features is 85.
2) AWA2 [27]: The seen class contains 40 categories, and the unseen class contains 10 categories. The number of samples in the seen class is 23527, the number of samples in the unseen class is 7913 and the dimension of the semantic features is 85.
3) aPY [28]: The seen class contains 20 categories, and the unseen class contains 12 categories. The number of samples in the seen class is 5932, the number of samples in the unseen class is 7924, and the dimension of the semantic features is 64.
The sample features and semantic features used in our study are taken from the literature [27]. Following the literature [12], the input dimension of encoder E1 is 2048 dimensions, the output of the first layer is 512 dimensions, and the dimension of the latent space is 128; the dimension of the output of the first layer of encoder E2 is 128.The dimension of the output of the first layer of decoder D1 is 256 and the dimension of output is 2048; the dimension of output of the first layer of decoder D2 is 256. We use the Adam algorithm for optimization, the learning rate is 0.001 and the batch size is 256.
We use the evaluation criteria proposed in the literature [27]. For the conventional zero-shot classification, only the accuracy of classification needs to be calculated:
| $ acc = \frac{1}{\left|C\right|}\sum _{i}^{\left|C\right|}\frac{\#correct\ predictions\ in\ i}{samples\ in\ i} $ |
For generalized zero-shot classification, not only the classification accuracy of the seen class and the unseen class should be calculated, but also the harmonic mean. Assuming that the classification accuracy of the samples of seen classes is denoted as $ {acc}_{tr} $ and the classification accuracy of the samples of unseen classes is denoted as $ {acc}_{ts} $, the harmonic mean can be written as:
| $ H = \frac{2\times {acc}_{tr}\times {acc}_{ts}}{{acc}_{tr}+{acc}_{ts}} $ |
The generalized zero-shot classification results and the conventional zero-shot classification results are shown in Tables 1 and 2, where the results of Semantic Autoencoder (SAE) [8], Direct Attribute Prediction (DAP) [26], Indirect Attribute Prediction (IAP) [26] and Structured Joint Embedding (SJE) [29] are from the literature [27]. In Table 1, "ts" represents the classification results of unseen classes and "tr" represents the classification results of the seen classes. From Table 1, the proposed method is 1% less than CADA-VAE [18] for the AWA1 dataset. For the AWA2 dataset, the proposed method is 0.5% better than Chen et al. [23]. For the aPY dataset, the proposed method is 3.1% higher than DAP [26], while it is 4.9% higher than the generative model Chen et al. [12]. The accuracy of the proposed method on unseen class is higher than other methods.
| AWA1 | AWA2 | aPY | |||||||
| ts | tr | H | ts | tr | H | ts | tr | H | |
| SAE [8] | 1.8 | 77.1 | 3.5 | 1.1 | 82.2 | 2.2 | 0.4 | 80.9 | 0.9 |
| DAP [26] | 46.5 | 68.5 | 55.4 | 43.7 | 70.2 | 53.3 | 27.6 | 55.8 | 37.0 |
| IAP [26] | 2.1 | 78.2 | 4.1 | 0.9 | 87.6 | 1.8 | 5.7 | 65.6 | 10.4 |
| SJE [29] | 11.3 | 74.6 | 19.6 | 8.0 | 73.9 | 14.4 | 3.7 | 55.7 | 6.9 |
| Preserving Semantic Relations (PSR) [30] | 20.7 | 73.8 | 32.3 | 13.5 | 51.4 | 21.4 | |||
| f-CLSWGAN [20] | 57.9 | 61.4 | 59.6 | ||||||
| Zhang et al. [31] | 20.7 | 67.9 | 38.6 | 16.1 | 66.9 | 25.9 | |||
| Li et al. [11] | 54.9 | 71.7 | 62.2 | ||||||
| CADA-VAE [18] | 57.3 | 72.8 | 64.1 | 55.8 | 75.0 | 63.9 | |||
| Chen et al. [23] | 54.7 | 72.7 | 62.4 | 55.6 | 76.9 | 64.2 | |||
| Chen et al. [12] | 54.5 | 72.8 | 62.3 | 55.2 | 73.5 | 63.0 | 26.7 | 51.5 | 35.2 |
| The proposed method | 62.4 | 63.9 | 63.1 | 60.6 | 69.5 | 64.7 | 31.5 | 55.3 | 40.1 |
DownLoad:
CSV
Table 2 shows the conventional zero-shot classification results. For the AWA1 dataset, the proposed method is slightly lower than f-CLSWGAN [20] and Li et al. [11], which used the GAN model. For the aPY dataset, the method in this paper is slightly lower than the method of Zhang et al. [31] and more accurate than the other methods. The accuracy of the method in this paper is higher than the other methods on the AWA2 dataset.
| AWA1 | AWA2 | aPY | |
| SAE [8] | 53.0 | 54.1 | 8.3 |
| DAP [26] | 44.1 | 46.1 | 33.8 |
| IAP [26] | 35.9 | 35.9 | 36.6 |
| SJE [29] | 65.6 | 61.9 | 32.9 |
| PSR [30] | 63.8 | 38.4 | |
| Cross-Class Sample Synthesis (CCSS) [32] | 56.3 | 63.7 | 35.5 |
| f-CLSWGAN [20] | 69.9 | ||
| Zhang et al. [31] | 68.8 | 41.3 | |
| Li et al. [11] | 69.9 | ||
| CADA-VAE [18] | 58.8 | 60.3 | |
| Chen et al. [12] | 65.2 | 65.5 | 32.7 |
| The proposed method | 67.1 | 66.1 | 39.8 |
DownLoad:
CSV
The parameters involved in the model are $ \alpha $, $ \beta $ and the dimensionality of the latent space, where we denote the dimensionality of the latent space as $ d $. The effects of taking different values of $ \alpha $, $ \beta $ and $ d $ on the generalized zero-shot classification and the conventional zero-shot classification are shown in Figures 2, 3 and 4.
Figure 2 shows the effects of the parameter $ \alpha $ on the zero-shot classification results. The parameter $ \alpha $ is used to prevent overfitting. Taking the values of $ \alpha $ as 0.1, 1, 10 and 100. It can be seen from Figure 2 that the classification results of the aPY dataset are decreasing and then increasing as $ \alpha $ keeps increasing. The results of the AWA2 dataset on the conventional zero-shot classification are increasing all the time, while the values of the generalized zero-shot classification are decreasing and then increasing. The results of AWA1 dataset on the conventional zero-shot classification is decreasing and then increasing, and the harmonic mean is always increasing.
The values of $ \beta $ are taken as 0.001, 0.01, 0.1 and 1. $ \beta $ is used to regulate the relationship between the training set samples and the generated unseen class semantic features, and the value of $ \beta $ is taken small because the training set samples are not the real unseen class samples. From Figure 3, the accuracy of conventional zero-shot classification on the aPY dataset is almost unaffected by the value of $ \beta $, but the value in the generalized zero-shot classification decreases with increasing of $ \beta $. The classification accuracy of AWA1 and AWA2 on conventional zero-shot classification is also almost unaffected by the value of $ \beta $, but the harmonic mean value increases and then decreases with increasing of $ \beta $.
Figure 4 shows the effects of dimension $ d $ on the zero-shot classification results, with $ d $ taking values of 64,128 and 256. For the aPY dataset, the accuracy of conventional zero-shot classification increases first and then decreases as $ d $ increases, the harmonic mean value keeps decreasing. For the AWA1 dataset, the results increase and then decrease with increasing $ d $, except for the classification results of the seen classes. For the AWA2 dataset, most of the zero-shot classification results show a trend of increasing and then decreasing with increasing $ d $.
Figure 5 shows the tSNE for generalized zero-shot classification of the aPY dataset, where (a) and (b) denote the training set samples and unseen class samples, respectively, and (c) and (d) are the generated training set samples and unseen class samples.
For the training set samples, the distribution between the generated samples and the original samples is almost the same, and the generated samples are more dispersed between different categories and more concentrated within classes than the original samples. For the unseen class samples, there are more samples presenting orange color in the original samples, while in the generated samples, since $ {A}_{US} $ is chosen for generating the unseen class samples in this paper, it will lead to the number of some classes will be more and the number of some other classes will be less in the generated samples. Except for the inconsistent number of samples, most of the generated samples are similar to the distribution of the real samples.
The ablation experiments are divided into the following cases: a. Only Eq (1) is retained as the loss function of the model. b. Add $ {L}_{latent-recon} $ to Eq(1). c. $ {L}_{cross-recon1}\ne 0 $ on the basis of b. d. $ {L}_{classifier}\ne 0 $ on the basis of c; e. Based on d, the second term in $ {L}_{cross-recon2} $ is not 0; f. Based on e, $ {L}_{recon2}\ne 0 $. The proposed method is to add the first term in $ {L}_{cross-recon2} $, on the basis of f. The harmonic mean H and the accuracy acc of the conventional zero-shot classification are shown in Table 3.
| AWA1 | AWA2 | aPY | ||||
| acc | H | acc | H | acc | H | |
| a | 45.1 | 30.0 | 45.1 | 17.9 | 30.7 | 22.0 |
| b | 52.6 | 32.3 | 59.4 | 38.4 | 38.8 | 25.0 |
| c | 56.5 | 33.3 | 57.6 | 23.4 | 35.2 | 26.3 |
| d | 59.7 | 48.3 | 59.7 | 40.2 | 36.8 | 34.4 |
| e | 61.1 | 51.4 | 60.2 | 43.8 | 36.9 | 35.1 |
| f | 61.1 | 49.8 | 61.0 | 45.7 | 37.0 | 36.4 |
| The proposed method | 67.1 | 63.1 | 66.1 | 63.1 | 39.8 | 40.1 |
DownLoad:
CSV
As can be seen in Table 3, most of the classification results are increased as the term increased in the loss function. However, for the AWA1 dataset when changing from e to f, the accuracy does not change for the conventional zero-shot classification, and the harmonic mean decreases slightly. The proposed method does not increase particularly much in the conventional zero-shot classification compared to other methods, especially in the aPY dataset, and for aPY dataset, the method b is larger than other methods except the proposed method. For AWA2 when changing from b to c, the results decreases, especially in harmonic mean. The seen class information increased when we add the $ {L}_{cross-recon1} $ and the accuracy of the unseen classes decreases. However, for generalized zero-shot classification, the proposed method can provide some information about the unseen classes when training the model, and reduce the similarity between the generated unseen class samples and the seen class samples.
By replacing $ \widehat{X} $ in the loss function $ {L}_{cross-recon2} $ with $ {X}_{S} $, the results are shown in Table 4 numbered as (1), and the results of the proposed model numbered as (2). From Table 4, when $ {X}_{S} $ is used instead of $ \widehat{X} $, the results of zero-shot classification are all decreased, especially for generalized zero-shot classification. This is because the loss function contains more information about the samples of the seen classes, making the results easily biased to the seen classes.
| AWA1 | AWA2 | aPY | ||||||||||
| acc | ts | tr | H | acc | ts | tr | H | acc | ts | tr | H | |
| (1) | 55.1 | 37.0 | 71.8 | 48.8 | 55.6 | 34.8 | 73.0 | 47.1 | 35.8 | 27.0 | 52.1 | 35.6 |
| (2) | 67.1 | 62.3 | 63.9 | 63.1 | 66.1 | 60.6 | 69.5 | 64.7 | 39.8 | 31.5 | 55.3 | 40.1 |
DownLoad:
CSV
In this study, an autoencoder approach is used for generating samples of unseen classes in zero-shot learning. For the problem that the generated unseen class sample features are always biased to the seen class features, we add the semantic features of the unseen class with the proposed new sample features to the cross-reconstruction loss function. This can reduce the information of the seen class samples and make the generated unseen class samples closer to the real unseen class samples, and improve the classification accuracy of the unseen class samples. The experimental results on three datasets verify that the proposed method can achieve good results.
The authors declare they have not used Artificial Intelligence (AI) tools in the creation of this article.
The authors declare there is no conflict of interest.
| [1] |
Noguchi K, Herr D, Mutoh T, et al. (2009) Lysophosphatidic acid (LPA) and its receptors. Curr Opin Pharmacol 9: 15-23. doi: 10.1016/j.coph.2008.11.010
|
| [2] |
Yung YC, Stoddard NC, Chun J (2014) LPA receptor signaling: pharmacology, physiology, and pathophysiology. J Lipid Res 55: 1192-1214. doi: 10.1194/jlr.R046458
|
| [3] |
van Meeteren LA, Ruurs P, Stortelers C, et al. (2006) Autotaxin, a secreted lysophospholipase D, is essential for blood vessel formation during development. Mol Cell Biol 26: 5015-5022. doi: 10.1128/MCB.02419-05
|
| [4] |
Tanaka M, Okudaira S, Kishi Y, et al. (2006) Autotaxin stabilizes blood vessels and is required for embryonic vasculature by producing lysophosphatidic acid. J Biol Chem 281: 25822-25830. doi: 10.1074/jbc.M605142200
|
| [5] | Gesta S, Simon MF, Rey A, et al. (2002) Secretion of a lysophospholipase D activity by adipocytes: involvement in lysophosphatidic acid synthesis. J Lipid Res 43: 904-910. |
| [6] | Ferry G, Tellier E, Try A, et al. (2003) Autotaxin is released from adipocytes, catalyzes lysophosphatidic acid synthesis, and activates preadipocyte proliferation. Up-regulated expression with adipocyte differentiation and obesity. J Biol Chem 278: 18162-18169. |
| [7] |
Boucher J, Quilliot D, Pradere JP, et al. (2005) Potential involvement of adipocyte insulin resistance in obesity-associated up-regulation of adipocyte lysophospholipase D/autotaxin expression. Diabetologia 48: 569-577. doi: 10.1007/s00125-004-1660-8
|
| [8] |
Rancoule C, Dusaulcy R, Tréguer K, et al. (2012) Depot-specific regulation of autotaxin with obesity in human adipose tissue. J Physiol Biochem 68: 635-644. doi: 10.1007/s13105-012-0181-z
|
| [9] | Pagés G, Girard A, Jeanneton O, et al. (2000) LPA as a paracrine mediator of adipocyte growth and function. Ann N Y Acad Sci 905: 159-164. |
| [10] |
Simon MF, Daviaud D, Pradere JP, et al. (2005) Lysophosphatidic acid inhibits adipocyte differentiation via lysophosphatidic acid 1 receptor-dependent down-regulation of peroxisome proliferator-activated receptor gamma2. J Biol Chem 280: 14656-14662. doi: 10.1074/jbc.M412585200
|
| [11] |
Dusaulcy R, Daviaud D, Pradere JP, et al. (2009) Altered food consumption in mice lacking lysophosphatidic acid receptor-1. J Physiol Biochem 65: 345-350. doi: 10.1007/BF03185929
|
| [12] |
Dusaulcy R, Rancoule C, Grès S, et al. (2011) Adipose-specific disruption of autotaxin enhances nutritional fattening and reduces plasma lysophosphatidic acid. J Lipid Res 52: 1247-1255. doi: 10.1194/jlr.M014985
|
| [13] |
Rancoule C, Attané C, Grès S, et al. (2013) Lysophosphatidic acid impairs glucose homeostasis and inhibits insulin secretion in high-fat diet obese mice. Diabetologia 56: 1394-1402. doi: 10.1007/s00125-013-2891-3
|
| [14] |
Rancoule C, Viaud M, Grès S, et al. (2014) Pro-fibrotic activity of lysophosphatidic acid in adipose tissue: in vivo and in vitro evidence. Biochim Biophys Acta 1841: 88-96. doi: 10.1016/j.bbalip.2013.10.003
|
| [15] |
Dalfó E, Hernandez M, Lizcano JM, et al. (2003) Activation of human lung semicarbazide sensitive amine oxidase by a low molecular weight component present in human plasma. Biochim Biophys Acta 1638: 278-286. doi: 10.1016/S0925-4439(03)00094-2
|
| [16] |
Bour S, Daviaud D, Grès S, et al. (2007) Adipogenesis-related increase of semicarbazide-sensitive amine oxidase and monoamine oxidase in human adipocytes. Biochimie 89: 916-925. doi: 10.1016/j.biochi.2007.02.013
|
| [17] |
Iglesias-Osma MC, Garcia-Barrado MJ, Visentin V, et al. (2004) Benzylamine exhibits insulin-like effects on glucose disposal, glucose transport, and fat cell lipolysis in rabbits and diabetic mice. J Pharmacol Exp Ther 309: 1020-1028. doi: 10.1124/jpet.103.063636
|
| [18] |
Mercader J, Wanecq E, Chen J, et al. (2011) Isopropylnorsynephrine is a stronger lipolytic agent in human adipocytes than synephrine and other amines present in Citrus aurantium. J Physiol Biochem 67: 443-452. doi: 10.1007/s13105-011-0078-2
|
| [19] | Visentin V, Morin N, Fontana E, et al. (2001) Dual action of octopamine on glucose transport into adipocytes: inhibition via beta3-adrenoceptor activation and stimulation via oxidation by amine oxidases. J Pharmacol Exp Ther 299: 96-104. |
| [20] |
Iffiu-Soltesz Z, Prévot D, Carpéné C (2009) Influence of prolonged fasting on monoamine oxidase and semicarbazide-sensitive amine oxidase activities in rat white adipose tissue. J Physiol Biochem 65: 11-23. doi: 10.1007/BF03165965
|
| [21] |
Carpéné C, Chalaux E, Lizarbe M, et al. (1993) Beta 3-adrenergic receptors are responsible for the adrenergic inhibition of insulin-stimulated glucose transport in rat adipocytes. Biochem J 296: 99-105. doi: 10.1042/bj2960099
|
| [22] |
Iglesias-Osma MC, Bour S, Garcia-Barrado MJ, et al. (2005) Methylamine but not mafenide mimics insulin-like activity of the semicarbazide-sensitive amine oxidase-substrate benzylamine on glucose tolerance and on human adipocyte metabolism. Pharmacol Res 52: 475-484. doi: 10.1016/j.phrs.2005.07.008
|
| [23] |
Carpéné C, Bousquet-Melou A, Galitzky J, et al. (1998) Lipolytic effects of beta 1-, beta 2-, and beta 3-adrenergic agonists in white adipose tissue of mammals. Ann N Y Acad Sci 839: 186-189. doi: 10.1111/j.1749-6632.1998.tb10756.x
|
| [24] | Castan I, Valet P, Quideau N, et al. (1994) Antilipolytic effects of alpha 2-adrenergic agonists, neuropeptide Y, adenosine, and PGE1 in mammal adipocytes. Am J Physiol 266: R1141-1147. |
| [25] |
Sekharam M, Cunnick JM, Wu J (2000) Involvement of lipoxygenase in lysophosphatidic acid-stimulated hydrogen peroxide release in human HaCaT keratinocytes. Biochem J 346: 751-758. doi: 10.1042/bj3460751
|
| [26] |
Pizzinat N, Marti L, Remaury A, et al. (1999) High expression of monoamine oxidases in human white adipose tissue: evidence for their involvement in noradrenaline clearance. Biochem Pharmacol 58: 1735-1742. doi: 10.1016/S0006-2952(99)00270-1
|
| [27] | Schimmel RJ, Honeyman TW, McMahon KK, et al. (1980) Inhibition of cyclic AMP accumulation in hamster adipocytes with phosphatidic acid: differences and similarities with alpha adrenergic effects. J Cyclic Nucleotide Res 6: 437-449. |
| [28] | Lafontan M, Bousquet-Melou A, Galitzky J, et al. (1995) Adrenergic receptors and fat cells: differential recruitment by physiological amines and homologous regulation. Obes Res 3 Suppl 4: 507s-514s. |
| [29] | Carpéné C, Schaak S, Guilbeau-Frugier C, et al. (2016) High intake of dietary tyramine does not deteriorate glucose handling and does not cause adverse cardiovascular effects in mice. J Physiol Biochem in press. |
| [30] | Liu YB, Kharode Y, Bodine PV, et al. (2010) LPA induces osteoblast differentiation through interplay of two receptors: LPA1 and LPA4. J Cell Biochem 109: 794-800. |
| [31] |
Jun DJ, Lee JH, Choi BH, et al. (2006) Sphingosine-1-phosphate modulates both lipolysis and leptin production in differentiated rat white adipocytes. Endocrinology 147: 5835-5844. doi: 10.1210/en.2006-0579
|
| [32] |
Hirakawa M, Karashima Y, Watanabe M, et al. (2007) Protein kinase A inhibits lysophosphatidic acid-induced migration of airway smooth muscle cells. J Pharmacol Exp Ther 321: 1102-1108. doi: 10.1124/jpet.106.118042
|
| [33] |
Chang CL, Lin ME, Hsu HY, et al. (2008) Lysophosphatidic acid-induced interleukin-1 beta expression is mediated through Gi/Rho and the generation of reactive oxygen species in macrophages. J Biomed Sci 15: 357-363. doi: 10.1007/s11373-007-9223-x
|
| [34] |
Lee MJ, Jeon ES, Lee JS, et al. (2008) Lysophosphatidic acid in malignant ascites stimulates migration of human mesenchymal stem cells. J Cell Biochem 104: 499-510. doi: 10.1002/jcb.21641
|
| [35] |
Carpéné C, Berlan M, Lafontan M (1983) Lack of functional antilipolytic alpha 2-adrenoceptor in rat fat cell:comparison with hamster adipocyte. Comp Biochem Physiol C 74: 41-45. doi: 10.1016/0742-8413(83)90145-7
|
| [36] |
Yea K, Kim J, Lim S, et al. (2008) Lysophosphatidic acid regulates blood glucose by stimulating myotube and adipocyte glucose uptake. J Mol Med (Berl) 86: 211-220. doi: 10.1007/s00109-007-0269-z
|
| [37] |
Thomson FJ, Moyes C, Scott PH, et al. (1996) Lysophosphatidic acid stimulates glucose transport in Xenopus oocytes via a phosphatidylinositol 3'-kinase with distinct properties. Biochem J 316: 161-166. doi: 10.1042/bj3160161
|
| [38] | Keller JN, Steiner MR, Mattson MP, et al. (1996) Lysophosphatidic acid decreases glutamate and glucose uptake by astrocytes. J Neurochem 67: 2300-2305. |
| [39] |
Rancoule C, Dusaulcy R, Tréguer K, et al. (2014) Involvement of autotaxin/lysophosphatidic acid signaling in obesity and impaired glucose homeostasis. Biochimie 96: 140-143. doi: 10.1016/j.biochi.2013.04.010
|
| [40] |
McIntyre TM, Pontsler AV, Silva AR, et al. (2003) Identification of an intracellular receptor for lysophosphatidic acid (LPA): LPA is a transcellular PPARgamma agonist. Proc Natl Acad Sci U S A 100: 131-136. doi: 10.1073/pnas.0135855100
|
| [41] |
Iffiu-Soltesz Z, Mercader J, Daviaud D, et al. (2011) Increased primary amine oxidase expression and activity in white adipose tissue of obese and diabetic db-/- mice. J Neural Transm (Vienna) 118: 1071-1077. doi: 10.1007/s00702-011-0586-9
|
| [42] |
Rancoule C, Pradere JP, Gonzalez J, et al. (2011) Lysophosphatidic acid-1-receptor targeting agents for fibrosis. Expert Opin Investig Drugs 20: 657-667. doi: 10.1517/13543784.2011.566864
|
| [43] |
Liu S, Umezu-Goto M, Murph M, ., et al. (2009) Expression of autotaxin and lysophosphatidic acid receptors increases mammary tumorigenesis, invasion, and metastases. Cancer Cell 15: 539-550. doi: 10.1016/j.ccr.2009.03.027
|
| [44] |
Sibon I, Mercier N, Darret D, et al. (2008) Association between semicarbazide-sensitive amine oxidase, a regulator of the glucose transporter, and elastic lamellae thinning during experimental cerebral aneurysm development: laboratory investigation. J Neurosurg 108: 558-566. doi: 10.3171/JNS/2008/108/3/0558
|
| [45] |
Taylor LA, Arends J, Hodina AK, et al. (2007) Plasma lyso-phosphatidylcholine concentration is decreased in cancer patients with weight loss and activated inflammatory status. Lipids Health Dis 6: 17. doi: 10.1186/1476-511X-6-17
|
| [46] |
Reeves VL, Trybula JS, Wills RC, et al. (2015) Serum Autotaxin/ENPP2 correlates with insulin resistance in older humans with obesity. Obesity (Silver Spring) 23: 2371-2376. doi: 10.1002/oby.21232
|
| [47] |
Visentin V, Prévot D, De Saint Front VD, et al. (2004) Alteration of amine oxidase activity in the adipose tissue of obese subjects. Obes Res 12: 547-555. doi: 10.1038/oby.2004.62
|
| 1. | Tianshu Wei, Jinjie Huang, A Dual Discriminator Method for Generalized Zero-Shot Learning, 2024, 79, 1546-2226, 1599, 10.32604/cmc.2024.048098 |
Figures(6)
Christian Carpéné, Jean Galitzky, Jean Sébastien Saulnier-Blache. Short-term and rapid effects of lysophosphatidic acid on human adipose cell lipolytic and glucose uptake activities[J]. AIMS Molecular Science, 2016, 3(2): 222-237. doi: 10.3934/molsci.2016.2.222
| AWA1 | AWA2 | aPY | |||||||
| ts | tr | H | ts | tr | H | ts | tr | H | |
| SAE [8] | 1.8 | 77.1 | 3.5 | 1.1 | 82.2 | 2.2 | 0.4 | 80.9 | 0.9 |
| DAP [26] | 46.5 | 68.5 | 55.4 | 43.7 | 70.2 | 53.3 | 27.6 | 55.8 | 37.0 |
| IAP [26] | 2.1 | 78.2 | 4.1 | 0.9 | 87.6 | 1.8 | 5.7 | 65.6 | 10.4 |
| SJE [29] | 11.3 | 74.6 | 19.6 | 8.0 | 73.9 | 14.4 | 3.7 | 55.7 | 6.9 |
| Preserving Semantic Relations (PSR) [30] | 20.7 | 73.8 | 32.3 | 13.5 | 51.4 | 21.4 | |||
| f-CLSWGAN [20] | 57.9 | 61.4 | 59.6 | ||||||
| Zhang et al. [31] | 20.7 | 67.9 | 38.6 | 16.1 | 66.9 | 25.9 | |||
| Li et al. [11] | 54.9 | 71.7 | 62.2 | ||||||
| CADA-VAE [18] | 57.3 | 72.8 | 64.1 | 55.8 | 75.0 | 63.9 | |||
| Chen et al. [23] | 54.7 | 72.7 | 62.4 | 55.6 | 76.9 | 64.2 | |||
| Chen et al. [12] | 54.5 | 72.8 | 62.3 | 55.2 | 73.5 | 63.0 | 26.7 | 51.5 | 35.2 |
| The proposed method | 62.4 | 63.9 | 63.1 | 60.6 | 69.5 | 64.7 | 31.5 | 55.3 | 40.1 |
DownLoad:
CSV
| AWA1 | AWA2 | aPY | |
| SAE [8] | 53.0 | 54.1 | 8.3 |
| DAP [26] | 44.1 | 46.1 | 33.8 |
| IAP [26] | 35.9 | 35.9 | 36.6 |
| SJE [29] | 65.6 | 61.9 | 32.9 |
| PSR [30] | 63.8 | 38.4 | |
| Cross-Class Sample Synthesis (CCSS) [32] | 56.3 | 63.7 | 35.5 |
| f-CLSWGAN [20] | 69.9 | ||
| Zhang et al. [31] | 68.8 | 41.3 | |
| Li et al. [11] | 69.9 | ||
| CADA-VAE [18] | 58.8 | 60.3 | |
| Chen et al. [12] | 65.2 | 65.5 | 32.7 |
| The proposed method | 67.1 | 66.1 | 39.8 |
DownLoad:
CSV
| AWA1 | AWA2 | aPY | ||||
| acc | H | acc | H | acc | H | |
| a | 45.1 | 30.0 | 45.1 | 17.9 | 30.7 | 22.0 |
| b | 52.6 | 32.3 | 59.4 | 38.4 | 38.8 | 25.0 |
| c | 56.5 | 33.3 | 57.6 | 23.4 | 35.2 | 26.3 |
| d | 59.7 | 48.3 | 59.7 | 40.2 | 36.8 | 34.4 |
| e | 61.1 | 51.4 | 60.2 | 43.8 | 36.9 | 35.1 |
| f | 61.1 | 49.8 | 61.0 | 45.7 | 37.0 | 36.4 |
| The proposed method | 67.1 | 63.1 | 66.1 | 63.1 | 39.8 | 40.1 |
DownLoad:
CSV
| AWA1 | AWA2 | aPY | ||||||||||
| acc | ts | tr | H | acc | ts | tr | H | acc | ts | tr | H | |
| (1) | 55.1 | 37.0 | 71.8 | 48.8 | 55.6 | 34.8 | 73.0 | 47.1 | 35.8 | 27.0 | 52.1 | 35.6 |
| (2) | 67.1 | 62.3 | 63.9 | 63.1 | 66.1 | 60.6 | 69.5 | 64.7 | 39.8 | 31.5 | 55.3 | 40.1 |
DownLoad:
CSV
| AWA1 | AWA2 | aPY | |||||||
| ts | tr | H | ts | tr | H | ts | tr | H | |
| SAE [8] | 1.8 | 77.1 | 3.5 | 1.1 | 82.2 | 2.2 | 0.4 | 80.9 | 0.9 |
| DAP [26] | 46.5 | 68.5 | 55.4 | 43.7 | 70.2 | 53.3 | 27.6 | 55.8 | 37.0 |
| IAP [26] | 2.1 | 78.2 | 4.1 | 0.9 | 87.6 | 1.8 | 5.7 | 65.6 | 10.4 |
| SJE [29] | 11.3 | 74.6 | 19.6 | 8.0 | 73.9 | 14.4 | 3.7 | 55.7 | 6.9 |
| Preserving Semantic Relations (PSR) [30] | 20.7 | 73.8 | 32.3 | 13.5 | 51.4 | 21.4 | |||
| f-CLSWGAN [20] | 57.9 | 61.4 | 59.6 | ||||||
| Zhang et al. [31] | 20.7 | 67.9 | 38.6 | 16.1 | 66.9 | 25.9 | |||
| Li et al. [11] | 54.9 | 71.7 | 62.2 | ||||||
| CADA-VAE [18] | 57.3 | 72.8 | 64.1 | 55.8 | 75.0 | 63.9 | |||
| Chen et al. [23] | 54.7 | 72.7 | 62.4 | 55.6 | 76.9 | 64.2 | |||
| Chen et al. [12] | 54.5 | 72.8 | 62.3 | 55.2 | 73.5 | 63.0 | 26.7 | 51.5 | 35.2 |
| The proposed method | 62.4 | 63.9 | 63.1 | 60.6 | 69.5 | 64.7 | 31.5 | 55.3 | 40.1 |
| AWA1 | AWA2 | aPY | |
| SAE [8] | 53.0 | 54.1 | 8.3 |
| DAP [26] | 44.1 | 46.1 | 33.8 |
| IAP [26] | 35.9 | 35.9 | 36.6 |
| SJE [29] | 65.6 | 61.9 | 32.9 |
| PSR [30] | 63.8 | 38.4 | |
| Cross-Class Sample Synthesis (CCSS) [32] | 56.3 | 63.7 | 35.5 |
| f-CLSWGAN [20] | 69.9 | ||
| Zhang et al. [31] | 68.8 | 41.3 | |
| Li et al. [11] | 69.9 | ||
| CADA-VAE [18] | 58.8 | 60.3 | |
| Chen et al. [12] | 65.2 | 65.5 | 32.7 |
| The proposed method | 67.1 | 66.1 | 39.8 |
| AWA1 | AWA2 | aPY | ||||
| acc | H | acc | H | acc | H | |
| a | 45.1 | 30.0 | 45.1 | 17.9 | 30.7 | 22.0 |
| b | 52.6 | 32.3 | 59.4 | 38.4 | 38.8 | 25.0 |
| c | 56.5 | 33.3 | 57.6 | 23.4 | 35.2 | 26.3 |
| d | 59.7 | 48.3 | 59.7 | 40.2 | 36.8 | 34.4 |
| e | 61.1 | 51.4 | 60.2 | 43.8 | 36.9 | 35.1 |
| f | 61.1 | 49.8 | 61.0 | 45.7 | 37.0 | 36.4 |
| The proposed method | 67.1 | 63.1 | 66.1 | 63.1 | 39.8 | 40.1 |
| AWA1 | AWA2 | aPY | ||||||||||
| acc | ts | tr | H | acc | ts | tr | H | acc | ts | tr | H | |
| (1) | 55.1 | 37.0 | 71.8 | 48.8 | 55.6 | 34.8 | 73.0 | 47.1 | 35.8 | 27.0 | 52.1 | 35.6 |
| (2) | 67.1 | 62.3 | 63.9 | 63.1 | 66.1 | 60.6 | 69.5 | 64.7 | 39.8 | 31.5 | 55.3 | 40.1 |
