Artificial-intelligence-assisted decision-making is appearing increasingly more frequently in our daily lives; however, it has been shown that biased data can cause unfairness in decision-making. In light of this, computational techniques are needed to limit the inequities in algorithmic decision-making. In this letter, we present a framework to join fair feature selection and fair meta-learning to do few-shot classification, which contains three parts: (1) a pre-processing component acts as an intermediate bridge between fair genetic algorithm (FairGA) and fair few-shot (FairFS) to generate the feature pool; (2) the FairGA module considers the presence or absence of words as gene expression, and filters out key features by a fairness clustering genetic algorithm; (3) the FairFS part carries out the task of representation and fairness constraint classification. Meanwhile, we propose a combinatorial loss function to cope with fairness constraints and hard samples. Experiments show that the proposed method achieves strong competitive performance on three public benchmarks.
Citation: Depei Wang, Lianglun Cheng, Tao Wang. Fairness-aware genetic-algorithm-based few-shot classification[J]. Mathematical Biosciences and Engineering, 2023, 20(2): 3624-3637. doi: 10.3934/mbe.2023169
Artificial-intelligence-assisted decision-making is appearing increasingly more frequently in our daily lives; however, it has been shown that biased data can cause unfairness in decision-making. In light of this, computational techniques are needed to limit the inequities in algorithmic decision-making. In this letter, we present a framework to join fair feature selection and fair meta-learning to do few-shot classification, which contains three parts: (1) a pre-processing component acts as an intermediate bridge between fair genetic algorithm (FairGA) and fair few-shot (FairFS) to generate the feature pool; (2) the FairGA module considers the presence or absence of words as gene expression, and filters out key features by a fairness clustering genetic algorithm; (3) the FairFS part carries out the task of representation and fairness constraint classification. Meanwhile, we propose a combinatorial loss function to cope with fairness constraints and hard samples. Experiments show that the proposed method achieves strong competitive performance on three public benchmarks.
| [1] |
Y. Li, J. Yang, J. Wen, Entropy-based redundancy analysis and information screening, Digital Commun. Networks, 2021 (2021). https://doi.org/10.1016/j.dcan.2021.12.001 doi: 10.1016/j.dcan.2021.12.001
|
| [2] |
Y. Lin, J. Yang, W. Lu, Q. Meng, Z. Lv, H. Song, Quality index for stereoscopic images by jointly evaluating cyclopean amplitude and cyclopean phase, IEEE J. Sel. Top. Signal Process., 11 (2017), 89–101. https://doi.org/10.1109/JSTSP.2016.2632422 doi: 10.1109/JSTSP.2016.2632422
|
| [3] |
Y. Li, J. Yang, Z. Zhang, J. Wen, P. Kumar, Healthcare data quality assessment for cybersecurity intelligence, IEEE Trans. Ind. Inf., 19 (2023), 841–848. https://doi.org/10.1109/TII.2022.3190405 doi: 10.1109/TII.2022.3190405
|
| [4] | S. Yang, L. Liu, M. Xu, Free lunch for few-shot learning: Distribution calibration, preprint, arXiv: 2101.06395. https://doi.org/10.48550/arXiv.2101.06395 |
| [5] | Y. Wang, Q. Yao, J. T. Kwok, L. M. Ni, Generalizing from a few examples: A survey on few-shot learning, 53 (2020), 1–34. https://doi.org/10.1145/3386252 |
| [6] | D. Chen, Y. Chen, Y. Li, F. Mao, Y. He, H. Xue, Self-supervised learning for few-shot image classification, in 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2021), (2021), 1745–1749. https://doi.org/10.1109/ICASSP39728.2021.9413783 |
| [7] | J. Xu, Q. Du, Learning transferable features in meta-learning for few-shot text classification, 135 (2020), 271–278. https://doi.org/10.1016/j.patrec.2020.05.007 |
| [8] | M. Morik, A. Singh, J. Hong, T. Joachims, Controlling fairness and bias in dynamic learning-to-rank, in Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, (2020), 429–438. https://doi.org/10.1145/3397271.3401100 |
| [9] | P. Li, H. Zhao, H. Liu, Deep fair clustering for visual learning, in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2020), 9070–9079. |
| [10] |
A. Chhabra, K. Masalkovaitė, P. Mohapatra, An overview of fairness in clustering, IEEE Access, 9 (2021), 130698–130720. https://doi.org/10.1109/ACCESS.2021.3114099 doi: 10.1109/ACCESS.2021.3114099
|
| [11] |
X. Deng, Y. Li, J. Weng, J. Zhang, Feature selection for text classification: A review, Multimedia Tools Appl., 78 (2019), 3797–3816. https://doi.org/10.1007/s11042-018-6083-5 doi: 10.1007/s11042-018-6083-5
|
| [12] | M. Fan, W. Wei, W. Jin, Z. Yang, T. Liu, Explanation-guided fairness testing through genetic algorithm, in 2022 IEEE/ACM 44th International Conference on Software Engineering (ICSE), (2022), 21843296. https://doi.org/10.1145/3510003.3510137 |
| [13] | X. Xing, H. Liu, C. Chen, J. Li, Fairness-aware unsupervised feature selection, in Proceedings of the 30th ACM International Conference on Information & Knowledge Management, (2021), 3548–3552. https://doi.org/10.1145/3459637.3482106. |
| [14] | C. Zhao, C. Li, J. Li, F. Chen, Fair meta-learning for few-shot classification, in /2020 IEEE International Conference on Knowledge Graph (ICKG), (2020), 275–282. http://arXiv.org/abs/2009.13516. |
| [15] | F. Chierichetti, R. Kumar, S. Lattanzi, S. Vassilvitskii, Fair clustering through fairlets, Adv. Neural Inf. Process. Syst., 30 (2017). |
| [16] | M. Kleindessner, S. Samadi, P. Awasthi, J. Morgenstern, Guarantees for spectral clustering with fairness constraints, in International Conference on Machine Learning, (2019), 3458–3467. |
| [17] | I. M. Ziko, E. Granger, J. Yuan, I. B. Ayed, Clustering with fairness constraints: A flexible and scalable approach, preprint, arXiv: 1906.08207. http://arXiv.org/abs/1906.08207. |
| [18] |
T. Y. Lin, P. Goyal, R. B. Girshick, K. He, P. Dollár, Focal loss for dense object detection, IEEE Trans. Pattern Anal. Mach. Intell., 42 (2020), 318–327. https://doi.org/10.1109/tpami.2018.2858826 doi: 10.1109/tpami.2018.2858826
|
| [19] |
H. Chen, W. Jiang, C. Li, R. Li, A heuristic feature selection approach for text categorization by using chaos optimization and genetic algorithm, Math. Problems Eng., 2013 (2013), e524017. https://doi.org/10.1155/2013/524017 doi: 10.1155/2013/524017
|
| [20] | S. Tizpaz-Niari, A. Kumar, G. Tan, A. Trivedi, Fairness-aware configuration of machine learning libraries, in 2022 IEEE/ACM 44th International Conference on Software Engineering (ICSE), 2022. https://doi.org/10.1145/3510003.3510202 |
| [21] | A. U. Rehman, A. Nadeem, M. Z. Malik, Fair feature subset selection using multiobjective genetic algorithm, in GECCO '22: Proceedings of the Genetic and Evolutionary Computation Conference Companion, (2022), 360–363. https://doi.org/10.1145/3520304.3529061 |
| [22] | Y. Bao, M. Wu, S. Chang, R. Barzilay, Few-shot text classification with distributional signatures, preprint, arXiv: 1908.06039. http://arXiv.org/abs/1908.06039 |
| [23] | J. Li, M. Sun, Scalable term selection for text categorization, in Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), (2007), 774–782. https://aclanthology.org/D07-1081 |
| [24] | K. Lang, Newsweeder: Learning to filter netnews, in Proceedings of the Twelfth International Conference on International Conference on Machine Learning, (1995), 331–339. https://doi.org/10.1016/B978-1-55860-377-6.50048-7 |
| [25] | R. He, J. McAuley, Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering, in Proceedings of the 25th International Conference on World Wide Web, (2016), 507–517. https://doi.org/10.1145/2872427.2883037 |
| [26] | C. Finn, P. Abbeel, S. Levine, Model-agnostic meta-learning for fast adaptation of deep networks, in International Conference on Machine Learning, (2017), 1126–1135. |
| [27] | J. Snell, K. Swersky, R. Zemel, Prototypical networks for few-shot learning, in Proceedings of the 31st International Conference on Neural Information Processing Systems, (2017), 4080–4090. |
| [28] | R. Geng, B. Li, Y. Li, X. Zhu, P. Jian, J. Sun, Induction networks for few-shot text classification, in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), (2019), 3904–3913. http://dx.doi.org/10.18653/v1/D19-1403 |
| [29] | T. Gao, X. Han, Z. Liu, M. Sun, Hybrid attention-based prototypical networks for noisy few-shot relation classification, in Proceedings of the AAAI Conference on Artificial Intelligence, (2019), 6407–6414. https://doi.org/10.1609/aaai.v33i01.33016407 |
| [30] |
D. Wang, Z. Wang, L. Cheng, W. Zhang, Few-shot text classification with global-local feature information, Sensors, 22 (2022), 4420. https://doi.org/10.3390/s22124420 doi: 10.3390/s22124420
|
| [31] | S. Majumder, J. Chakraborty, G. R. Bai, K. T. Stolee, T. Menzies, Fair enough: Searching for sufficient measures of fairness, preprint, arXiv: 2110.13029. https://doi.org/10.48550/arXiv.2110.13029 |
Figures(7) / Tables(2)
Depei Wang, Lianglun Cheng, Tao Wang. Fairness-aware genetic-algorithm-based few-shot classification[J]. Mathematical Biosciences and Engineering, 2023, 20(2): 3624-3637. doi: 10.3934/mbe.2023169
DownLoad: