A Vision sensing-based automatic evaluation method for teaching effect based on deep residual network

Meijuan Sun; Meijuan Sun

doi:10.3934/mbe.2023275

Mathematical Biosciences and Engineering

2023, Volume 20, Issue 4: 6358-6373. doi: 10.3934/mbe.2023275

Previous Article Next Article

Research article

A Vision sensing-based automatic evaluation method for teaching effect based on deep residual network

Meijuan Sun ^{1,2
,
,}

1.
Kansas International School, Sias University, Zhengzhou 451100, Henan, China
2.
Center of Research on Sino-American Cooperation in Running Schools of Sias University, China

Academic Editor: Mariano Torrisi

Received: 29 November 2022 Revised: 03 January 2023 Accepted: 09 January 2023 Published: 01 February 2023

The automatic evaluation of the teaching effect has been a technical problem for many years. Because only video frames are available for it, and the information extraction from such dynamic scenes still remains challenging. In recent years, the progress of deep learning has boosted the application of computer vision in many areas, which can provide much insight into the above issue. As a consequence, this paper proposes a vision sensing-based automatic evaluation method for teaching effects based on deep residual network (DRN). The DRN is utilized to construct a backbone network for sensing from visual features such as attending status, taking notes, playing phones, looking outside, etc. The extracted visual features are further selected as the basis for the evaluation of the teaching effect. We have also collected some realistic course images to establish a real-world dataset for the performance assessment of the proposal. The proposed method is implemented on collected datasets via computer programming-based simulation experiments, so as to obtain accuracy assessment results as measurement. The obtained results show that the proposal can well perceive typical visual features from video frames of courses and realize automatic evaluation of the teaching effect.
- residual neural network,
- intelligent assessment,
- behavior recognition,
- social computing
Citation: Meijuan Sun. A Vision sensing-based automatic evaluation method for teaching effect based on deep residual network[J]. Mathematical Biosciences and Engineering, 2023, 20(4): 6358-6373. doi: 10.3934/mbe.2023275

Related Papers:

Abstract

The automatic evaluation of the teaching effect has been a technical problem for many years. Because only video frames are available for it, and the information extraction from such dynamic scenes still remains challenging. In recent years, the progress of deep learning has boosted the application of computer vision in many areas, which can provide much insight into the above issue. As a consequence, this paper proposes a vision sensing-based automatic evaluation method for teaching effects based on deep residual network (DRN). The DRN is utilized to construct a backbone network for sensing from visual features such as attending status, taking notes, playing phones, looking outside, etc. The extracted visual features are further selected as the basis for the evaluation of the teaching effect. We have also collected some realistic course images to establish a real-world dataset for the performance assessment of the proposal. The proposed method is implemented on collected datasets via computer programming-based simulation experiments, so as to obtain accuracy assessment results as measurement. The obtained results show that the proposal can well perceive typical visual features from video frames of courses and realize automatic evaluation of the teaching effect.

References

[1]	Z. Guo, K. Yu, Z. Lv, K. K. R. Choo, P. Shi, J. Rodrigues, Deep federated learning enhanced secure poi microservices for cyber-physical systems, IEEE Wireless Commun., 29 (2022), 22–29. https://doi.org/10.1109/MWC.002.2100272 doi: 10.1109/MWC.002.2100272
[2]	S. Xia, Z. Yao, G. Wu, Y. Li, Distributed offloading for cooperative intelligent transportation under heterogeneous networks, IEEE Trans. Intell. Transp. Syst., 23 (2022), 16701–16714. https://doi.org/10.1109/TITS.2022.3190280 doi: 10.1109/TITS.2022.3190280
[3]	Z. Guo, K. Yu, A. Jolfaei, F. Ding, N. Zhang, Fuz-spam: label smoothing-based fuzzy detection of spammers in internet of things, IEEE Trans. Fuzzy Syst., 30 (2022), 4543–4554. https://doi.org/10.1109/TFUZZ.2021.3130311 doi: 10.1109/TFUZZ.2021.3130311
[4]	L. Zhao, Z. Yin, K. Yu, X. Tang, L. Xu, Z. Guo, et al., A fuzzy logic based intelligent multi-attribute routing scheme for two-layered sdvns, IEEE Trans. Network Serv. Manage., 2022 (2022). https://doi.org/10.1109/TNSM.2022.3202741 doi: 10.1109/TNSM.2022.3202741
[5]	Z. Zhou, X. Dong, Z. Li, K. Yu, C. Ding, Y. Yang, Spatio-yemporal feature encoding for traffic accident detection in vanet environment, IEEE Trans. Intell. Transp. Syst., 23 (2022), 19772–19781. https://doi.org/10.1109/TITS.2022.3147826 doi: 10.1109/TITS.2022.3147826
[6]	S. Zhang, H. Gu, K. Chi, L. Huang, K. Yu, S. Mumtaz, Drl-based partial offloading for maximizing sum computation rate of wireless powered mobile edge computing network, IEEE Trans. Wireless Commun., 21 (2022), 10934–10948. https://doi.org/10.1109/TWC.2022.3188302 doi: 10.1109/TWC.2022.3188302
[7]	D. Peng, D. He, Y. Li, Z. Wang, Integrating terrestrial and satellite multibeam systems toward 6G: techniques and challenges for interference mitigation, IEEE Wireless Commun., 29 (2022), 24–31. https://doi.org/10.1109/MWC.002.00293 doi: 10.1109/MWC.002.00293
[8]	A. Büyükkarci, M. Müldür, digital storytelling for primary school mathematics teaching: product and process evaluation, Educ. Inf. Technol., 27 (2022), 5365–5396. https://doi.org/10.1007/s10639-021-10813-8 doi: 10.1007/s10639-021-10813-8
[9]	Z. Guo, K. Yu, A. K. Bashir, D. Zhang, Y. D. Al-Otaibi, M. Guizani, Deep information fusion-driven POI scheduling for mobile social networks, IEEE Network, 36 (2022), 210–216. https://doi.org/10.1109/MNET.102.2100394 doi: 10.1109/MNET.102.2100394
[10]	A. Cahyadi, Hendryadi, S. Widyastuti, Suryani, Covid-19, emergency remote teaching evaluation: the case of Indonesia, Educ. Inf. Technol., 27 (2022), 2165–2179. https://doi.org/10.1007/s10639-021-10680-3 doi: 10.1007/s10639-021-10680-3
[11]	Y. Lu, L. Yang, S. X. Yang, Q. Hua, A. K. Sangaiah, T. Guo, et al., An intelligent deterministic scheduling method for ultra-low latency communication in edge enabled industrial internet of things, IEEE Trans. Ind. Inf., 19 (2023), 1756–1767. https://doi.org/10.1109/TII.2022.3186891 doi: 10.1109/TII.2022.3186891
[12]	B. Huang, K. Wang, An improved BP neural network-based quality evaluation model for Chinese international education teaching courses, in ICCDA 2022: The 6th International Conference on Compute and Data Analysis, (2022), 122–127. https://doi.org/10.1145/3523089.3523109
[13]	Q. Zhang, K. Yu, Z. Guo, S. Garg, J. Rodrigues, M. M. Hassan, et al., Graph neural network-driven traffic forecasting for the connected internet of vehicles, IEEE Trans. Network Sci. Eng., 9 (2022), 3015–3027. https://doi.org/10.1109/TNSE.2021.3126830 doi: 10.1109/TNSE.2021.3126830
[14]	C. Hou, J. Ai, Y. Lin, C. Guan, J. Li, W. Zhu, Evaluation of online teaching quality based on facial expression recognition, Future Internet, 14 (2022). https://doi.org/10.3390/fi14060177 doi: 10.3390/fi14060177
[15]	S. Qi, L. Liu, B. S. Kumar, A. Prathik, An english teaching quality evaluation model based on gaussian process machine learning, Expert Syst. J. Knowl. Eng., 39 (2022). https://doi.org/10.1111/exsy.12861 doi: 10.1111/exsy.12861
[16]	H. Shu, English teaching effect evaluation based on data association mining, in CIPAE 2021: 2nd International Conference on Computers, Information Processing and Advanced Education, (2021), 1223–1226. https://doi.org/10.1145/3456887.3457494
[17]	P. Gao, VIKOR method for intuitionistic fuzzy multi-attribute group decision-making and its application to teaching quality evaluation of college english, J. Intell. Fuzzy Syst., 42 (2022), 5189–5197. https://doi.org/10.3233/JIFS-211749 doi: 10.3233/JIFS-211749
[18]	D. Wei, Y. Rong, H. Garg, J. Liu, An extended WASPAS approach for teaching quality evaluation based on pythagorean fuzzy reducible weighted maclaurin symmetric mean, J. Intell. Fuzzy Syst., 42 (2022), 3121–3152. https://doi.org/10.3233/JIFS-210821 doi: 10.3233/JIFS-210821
[19]	M. Li, Multidimensional analysis and evaluation of college english teaching quality based on an artificial intelligence model, J. Sens., 2022 (2022), 1–13. https://doi.org/10.1155/2022/1314736 doi: 10.1155/2022/1314736
[20]	S. Zeng, Y. Pan, H. Jin, Online teaching quality evaluation of business statistics course utilizing fermatean fuzzy analytical hierarchy process with aggregation operator, Systems, 10 (2022). https://doi.org/10.3390/systems10030063 doi: 10.3390/systems10030063
[21]	B. Feng, Dynamic analysis of college physical education teaching quality evaluation based on network under the big data, Comput. Intell. Neurosci., 2021 (2021). https://doi.org/10.1155/2021/5949167 doi: 10.1155/2021/5949167
[22]	X. Xu, F. Liu, Optimization of online education and teaching evaluation system based on GA-BP neural network, Comput. Intell. Neurosci., 2021 (2021). https://doi.org/10.1155/2021/8785127 doi: 10.1155/2021/8785127
[23]	J. Heo, S. Han, The mediating effect of literacy of LMS between self-evaluation online teaching effectiveness and self-directed learning readiness, Educ. Inf. Technol., 26 (2021), 6097–6108. https://doi.org/10.1007/s10639-021-10590-4 doi: 10.1007/s10639-021-10590-4
[24]	R. Tárraga-Mínguez, C. S. Guerrero, P. Sanz-Cervera, Digital teaching competence evaluation of pre-service teachers in spain: a review study, IEEE Rev. Iberoam. Tecnol. Aprendizaje, 16 (2021), 70–76. https://doi.org/10.1109/RITA.2021.3052848 doi: 10.1109/RITA.2021.3052848
[25]	Y. V. Tsekhmister, T. Konovalova, B. Y. Tsekhmister, A. Agrawal, D. Ghosh, Evaluation of virtual reality technology and online teaching system for medical students in ukraine during COVID-19 pandemic, Int. J. Emerging Technol. Learn., 16 (2021). https://doi.org/10.3991/ijet.v16i23.26099 doi: 10.3991/ijet.v16i23.26099
[26]	Y. Wang, S. Li, B. Zhao, J. Zhang, Y. Yang, B. Li, A resnet-based approach for accurate radiographic diagnosis of knee osteoarthritis, CAAI Trans. Intell. Technol., 7 (2022), 512–521. https://doi.org/10.1049/cit2.12079 doi: 10.1049/cit2.12079
[27]	Y. Wang, C. Sun, Y. Guo, A multi-attribute fuzzy evaluation model for the teaching quality of physical education in colleges and its implementation strategies, Int. J. Emerging Technol. Learn., 16 (2021). https://doi.org/10.3991/ijet.v16i02.19725 doi: 10.3991/ijet.v16i02.19725
[28]	S. Qiao, S. Pang, G. Luo, S. Pan, Z. Yu, T. Chen, et al., RLDS: an explainable residual learning diagnosis system for fetal congenital heart disease, Future Gener. Comput. Syst., 128 (2022), 205–218. https://doi.org/10.1016/j.future.2021.10.001 doi: 10.1016/j.future.2021.10.001
[29]	S. Qiao, S. Pang, G. Luo, S. Pan, T. Chen, Z. Lv, FLDS: an intelligent feature learning detection system for visualizing medical images supporting fetal four-chamber views, IEEE J. Biomed. Health Inf., 26 (2022), 4814–4825. https://doi.org/10.1109/JBHI.2021.3091579 doi: 10.1109/JBHI.2021.3091579
[30]	S. Qiao, S. Pang, Y. Sun, G. Luo, W. Yin, Y. Zhao, et al., Sprechd: four-chamber semantic parsing network for recognizing fetal congenital heart disease in medical Metaverse, IEEE J. Biomed. Health. Inf., (2022), 1–11. https://doi.org/10.1109/JBHI.2022.3218577 doi: 10.1109/JBHI.2022.3218577
[31]	Y. Zhang, The development of an evaluation model to assess the effect of online english teaching based on fuzzy mathematics, Int. J. Emerging Technol. Learn., 16 (2021). https://doi.org/10.3991/ijet.v16i12.23325 doi: 10.3991/ijet.v16i12.23325
[32]	Y. Han, Evaluation of english online teaching based on remote supervision algorithms and deep learning, J. Intell. Fuzzy Syst., 40 (2021), 7097–7108. https://doi.org/10.3233/JIFS-189539 doi: 10.3233/JIFS-189539
[33]	H. Liang, Role of artificial intelligence algorithm for taekwondo teaching effect evaluation model, J. Intell. Fuzzy Syst., 40 (2021), 3239–3250. https://doi.org/10.3233/JIFS-189364 doi: 10.3233/JIFS-189364
[34]	Y. Liu, Evaluation algorithm of teaching work quality in colleges and universities based on deep denoising autoencoder network, Mobile Inf. Syst., 2021 (2021). https://doi.org/10.1155/2021/8161985 doi: 10.1155/2021/8161985
[35]	G. Li, F. Liu, Y. Wang, Y. Guo, L. Xiao, L. Zhu, A convolutional neural network (CNN) based approach for the recognition and evaluation of classroom teaching behavior, Sci. Program., 2021 (2021). https://doi.org/10.1155/2021/6336773 doi: 10.1155/2021/6336773
[36]	P. Liu, X. Wang, F. Teng, Online teaching quality evaluation based on multi-granularity probabilistic linguistic term sets, J. Intell. Fuzzy Syst., 40 (2021), 9915–9935. https://doi.org/10.3233/JIFS-202543 doi: 10.3233/JIFS-202543
[37]	Q. Wang, Research on teaching quality evaluation of college english based on the CODAS method under interval-valued intuitionistic fuzzy information, J. Intell. Fuzzy Syst., 41 (2021), 1499–1508. https://doi.org/10.3233/JIFS-210366 doi: 10.3233/JIFS-210366
[38]	H. Yu, Online teaching quality evaluation based on emotion recognition and improved aprioritid algorithm, J. Intell. Fuzzy Syst., 40 (2021), 7037–7047. https://doi.org/10.3233/JIFS-189534 doi: 10.3233/JIFS-189534
[39]	Y. Yu, English teaching ability evaluation algorithm based on big data fuzzy k-means clustering, Advances in Intelligent Systems and Computing, Springer, (2021), 557–564. https://doi.org/10.1007/978-3-030-69999-4_77
[40]	A. Amelio, G. Bonifazi, F. Cauteruccio, E. Corradini, M. Marchetti, D. Ursino, et al., Representation and compression of residual neural networks through a multilayer network based approach, Expert Syst. Appl., 215 (2023). https://doi.org/10.1016/j.eswa.2022.119391 doi: 10.1016/j.eswa.2022.119391

Reader Comments

Your name:*

Email:*
© 2023 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)