HDS-YOLOv5: An improved safety harness hook detection algorithm based on YOLOv5s

Mingju Chen; Zhongxiao Lan; Zhengxu Duan; Sihang Yi; Qin Su; Mingju Chen; Zhongxiao Lan; Zhengxu Duan; Sihang Yi; Qin Su

doi:10.3934/mbe.2023691

Mathematical Biosciences and Engineering

2023, Volume 20, Issue 8: 15476-15495. doi: 10.3934/mbe.2023691

Previous Article Next Article

Research article Special Issues

HDS-YOLOv5: An improved safety harness hook detection algorithm based on YOLOv5s

1.
Artificial Intelligence Key Laboratory of Sichuan Province, Sichuan University of Science & Engineering, Yibin 644002, China
2.
School of Automation and Information Engineering, Sichuan University of Science & Engineering, Yibin 644002, China
3.
Key Laboratory of Higher Education of Sichuan Province for Enterprise Informationalization and Internet of Things, Sichuan University of Science & Engineering, Yibin 644002, China

Academic Editor: Yiu-ming Cheung

Received: 18 May 2023 Revised: 17 July 2023 Accepted: 20 July 2023 Published: 25 July 2023

Improperly using safety harness hooks is a major factor of safety hazards during power maintenance operation. The machine vision-based traditional detection methods have low accuracy and limited real-time effectiveness. In order to quickly discern the status of hooks and reduce safety incidents in the complicated operation environments, three improvements are incorporated in YOLOv5s to construct the novel HDS-YOLOv5 network. First, HOOK-SPPF (spatial pyramid pooling fast) feature extraction module replaces the SPPF backbone network. It can enhance the network's feature extraction capability with less feature loss and extract more distinctive hook features from complex backgrounds. Second, a decoupled head module modified with confidence and regression frames is implemented to reduce negative conflicts between classification and regression, resulting in increased recognition accuracy and accelerated convergence. Lastly, the Scylla intersection over union (SIoU) is employed to optimize the loss function by utilizing the vector angle between the real and predicted frames, thereby improving the model's convergence. Experimental results demonstrate that the HDS-YOLOv5 algorithm achieves a 3% increase in mAP@0.5, reaching 91.2%. Additionally, the algorithm achieves a detection rate of 24.0 FPS (frames per second), demonstrating its superior performance compared to other models.
- power operation,
- safety harness hook,
- YOLOv5,
- decoupled head,
- loss function
Citation: Mingju Chen, Zhongxiao Lan, Zhengxu Duan, Sihang Yi, Qin Su. HDS-YOLOv5: An improved safety harness hook detection algorithm based on YOLOv5s[J]. Mathematical Biosciences and Engineering, 2023, 20(8): 15476-15495. doi: 10.3934/mbe.2023691

Related Papers:

Abstract

Improperly using safety harness hooks is a major factor of safety hazards during power maintenance operation. The machine vision-based traditional detection methods have low accuracy and limited real-time effectiveness. In order to quickly discern the status of hooks and reduce safety incidents in the complicated operation environments, three improvements are incorporated in YOLOv5s to construct the novel HDS-YOLOv5 network. First, HOOK-SPPF (spatial pyramid pooling fast) feature extraction module replaces the SPPF backbone network. It can enhance the network's feature extraction capability with less feature loss and extract more distinctive hook features from complex backgrounds. Second, a decoupled head module modified with confidence and regression frames is implemented to reduce negative conflicts between classification and regression, resulting in increased recognition accuracy and accelerated convergence. Lastly, the Scylla intersection over union (SIoU) is employed to optimize the loss function by utilizing the vector angle between the real and predicted frames, thereby improving the model's convergence. Experimental results demonstrate that the HDS-YOLOv5 algorithm achieves a 3% increase in mAP@0.5, reaching 91.2%. Additionally, the algorithm achieves a detection rate of 24.0 FPS (frames per second), demonstrating its superior performance compared to other models.

References

[1]	J. Li, H. Liu, T. Wang, M. Jiang, S. Wang, K. Li, et al., Safety helmet wearing detection based on image processing and machine learning, in 2017 Ninth International Conference on Advanced Computational Intelligence (ICACI), (2017), 201–205. https://doi.org/10.1109/icaci.2017.7974509
[2]	X. Xu, X. Wang, Z. Q. Sun, S. X. Wang, Face recognition technology based on CNN, XGBoost, model fusion and its application for safety management in power system, in IOP Conference Series: Earth and Environmental Science, 645 (2021), 012054. https://dx.doi.org/10.1088/1755-1315/645/1/012054
[3]	Z. Sun, Y. Xuan, L. Fan, R. Han, Y. Tu, J. Huang, et al., Security monitoring strategy of distribution community operation site based on intelligent image processing method, Front. Energy Res., 10 (2022), 931515. https://doi.org/10.3389/fenrg.2022.931515 doi: 10.3389/fenrg.2022.931515
[4]	B. Weng, W. Gao, W. Zheng, G. Yang, Newly designed identifying method for ice thickness on high-voltage transmission lines via machine vision, High Voltage, 6 (2021), 904–922. https://doi.org/10.1049/hve2.12086 doi: 10.1049/hve2.12086
[5]	J. X. Li, Y. Y. Liu, H. Wang, Safety supervision method of power work site based on computer machine learning and image recognition, J. Phys. Conf. Ser., 2074 (2021), 012021. https://dx.doi.org/10.1088/1742-6596/2074/1/012021 doi: 10.1088/1742-6596/2074/1/012021
[6]	R. Girshick, J. Donahue, T. Darrell, J. Malik, Rich feature hierarchies for accurate object detection and semantic segmentation, in 2014 IEEE Conference on Computer Vision and Pattern Recognition, (2014), 580–587. https://doi.org/10.1109/cvpr.2014.81
[7]	R. Girshick, Fast R-CNN, in 2015 IEEE International Conference on Computer Vision (ICCV), (2015), 1440–1448. https://doi.org/10.1109/iccv.2015.169
[8]	S. Ren, K. He, R. Girshick, J. Sun, Faster R-CNN: Towards real-time object detection with region proposal networks, IEEE Trans. Pattern Anal. Mach. Intell., 39 (2017), 1137–1149. https://doi.org/10.1109/tpami.2016.2577031 doi: 10.1109/tpami.2016.2577031
[9]	K. He, G. Gkioxari, P. Dollár, R. Girshick, Mask R-CNN, in 2017 IEEE International Conference on Computer Vision (ICCV), (2017), 2980–2988. http://doi.org/10.1109/ICCV.2017.322
[10]	T. Y. Lin, P. Dollár, R. Girshick, K. He, B. Hariharan, S. Belongie, Feature pyramid networks for object detection, in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (2017), 936–944. http://doi.org/10.1109/CVPR.2017.106
[11]	K. He, X. Zhang, S. Ren, J. Sun, Spatial pyramid pooling in deep convolutional networks for visual recognition, IEEE Trans. Pattern Anal. Mach. Intell., 37 (2015), 1904–1916. http://doi.org/10.1109/TPAMI.2015.2389824 doi: 10.1109/TPAMI.2015.2389824
[12]	W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. E. Reed, C. Y. Fu, et al., SSD: Single shot multibox detector, in European Conference on Computer Vision, preprint, arXiv: 1512.02325. https://doi.org/10.48550/arXiv.1512.02325
[13]	C. Y. Fu, W. Liu, A. Ranga, A. Tyagi, A. C. Berg, DSSD: Deconvolutional single shot detector, preprint, arXiv: 1701.06659. http://doi.org/10.48550/arXiv.1701.06659
[14]	M. Tan, R. Pang, Q. V. Le, EfficientDet: Scalable and efficient object detection, in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2020), 10778–10787. http://doi.org/10.1109/CVPR42600.2020.01079
[15]	T. Y. Lin, P. Goyal, R. Girshick, K. He, P. Dollár, Focal loss for dense object detection, IEEE Trans. Pattern Anal. Mach. Intell., 42 (2020), 318–327. http://doi.org/10.1109/TPAMI.2018.2858826 doi: 10.1109/TPAMI.2018.2858826
[16]	J. Redmon, S. Divvala, R. Girshick, A. Farhadi, You only look once: Unified, real-time object detection, in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (2016), 779–788. http://doi.org/10.1109/CVPR.2016.91
[17]	J. Redmon, A. Farhadi, YOLO9000: Better, faster, stronger, in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (2017), 6517–6525. http://doi.org/10.1109/CVPR.2017.690
[18]	J. Redmon, A. Farhadi, YOLOv3: An incremental improvement, preprint, arXiv: 1804.02767. https://doi.org/10.48550/arXiv.1804.02767
[19]	A. Bochkovskiy, C. Y. Wang, H. Y. M. Liao, YOLOv4: Optimal speed and accuracy of object detection, preprint, arXiv: 2004.10934. https://doi.org/10.48550/arXiv.2004.10934
[20]	C. Y. Wang, A. Bochkovskiy, H. Y. M. Liao, YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors, preprint, arXiv: 2207.02696. https://doi.org/10.48550/arXiv.2207.02696
[21]	Z. Ge, S. Liu, F. Wang, Z. Li, J. Sun, YOLOX: Exceeding YOLO series in 2021, preprint, arXiv: 2107.08430. https://doi.org/10.48550/arXiv.2107.08430
[22]	K. Yan, Q. Li, H. Li, H. Wang, Y. Fang, L. Xing, et al., Deep learning-based substation remote construction management and AI automatic violation detection system, IET Gener. Transm. Distrib., 16 (2022), 1714–1726. https://doi.org/10.1049/gtd2.12387 doi: 10.1049/gtd2.12387
[23]	W. Fang, L. Ding, H. Luo, P. E. D. Love, Falls from heights: A computer vision-based approach for safety harness detection, Autom. Constr., 91 (2018), 53–61. https://doi.org/10.1016/j.autcon.2018.02.018 doi: 10.1016/j.autcon.2018.02.018
[24]	C. Fang, H. Xiang, C. Leng, J. Chen, Q. Yu, Research on real-time detection of safety harness wearing of workshop personnel based on YOLOv5 and OpenPose, Sustainability, 14 (2022), 5872. https://doi.org/10.3390/su14105872 doi: 10.3390/su14105872
[25]	J. Li, C. Liu, X. Lu, B. Wu, CME-YOLOv5: An efficient object detection network for densely spaced fish and small targets, Water, 14 (2022), 2412. https://doi.org/10.3390/w14152412 doi: 10.3390/w14152412
[26]	R. Chang, S. Zhou, Y. Zhang, N. Zhang, C. Zhou, M. Li, Research on insulator defect detection based on improved YOLOv7 and multi-UAV cooperative system, Coatings, 13 (2023), 880. https://doi.org/10.3390/coatings13050880 doi: 10.3390/coatings13050880
[27]	M. Chen, Z. Duan, Z. Lan, S. Yi, Scene reconstruction algorithm for unstructured weak-texture regions based on stereo vision, Appl. Sci., 13 (2023), 6407. https://doi.org/10.3390/app13116407 doi: 10.3390/app13116407
[28]	M. J. Chen, T. T Liu, X. Z. Xiong, Z. X. Duan, A. L. Cui, A transformer-based cross-window aggregated attentional image inpainting model, Electronics, 12 (2023), 2726. https://doi.org/10.3390/electronics12122726 doi: 10.3390/electronics12122726
[29]	M. O. Lawal, Tomato detection based on modified YOLOv3 framework, Sci. Rep., 11 (2021), 1447. https://doi.org/10.1038/s41598-021-81216-5 doi: 10.1038/s41598-021-81216-5
[30]	A. M. Roy, J. Bhaduri, DenseSPH-YOLOv5: An automated damage detection model based on DenseNet and Swin-Transformer prediction head-enabled YOLOv5 with attention mechanism, Adv. Eng. Inf., 56 (2023), 102007. https://doi.org/10.1016/j.aei.2023.102007 doi: 10.1016/j.aei.2023.102007
[31]	Z. Xu, J. Huang, K. Huang, A novel computer vision-based approach for monitoring safety harness use in construction, IET Image Process., 17 (2023), 1071–1085. https://doi.org/10.1049/ipr2.12696 doi: 10.1049/ipr2.12696
[32]	Z. Gevorgyan, SIoU Loss: More powerful learning for bounding box regression, preprint, arXiv: 2205.12740. https://doi.org/10.48550/arXiv.2205.12740
[33]	K. He, X. Zhang, S. Ren, J. Sun, Spatial pyramid pooling in deep convolutional networks for visual recognition, IEEE Trans. Pattern Anal. Mach. Intell., 37 (2014), 1904–1916. https://doi.org/10.1007/978-3-319-10578-9_23 doi: 10.1007/978-3-319-10578-9_23
[34]	C. Y. Wang, H. Y. M. Liao, I. H. Yeh, Y. H. Wu, P. Y. Chen, J. W. Hsieh, CSPNet: A new backbone that can enhance learning capability of CNN, in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), (2019), 1571–1580. https://doi.org/10.48550/arXiv.1911.11929
[35]	Y. Wu, Y. Chen, L. Yuan, Z. Liu, L. Wang, H. Li, et al., Rethinking classification and localization for object detection, in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2020), 10183–10192. https://doi.org/10.1109/cvpr42600.2020.01020
[36]	G. Song, Y. Liu, X. Wang, Revisiting the sibling head in object detector, in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2020), 11560–11569. https://doi.org/10.1109/cvpr42600.2020.01158
[37]	Z. Zheng, P. Wang, D. Ren, W. Liu, R. Ye, Q. Hu, et al., Enhancing geometric factors in model learning and inference for object detection and instance segmentation, IEEE Trans. Cybern., 52 (2022), 8574–8586. https://doi.org/10.1109/tcyb.2021.3095305 doi: 10.1109/tcyb.2021.3095305

Reader Comments

Your name:*

Email:*
© 2023 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)