In tobacco production, cigarettes with appearance defects are inevitable and dramatically impact the quality of tobacco products. Currently, available methods do not balance the tension between detection accuracy and speed. To achieve accurate detection on a cigarette production line with the rate of 200 cigarettes per second, we propose a defect detection model for cigarette appearance based on YOLOv5n (You Only Look Once Version 5 Nano), called CJS-YOLOv5n (YOLOv5n with C2F (Cross Stage Partial (CSP) Bottleneck with 2 convolutions-fast), Jump Concat, and SCYLLA-IoU (SIoU)). This model incorporates the C2F module proposed in the state-of-the-art object detection network YOLOv8 (You Only Look Once Version 8). This module optimizes the network by parallelizing additional gradient flow branches, enhancing the model's feature extraction capability and obtaining richer gradient information. Furthermore, this model uses Jump Concat to preserve minor defect feature information during the fusion process in the feature fusion pyramid's P4 layer. Additionally, this model integrates the SIoU localization loss function to improve localization accuracy and detection precision. Experimental results demonstrate that our proposed CJS-YOLOv5n model achieves superior overall performance. It maintains a detection speed of over 500 FPS (frames per second) while increasing the recall rate by 2.3% and mAP (mean average precision)@0.5 by 1.7%. The proposed model is suitable for application in high-speed cigarette production lines.
Citation: Yihai Ma, Guowu Yuan, Kun Yue, Hao Zhou. CJS-YOLOv5n: A high-performance detection model for cigarette appearance defects[J]. Mathematical Biosciences and Engineering, 2023, 20(10): 17886-17904. doi: 10.3934/mbe.2023795
In tobacco production, cigarettes with appearance defects are inevitable and dramatically impact the quality of tobacco products. Currently, available methods do not balance the tension between detection accuracy and speed. To achieve accurate detection on a cigarette production line with the rate of 200 cigarettes per second, we propose a defect detection model for cigarette appearance based on YOLOv5n (You Only Look Once Version 5 Nano), called CJS-YOLOv5n (YOLOv5n with C2F (Cross Stage Partial (CSP) Bottleneck with 2 convolutions-fast), Jump Concat, and SCYLLA-IoU (SIoU)). This model incorporates the C2F module proposed in the state-of-the-art object detection network YOLOv8 (You Only Look Once Version 8). This module optimizes the network by parallelizing additional gradient flow branches, enhancing the model's feature extraction capability and obtaining richer gradient information. Furthermore, this model uses Jump Concat to preserve minor defect feature information during the fusion process in the feature fusion pyramid's P4 layer. Additionally, this model integrates the SIoU localization loss function to improve localization accuracy and detection precision. Experimental results demonstrate that our proposed CJS-YOLOv5n model achieves superior overall performance. It maintains a detection speed of over 500 FPS (frames per second) while increasing the recall rate by 2.3% and mAP (mean average precision)@0.5 by 1.7%. The proposed model is suitable for application in high-speed cigarette production lines.
[1] | R. Girshick, J. Donahue, T. Darrell, J. Malik, Rich feature hierarchies for accurate object detection and semantic segmentation, in Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, (2014), 580–587. https://doi.org/10.1109/CVPR.2014.81 |
[2] | R. Girshick, Fast R-CNN, in Proceedings of the International Conference on Computer Vision, (2015), 1440–1448. https://doi.org/10.1109/ICCV.2015.169 |
[3] | S. Ren, K. He, R. Girshick, J. Sun, Faster R-CNN: Towards real-time object detection with region proposal networks, IEEE Trans. Pattern Anal. Mach. Intell., 39 (2017), 1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031 doi: 10.1109/TPAMI.2016.2577031 |
[4] | J. Redmon, S. Divvala, R. Girshick, A. Farhadi, You only look once: Unified, real-time object detection, in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (2016), 779–788. https://doi.org/10.1109/CVPR.2016.91 |
[5] | J. Redmon, A. Farhadi, YOLO9000: Better, faster, stronger, in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (2017), 6517–6525. https://doi.org/10.1109/CVPR.2017.690 |
[6] | J. Redmon, A. Farhadi, YOLOv3: An incremental improvement, preprint, arXiv: 1804.02767. |
[7] | A. Bochkovskiy, C. Y. Wang, H. Liao, YOLOv4: Optimal speed and accuracy of object detection, preprint, arXiv: 2004.10934 |
[8] | W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C. Y. Fu, et al., SSD: single shot multibox detector, in Proceedings of the European Conference on Computer Vision, 9905 (2016), 21–37. https://doi.org/10.1007/978-3-319-46448-0_2 |
[9] | J. Liu, X. Zhu, X. Zhou, S. Qian, J. Yu, Defect detection for metal base of TO-Can packaged laser diode based on improved YOLO algorithm, Electronics, 11 (2022), 1561. https://doi.org/10.3390/electronics11101561 doi: 10.3390/electronics11101561 |
[10] | C. S. Han, T. C. Chun, SMD LED chips defect detection using a YOLOv3-dense model, Adv. Eng. Inf., 47 (2021), 101255. https://doi.org/10.1016/j.aei.2021.101255 doi: 10.1016/j.aei.2021.101255 |
[11] | B. Hu, J. H. Wang, Detection of PCB surface defects with improved faster-RCNN and feature pyramid network, IEEE Access, 8 (2020), 108335–108345. https://doi.org/10.1109/ACCESS.2020.3001349 doi: 10.1109/ACCESS.2020.3001349 |
[12] | Y. Li, J. Xu, Electronic product surface defect detection based on a MSSD network, in 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), (2020), 773–777. https://doi.org/10.1109/ITNEC48623.2020.9084756 |
[13] | L. M. Duan, Y. Ke, R. Lang, Research on automatic recognition of casting defects based on deep learning, IEEE Access, 9 (2020), 12209–12216. https://doi.org/10.1109/ACCESS.2020.3048432 doi: 10.1109/ACCESS.2020.3048432 |
[14] | X. P. Kou, S. J. Liu, K. Q. Cheng, Y. Qian, Development of a YOLO-V3-based model for detecting defects on steel strip surface, Measurement, 182 (2021), 109454. https://doi.org/10.1016/j.measurement.2021.109454 doi: 10.1016/j.measurement.2021.109454 |
[15] | G. W. Yuan, J. C. Liu, H. Y. Liu, R. Qu, H. Zhou, Classification of cigarette appearance defects based on ResNeSt, J. Yunnan Univ.: Nat. Sci. Ed., 44 (2022), 464–470. https://doi.org/10.7540/j.ynu.20210257 doi: 10.7540/j.ynu.20210257 |
[16] | R. Qu, G. W. Yuan, J. C. Liu, H. Zhou, Detection of cigarette appearance defects based on improved SSD model, in Proceedings of the 2021 5th International Conference on Electronic Information Technology and Computer Engineering (EITCE '21), (2021), 1148–1153. https://doi.org/10.1145/3501409.3501612 |
[17] | H. Y. Liu, G. W. Yuan, Cigarette appearance defect detection method based on improved YOLOv5s, Comput. Technol. Dev., 32 (2022), 161–167. https://doi.org/10.3969/j.issn.1673-629X.2022.08.026 doi: 10.3969/j.issn.1673-629X.2022.08.026 |
[18] | G. W. Yuan, J. C. Liu, H. Y. Liu, Y. H. Ma, H. Wu, H. Zhou, Detection of cigarette appearance defects based on improved YOLOv4, Electr. Res. Arch., 31 (2023), 1344–1364. https://doi.org/10.3934/era.2023069 doi: 10.3934/era.2023069 |
[19] | H. Y. Liu, G. W. Yuan, L. Yang, K. X. Liu, H. Zhou, An appearance defect detection method for cigarettes based on C-CenterNet, Electronics, 11 (2022), 2182. https://doi.org/10.3390/electronics11142182 doi: 10.3390/electronics11142182 |
[20] | D. Y. Xu, G. D. Deng, C. X. Liu, F. Y. Shu, J. F. Yan, Q. Zhou, Particle size analysis of cigarette-puncturing slivers, Acta Tabacaria Sinica, 27 (2021), 37–42. https://doi.org/10.16472/j.chinatobacco.2020.148 doi: 10.16472/j.chinatobacco.2020.148 |
[21] | Y. W. Li, J. J. Qiao, S. J. Ma, Z. Q. Wu, Q. H. Wu, Improvement of filter plug assembling quality in cigarette making, Tob. Sci. Technol., 45 (2012), 24–27. https://doi.org/10.3969/j.issn.1002-0861.2012.10.006 doi: 10.3969/j.issn.1002-0861.2012.10.006 |
[22] | G. Jocher, A. Stoken, J. Borovec, X. Tao, Y. Kwon, K. Michael, et al., Ultralytics/YOLOv5: V6.0—YOLOv5n 'Nano' Models, Roboflow Integration, TensorFlow Export, OpenCV DNN Support, 2021. Available from: https://zenodo.org/record/5563715. |
[23] | Z. Zheng, P. Wang, W. Liu, J. Li, R. Ye, D. Ren, Distance-IoU loss: Faster and better learning for bounding box regression, in Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20), 34 (2020), 12993–13000. https://doi.org/10.1609/aaai.v34i07.6999 |
[24] | J. Terven, D. C. Esparza, A comprehensive review of YOLO: From YOLOv1 to YOLOv8 and beyond, preprint, arXiv: 2304.00501. |
[25] | H. Park, Y. Yoo, G. Seo, D. Han, S. Yun, N. Kwak, C3: Concentrated-comprehensive convolution and its application to semantic segmentation, preprint, arXiv: 1812.04920. |
[26] | Z. Gevorgyan, SIoU loss: More powerful learning for bounding box regression, preprint, arXiv: 2205.12740. |
[27] | T. Y. Lin, P. Dollár, R. Girshick, K. He, B. Hariharan, S. Belongie, Feature pyramid networks for object detection, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (2017), 2117–2125. https://doi.org/10.1109/CVPR.2017.106 |
[28] | S. Liu, L. Qi, H. Qin, J. Shi, J. Jia, Path aggregation network for instance segmentation, in Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, (2018), 8759–8768. https://doi.org/10.1109/cvpr.2018.00913 |
[29] | L. T. Jiao, B. Hong, An optimized YOLO method for object detection, in 2020 16th International Conference on Computational Intelligence and Security (CIS), (2020), 30–34. https://doi.org/10.1109/CIS52066.2020.00015 |
[30] | H. Rezatofighi, T. Nathan, J. Y. Gwak, S. Amir, R. Ian, S. Silvio, Generalized intersection over union: A metric and a loss for bounding box regression, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (2019), 658–666. https://doi.org/10.1109/cvpr.2019.00075 |
[31] | S. Woo, J. Park, J. Y. Lee, I. S. Kweon, CBAM: Convolutional block attention module, in Proceedings of the European Conference on Computer Vision (ECCV), 11211 (2018), 3–19. https://doi.org/10.1007/978-3-030-01234-2_1 |
[32] | C. C. Zhu, Y. H. He, S. Marios, Feature selective anchor-free module for single-shot object detection, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2019), 840–849. https://doi.org/10.1109/cvpr.2019.00093 |
[33] | C. Hao, T. Jin, F. L. Tan, J. R. Gao, Z. X. Ma, J. Cao, The analysis of time-varying high-order moment of wind power time series, Energy Rep., 9 (2023), 3154–3159. https://doi.org/10.1016/j.egyr.2023.02.010 doi: 10.1016/j.egyr.2023.02.010 |
[34] | T. Jin, F. Li, H. Peng, B. Li, D. Jiang, Uncertain barrier swaption pricing problem based on the fractional differential equation in Caputo sense, Soft Comput., 27 (2023), 11587–11602. https://doi.org/10.1007/s00500-023-08153-5 doi: 10.1007/s00500-023-08153-5 |