基于改进YOLOv7和ByteTrack的煤矿多目标人员跟踪算法

    Multi-target personnel tracking algorithm for coal mine based on improved YOLOv7 and ByteTrack

    • 摘要: 为了解决现有的目标跟踪算法在煤矿复杂环境下存在精度低和实时性差的问题,基于Tracking by Detection(TBD)范式,提出了YOLO-FasterNet+ByteTrack的煤矿人员跟踪算法。首先,构建FasterNet-Block特征提取模块改进YOLOv7的Backbone,提升目标检测阶段的实时性;然后,通过在Neck中引入CBAM注意力机制,提升模型在复杂场景下的特征感知能力;接着,在目标检测的解码阶段引入Soft-NMS,优化模型在人员交叠场景下的检测精度;最后,在目标跟踪阶段,针对人员重叠和遮挡导致的目标ID翻转问题,设计了一种融合GRU和卡尔曼滤波的多目标运动特征预测机制,有效提升了煤矿人员跟踪的准确性。实验结果表明:YOLO-FasterNet在煤矿人员数据集上相对于YOLOv7的平均精度提高了3.6%,检测速度提升了8.2FPS;在自定义跟踪数据集GBMOT上,所提目标跟踪算法相对于ByteTrack,MOTA值提升了1.7%,IDSW减少了149次。

       

      Abstract: In order to solve the problems of low accuracy and poor real-time performance of existing target tracking algorithms in the complex environment of coal mines, a YOLO-FasterNet+ByteTrack coal mine personnel tracking algorithm was proposed based on the Tracking by Detection (TBD) paradigm. Firstly, the FasterNet-Block feature extraction module was constructed to improve the Backbone of YOLOv7 and improve the real-time performance of the object detection stage. Then, the CBAM attention mechanism was introduced into Neck to improve the feature perception ability of the model in complex scenes. Then, Soft-NMS is introduced in the decoding stage of object detection to optimize the detection accuracy of the model in personnel overlapping scenario. Finally, in the target tracking stage, a multi-target motion feature prediction mechanism fused with GRU and Kalman filter was designed to solve the problem of target ID flipping caused by personnel overlap and occlusion, which effectively improved the accuracy of coal mine personnel tracking. Experimental results show that the average accuracy of YOLO-FasterNet is increased by 3.6% and the detection speed is increased by 8.2FPS compared with YOLOv7 on the coal mine personnel dataset, and the MOTA value of the proposed target tracking algorithm is increased by 1.7% and the IDSW is reduced by 149 times compared with ByteTrack on the custom tracking dataset GBMOT.

       

    /

    返回文章
    返回