首页|基于生成对抗机制的多目标跟踪方法

基于生成对抗机制的多目标跟踪方法

扫码查看
原文链接
  • 万方数据
  • 维普
针对多目标跟踪中的跟踪结果易受遮挡而产生的漏检问题,提出一种公路场景下的基于生成对抗机制的多目标跟踪方法.首先,对经过预训练的跟踪网络输出的特征进行处理,在特征空间中添加自适应的二维遮挡掩码,生成现实生活中难以获得的遮挡样本;其次,利用生成对抗网络在无监督学习方面的优势,将FairMOT模型作为判别网络,加入结合强化学习机制的生成网络来学习如何筛选困难样本,2个网络进行对抗训练以提升多目标跟踪模型的遮挡不变性,提高跟踪精度;最后,在重识别分支中引入中心损失函数以提高重识别准确度.取数据集BDD100K中部分视频序列进行实验,实验结果表明:改进后算法的跟踪准确率提升了 0.8个百分点,跟踪精度降低了 0.4个百分点,跟踪过程中身份的切换次数减少了 208.
Multi-target Tracking Method Based on Generative Adversarial Mechanism
A multi-objective tracking method based on generative adversarial mechanism is proposed in highway scenes to address the problem of missed detections caused by occlusion in tracking results in multi-target tracking.Firstly,the features output by the pre-trained tracking network are processed,and adaptive two-dimensional occlu-sion masks are added to the feature space to generate occlusion samples that are difficult to obtain in real life.Sec-ondly,to leverage the advantages of generative adversarial networks in unsupervised learning,the FairMOT model is used as the discriminative network,and a generative network combined with reinforcement learning mechanism is added to learn how to filter difficult samples.The two networks were trained adversarially to improve the occlusion invariance of multi-target tracking models and the tracking accuracy was improved.Finally,the center loss function was introduced into the re-identification branch to improve the accuracy of re-identification.Experiments were con-ducted on partial video sequences from the BDD100K dataset.The experimental results show that the improved algo-rithm improves tracking accuracy by 0.8 percentage points,reduces tracking accuracy by 0.4 percentage points,and reduces the number of identity switches during the tracking process by 208 times.

image processingmulti-target trackingdeep learningconvolutional neural networkgenerative adver-sarial network

孙逸凡、代素敏、党建武、雍玖

展开 >

兰州交通大学电子与信息工程学院,兰州 730070

兰州交通大学轨道交通信息与控制国家级虚拟仿真实验教学中心,兰州 730070

北京中电飞华通信有限公司,北京 100700

图像处理 多目标跟踪 深度学习 卷积神经网络 生成对抗网络

国家自然科学基金国家自然科学基金甘肃省知识产权计划项目甘肃省高校科研创新平台重大培育项目教育部人文社会科学研究项目甘肃省自然科学基金项目兰州市青年科技人才创新项目

620670066236700521ZSCQ0132024CXPT-1721YJC88008523JRRA8452023-QN-117

2024

10.3969/j.issn.2096-9066.2024.04.011

兰州交通大学学报
兰州交通大学

兰州交通大学学报

影响因子：0.532
ISSN：1001-4373
年,卷(期)：2024.43(4)
  • 3