兰州交通大学学报2024,Vol.43Issue(4) :87-97.DOI:10.3969/j.issn.2096-9066.2024.04.011

基于生成对抗机制的多目标跟踪方法

Multi-target Tracking Method Based on Generative Adversarial Mechanism

孙逸凡 代素敏 党建武 雍玖
兰州交通大学学报2024,Vol.43Issue(4) :87-97.DOI:10.3969/j.issn.2096-9066.2024.04.011

基于生成对抗机制的多目标跟踪方法

Multi-target Tracking Method Based on Generative Adversarial Mechanism

孙逸凡 1代素敏 2党建武 1雍玖1
扫码查看

作者信息

  • 1. 兰州交通大学电子与信息工程学院,兰州 730070;兰州交通大学轨道交通信息与控制国家级虚拟仿真实验教学中心,兰州 730070
  • 2. 北京中电飞华通信有限公司,北京 100700
  • 折叠

摘要

针对多目标跟踪中的跟踪结果易受遮挡而产生的漏检问题,提出一种公路场景下的基于生成对抗机制的多目标跟踪方法.首先,对经过预训练的跟踪网络输出的特征进行处理,在特征空间中添加自适应的二维遮挡掩码,生成现实生活中难以获得的遮挡样本;其次,利用生成对抗网络在无监督学习方面的优势,将FairMOT模型作为判别网络,加入结合强化学习机制的生成网络来学习如何筛选困难样本,2个网络进行对抗训练以提升多目标跟踪模型的遮挡不变性,提高跟踪精度;最后,在重识别分支中引入中心损失函数以提高重识别准确度.取数据集BDD100K中部分视频序列进行实验,实验结果表明:改进后算法的跟踪准确率提升了 0.8个百分点,跟踪精度降低了 0.4个百分点,跟踪过程中身份的切换次数减少了 208.

Abstract

A multi-objective tracking method based on generative adversarial mechanism is proposed in highway scenes to address the problem of missed detections caused by occlusion in tracking results in multi-target tracking.Firstly,the features output by the pre-trained tracking network are processed,and adaptive two-dimensional occlu-sion masks are added to the feature space to generate occlusion samples that are difficult to obtain in real life.Sec-ondly,to leverage the advantages of generative adversarial networks in unsupervised learning,the FairMOT model is used as the discriminative network,and a generative network combined with reinforcement learning mechanism is added to learn how to filter difficult samples.The two networks were trained adversarially to improve the occlusion invariance of multi-target tracking models and the tracking accuracy was improved.Finally,the center loss function was introduced into the re-identification branch to improve the accuracy of re-identification.Experiments were con-ducted on partial video sequences from the BDD100K dataset.The experimental results show that the improved algo-rithm improves tracking accuracy by 0.8 percentage points,reduces tracking accuracy by 0.4 percentage points,and reduces the number of identity switches during the tracking process by 208 times.

关键词

图像处理/多目标跟踪/深度学习/卷积神经网络/生成对抗网络

Key words

image processing/multi-target tracking/deep learning/convolutional neural network/generative adver-sarial network

引用本文复制引用

基金项目

国家自然科学基金(62067006)

国家自然科学基金(62367005)

甘肃省知识产权计划项目(21ZSCQ013)

甘肃省高校科研创新平台重大培育项目(2024CXPT-17)

教育部人文社会科学研究项目(21YJC880085)

甘肃省自然科学基金项目(23JRRA845)

兰州市青年科技人才创新项目(2023-QN-117)

出版年

2024
兰州交通大学学报
兰州交通大学

兰州交通大学学报

影响因子:0.532
ISSN:1001-4373
参考文献量3
段落导航相关论文