基于双分支在线优化和特征融合的视频目标跟踪算法
Video object tracking algorithm based on dual-branch online optimization and feature fusion
李新鹏 1王鹏 1李晓艳 1孙梦宇 1陈遵田 2郜辉1
作者信息
- 1. 西安工业大学 电子信息工程学院,陕西 西安 710021
- 2. 西安机电信息技术研究所,陕西 西安 710065
- 折叠
摘要
针对D3S算法对跟踪目标的判别能力不足的问题,提出了一种基于双分支在线优化和特征融合的视频目标跟踪算法.首先,构建双分支的在线优化分类器,实现对目标的二次定位,得到更准确的目标位置响应图;然后,在特征层上实现响应图与搜索特征的融合,并通过encoder模块促进融合过程,进一步突出跟踪目标的特征;最后,通过encoder模块实现模板特征的更新,拟合特征间的差异,提高分割模块的判别能力.在VOT2018和UAV123数据集进行实验,改进后算法与原算法相比,在VOT2018数据集上EAO提高了2.9%,在UAV123数据集上成功率提高了2.4%,准确率提高了2.9%.实验结果表明,本文方法提高了算法的判别能力,并且进一步提升了精度和鲁棒性.
Abstract
In response to the issue of inadequate discrimination capability in the D3S algorithm for tracking target,a video object tracking algorithm based on dual-branch online optimization and feature fusion is proposed.Firstly,a dual-branch online optimization classifier is constructed,which achieves secondary location of the target,resulting in a more accurate target position response map.Secondly,the fusion of the response map and search features is realized on the feature layer,and the encoder module promotes the fusion process,further highlighting the features of tracking target.Finally,by updating the template features with the encoder module,the differences between features are fitted,thereby enhancing the discriminative capability of the segmentation module.Experimental evaluations are conducted on the VOT2018 and UAV123 datasets.Compared with the original algorithm,the improved algorithm improves EAO by 2.9%on the VOT2018 dataset,increases success rate by 2.4%and accuracy by 2.9%on the UAV123 dataset.The experimental results demonstrate that the method in this paper improves the algorithm's discriminative ability and further improves accuracy and robustness.
关键词
视频目标跟踪/目标分割/在线优化/特征融合/注意力机制Key words
object tracking/object segmentation/online optimization/feature fusion/mechanism of attention引用本文复制引用
基金项目
国家自然基金(62171360)
陕西省科技厅重点研发计划(2024GX-YBXM-162)
陕西省电子设备智能测试与可靠性评估工程技术研究中心项目(2023-ZC-GCZX-0047)
2022年度陕西高校青年创新团队项目()
山东省智慧交通重点实验室(筹)项目()
2023年陕西省高校工程研究中心项目()
西安市军民两用智能测评技术重点实验室项目(62171360)
Project of 2022 Shaanxi University Youth Innovation Team()
Project of Shandong Key Laboratory of Smart Transportation(Preparation)()
Project of 2023 Shaanxi University Engineering Research Center()
Project of Xi'an Key Laboratory of Military Civilian Dual-Use Intelligent Evaluation Technology()
出版年
2024