系统工程与电子技术(英文版)2024,Vol.35Issue(6) :1357-1371.DOI:10.23919/JSEE.2023.000168

A content-aware correlation filter with multi-feature fusion for RGB-T tracking

FENG Zihang YAN Liping BAI Jinglan XIA Yuanqing XIAO Bo
系统工程与电子技术(英文版)2024,Vol.35Issue(6) :1357-1371.DOI:10.23919/JSEE.2023.000168

A content-aware correlation filter with multi-feature fusion for RGB-T tracking

FENG Zihang 1YAN Liping 1BAI Jinglan 1XIA Yuanqing 1XIAO Bo2
扫码查看

作者信息

  • 1. School of Automation,Beijing Institute of Technology,Beijing 100081,China
  • 2. School of Artificial Intelligence,Beijing University of Posts and Telecommunications,Beijing 100876,China
  • 折叠

Abstract

In challenging situations,such as low illumination,rain,and background clutter,the stability of the thermal infrared(TIR)spectrum can help red,green,blue(RGB)visible spectrum to improve tracking performance.However,the high-level image information and the modality-specific features have not been sufficiently studied.The proposed correlation filter uses the fused saliency content map to improve filter training and extracts different features of modalities.The fused content map is intro-duced into the spatial regularization term of correlation filter to highlight the training samples in the content region.Furthermore,the fused content map can avoid the incompleteness of the con-tent region caused by challenging situations.Additionally,differ-ent features are extracted according to the modality characteris-tics and are fused by the designed response-level fusion stra-tegy.The alternating direction method of multipliers(ADMM)algorithm is used to solve the tracker training efficiently.Experi-ments on the large-scale benchmark datasets show the effec-tiveness of the proposed tracker compared to the state-of-the-art traditional trackers and the deep learning based trackers.

Key words

visual tracking/red/green/blue(RGB)and thermal infrared(TIR)tracking/correlation filter/content perception/multi-feature fusion

引用本文复制引用

出版年

2024
系统工程与电子技术(英文版)
中国航天科工防御技术研究院 中国宇航学会 中国系统工程学会 中国系统仿真学会

系统工程与电子技术(英文版)

CSTPCD
影响因子:0.64
ISSN:1004-4132
段落导航相关论文