首页|基于双注意力机制的可见光-红外行人重识别

基于双注意力机制的可见光-红外行人重识别

扫码查看
[目的]由于可见光图像和红外图像之间的巨大模态差异,导致可见光-红外行人重识别是一项非常具有挑战性的图像检索问题.[方法]为了进一步减小两种模态之间的差异,重点关注行人信息,提出一种基于双注意力机制的网络结构用于可见光-红外行人重识别.一方面通过双注意力机制挖掘不同尺度的行人空间信息和增强局部特征的通道交互能力,另一方面利用全局分支和局部分支,学习多粒度的特征信息,使不同粒度信息可以相互补充,形成一个更具辨别性的特征.[结果]在两个公共数据集上的实验结果表明,该方法相较于基线有明显的提升,在RegDB数据集和SYSU-MM01数据集上均表现出理想的性能.[结论]该方法可为以后解决可见光-红外行人重识别的模态差异问题提供有效的参考.
Visible-Infrared Person Re-Identification Based on Dual Attention Mechanism
[Objective]Visible-infrared person re-identification is a very challenging image retrieval problem due to the huge modal difference between visible and infrared images.[Method]In order to further reduce the difference between the two modalities and focus on pedestrian information,a network structure based on dual at-tention mechanism is proposed for visible-infrared person re-identification.On the one hand,through the dual at-tention mechanism to mine personal spatial information of different scales and enhance the channel interaction ability of local features.On the other hand,through learning multi-granular feature information through using global and local branches,different granular information can complement with each other to form a more dis-criminating feature.[Result]Experimental results on two public datasets show that the proposed method has a significant improvement compared with the baseline,and shows ideal performance on both the RegDB dataset and the SYSU-MM01 dataset.[Conclusion]The proposed method can provide an effective reference for solving the problem of modal difference of visible-infrared person re-identification in the future.

visible-infrared person re-identificationattention mechanismmitigate modal differences

魏克铭、韩星宇、王辉、范自柱

展开 >

华东交通大学理学院,江西南昌 330013

华东交通大学江西省先进控制与优化重点实验室,江西南昌 330013

可见光-红外行人重识别 注意力机制 缓解模态差异

国家自然科学基金江西省自然科学基金

6199140120224BAB212014

2024

华东交通大学学报
华东交通大学

华东交通大学学报

CSTPCD
影响因子:0.748
ISSN:1005-0523
年,卷(期):2024.41(2)