首页|基于注意力特征融合的跨模态行人重识别

基于注意力特征融合的跨模态行人重识别

扫码查看
跨模态行人重识别任务旨在匹配同一行人的可见光图像和红外图像,在智能安全监控系统中广泛应用.由于可见光模态和红外模态存在固有的模态差异,给跨模态行人重识别任务在实际应用过程中带来了巨大的挑战.为了缓解模态差异,研究人员提出了很多有效的解决方法.但是由于这些方法提取的是不同模态之间的特征,彼此缺少对应的模态信息,导致特征缺少充分的鉴别性.为了提高模型提取特征的鉴别性,本文提出基于注意力特征融合的跨模态行人重识别方法.通过设计高效的特征提取网络和注意力融合模块,并在多种损失函数的优化下,实现不同模态信息的融合和模态对齐,从而促进模型匹配行人准确度的提升.实验结果表明,本方法在多个数据集上都取得了很好的性能.
Cross-modality Person Re-identification Based on Attention Feature Fusion
Cross-modality person re-identification is widely used in intelligent safety monitoring systems,aiming to match visible light images and infrared images of the same person.Due to the inherent modality differences between visible and infrared modalities,cross-modality person re-identification poses significant challenges in practical applications.To alleviate modality differences,researchers have proposed many effective solutions.However,existing methods extract different modality features without corresponding modality information,resulting in insufficient discriminability of the features.To improve the discriminability of the features extracted from models,this study proposes a cross-modality person re-identification method based on attention feature fusion.By designing an efficient feature extraction network and attention feature fusion module,and optimizing multiple loss functions,the fusion and alignment of different modality information can be achieved,thereby promoting the model matching accuracy for persons.Experimental results show that this method achieves great performance on multiple datasets.

cross-modality person re-identificationattention mechanismfeature fusionmodality differencemodality alignment

邓淑雅、李浩源

展开 >

南京信息工程大学计算机学院、网络空间安全学院,南京 210044

跨模态行人重识别 注意力机制 特征融合 模态差异 模态对齐

江苏省研究生科研创新计划

KYCX23_1369

2024

计算机系统应用
中国科学院软件研究所

计算机系统应用

CSTPCD
影响因子:0.449
ISSN:1003-3254
年,卷(期):2024.33(9)
  • 2