关键细粒度信息指导的多尺度遮挡行人重识别
Multi-Scale Occluded Person Re-Identification Guided by Key Fine-Grained Information
周玉 1赵小锋 2汪一 3孙彦景 2李松2
作者信息
- 1. 中国矿业大学信息与控制工程学院 徐州 221116;徐州市第一人民医院 徐州 221116
- 2. 中国矿业大学信息与控制工程学院 徐州 221116
- 3. 中国矿业大学信息与控制工程学院 徐州 221116;江苏师范大学科文学院 徐州 221132
- 折叠
摘要
为了减轻背景和遮挡等干扰信息对行人身份重识别(ReID)准确率的影响以及充分利用细粒度和粗粒度信息之间的互补性,该文提出关键细粒度信息指导的多尺度遮挡行人重识别网络.首先,将图像划分为两种不同尺寸的重叠图像块,构建同时包含细粒度和粗粒度信息提取分支的多尺度识别网络,以更好模拟人类观察图像时的多尺度特性以及观察相邻区域时的连续性特性.然后,考虑到细粒度分支能够提取更多的图像细节信息且细粒度和粗粒度信息之间存在一定的共性与差异,进一步通过细粒度注意力模块实现细粒度信息对粗粒度信息学习分支的指导.其中,参与指导的细粒度信息是通过干扰信息剔除(IIE)模块滤除干扰信息后保留的关键信息.最后,通过双次差分获取与行人身份识别相关的关键信息,并通过标签和特征等多维度的联合监督,实现行人身份的预测.在多个公开的行人重识别数据库进行的大量实验证明了该算法的性能优越性以及其中各个模块的有效性和必要性.
Abstract
To reduce the influence of background and occlusion on the accuracy of pedestrian identity Re-IDentification(ReID)and make full use of the complementarity between fine-grained and coarse-grained information,a multi-scale occluded pedestrian ReID network guided by key fine-grained information is proposed.First,the image is divided into two types of overlapping patches with different sizes to better simulate the multi-scale characteristics of human observing images and the continuity characteristics of human observing adjacent regions,so a multi-scale recognition network containing both fine-grained and coarse-grained information extraction branches is constructed.Then,considering fine-grained information contains more details and there are similarities and differences between fine-grained and coarse-grained information,fine-grained attention module is further employed to realize the guide of the fine-grained branch to the coarse-grained branch.Among them,the fine-grained information is the key information retained after filtering out the interference information by the Interference Information Elimination(IIE)module.Finally,the key information related to pedestrian ReID is obtained by bivariate difference,and the prediction of pedestrian identity is realized by multi-dimensional joint supervision such as tags and features.Extensive experiments on several public pedestrian ReID databases prove the superiority of this algorithm and the effectiveness and necessity of each module.
关键词
遮挡行人重识别/多尺度/细粒度信息/粗粒度信息/干扰信息剔除Key words
Occluded person ReID/Multi-scale/Fine-grained information/Coarse-grained information/Interference information elimination引用本文复制引用
基金项目
国家自然科学基金(62001475)
江苏省自然科学基金(BK20200649)
出版年
2024
NETL
NSTL
万方数据