科学技术与工程2024,Vol.24Issue(12) :5051-5058.DOI:10.12404/j.issn.1671-1815.2303944

基于姿态估计和Transformer模型的遮挡行人重识别

Person Re-identification Based on Pose Estimation and Transformer Model

陈禹 刘慧 梁东升 张雷
科学技术与工程2024,Vol.24Issue(12) :5051-5058.DOI:10.12404/j.issn.1671-1815.2303944

基于姿态估计和Transformer模型的遮挡行人重识别

Person Re-identification Based on Pose Estimation and Transformer Model

陈禹 1刘慧 2梁东升 2张雷2
扫码查看

作者信息

  • 1. 东软汉枫医疗科技有限公司,沈阳 110034
  • 2. 北京建筑大学电气与信息工程学院,北京 100044
  • 折叠

摘要

行人重识别(re-identification,ReID)是利用人工智能解决边防检查、人员追踪等公共安全应用问题的技术,具有从跨设备采集的图像中识别某一特定行人的能力.但是在人员追踪等问题中,往往会出现行人刻意遮挡、复杂场景环境遮挡等因素,大大提高了行人重识别的难度.针对行人重识别遮挡问题,基于ResNet50网络,结合姿态估计和Transformer模型,提出了一种改进的行人重识别网络PT-Net,以提高遮挡条件下的行人重识别能力.该方法首先利用现有的姿态估计方法对输入图像进行关键点检测,并将关键点信息与行人特征图像结合起来生成一个基于姿态的行人特征表示;然后利用Transformer模型对基于姿态的行人特征表示编码,用来实现特征对齐和特征融合.基于国际公开的数据集Occluded-Duke开展实验验证.结果表明:PT-Net方法相对于基线模型,其均值平均精度(mAP)和相似度排序Rank-1指标分别提高了1.3、1.5个百分点,验证了该方法的有效性和优越性.

Abstract

Person re-identification(ReID)is a technology that utilizes artificial intelligence to solve public safety application problems such as border inspection and personnel tracking.It has the ability to identify a specific person from images collected across devices.However,in person tracking and other issues,deliberate person occlusion and complex scene environment occlusion greatly increases the difficulty of person re-identification.An improved person re-identification network PT-Net based on ResNet50 network was proposed,which combined with pose estimation and Transformer models to improve the person re-identification ability under occlusion conditions.The existing pose estimation method was utilized to detect key-points in the input image,and combined the key-point information with the person feature maps to generate a pose based person feature representation.Then,the Transformer model was used to encode the pose-based person feature representation for feature alignment and fusion.Based on the internationally available dataset Occluded-Duke,the experimental validation was conducted.The results show that the PT-Net method improves its mean average precision(mAP)and similarity ranking Rank-1 increase by 1.3,1.5 percentage points compared to the baseline model,respectively,verifying the effectiveness and superiority of the method.

关键词

行人重识别(ReID)/姿态估计/Transformer模型/遮挡/关键点检测

Key words

person re-identification(ReID)/pose estimation/Transformer model/occlusion/key-point detection

引用本文复制引用

基金项目

辽宁省科技攻关计划专项(2022JH1/10800104)

出版年

2024
科学技术与工程
中国技术经济学会

科学技术与工程

CSTPCD北大核心
影响因子:0.338
ISSN:1671-1815
参考文献量31
段落导航相关论文