江苏理工学院学报2024,Vol.30Issue(4) :85-89.

基于点云和RGB的三维增强人脸识别

3D enhanced face recognition based on point cloud and RGB

毛广志 丁彬 唐飞洋 刘聪聪 郁钱
江苏理工学院学报2024,Vol.30Issue(4) :85-89.

基于点云和RGB的三维增强人脸识别

3D enhanced face recognition based on point cloud and RGB

毛广志 1丁彬 1唐飞洋 1刘聪聪 1郁钱1
扫码查看

作者信息

  • 1. 江苏理工学院 计算机工程学院,江苏 常州 213001
  • 折叠

摘要

针对普通相机无法获取人脸图片的深度信息而导致识别率低的问题,提出了一种基于点云和RGB图像的三维人脸增强识别方法.首先,利用深度相机采集点云数据和RGB图像,并利用Transformer的Attention机制建立图像的融合机制.其次,在FaceNet的MobileNet中增加encoder网络层,即PointTransformer,可以将数据分成多块计算.在encoder网络中,利用Attention机制将点云与RGB图像融合,以增强 3D人脸识别的准确率.结果表明:基于点云和RGB图像的三维人脸增强识别方法的准确率达到99.67%,验证了此方法的可行性.

Abstract

To solve the problem of low recognition rate due to the fact that the depth information of face images cannot be obtained by ordinary cameras,a 3D face enhancement recognition method based on point cloud and RGB images is proposed.Firstly,the depth camera is used to collect point cloud data and RGB images,and the attention mechanism of Transformer is utilized to establish the image fusion mechanism.Secondly,the encoder network layer,i.e.,PointTransformer,is added to the Mobilenet of Facenet,which can be realized to divide the data into multiple pieces for calculation.In the encoder network,the attention mechanism is utilized to fuse point cloud with RGB image to enhance the accuracy of 3D face recognition.The simulation results show that the accuracy of the 3D face enhancement recognition method based on point cloud and RGB image is 99.67%,which verifies the feasibility of this method.

关键词

三维人脸点云/人脸识别/Transformer/注意力机制/特征融合

Key words

three-dimensional face point cloud/face recognition/transformer/attention mechanism/feature fusion

引用本文复制引用

基金项目

江苏省大学生创新创业大赛重点项目(202311463101Z)

出版年

2024
江苏理工学院学报
江苏技术师范学院

江苏理工学院学报

CHSSCD
影响因子:0.369
ISSN:2095-7394
段落导航相关论文