首页|面向遮挡感知的人体姿态估计算法研究

面向遮挡感知的人体姿态估计算法研究

扫码查看
传统的舞台追光技术依赖于人工操作,常常难以达到设计师对追光精确性的高标准.对此,本文提出了一种基于人体位姿估计的舞台灯自动跟踪方案.目前,在舞台演出中,演员之间或与道具之间的遮挡会对姿态估计模型的准确性造成影响,进而影响追光效果的质量.为了解决演员遮挡问题,并提升人体姿态估计的准确度,本文设计了一种自顶向下的遮挡感知人体姿态估计模型和方法,该模型能显式学习人体的结构信息,采用空间注意力机制将图像特征转换为关键点特征向量,以及利用多头注意力机制增强对人体结构的学习能力,提高姿态估计在遮挡情况下的鲁棒性.此外,该模型还集成了遮挡信息的预测模块.实验表明,该方法在公开数据集上取得了优秀的表现,有效减少了在遮挡状态下的预测误差,并能判断关键点是否遭受遮挡,有望在舞台灯自动跟踪系统等复杂场景中推广应用.
Research on Human Pose Estimation Algorithms Considering Occlusion Perception
Traditional stage lighting techniques rely on manual operation,often making it difficult to achieve the high standards of precision desired by designers.In response to this challenge,this paper propose an automatic stage lighting tracking solution based on human pose estimation.Currently,in stage performances,occlusions between actors or between actors and props can adversely affect the accuracy of pose estimation model,thereby impacting the quality of the lighting tracking.To address occlusion issues with actors and enhance the accuracy of human pose estimation,this paper designs a top-down occlusion-aware human pose estimation model and method.The model explicitly learns structural information of the human body,utilizes spatial attention mechanisms to transform image features into keypoint feature vectors,and employs multi-head attention mechanisms to enhance the learning capability of human body structure.This approach improves the robustness of pose estimation under occlusion conditions.Additionally,the model integrates a module for predicting occlusion information.Experimental results demonstrate that this method achieves outstanding performance on public datasets,effectively reducing prediction errors under occlusion conditions.Moreover,it can determine whether keypoints are occluded,making it promising for widespread application in complex scenarios such as stage lighting automatic tracking systems.

machine visionstage lightinghuman pose estimationocclusion perception

彭颖茹、许凯涵、刘建平、王立辉、邓辅秦

展开 >

广州市浩洋电子股份有限公司,广东 广州 511450

五邑大学 电子与信息工程学院,广东 江门 529020

苏州大学 未来科学与工程学院,江苏 苏州 215222

机器视觉 舞台灯光 人体姿态估计 遮挡感知

2024

照明工程学报
中国照明学会

照明工程学报

影响因子:0.745
ISSN:1004-440X
年,卷(期):2024.35(3)
  • 5