首页|基于点代理增强和逐层上采样的猪体点云补全方法

基于点代理增强和逐层上采样的猪体点云补全方法

扫码查看
采用逆向工程技术进行猪体的三维重建并测算,是低成本无接触式猪体型体况评估的一大解决方案,在比较单视角和多视角采集方法的优缺点后,本文提出基于深度学习的点云补全方法,将猪体局部点云恢复成一个完整的点云以实现猪体三维重建.该猪体点云补全方法基于点代理增强和逐层上采样,首先通过特征提取结合位置嵌入生成点代理,使用点代理增强Transformer进一步提高点代理的特征表示能力,再基于点代理通过逐层上采样由粗到细逐步恢复最终的高分辨率、细粒度和分布均匀的完整点云.本文对实际生产环境中采集的猪体点云进行补全,所提方法与目前主流的点云补全方法进行对比试验,在多个指标的评定上,本文提出的方法都取得了较好性能,尤其是在猪体点云缺失严重补全难度较大的情况下效果更为突出.试验证明该方法对猪体主干部位的补全具备应用价值,能够用于实现基于局部点云的猪体三维点云重建.
A Method of Pig Body Point Cloud Completion Based on Point Proxy Enhancement and Layered Upsampling
Utilizing reverse engineering technology for three-dimensional reconstruction and measurement of pig body was a significant solution for cost-effective and non-contact assessment of pig body shape and condition.After compared the advantage and disadvan-tage of single and multi-view acquisition methods,we proposed in this paper a deep learning-based point cloud completion approach to restore partial pig body point cloud into complete point cloud,realizing the three-dimensional reconstruction of pig body.Our method completed the pig body point clouds collected from real production environments.This method of pig body point cloud completion was based on point proxy enhancement and layered upsampling.Initially,point proxies were generated through a combination of feature ex-traction and positional embedding.By employing Transformer for point proxy enhancement,the feature representation capabilities of these point proxies were further improved.Subsequently,based on these point proxies,a gradual and layered upsampling process was adopted to progressively restore complete point cloud with high resolution,fine granularity,and uniform distribution,transitioning from coarse level to fine level.Experiments were conducted for comparison between the proposed method and existing mainstream point cloud completion network models.Across various evaluation metrics,the method proposed in this paper had all achieved performance,which was particularly noticeable in situations where missing points in the pig body point cloud were substantial,highlighting its effec-tiveness in challenging completion scenarios.Experimental results also demonstrated the practical value of this method for completing the main parts of pig body,making it suitable for achieving three-dimensional pig body reconstruction based on partial point cloud.

pigs3D reconstructiondeep learningpig body point cloud completionTransformerpoint cloud upsampling

尹令、罗泗港、吴珍芳、蔡更元、沈卓婷、李钦萍、周润林

展开 >

华南农业大学数学与信息学院,广东广州 510642

国家生猪种业工程技术研究中心,广东广州 510642

猪禽种业全国重点实验室,广东广州 510640

华南农业大学动物科学学院,广东广州 510642

展开 >

三维重建 深度学习 猪体点云补全 Transformer 点云上采样

国家自然科学基金面上基金项目国家重点研发计划子课题项目

321727802023YFD1300202

2024

中国猪业
中国农业科学院农业信息研究所

中国猪业

影响因子:0.241
ISSN:1673-4645
年,卷(期):2024.19(1)
  • 19