清华大学学报自然科学版(英文版)2024,Vol.29Issue(1) :232-243.DOI:10.26599/TST.2023.9010002

Dynamic Scene Graph Generation of Point Clouds with Structural Representation Learning

Chao Qi Jianqin Yin Zhicheng Zhang Jin Tang
清华大学学报自然科学版(英文版)2024,Vol.29Issue(1) :232-243.DOI:10.26599/TST.2023.9010002

Dynamic Scene Graph Generation of Point Clouds with Structural Representation Learning

Chao Qi 1Jianqin Yin 2Zhicheng Zhang 2Jin Tang2
扫码查看

作者信息

  • 1. School of Artificial Intelligence,Beijing University of Posts and Telecommunications,Beijing 100876,China;Standard and Metrology Research Institute,China Academy of Railway Sciences Corporation Limited,Beijing 100081,China
  • 2. School of Artificial Intelligence,Beijing University of Posts and Telecommunications,Beijing 100876,China
  • 折叠

Abstract

Scene graphs of point clouds help to understand object-level relationships in the 3D space.Most graph generation methods work on 2D structured data,which cannot be used for the 3D unstructured point cloud data.Existing point-cloud-based methods generate the scene graph with an additional graph structure that needs labor-intensive manual annotation.To address these problems,we explore a method to convert the point clouds into structured data and generate graphs without given structures.Specifically,we cluster points with similar augmented features into groups and establish their relationships,resulting in an initial structural representation of the point cloud.Besides,we propose a Dynamic Graph Generation Network(DGGN)to judge the semantic labels of targets of different granularity.It dynamically splits and merges point groups,resulting in a scene graph with high precision.Experiments show that our methods outperform other baseline methods.They output reliable graphs describing the object-level relationships without additional manual labeled data.

Key words

scene graph generation/structural representation/point cloud

引用本文复制引用

基金项目

National Natural Science Foundation of China(62173045)

National Natural Science Foundation of China(61673192)

Fundamental Research Funds for the Central Universities(2020XD-A04-2)

BUPT Excellent PhD Students Foundation(CX2021222)

出版年

2024
清华大学学报自然科学版(英文版)
清华大学

清华大学学报自然科学版(英文版)

CSTPCDEI
影响因子:0.474
ISSN:1007-0214
参考文献量34
段落导航相关论文