中国科学:信息科学(英文版)2024,Vol.67Issue(4) :160-176.DOI:10.1007/s11432-022-3928-x

Retrieval-and-alignment based large-scale indoor point cloud semantic segmentation

Zongyi XU Xiaoshui HUANG Bo YUAN Yangfu WANG Qianni ZHANG Weisheng LI Xinbo GAO
中国科学:信息科学(英文版)2024,Vol.67Issue(4) :160-176.DOI:10.1007/s11432-022-3928-x

Retrieval-and-alignment based large-scale indoor point cloud semantic segmentation

Zongyi XU 1Xiaoshui HUANG 2Bo YUAN 3Yangfu WANG 3Qianni ZHANG 4Weisheng LI 3Xinbo GAO1
扫码查看

作者信息

  • 1. School of Computer Science and Technology,Chongqing University of Posts and Telecommunications,Chongqing 400065,China;Chongqing Institute for Brain and Intelligence,Guangyang Bay Laboratory,Chongqing 400064,China
  • 2. Shanghai Artificial Intelligence Laboratory,Shanghai 200232,China
  • 3. School of Computer Science and Technology,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
  • 4. School of Electronic Engineering and Computer Science,Queen Mary University of London,London E1 4NS,UK
  • 折叠

Abstract

Current methods for point cloud semantic segmentation depend on the extraction of descriptive features.However,unlike images,point clouds are irregular and often lack texture information,making it demanding to extract discriminative features.In addition,noise,outliers,and uneven point distribution are commonly present in point clouds,which further complicates the segmentation task.To address these problems,a novel architecture is proposed for direct and accurate large-scale point cloud segmentation based on point cloud retrieval and alignment.The proposed approach involves using a feature-based point cloud retrieval method for searching for reference point clouds with annotations from a dataset.In the following segmentation stage,an overlap-based point cloud registration method has been developed to align the target and reference point clouds.For accurate and robust alignment,an overlap region estimation module is trained to locate the optimal overlap region between two pieces of point clouds in a coarse-to-fine manner.In the detected overlap region,the global and local features of the points are extracted and combined for feature-metric registration to obtain accurate transformation parameters between the target and reference point clouds.After alignment,the annotated segmentation of the reference is transferred to the target point clouds to obtain accurate segmentation results.Extensive experiments are conducted to show that the developed method outperforms the state-of-the-art approaches in terms of both accuracy and robustness against noise and outliers.

Key words

point cloud semantic segmentation/large-scale indoor point clouds/point cloud alignment/overlap estimation/label transfer

引用本文复制引用

基金项目

国家自然科学基金(62206033)

国家自然科学基金(62221005)

国家自然科学基金(U22A2096)

重庆市自然科学基金(cstc2020jcyjmsxmX0855)

重庆市自然科学基金(cstc2021ycjhbgzxm0339)

Chongqing Postdoctoral Research Special Funding Project(2021XM2044)

出版年

2024
中国科学:信息科学(英文版)
中国科学院

中国科学:信息科学(英文版)

CSTPCDEI
影响因子:0.715
ISSN:1674-733X
参考文献量44
段落导航相关论文