计算机辅助设计与图形学学报2024,Vol.36Issue(11) :1791-1804.DOI:10.3724/SP.J.1089.2024.20071

面向三维模型草图检索的三元层次度量网络

Triplet Hierarchical Metric Network for Sketch-Based 3D Shape Retrieval

杨瞻源 白静 李文静 彭斌 拖继文
计算机辅助设计与图形学学报2024,Vol.36Issue(11) :1791-1804.DOI:10.3724/SP.J.1089.2024.20071

面向三维模型草图检索的三元层次度量网络

Triplet Hierarchical Metric Network for Sketch-Based 3D Shape Retrieval

杨瞻源 1白静 2李文静 1彭斌 1拖继文1
扫码查看

作者信息

  • 1. 北方民族大学计算机科学与工程学院 银川 750021
  • 2. 北方民族大学计算机科学与工程学院 银川 750021;国家民委图像图形智能处理实验室 银川 750021
  • 折叠

摘要

针对基于草图的三维模型检索仍然存在将草图视作普通图像忽略其特有的稀疏性,以及对草图和三维模型的类内差异性重视不足,从而影响检索性能的问题,提出一种面向三维模型草图检索的三元层次度量网络.首先引入笔画点序列分支构建三元组网络结构,实现对草图数据的信息增强;然后通过多层次联合损失对网络进行域内域间跨域的全面约束,使得网络学习到同时体现数据的单域类内差异和域间关系的表示特征,有效地提升网络的检索性能.实验结果表明,在2个公开数据集SHREC2013和SHREC2014上,所提网络的平均检索精度均值分别为87.7%和83.3%,比先进工作(相同基础网络)分别提升0.5个百分点和1.5个百分点以上.

Abstract

A triplet hierarchical metric network for 3D model sketch retrieval is proposed to address the problem that sketches are treated as ordinary images and their unique sparsity is ignored,and the intra-class differences between sketches and 3D models are not given enough attention,which affects the retrieval per-formance.Then,the network is fully constrained by multi-level joint loss across domains,so that the net-work learns to represent both single-domain intra-class differences and inter-domain relationships,which effectively improves the retrieval performance of the network.The experimental results show that the aver-age retrieval accuracy of the proposed network on two publicly available datasets SHREC2013 and SHREC2014 is 87.7%and 83.3%,respectively,which is more than 0.5 percentage points and 1.5 percentage points better than the advanced work(the same base-net).

关键词

基于草图的三维模型检索/三元网络结构/多层次联合损失/语义嵌入/跨模态检索

Key words

sketch-based 3D shape retrieval/triplet network structure/multi-level joint loss function/semantic embedding/cross-modality retrieval

引用本文复制引用

出版年

2024
计算机辅助设计与图形学学报
中国计算机学会

计算机辅助设计与图形学学报

CSTPCDCSCD北大核心
影响因子:0.892
ISSN:1003-9775
段落导航相关论文