首页|集间两级语义互补的小样本语义分割

集间两级语义互补的小样本语义分割

扫码查看
现有的小样本语义分割模型通常只提取单一级别的语义特征,然而由于小样本数据的样本量少、各级语义特征具有不同属性等原因,提取单一级别语义特征的网络模型很难在保证分割能力的同时兼具泛化性.针对该问题,提出了一种集间两级语义互补的小样本语义分割方法.该方法使用具有强类别特征的支持集高级语义特征对具备泛化性的查询集中级语义特征加权,在增强查询集各目标类别特征的同时保留查询集中级语义特征的泛化能力;另外,该模型通过最大化支持集潜在语义信息、为查询集构建非参数学习的先验信息等方式增强两集信息之间的交互性以获得更丰富的判别信息.该方法在PASCAL-5i数据集上进行仿真实验,mIoU值在1-shot和5-shot两类设置上分别能达到45.3%和48.8%,其结果超越部分先进主流的小样本语义分割算法,且网络模型的参数量也控制在可以接受的范围之内.
Few-shot semantic segmentation based on inter-set semantic complementarity of two levels
Existing few-shot semantic segmentation models typically rely on single level semantic feature,but due to the small sample data of less sample size and different attributes of semantic features at each level,it is difficult for the network model to extract semantic features at a single level to ensure the segmentation ability and generalization.To solve this problem,a few-shot semantic segmentation based on inter-set semantic complementarity of two levels is proposed.In this method,the high-level semantic features of the support set with strong category are used to weight the generalization middle-level semantic features of the query set,and the generalization capability of the query set semantic features is preserved while the features of the query set target categories are enhanced.In addition,the model enhances the interaction between the two sets of information by optimizing support middle-level semantic feature and constructing non-parametric learning prior information for the query set,so as to obtain richer discriminant information.Experimental results based on PASCAL-5i data set show that the proposed method is effective in solving the problem of few-shot semantic segmentation.The mIoU value of the network can reach 44.6%and 48.8%in 1-shot and 5-shot settings,respectively,and its results surpass some state-of-the-art method.and the number of parameters in the network model is controlled within the acceptable range.

few-shot semantic segmentationprototype learninginter-set semantic features of two levelsmulti-scale

文婧、陈少波

展开 >

中南民族大学 电子与信息工程学院,武汉 430074

小样本语义分割 原型学习 集间两级语义特征 多尺度

中央高校基本科研业务费专项

CZY22012

2024

中南民族大学学报(自然科学版)
中南民族大学

中南民族大学学报(自然科学版)

影响因子:0.536
ISSN:1672-4321
年,卷(期):2024.43(3)
  • 16