首页|Weakly-supervised semantic segmentation with superpixel guided local and global consistency

Weakly-supervised semantic segmentation with superpixel guided local and global consistency

扫码查看
Weakly supervised semantic segmentation task aims to learn a segmentation model with only image level annotations. Existing methods generally refine the initial seeds to obtain pseudo labels for training a fully supervised model. In recent years, some affinity-based methods perform well in this task. However, most of these methods only focus on the localization information from class activation map, while ignoring rule-based appearance information. In this paper, we find that the superpixel guidance is helpful for mining semantic affinities between pixels because pixels belonging to the same superpixel often have the same class label. As such, we propose a Superpixel Guided Weakly Segmentation framework, which alternately learns two modules to fuse superpixel information and localization information. The semantic segmentation results are more consistent with the image's local and global consistency through our framework. Experiments show that the proposed method achieves state-of-the-art performance, with mIoU at 70.5% on the PASCAL VOC 2012 test set and mIoU at 34.4% on the MS-COCO 2014 val set. (c) 2021 Elsevier Ltd. All rights reserved.

Weakly supervised conditionSemantic segmentationPixel-level affinitySuperpixel

Ma, Huimin、Wang, Xiang、Hu, Tianyu、Li, Xi、Wang, Yu、Yi, Sheng

展开 >

Univ Sci & Technol Beijing

Tencent Res

Tsinghua Univ

2022

Pattern Recognition

Pattern Recognition

EISCI
ISSN:0031-3203
年,卷(期):2022.124
  • 13
  • 40