中国科学:信息科学(英文版)2024,Vol.67Issue(7) :180-192.DOI:10.1007/s11432-023-4051-9

Rethinking attribute localization for zero-shot learning

Shuhuang CHEN Shiming CHEN Guo-Sen XIE Xiangbo SHU Xinge YOU Xuelong LI
中国科学:信息科学(英文版)2024,Vol.67Issue(7) :180-192.DOI:10.1007/s11432-023-4051-9

Rethinking attribute localization for zero-shot learning

Shuhuang CHEN 1Shiming CHEN 1Guo-Sen XIE 2Xiangbo SHU 2Xinge YOU 1Xuelong LI3
扫码查看

作者信息

  • 1. School of Electronic Information and Communication,Huazhong University of Science and Technology,Wuhan 430074,China
  • 2. School of Computer Science and Engineering,Nanjing University of Science and Technology,Nanjing 210094,China
  • 3. School of Artificial Intelligence,Optics and Electronics,Northwestern Polytechnical University,Xi'an 710072,China
  • 折叠

Abstract

Recent advancements in attribute localization have showcased its potential in discovering the intrinsic semantic knowledge for visual feature representations,thereby facilitating significant visual-semantic interactions essential for zero-shot learning(ZSL).However,the majority of existing attribute localization methods heavily rely on classification constraints,resulting in accurate localization of only a few attributes while neglecting the rest important attributes associated with other classes.This limitation hinders the discovery of the intrinsic semantic relationships between attributes and visual features across all classes.To address this problem,we propose a novel attribute localization refinement(ALR)module designed to enhance the model's ability to accurately localize all attributes.Essentially,we enhance weak discriminant attributes by grouping them and introduce weighted attribute regression to standardize the mapping values of semantic attributes.This module can be flexibly combined with existing attribute localization methods.Our experiments show that when combined with the ALR module,the localization errors in existing methods are corrected,and state-of-the-art classification performance is achieved.

Key words

zero-shot learning/attention mechanism/attribute localization/image classification

引用本文复制引用

基金项目

National Key R&D Program of China(2022YFC3301000)

出版年

2024
中国科学:信息科学(英文版)
中国科学院

中国科学:信息科学(英文版)

CSTPCDEI
影响因子:0.715
ISSN:1674-733X
段落导航相关论文