首页|Deep collaborative multi-task network: A human decision process inspired model for hierarchical image classification

Deep collaborative multi-task network: A human decision process inspired model for hierarchical image classification

扫码查看
Hierarchical classification is significant for big data, where the original task is divided into several sub-tasks to provide multi-granularity predictions based on a tree-shape label structure. Obviously, these sub-tasks are highly correlated: results of the coarser-grained sub-tasks can reduce the candidates for the fine-grained sub-tasks, while results of the fine-grained sub-tasks provide attributes describing the coarser-grained classes. A human can integrate feedbacks from all the related sub-tasks instead of con-sidering each sub-task independently. Therefore, we propose a deep collaborative multi-task network for hierarchical image classification. Specifically, we first extract the relationship matrix between every two sub-tasks defined by the hierarchical label structure. Then, the information of each sub-task is broad-casted to all the related sub-tasks through the relationship matrix. Finally, to combine this information, a novel fusion function based on the task evaluation and the decision uncertainty is designed. Extensive experimental results demonstrate that our model can achieve state-of-the-art performance. (c) 2021 Elsevier Ltd. All rights reserved.

Hierarchical image classificationDeep multi-task networkCollaborative learningDecision uncertainty evaluationEFFICIENT

Zhou, Yu、Li, Xiaoni、Zhou, Yucan、Wang, Yu、Hu, Qinghua、Wang, Weiping

展开 >

Chinese Acad Sci

Tianjin Univ

2022

Pattern Recognition

Pattern Recognition

EISCI
ISSN:0031-3203
年,卷(期):2022.124
  • 5
  • 37