首页|Human object interaction detection using two-direction spatial enhancement and exclusive object prior

Human object interaction detection using two-direction spatial enhancement and exclusive object prior

扫码查看
Human-Object Interaction (HOI) detection aims to detect visual relations between humans and objects in images. One significant problem of HOI detection is that non-interactive human-object pair can be easily mis-grouped and misclassified as an action, especially when the humans are close and performing similar actions in the scene. To address the mis-grouping problem, we propose a spatial enhancement approach to enforce fine-level spatial constraints in two directions between human body parts and object parts. At inference, we propose a human-object regrouping approach for object-exclusive actions by considering the object-exclusive property of the interactive object, where the target object should not be shared by more than one human. By suppressing non-interactive pairs, our approach can decrease the false positives. Experiments on V-COCO and HICO-DET datasets demonstrate our approach is more robust compared to the existing methods under the presence of multiple humans and objects in the scene. (c) 2021 Elsevier Ltd. All rights reserved.

Human-object interaction detectionTwo-direction spatial enhancementExclusive object priorMis-grouped human-object pairsNon-interactive suppression

Liu, Lu、Tan, Robby T.

展开 >

Natl Univ Singapore

2022

Pattern Recognition

Pattern Recognition

EISCI
ISSN:0031-3203
年,卷(期):2022.124
  • 6
  • 42