电子与信息学报2024,Vol.46Issue(5) :2228-2236.DOI:10.11999/JEIT231304

多尺度子群体交互关系下的群体行为识别方法

Group Activity Recognition under Multi-scale Sub-group Interaction Relationships

朱丽萍 吴祀霖 陈晓禾 李承阳 朱凯杰
电子与信息学报2024,Vol.46Issue(5) :2228-2236.DOI:10.11999/JEIT231304

多尺度子群体交互关系下的群体行为识别方法

Group Activity Recognition under Multi-scale Sub-group Interaction Relationships

朱丽萍 1吴祀霖 1陈晓禾 1李承阳 2朱凯杰1
扫码查看

作者信息

  • 1. 石油数据挖掘北京市重点实验室 北京 102249;中国石油大学(北京)信息科学与工程学院/人工智能学院 北京 102249
  • 2. 北京大学计算机学院 北京 100871
  • 折叠

摘要

群体行为识别旨在识别包含多个个体的群体行为.在现实场景中,群体行为通常可以被视为从群体到子群体再到个人的层次结构.然而,以前的群体行为识别方法主要侧重于对个体之间的关系进行建模,缺乏对子群体之间关系的深度研究.从该角度出发,该文提出一种基于多尺度子群体交互关系(MSIR)的多层次群体行为识别框架.除对个体关系进行建模外,重点关注了子群体之间的多尺度交互特征.具体优化如下:设计子群体划分模块,通过个体外观特征和其空间位置来聚合可能存在关联的个体,再进一步利用语义信息动态地生成不同尺度大小的子群体;设计子群体交互特征提取模块,通过构建不同子群体之间的交互矩阵以及图神经网络的关系推理能力,提取更具判别力的子群体特征.实验结果表明,与现有12种方法在排球数据集和集体活动数据集这两个群体行为识别基准数据集上对比,该文方法都取得最好的性能结果.作为一个易于扩展和优化的群体行为识别框架,该算法在不同数据集上都具有较好的泛化能力.

Abstract

Group activity recognition aims to identify behaviors involving multiple individuals.In real-world applications,group behavior is often treated as a hierarchical structure,which consists group,subgroups and individuals.Previous researches have been focused on modeling relationships between individuals,without in-depth relationship analysis between subgroups.Therefore,a novel hierarchical group activity recognition framework based on Multi-scale Sub-group Interaction Relationships(MSIR)is proposed,and an innovative multi-scale interaction features extraction method between subgroups is presented as specified below.A sub-group division module is implemented.It aggregates individuals with potential correlations based on their appearance features and spatial positions,then dynamically generates subgroups of different scales using semantic information.A sub-group interactive feature extraction module is developed to extract more discriminative subgroup features.It constructs interaction matrices between different subgroups and leverages the relational reasoning capabilities of graph neural networks.Compared with existing twelve methods on benchmark datasets for group behavior recognition,including volleyball and collective activity datasets,the methodology of this paper demonstrates superior performance.This research presents an easily extendable and adaptable group activity recognition framework,exhibiting strong generalization capabilities across different datasets.

关键词

行为识别/群体行为/子群体划分/关系推理

Key words

Activity recognition/Group activity/Sub-group division/Relational reasoning

引用本文复制引用

基金项目

北京市自然科学基金(L233002)

中国石油科技创新基金(2022DQ02-0609)

出版年

2024
电子与信息学报
中国科学院电子学研究所 国家自然科学基金委员会信息科学部

电子与信息学报

CSTPCDCSCD北大核心
影响因子:1.302
ISSN:1009-5896
参考文献量25
段落导航相关论文