Behaviour recognition based on the integration of multigranular motion features in the Internet of Things

扫码查看

原文链接

万方数据
维普

外文摘要：With the adoption of cutting-edge communication technologies such as 5G/6G systems and the extensive development of devices,crowdsensing systems in the Internet of Things(IoT)are now conducting complicated video analysis tasks such as behaviour recognition.These applications have dramatically increased the diversity of IoT systems.Specifically,behaviour recognition in videos usually requires a combinatorial analysis of the spatial information about objects and information about their dynamic actions in the temporal dimension.Behaviour recognition may even rely more on the modeling of temporal information containing short-range and long-range motions,in contrast to computer vision tasks involving images that focus on understanding spatial information.However,current solutions fail to jointly and comprehensively analyse short-range motions between adjacent frames and long-range temporal aggregations at large scales in videos.In this paper,we propose a novel behaviour recognition method based on the integration of multigranular(IMG)motion features,which can provide support for deploying video analysis in multimedia IoT crowdsensing systems.In particular,we achieve reliable motion information modeling by integrating a channel attention-based short-term motion feature enhancement module(CSEM)and a cascaded long-term motion feature integration module(CLIM).We evaluate our model on several action recognition benchmarks,such as HMDB51,Something-Something and UCF101.The experimental results demonstrate that our approach outperforms the previous state-of-the-art methods,which confirms its effective-ness and efficiency.

外文关键词：

Behaviour recognitionMotion featuresAttention mechanismInternet of thingsCrowdsensing

作者：

Lizong Zhang、Yiming Wang、Ke Yan、Yi Su、Nawaf Alharbe、Shuxin Feng

展开 >

作者单位：

School of Computer Science and Engineering,University of Electronic Science and Technology of China,Chengdu,611731,China

Beijing Institute of Remote Sensing Equipment,Beijing 100039,China

Applied College,Taibah University,Medina,42353,Saudi Arabia

基金：

National Natural Science Foundation of ChinaNational Natural Science Foundation of ChinaSichuan Science and Technology ProgramSichuan Science and Technology ProgramXinjiang Science and Technology ProgramFundamental Research Funds for the Central UniversitiesFundamental Research Funds for the Central Universities

项目编号：

62271125622730712022YFG00382021YFG00182022273061ZYGX2020ZB034ZYGX2021J019

出版年：

2024

DOI：

10.1016/j.dcan.2022.10.011

数字通信与网络(英文)

ISSN：

年,卷(期)：2024.10(3)