首页|Behavior detection and evaluation based on multi‑frame MobileNet

Behavior detection and evaluation based on multi‑frame MobileNet

扫码查看
Video-based behavior detection is an important research direction in computer vision,which has great application potential in intelligent video surveillance, sports behavior evaluation,gait recognition, and so on. However, due to the complexity of video content andbackground, video behavior detection and evaluation face many challenges and are stillin their early stages. This paper proposes a novel multi-frame MobileNet model, whichdescribes the internal differences of similar behaviors by introducing multiple continuousframes of behaviors to be detected, and realizes fine-grained behavior detection and evaluation.Firstly, using energy trend images (ETIs) of behaviors as features, multiple continuousframes of the target video are fed into the proposed network to explore the relationshipbetween adjacent frames. Then,in the weighted point-wise convolution stage, by adding afade-in factor to the timeline for providing different weights to each involved frame, whichmakes better use of the progressive relationship between behavior frames at different times.Finally, the effectiveness of the proposed method is verified by comparative experimentson multiple video data sets such as UCF101, HMDB51 and CASIA-B.

Behavior detectionMulti-frame MobileNetDepth-wise convolutionPointwise convolution

Linqi Liu、Xiuhui Wang、Qifu Bao、Xuesheng Li

展开 >

College of Information Engineering, China Jiliang University, Hangzhou 310018, China

Key Laboratory of Safety Engineering and Technology Research of Zhejiang Province,Hangzhou 310027, China

2024

Multimedia tools and applications

Multimedia tools and applications

EISCI
ISSN:1380-7501
年,卷(期):2024.83(6)
  • 1
  • 37