首页|Action recognition using global spatio-temporal features derived from sparse representations

Action recognition using global spatio-temporal features derived from sparse representations

扫码查看
Recognizing actions is one of the important challenges in computer vision with respect to video data, with applications to surveillance, diagnostics of mental disorders, and video retrieval。 Compared to other data modalities such as documents and images, processing video data demands orders of magnitude higher computational and storage resources。 One way to alleviate this difficulty is to focus the computations to informative (salient) regions of the video。 In this paper, we propose a novel global spatio-temporal self-similarity measure to score saliency using the ideas of dictionary learning and sparse coding。 In contrast to existing methods that use local spatio-temporal feature detectors along with descriptors (such as HOG, HOG3D, and HOF), dictionary learning helps consider the saliency in a global setting (on the entire video) in a computationally efficient way。 We consider only a small percentage of the most salient (least self-similar) regions found using our algorithm, over which spatio-temporal descriptors such as HOG and region covariance descriptors are computed。 The ensemble of such block descriptors in a bag-of-features framework provides a holistic description of the motion sequence which can be used in a classification setting。 Experiments on several benchmark datasets in video based action classification demonstrate that our approach performs competitively to the state of the art。

Guruprasad Somasundaram、Anoop Cherian、Vassilios Morellas、Nikolaos Papanikolopoulos

展开 >

Department of Computer Science and Engineering, University of Minnesota, 200 Union Street SE, Minneapolis, MN 55455, USA

2014

参考文献引证文献相关文献
Computer vision and image understanding

Computer vision and image understanding

EISCI
ISSN:1077-3142
年,卷(期):2014.123(Jun.)
Guruprasad Somasundaram,Anoop Cherian,Vassilios Morellas,et al.Action recognition using global spatio-temporal features derived from sparse representations[J].Computer vision and image understanding,2014,123(Jun.):1-13.DOI:10.1016/j.cviu.2014.01.002.
  • 26
  • 64