首页|MBO:基于多目标平衡优化的监控视频浓缩

MBO:基于多目标平衡优化的监控视频浓缩

扫码查看
视频浓缩可在极大压缩视频长度的同时完整保留目标运动信息,在学术界和工业界受到广泛关注.然而现有浓缩方法无法精准保留目标之间的交互行为,且难以平衡压缩和碰撞,严重阻碍了视频浓缩的性能提升和实际应用.为此,本文提出了一种基于多目标平衡优化的监控视频浓缩方法(Multi-Objective Balance Optimization,MBO).首先,提出了一种基于目标交互帧数量和动态阈值对比的交互行为判断方法,用以组建多目标单元,结合目标在每帧的移动方向并采用动态阈值提升交互行为判断的准确性;其次,定义了碰撞矩阵和插入位置占比率,分别记录目标碰撞和插入位置深浅;然后,提出了一种压缩与碰撞的动态平衡方法,以优化重排目标,能在极大程度缩短视频长度的同时减少产生的目标碰撞;最后,融合视频背景和重排后的目标生成浓缩视频.VISOR、CAVIAR和KTH等多个数据集上的实验结果表明,相较于当前主流方法,本文所提方法保留交互行为的F-score提升高达0.472,并且能够有效平衡压缩和目标碰撞.
MBO:Surveillance Video Synopsis Based on Multi-Objective Balance Optimization
Video synopsis,which can greatly compress video length while preserving complete object motion information,has received widespread attention in both academic and industrial cir-cles.However,existing synopsis methods cannot accurately preserve the interactive behaviors between objects and have difficulties in balancing compression and collisions,which seriously hin-ders the performance improvement and practical application of video synopsis.To address this is-sue,this paper proposes a surveillance video synopsis method based on multi-objective balance optimization(MBO).Firstly,a method for judging interactive behaviors based on the number of interactive frames and dynamic threshold comparison is proposed to form multi-objective units,combining the movement direction of the object in each frame and using dynamic thresholds to improve the accuracy of interaction behavior judgment.Secondly,the collision matrix and inser-tion position ratio are defined to record target collisions and the depth of insertion positions,re-spectively.Then,a dynamic balancing method between compression and collisions is proposed to optimize the rearrangement of objects,can greatly compress video length while reducing object collisions.Finally,the video background and rearranged objects are fused to generate the synop-sis video.Experimental results on multiple datasets such as VISOR,CAVIAR,and KTH show that compared with current mainstream methods,our method improves the F-score of preserving interactivity by up to 0.472 and can effectively balance compression and object collisions.

video synopsismulti-objectivebalance optimizationinteractive behavior

张云佐、朱鹏飞

展开 >

石家庄铁道大学信息科学与技术学院 石家庄 050043

视频浓缩 多目标 平衡优化 交互行为

国家自然科学基金国家自然科学基金河北省自然科学基金河北省自然科学基金河北省高等学校科学技术研究项目中央引导地方科技发展资金项目研究生创新项目

6170234762027801F2022210007F2017210161ZD2022100226Z0501GYC2023081

2024

计算机学报
中国计算机学会 中国科学院计算技术研究所

计算机学报

CSTPCD北大核心
影响因子:3.18
ISSN:0254-4164
年,卷(期):2024.47(9)
  • 5