计算机工程与设计2024,Vol.45Issue(10) :3010-3016.DOI:10.16208/j.issn1000-7024.2024.10.017

基于显著性检测的云边协同视频流分析

Cloud-edge collaborative video stream analysis based on saliency detection

宋泽辉 郝晓燕 于丹 马垚 陈永乐
计算机工程与设计2024,Vol.45Issue(10) :3010-3016.DOI:10.16208/j.issn1000-7024.2024.10.017

基于显著性检测的云边协同视频流分析

Cloud-edge collaborative video stream analysis based on saliency detection

宋泽辉 1郝晓燕 1于丹 1马垚 1陈永乐1
扫码查看

作者信息

  • 1. 太原理工大学计算机科学与技术学院(大数据学院),山西晋中 030600
  • 折叠

摘要

为解决实时视频分析任务中精度和延迟的平衡问题,进一步提升系统性能,提出一种基于显著性检测的云边协同视频流分析框架.通过计算推理结果在视频帧上的梯度来准确衡量不同区域的显著性,结合监控摄像机的上下文特征构建宏块(视频编码的基本单元)粒度的感知区.通过建立这些感知区,边缘端可以针对视频帧中不同区域的内容进行不同层次的压缩过滤,降低传输过程中的带宽消耗.实验结果表明,该框架在较小精度损失的前提下,能够显著降低带宽消耗和延迟.

Abstract

To address the trade-off between accuracy and latency in real-time video analysis tasks and further enhance the system,a cloud-edge collaborative video stream analysis framework based on saliency detection was proposed.The saliency of different regions was accurately measured by calculating the gradient of the inference result on the video frame,and the perception area of the macroblock(the basic unit of video coding)was constructed by combining the context features of the surveillance camera.By establishing these perception areas,the edge end could perform different levels of compression and filtering on the content of dif-ferent areas in the video frame,thereby reducing bandwidth consumption during transmission.Experimental results demonstrate that the framework can significantly reduce bandwidth consumption and latency with only slight accuracy degradation.

关键词

边缘计算/云边协同/视频分析/神经网络模型/显著性检测/目标检测/聚类

Key words

edge computing/cloud-edge collaboration/video analysis/neural network model/saliency detection/target detec-tion/clustering

引用本文复制引用

基金项目

山西省基础研究计划基金项目(20210302123131)

山西省基础研究计划基金项目(20210302124395)

山西省自然科学基金面上基金项目(202203021221234)

计划外技术服务横向基金项目(RH2100005178)

出版年

2024
计算机工程与设计
中国航天科工集团二院706所

计算机工程与设计

CSTPCD北大核心
影响因子:0.617
ISSN:1000-7024
段落导航相关论文