首页|异步感知信息的自主神经隐式事件帧生成方法

异步感知信息的自主神经隐式事件帧生成方法

扫码查看
在事件相机事件帧的生成方式上,传统的固定时间间隔方法和固定事件数量方法产生的事件帧均会出现图像纹理过于稀疏和图像模糊的现象,导致基于这两种种方式生成的事件帧执行的视觉任务效果降低.针对上述问题,提出了一种异步感知信息的自主神经隐式事件帧生成方法,能够根据累计事件数据的信息量生成事件帧.首先,设计了基于残差网络的图像质量判别网络,用于异步感知事件时隐式判别事件帧所包含的语义信息量;然后,将基于质量判别网络定义的事件帧嵌入到语义分割任务中,在保证分割精度的情况下,降低了基于事件相机任务的信息获取延迟;最后,将提出的方法在公开数据集DSEC上进行了验证,相比传统方法,该事件帧生成方法在保持语义分割精度的生成每一帧事件帧的信息获取延迟降低了30 ms.
An Autonomic Implicit Event Frame Generation Method for Asynchronously Perceiving Information
Regarding the generation method of event frame mode for event cameras,the event frames generated by traditional fixed time interval methods and fixed event number methods are subject to the phenomena of overly sparse image texture and blurred images,which lead to the reduced effectiveness of the visual tasks performed by the event frames gener-ated based on such methods.To address the above problems,an autonomic implicit event frame generation method with a-synchronously perceiving information is proposed,which can generate event frames according to the amount of information of accumulated event data.First,an image quality discrimination network based on residual network is designed to implicitly discriminate the semantic information amount contained in event frames during asynchronous sensory events;second,the event frames defined by the quality discriminative network are embedded into the semantic segmentation task,which re-duces the information acquisition latency of the event-based camera task while maintaining the segmentation accuracy;and third,the proposed method is verified on the public dataset DSEC.Compared with traditional methods,this event genera-tion method reduces the information acquisition delay of each event frame by 30 ms while maintaining the semantic segmen-tation accuracy.

asynchronous sensingevent-cameracomputer visionevent-framessemantic segmentationdelays in obtaining information

韦李涛、熊超然、项艳

展开 >

上海交通大学上海市北斗导航与位置服务重点实验室,上海 200240

异步感知 事件相机 计算机视觉 事件帧 语义分割 信息获取延迟

2024

导航与控制
北京航天控制仪器研究所

导航与控制

CSTPCD
影响因子:0.133
ISSN:1674-5558
年,卷(期):2024.23(4)