同济大学学报(自然科学版)2024,Vol.52Issue(10) :1640-1648.DOI:10.11908/j.issn.0253-374x.22483

基于两阶段代价矩阵和动态注意力的双目立体匹配网络

EDNet++:Improving Stereo Matching with Two-Stage Combined Cost Volume and Multiscale Dynamic Attention

王志成 王泽灏
同济大学学报(自然科学版)2024,Vol.52Issue(10) :1640-1648.DOI:10.11908/j.issn.0253-374x.22483

基于两阶段代价矩阵和动态注意力的双目立体匹配网络

EDNet++:Improving Stereo Matching with Two-Stage Combined Cost Volume and Multiscale Dynamic Attention

王志成 1王泽灏1
扫码查看

作者信息

  • 1. 同济大学 电子与信息工程学院,上海 201804
  • 折叠

摘要

目前大多数先进的双目立体匹配网络通过构建4D代价矩阵以保留图像的语义信息,增加了网络的计算量开销.为了解决上述问题,提出了两阶段的组合代价矩阵和多尺度动态注意力的EDNet++网络.首先从全局的、粗粒度的视差搜索范围上构建的基于相似度的代价矩阵作为引导,在局部的搜索范围上实现细粒度的组合代价矩阵,其次提出基于残差的动态注意力机制,其根据中间结果信息自适应地生成空间上的注意力分布,并且通过迁移实验证明了该方法的有效性,最后在各大公开数据集上的对比实验结果表明,相较于其他方法,EDNet++方法能够达到算法精度和实时性的良好平衡.

Abstract

Most state-of-the-art stereo matching networks construct 4D cost volume to preserve the semantic information of the image,which increases the computational cost of the network.To solve this problem,a network named EDNet++with a two-stage combined cost volume and a multi-scale dynamic attention is proposed.First,a correlation cost volume is constructed based on global and coarse-grained disparity search range,which is used as a guide to construct a fine-grained combined cost volume on the local disparity search range.Then,the dynamic attention mechanism based on residuals can adaptively generate spatial attention distribution according to the intermediate result information,and the effectiveness of this method is proved by the transfer experiment.The comparison experiments on various public data sets show that EDNet++can achieve a good balance between accuracy and real-time performance compared with other methods.

关键词

双目立体匹配/神经网络/注意力机制

Key words

stereo matching/neural network/attention mechanism

引用本文复制引用

基金项目

中国国防基础研究项目(JCKY 2020206B03)

出版年

2024
同济大学学报(自然科学版)
同济大学

同济大学学报(自然科学版)

CSTPCD北大核心
影响因子:0.88
ISSN:0253-374X
段落导航相关论文