导航定位与授时2024,Vol.11Issue(6) :28-46.DOI:10.19306/j.cnki.2095-8110.2024.06.003

一种结合等变滤波和视觉观测网络的混合视觉惯性里程计

A hybrid visual-inertial odometry combining equivariant filter and visual observation network

胡建朗 罗亚荣 郭迟 刘经南
导航定位与授时2024,Vol.11Issue(6) :28-46.DOI:10.19306/j.cnki.2095-8110.2024.06.003

一种结合等变滤波和视觉观测网络的混合视觉惯性里程计

A hybrid visual-inertial odometry combining equivariant filter and visual observation network

胡建朗 1罗亚荣 2郭迟 3刘经南2
扫码查看

作者信息

  • 1. 武汉大学计算机学院,武汉 430079
  • 2. 武汉大学卫星导航定位技术研究中心,武汉 430079
  • 3. 武汉大学计算机学院,武汉 430079;武汉大学卫星导航定位技术研究中心,武汉 430079;湖北珞珈实验室,武汉 430079
  • 折叠

摘要

传统的面向惯导的滤波器在设计时通常没有考虑零偏状态的几何性质,针对这一问题,提出了新的群以及群作用,并以此为基础推导了一种新的等变滤波方法.为了验证该滤波算法的性能,构建了一个基于学习的结合等变滤波和视觉观测网络的视觉惯性里程计系统,名为Deep-EqF-VIO.首先,构建了流形上的导航状态动力学系统,其次根据等变滤波原理推导了等变滤波方法,最后结合视觉观测网络构建了视觉惯性里程计系统.为了进一步提高系统性能,提出了一种融合稠密光流伪标签的预训练方法,通过光流估计任务引导视觉观测网络从输入图像中提取更加通用的几何运动特征.实验结果表明,在大多数场景中,Deep-EqF-VIO相较于同类方法有更好的表现,并且在使用预训练方法进行重新训练后,性能得到了进一步的改善,误差下降率最大达到了49.80%,具有一定的应用前景.

Abstract

Traditional geometric filter algorithms are usually designed without considering the geo-metric properties of bias states.To deal with this problem,a group and a group action are pro-posed,and a new equivariant filter method is derived.To evaluate the performance of this filter al-gorithm,a visual-inertial odometry system based on an equivariant filter and a visual observation network,named Deep-EqF-VIO,is developed.Firstly,a navigation state dynamics system is con-structed on the manifold,then an equivariant filter method is derived by the equivariant filter prin-ciple,and finally a visual-inertial odometry system is constructed by combining with a visual ob-servation network.In order to further improve the performance of the system,a pretraining meth-od incorporating with dense optical flow pseudo-labels is proposed.This method guides the visual observation network to extract more generalized geometric motion features from input images via the optical flow estimation task.Experimental results show that Deep-EqF-VIO achieves the best accuracy in most scenes compared to similar algorithms.After retraining the VIO system by using the proposed pre-training method,the VIO performance can be further improved,with the maxi-mum error reduction rate reaching 49.80%.This method has a certain degree of application poten-tial.

关键词

视觉惯性里程计/等变滤波/光流估计/预训练/深度学习

Key words

Visual-inertial odometry/Equivariant filter/Optical flow estimation/Pretraining/Deep learn-ing

引用本文复制引用

出版年

2024
导航定位与授时

导航定位与授时

CSTPCDCSCD
ISSN:
段落导航相关论文