RGB-D SLAM method of dynamic scene based on instance segmentation and optical flow
A new method for improving the accuracy of camera pose estimation in RGB-D SLAM of dy-namic scenes was proposed.This method was based on instance segmentation and optical flow.The first step was to detect objects in the scene using instance segmentation,eliminate non-rigid objects,and con-struct a semantic map.The second step involved calculating motion residuals through optical flow informa-tion,detecting dynamic rigid objects,and tracking them in the semantic map.Next,dynamic feature points on non-rigid objects and dynamic rigid objects in each frame were removed,and the camera pose was optimized using stable feature points.Finally,the static background was reconstructed using the TS-DF model,and the dynamic rigid objects were displayed as point clouds.Tests conducted on the TUM and Bonn datasets demonstrate that Compared with the most advanced work ACEFusion,the method proposed in this article improves camera accuracy by approximately 43%.The results show that retaining feature points of dynamic rigid objects in a static state can significantly improve camera pose estimation results.The dense map-ping experiments show that our method outperforms better in dynamic 3D reconstruction,the average recon-struction error is 0.042 m.Our code is available athttps://github.com/wawcg/dy_wcg.
万方数据
维普
