In this paper,a neural network method for solving the time-domain inverse scattering problem of moving obstacles is studied.The method is composed of one-dimensional convolution module and multi-head self-attention mechanism module,in which the ability of feature extraction of one-dimensional convolution module can effectively capture the local features of scattering data;The global information capture ability of the multi-head self-attention mechanism module synthetically analyzes the global characteristics of the scattered data,and uses the back propagation of the error to train,and retrieves the movement track of the obstacle.The experimental results show that this method can effectively retrieve the moving obstacle trajectory.