Infrared and Visible Image Registration Based on Compound 2S Network
Aiming at the problem that traditional image registration methods have poor effect in infrared and visible image registra-tion tasks.A feature matching method based on Superpoint+Superglue(2S)composite network was proposed for infrared and visible image registration.The method first used Superpoint's unique feature extraction method to fully extract common features between infra-red and visible light images.Secondly,the idea of adding matching constraints and using attention mechanism in Superlube feature matching method was used to give full play to the advantages of neural network and improve the matching efficiency.In the training phase,the method of using self built datasets was used to improve the generalization and accuracy of the neural network.The results show that the repeatability and accuracy scores of traditional registration methods for feature point extraction on three sets of experimen-tal images are(0.006 7,0.006 1),(0.001 0,0.000 8),and(0,0),respectively.The correct matching logarithms of feature points are 7 pairs,1 pair,and 0 pairs,with an average number lower than the minimum four matching point pairs required to estimate the transformation matrix.The scores of infrared and visible image registration methods based on Superpoint+Superglue are(0.240 2,0.262 5),(0.193 9,0.172 2),(0.263 0,0.264 4),and the correct matching logarithms of feature points are 252,165,and 252 pairs.The evaluation index of feature point extraction and the number of correct matching of feature point pairs are significantly in-creased compared with traditional methods,which can better complete the registration task.
NETL
NSTL
万方数据
