Research on Spiking Neural Network fine-tuning method for object detection in remote sensing images
Object detection in remote sensing images is essential research contents of visual image recognition tasks.However,in the remote sensing images of ships,a ship target is small and sparsely distributed,and using a traditional Artificial Neural Network(ANN)for object detection often wastes a considerable amount of computing resources.SpikinG Neural Networks(SNNs)can be applied due to its event-driven and low-power characteristics,greatly saving energy and computing resources.However,training an SNN is difficult because of the complex dynamics and nondifferentiable pulse operation of SNN neurons.Instead,converting a trained ANN into SNN can effectively circumvent training difficulties.For a converted deep SNN,many time steps are often required to maintain its performance.Unfortunately,this process requires a substantial amount of computing resources.This paper studies the reason why a large number of time steps are required to maintain an SNN model's performance after conversion and proposes a novel conversion method:a layer-by-layer conversion method based on fine-tuning.During conversion,the network is converted layer by layer,and the subsequent unconverted network is fine-tuned,and thus the errors accumulate layer by layer during conversion is prevented.In addition,given the rationality of hardware deployment,we propose Poisson group coding,which uses multiple Poisson coding neurons to encode input images and sends them to the network after average pooling.Compared with Poisson coding,the output of Poisson group coding is less noisy and has less impact on model performance.The fine-tuning transformation method achieves a result(96.9％,70.3％),similar to that of YOLOv3-tiny(97.9％,79.6％)on the SAR ship detection datasets(AIR-SARShip),and 80％of the performance of the preconversion model can be achieved by using few time steps(20 and 80 steps).The method achieves good detection performance(49.2％)on the PASCAL VOC dataset.By contrast,the performance of the conventional conversion method is inferior to that of the fine-tuning conversion method in the same number of time steps and usually requires many time steps(more than 150 time steps),achieving improved detection performance.For Poisson group coding,the impact on model performance under the same time steps decreases with increasing neurons.Performance similar to the input simulation frequency can be achieved with few time steps.The layer-by-layer conversion method based on the proposed fine-tuning method effectively adapts the SNN network for the layer-by-layer conversion of error,preventing the accumulation of error in each layer and reducing SNN.This method can improve the performance of a converted SNN and reduce the time steps.Meanwhile,Poisson group coding provides an effective input coding method for the hardware deployment of an SNN.
Spiking Neural Network(SNN)object detectionship remote sensing imagesconvert ANN to SNNPoisson group coding
NETL
NSTL
万方数据
