Video compressed sensing reconstruction is a highly underdetermined problem,where the low-quality of initial reconstructed and the single-motion estimation approach limit the effective modeling of inter-frames correlations.To improve video reconstruction performance,the Static and Dynamic-domain Prior Enhancement Two-stage reconstruction Network(SDPETs-Net)is proposed.Firstly,a strategy of reconstructing second-order static-domain residuals using reference frame measurements is proposed,and a corresponding Static-domain Prior Enhancement Network(SPE-Net)is designed to provide a reliable basis for dynamic-domain prior modeling.Secondly,the Pyramid Deformable-convolution Combined with Attention-search Network(PDCA-Net)is designed,which combines the advantages of deformable-convolution and attention mechanisms,and a pyramid cascade structure is constructed to effectively model and utilize dynamic-domain prior knowledge.Lastly,the Multi-Feature Fusion Residual Reconstruction Network(MFRR-Net)extracts and fuses key information of each feature from multiple scales to reconstruct residues,alleviating the instability of model training caused by the coupling of the two stages and suppressing feature degradation.Simulation results show that the Peak Signal-to-Noise Ratio(PSNR)is improved by an average of 3.34 dB compared to the representative two-stage network JDR-TAFA-Net under the UCF101 test set,and by an average of 0.79 dB compared to the recent multi-stage network DMIGAN.
关键词
视频压缩感知/帧间相关性建模/两阶段重构/特征对齐
Key words
Video Compressed Sensing(VCS)/Inter-frame correlation modeling/Two-stage reconstruction/Feature alignment