Deepfake Video Detection on Social Networks Using Multi-domain Aware Driven by Common Mechanism Analysis Between Artifacts
The misuse of deepfake technology on social networks has raised serious concerns about the authenticity and reliability of visual content.The degradation phenomenon of deepfake videos on social networks has not been adequately considered in existing detection algorithms,resulting in deepfake detection performance being limited by challenging issues such as compression artifacts interference and lack of context-related information.Compression encoding and up-sampling operations in deepfake generation algorithms can leave artifacts on videos,which can result in fine-grained differences between real videos and deepfake videos.The common mechanisms between compression artifacts and deepfake artifacts are analyzed to reveal the structural similarities between them,which provides a reliable theoretical basis for enhancing the robustness of deepfake detection models against compression.Firstly,to address the interference of compression noise on deepfake features,the frequency-domain adaptive notch filter is designed based on the structural similarity of compression artifacts and deepfake artifacts to eliminate the interference of compression artifacts on specific frequency bands.Secondly,the denoising branch based on residual learning is designed to reduce the sensitivity of the deepfake detection model to unknown noise.Additionally,the attention-based feature fusion method is adopted to enhance the discriminative features of deepfakes.Metric learning strategies are adopted to optimize network models,achieving deepfake detection with resistance to compression.Theoretical analysis and experimental results indicate that the detection performance of compressed deepfake videos is significantly enhanced by using the algorithm proposed in this paper.It can be used as a plug-and-play model combined with existing detection methods to enhance their robustness against compression.
Deepfake detectionSocial networkCompressed deepfakeCommon mechanism between artifacts