信息安全学报2024,Vol.9Issue(6) :208-226.DOI:10.19363/J.cnki.cn10-1380/tn.2022.12.14

基于神经网络的模型反演攻击技术综述

A Survey of Model Inversion Attack Techniques Based on Neural Networks

张欢 韩言妮 赵一宁 张帆 谭倩 孟渊
信息安全学报2024,Vol.9Issue(6) :208-226.DOI:10.19363/J.cnki.cn10-1380/tn.2022.12.14

基于神经网络的模型反演攻击技术综述

A Survey of Model Inversion Attack Techniques Based on Neural Networks

张欢 1韩言妮 1赵一宁 2张帆 2谭倩 3孟渊4
扫码查看

作者信息

  • 1. 中国科学院信息工程研究所 北京 中国 100085;中国科学院大学网络空间安全学院 北京 中国 100049
  • 2. 中国移动信息技术中心 北京 中国 100083
  • 3. 中国科学院信息工程研究所 北京 中国 100085
  • 4. 新疆阿克苏地区阿克苏市公安局网安部门 新疆阿克苏 中国 843000
  • 折叠

摘要

大数据时代下,基于神经网络的模型研究是人工智能领域的一个主流方向.相比于其它的智能优化算法,神经网络具有自适应性强、泛化能力显著等优点,被广泛应用于语音识别、计算机视觉和自然语言处理等领域.然而,随着神经网络在各领域发挥关键作用的同时,也引发了隐私泄露、数据窃取等隐私安全问题.人工智能安全问题也随之成为当前国内外的研究热点.基于神经网络的模型反演攻击技术研究如何从神经网络模型输出数据中进行学习、推导,以得到有关输入数据的信息.通过对输入数据进行深度挖掘和关联分析,可能会还原出用户的重要敏感数据,从而引发更为严重的安全问题.同时,模型反演攻击技术也会推导出有关神经网络的网络结构和模型参数等信息,对神经网络模型的安全造成威胁.为了系统了解基于神经网络的模型反演攻击技术的研究进展和现状,本文对神经网络的安全问题及模型反演攻击技术研究进行了详细调研.首先,本文介绍了模型反演攻击技术的概念和常见攻击场景.然后,讨论神经网络面临的模型反演攻击挑战,包括原始数据保护、敏感数据泄露、模型训练隐私等安全问题.接着,对基于梯度优化和参数训练的两类神经网络模型反演攻击技术进行综述,对各类方法进行对比,并总结了典型的防御方法.最后总结全文并探讨了未来的研究方向.

Abstract

In the era of big data,neural network-based model research is a mainstream direction in the field of artificial intelligence.Compared with other intelligent optimization algorithms,neural network has the advantages of strong adapta-bility and significant generalization ability,and is widely used in the fields of speech recognition,computer vision and natural language processing.However,as neural network plays a key role in various fields,it also causes privacy security problems such as privacy leakage and data theft.Artificial intelligence security has become a hot topic at home and abroad.Model inversion attack technique based on neural network studies how to learn and derive from the output data of neural network models to obtain information about the input data.Through in-depth mining and association analysis of the input data,important sensitive data of users may be restored,leading to more serious security problems.At the same time,the model inversion attack technology can also deduce the information about the network structure and model parameters of the neural network,which will threaten the security of the neural network model.In order to systematically understand the research progress and present situation of model inversion attack technology based on neural network,this paper makes a detailed investigation on the security problems of neural network and model inversion attack technology.Firstly,this paper introduces the concept of model inversion attack technology and common attack scenarios.Then,the challenges of model inversion attacks faced by neural networks are discussed,including original data protection,sensitive data leakage,model training privacy and other security issues.Then,two kinds of neural network model inversion attack techniques based on gradient optimization and parameter training are reviewed,various methods are compared,and the typical defense meth-ods are summarized.Finally,the paper summarizes the whole paper and discusses the future research direction.

关键词

神经网络/模型反演攻击/人工智能安全

Key words

neural network/model inversion attack/artificial intelligence security

引用本文复制引用

出版年

2024
信息安全学报

信息安全学报

CSTPCDCSCD
ISSN:
段落导航相关论文