首页|针对自动驾驶智能模型的攻击与防御

针对自动驾驶智能模型的攻击与防御

扫码查看
近年来,以深度学习算法为代表的人工智能技术为人类生产生活的方方面面带来了巨大的革新,尤其是在自动驾驶领域,部署着自动驾驶系统的智能汽车已经走进入们的生活,成为了重要的生产力工具.然而,自动驾驶系统中的人工智能模型面临着潜在的安全隐患和风险,这给人民群众生命财产安全带来了严重威胁.本文通过回顾自动驾驶智能模型攻击和防御的相关研究工作,揭示自动驾驶系统在物理世界下面临的安全风险并归纳总结了相应的防御对策.具体来说,本文首先介绍了包含攻击面、攻击能力和攻击目标的自动驾驶系统安全风险模型.其次,面向自动驾驶系统的三个关键功能层——传感器层、感知层和决策层,本文依据受攻击的智能模型和攻击手段归纳、分析了对应的攻击方法以及防御对策,并探讨了现有方法的局限性.最后,本文讨论和展望了自动驾驶智能模型攻击与防御技术面临的难题与挑战,并指出了未来潜在的研究方向和发展趋势.
Attacks and Defenses for Autonomous Driving Intelligence Models
In recent years,artificial intelligence(AI)technologies,notably deep learning algorithms,have ushered in significant innovations across various facets of human existence.One prominent domain benefiting from these advancements is autonomous driving.Intelligent vehicles equipped with autonomous driving systems have gradually integrated into people's daily lives,emerging as pivotal tools that enhance productivity and redefine transportation paradigms.However,the surge in traffic safety incidents in recent years has served as a stark warning,signaling that artificial intelligence models within autonomous driving systems are susceptible to potential safety hazards and risks.This reality poses a significant threat to the safety of people's lives and properties.This paper reviews previous research works related to intelligent attack and corresponding defense works to reveal the security risks of autonomous driving systems in the physical world,and summarizes the corresponding defense strategies.Specifically,we first introduce in this paper the security risk model for autonomous driving systems that includes attack surfaces,attack capa-bilities,and attack goals.The main workflow of the autonomous driving system can be grouped into three layers.The autonomous driving system first takes the information about the nearby environment gathered by the sensor layer as input,and then processes the data through the perception layer equipped with intelligent models to extract key information such as obstacles,traffic signs,traffic lights and lane lines.Subsequently,the decision layer predicts the movement trajectories of the surrounding obstacles and plans the travel path of the autonomous vehicle based on the extracted information.In this process,the attacker could use different physical attacks to execute attacks against the intelligent model,thus posing a huge security risk.Building upon the known attack intelligence of the attacker,we categorize attacks into three types:white-box,gray-box,and black-box attacks.Furthermore,considering the diverse methods of interference available to attackers,we classify the attacks into two main categories:physical world attacks and sensor injection attacks.Secondly,for the three key functional layers of the autonomous driving system including sensor layer,perception layer and decision layer,this paper summarizes and analyzes the corresponding attack methods as well as defense countermeasures depending on the victim intelligent models and methods of attack,and discusses the limitations of the existing methods.Finally,this paper discusses and outlooks the difficulties and challenges of attack and defense technologies for autonomous driving intelligent models,and indicates potential future research directions and development trends.We propose that the absence of comprehensive and objective evaluation criteria for physical countermeasure attacks,coupled with the limited feasi-bility studies on physical attacks and research gaps in system-level attack methodologies,pose challenges and point towards future research directions in the current landscape of intelligent model attacks in autonomous driving.Moreover,the current research on defense countermeasures remains relatively scant,and the development of defense strategies in the physical realm holds great promise as a research avenue for the future.Addressing these gaps in both attack and defense methodologies will contribute substantially to the robustness and security of the intelligent models in autonomous driving.

autonomous driving securityartificial intelligence securitycyber-physical system securityphysical adversarial attackdefense strategy

马晨、沈超、蔺琛皓、李前、王骞、李琦、管晓宏

展开 >

西安交通大学电子与信息学部网络空间安全学院 西安 710049

智能网络与网络安全教育部重点实验室(西安交通大学) 西安 710049

武汉大学国家网络安全学院 武汉 430072

清华大学网络科学与网络空间研究院 北京 100084

展开 >

自动驾驶安全 人工智能安全 信息物理系统安全 物理对抗攻击 防御策略

科技创新2030-"新一代人工智能"重大项目国家自然科学基金国家自然科学基金国家自然科学基金国家自然科学基金国家自然科学基金国家自然科学基金国家自然科学基金国家自然科学基金陕西省重点研发计划陕西省重点研发计划

2020AAA0107702U21B201862161160337621320116237621062006181U20B2049U20A20177622062172021ZDLGY01-022023-ZDLGY-38

2024

计算机学报
中国计算机学会 中国科学院计算技术研究所

计算机学报

CSTPCD北大核心
影响因子:3.18
ISSN:0254-4164
年,卷(期):2024.47(6)
  • 1