计算机研究与发展2024,Vol.61Issue(4) :983-1002.DOI:10.7544/issn1000-1239.202220794

面向机器学习应用的可解释性需求分析框架

An Explainability-Centric Requirements Analysis Framework for Machine Learning Applications

裴忠一 刘璘 王晨 王建民
计算机研究与发展2024,Vol.61Issue(4) :983-1002.DOI:10.7544/issn1000-1239.202220794

面向机器学习应用的可解释性需求分析框架

An Explainability-Centric Requirements Analysis Framework for Machine Learning Applications

裴忠一 1刘璘 1王晨 1王建民1
扫码查看

作者信息

  • 1. 大数据系统软件国家工程研究中心(清华大学) 北京 100084;清华大学软件学院 北京 100084
  • 折叠

摘要

基于大数据机器学习的智能软件研发过程需要综合运用软件工程、数据与领域知识工程、机器学习等多方面的知识和工具,涉及的研究主题和人员角色众多,技术实现手段复杂、研发难度大.面向智能软件的需求工程需要面对领域知识、业务知识、数据科学交织带来的挑战.然而,如何将领域知识和端到端的机器学习技术恰当地融合到给定的业务流程之中,以及如何应对工业、医疗等高可信要求场景中的可解释性需求,仍是亟待探索的重要研究问题.调研了近年来面向机器学习应用的需求工程研究文献,对该领域的发展现状、核心问题和代表性方法进行综述.提出了面向机器学习应用的可解释性需求分析框架.基于该框架,通过一个工业智能应用案例分析了未来待研究的重要问题,展望了可行的研究路径.

Abstract

Data-driven intelligent software based on machine learning technology is an important means to realize industrial digital transformation.The research and development processes of data-driven intelligent software require the combined use of software requirements engineering,data and domain knowledge engineering,machine learning and so on.This process involves many subjects and roles,making it extremely challenging to clearly explain why and how the domain knowledge,business logic and data semantics relate to each other.Hence,a systematic requirements engineering approach is needed to explicitly address the explainability requirements issues of data-driven intelligence applications.It is still a fast-evolving research field which requires the proper embedding of various domain models and end-to-end machine learning technology fused into a given business processes.A key research question is how to deal with explainability as a core requirement for safety-critical scenarios in industrial,medical and other applications.We provide a research overview on requirements engineering for machine learning applications,in relation to explainability.First,the research status quo,research foci and representative research progress are reviewed.Then,an explainability-centric requirements analysis framework for machine learning applications is proposed,and some open important issues are put forward.Finally,based on the proposed framework,a case study of industrial intelligence application is discussed to illustrate the proposed requirements analysis methodological framework.

关键词

需求工程/机器学习/领域模型/工业工程/可解释性

Key words

requirements engineering/machine learning/domain model/industrial engineering/explainability

引用本文复制引用

基金项目

国家重点研发计划(2021YFB1715200)

国家自然科学基金创新研究群体项目(62021002)

出版年

2024
计算机研究与发展
中国科学院计算技术研究所 中国计算机学会

计算机研究与发展

CSTPCDCSCD北大核心
影响因子:2.649
ISSN:1000-1239
参考文献量199
段落导航相关论文