中国科学:信息科学(英文版)2024,Vol.67Issue(5) :95-110.DOI:10.1007/s11432-022-3852-0

Understanding and improving fairness in cognitive diagnosis

Zheng ZHANG Le WU Qi LIU Jiayu LIU Zhenya HUANG Yu YIN Yan ZHUANG Weibo GAO Enhong CHEN
中国科学:信息科学(英文版)2024,Vol.67Issue(5) :95-110.DOI:10.1007/s11432-022-3852-0

Understanding and improving fairness in cognitive diagnosis

Zheng ZHANG 1Le WU 2Qi LIU 1Jiayu LIU 1Zhenya HUANG 1Yu YIN 1Yan ZHUANG 1Weibo GAO 1Enhong CHEN1
扫码查看

作者信息

  • 1. Anhui Province Key Laboratory of Big Data Analysis and Application,School of Computer Science and Technology& School of Data Science,University of Science and Technology of China,Hefei 230026,China;State Key Laboratory of Cognitive Intelligence,Hefei 230088,China
  • 2. School of Computer Science and Information Engineering,Hefei University of Technology,Hefei 230601,China
  • 折叠

Abstract

Intelligent education is a significant application of artificial intelligence.One of the key research topics in intelligence education is cognitive diagnosis,which aims to gauge the level of proficiency among students on specific knowledge concepts(e.g.,Geometry).To the best of our knowledge,most of the existing cognitive models primarily focus on improving diagnostic accuracy while rarely considering fairness issues;for instance,the diagnosis of students may be affected by various sensitive attributes(e.g.,region).In this paper,we aim to explore fairness in cognitive diagnosis and answer two questions:(1)Are the results of existing cognitive diagnosis models affected by sensitive attributes?(2)If yes,how can we mitigate the impact of sensitive attributes to ensure fair diagnosis results?To this end,we first empirically reveal that several well-known cognitive diagnosis methods usually lead to unfair performances,and the trend of unfairness varies among different cognitive diagnosis models.Then,we make a theoretical analysis to explain the reasons behind this phenomenon.To resolve the unfairness problem in existing cognitive diagnosis models,we propose a general fairness-aware cognitive diagnosis framework,FairCD.Our fundamental principle involves eliminating the effect of sensitive attributes on student proficiency.To achieve this,we divide student proficiency in existing cognitive diagnosis models into two components:bias proficiency and fair proficiency.We design two orthogonal tasks for each of them to ensure that fairness in proficiency remains independent of sensitive attributes and take it as the final diagnosed result.Extensive experiments on the Program for International Student Assessment(PISA)dataset clearly show the effectiveness of our framework.

Key words

fairness/intelligent education/cognitive diagnosis/psychometrics/adversarial learning

引用本文复制引用

基金项目

National Key Research and Development Program of China(2021YFF0901003)

National Natural Science Foundation of China(61922073)

National Natural Science Foundation of China(U20A20229)

University Synergy Innovation Program of Anhui Province(GXXT-2022-042)

出版年

2024
中国科学:信息科学(英文版)
中国科学院

中国科学:信息科学(英文版)

CSTPCDEI
影响因子:0.715
ISSN:1674-733X
参考文献量3
段落导航相关论文