现代智慧教育下的认知诊断模型比较分析研究
Comparative Analysis Research of Cognitive Diagnostic Models under Modern Intelligent Education
丁泽元 1梁嘉辉 1张云飞 1郝飞 1李鹏 1郭龙江1
作者信息
- 1. 陕西师范大学 计算机科学学院,陕西 西安 710119
- 折叠
摘要
认知诊断是认知心理学与教育测量理论的融合,它可以通过学生的答题记录和试题信息,推断出学生当前的知识状态,从而全面地评估和诊断被测个体的心理或活动行为规律.由于认知诊断可以提供相较教育测量理论更为丰富的测量信息,它逐渐成为现代智慧教育场景下的主要能力评估手段.该文首先详细介绍了认知诊断的概念、历史发展以及研究现状,之后聚焦4 个具有代表性的认知诊断模型:项目反应理论、多维项目反应理论、DINA模型以及神经认知诊断模型,详细介绍了它们的理论基础、模型结构以及训练方式,并基于经典的认知诊断数据集ASSISTments 2009-2010 Skill-builder data的346 860 条样本,对4 个模型的认知准确度和模型的可解释性分别进行了比较分析.经过比较分析,发现神经认知诊断模型与其他认知诊断模型相比不仅具有更好的认知准确度,而且具备高度的可解释性.此外,通过调研和实践总结出了4 个认知诊断模型在现代智慧教育下的不同适用场景,为认知诊断研究提供了新视角.
Abstract
Cognitive diagnosis is a fusion of cognitive psychology and educational measurement theory,which can infer the current knowledge state of students from their answer records and test information,and thus comprehensively assess and diagnose the psychological or activity behavior patterns of the tested individuals.Since cognitive diagnosis can provide richer measurement information compared with educational measurement theories,it is gradually becoming a major ability assessment tool in modern intelligent education scenarios.Firstly we introduce the concept,historical development and current research status of cognitive diagnosis,then focus on four representative cognitive diagnosis models:item response theory;multidimensional item response theory;deterministic input,noise"and"gate;neural-cognitive diagnostics,and introduce their theoretical basis,model structure and training methods in detail.The cognitive accuracy and model interpretability of the four models were compared and analyzed based on the classical cognitive diagnostic dataset AS-SISTments 2009-2010 Skill-builder data with 346 860 samples,respectively.After the comparative analysis,we found that the neural-cognitive diagnostics model not only has better cognitive accuracy but also has higher interpretability compared with other cognitive diagnostic models.In addition,we summarized the different application scenarios of the four cognitive diagnostic models under modern intelligent education through research and practice,which provided a new perspective for cognitive diagnostic research.
关键词
认知诊断/项目反应理论/多维项目反应理论/DINA模型/神经认知诊断模型/比较分析/可解释性Key words
cognitive diagnosis/item response theory(IRT)/multidimensional item response theory(MIRT)/deterministic inputs,noisy"and"gate(DINA)/neural-cognitive diagnostics(NeuralCD)/comparative analysis/interpretability引用本文复制引用
基金项目
教育部人文社会科学研究青年基金(22YJCZH046)
陕西师范大学教学改革研究重点项目(22JG04)
陕西师范大学教学管理改革重点项目(22GX-JG05)
出版年
2023