首页|基于对比学习和语义增强的多模态推荐算法

基于对比学习和语义增强的多模态推荐算法

扫码查看
产品的多模态数据通常被作为额外的辅助信息引入推荐算法中,丰富用户与产品的表示特征,有效融合用户与产品的交互信息和多模态信息是关键研究内容之一.现有方法在特征融合与语义关联建模上仍存在不足,对此,文中从特征融合视角出发,构建基于对比学习和语义增强的多模态推荐算法.首先,采用图神经网络与注意力机制充分融合协同特征与多模态特征.然后,以协同信息中的交互结构为指导,学习各模态内的语义关联结构.同时,采用对比学习范式捕捉跨模态的表征依赖关系,在对比损失中引入可靠性因子,自适应调整对多模态特征的约束强度,抑制数据噪声的影响.最后,联合优化上述任务,生成推荐结果.在4个真实数据集上的实验表明文中算法的优越性.
Multimodal Recommendation Algorithm Based on Contrastive Learning and Semantic Enhancement
The multimodal data of items is typically introduced into recommendation algorithms as additional auxiliary information to enrich the representation features of users and items.How to effectively integrate the interaction information with multimodal information of users and items is a key issue to the research.Existing methods are still insufficient in feature fusion and semantic association modeling.Therefore,a multimodal recommendation algorithm based on contrastive learning and semantic enhancement is proposed from the perspective of feature fusion.Firstly,the graph neural network and attention mechanism are adopted to fully integrate collaborative features and multimodal features.Next,the semantic association structures within each modality are learned under the guidance of the interaction structure in collaborative information.Meanwhile,the contrastive learning paradigm is employed to capture cross-modal representation dependencies.A reliability factor is introduced into the contrastive loss to adaptively adjust the constraint strength of the multimodal features,consequently suppressing the influence of data noise.Finally,the aforementioned tasks are jointly optimized to generate recommendation results.Experimental results on four real datasets show that the proposed algorithm yields excellent performance.

Recommender SystemMultimodal Recommendation AlgorithmGraph Neural NetworkContrastive Learning

张凯涵、冯晨娇、姚凯旋、宋鹏、梁吉业

展开 >

中北大学计算机科学与技术学院 太原 030051

山西财经大学应用数学学院 太原 030006

山西大学计算智能与中文信息处理教育部重点实验室 太原 030006

山西大学经济与管理学院 太原 030031

展开 >

推荐系统 多模态推荐算法 图神经网络 对比学习

国家自然科学基金项目山西省基础研究计划项目山西省基础研究计划项目

72171137202203021222075202203021211331

2024

模式识别与人工智能
中国自动化学会,国家智能计算机研究开发中心,中国科学院合肥智能机械研究所

模式识别与人工智能

CSTPCD北大核心
影响因子:0.954
ISSN:1003-6059
年,卷(期):2024.37(6)
  • 2