计算机工程与设计2024,Vol.45Issue(10) :2953-2959.DOI:10.16208/j.issn1000-7024.2024.10.010

采用偏好编辑的轻量自注意降噪序列推荐模型

Lightweight and denoising self-attentive sequential recommendation using preference editing

杨兴耀 钟志强 于炯 李梓杨 张少东 党子博
计算机工程与设计2024,Vol.45Issue(10) :2953-2959.DOI:10.16208/j.issn1000-7024.2024.10.010

采用偏好编辑的轻量自注意降噪序列推荐模型

Lightweight and denoising self-attentive sequential recommendation using preference editing

杨兴耀 1钟志强 1于炯 1李梓杨 1张少东 1党子博1
扫码查看

作者信息

  • 1. 新疆大学软件学院,新疆乌鲁木齐 830008
  • 折叠

摘要

在自注意序列推荐中,除项目嵌入矩阵带来巨大内存消耗问题和自注意层中的不相关信息带来噪声问题,还存在如何在用户行为数据稀疏的情况下准确提取和表示用户偏好的关键问题.针对这些问题,提出一种采用偏好编辑的轻量自注意降噪序列推荐模型(LDSR-PE).采用上下文感知的动态嵌入组合方案缓解内存消耗问题,在每个自注意层上附加可训练的二进制掩膜,实现自适应修剪不相关噪声项.为更好训练模型,设计基于偏好编辑的自监督学习策略,促使序列推荐模型在不同的交互序列之间区分公共和唯一的偏好.在3个公开数据集上的实验结果表明,LDSR-PE优于主流先进推荐模型.

Abstract

In the self-attentive sequential recommendation,in addition to the huge memory consumption caused by the item embedding matrix and the noise caused by irrelevant information in the self-attention layer,there is also a key problem of how to accurately extract and represent user preferences in the case of sparse user behavior data.A lightweight and denoising self-atten-tive sequential recommendation using preference editing(LDSR-PE)was proposed to solve the above problems.A context-aware dynamic embedding composition scheme was used to alleviate the memory consumption problem,and trainable binary masks were attached to each self-attention layer to achieve adaptive pruning of irrelevant noise items.To better train the model,a self-super-vised learning strategy based on preference editing was designed to force the sequential recommendation model to discriminate common and unique preferences in different sequences of interaction.Results of a large number of experiments conducted on three public datasets show that the LDSR-PE outperforms the mainstream advanced recommendation models.

关键词

序列推荐/偏好编辑/嵌入组合/自注意力机制/自监督学习/数据稀疏性/深度神经网络

Key words

sequential recommendation/preference editing/embedding composition/self-attention mechanism/self-supervised learning/data sparsity/deep neural network

引用本文复制引用

基金项目

国家自然科学基金项目(62262064)

国家自然科学基金项目(61862060)

新疆维吾尔自治区教育厅基金项目(XJEDU2016S035)

新疆大学博士科研启动基金项目(BS150257)

新疆维吾尔自治区自然科学基金项目(2022D01C56)

出版年

2024
计算机工程与设计
中国航天科工集团二院706所

计算机工程与设计

CSTPCD北大核心
影响因子:0.617
ISSN:1000-7024
段落导航相关论文