首页|Quantum self-attention neural networks for text classification

Quantum self-attention neural networks for text classification

扫码查看
原文链接
  • 万方数据
  • 维普
An emerging direction of quantum computing is to establish meaningful quantum applications in various fields of artificial intelligence,including natural language processing(NLP).Although some efforts based on syntactic analysis have opened the door to research in quantum NLP(QNLP),limitations such as heavy syntactic preprocessing and syntax-dependent network architecture make them impracticable on larger and real-world data sets.In this paper,we propose a new simple network architecture,called the quantum self-attention neural network(QSANN),which can compensate for these limitations.Specifically,we introduce the self-attention mechanism into quantum neural networks and then utilize a Gaussian projected quantum self-attention serving as a sensible quantum version of self-attention.As a result,QSANN is effective and scalable on larger data sets and has the desirable property of being implementable on near-term quantum devices.In particular,our QSANN outperforms the best existing QNLP model based on syntactic analysis as well as a simple classical self-attention neural network in numerical experiments of text classification tasks on public data sets.We further show that our method exhibits robustness to low-level quantum noises and showcases resilience to quantum neural network architectures.

quantum neural networksself-attentionnatural language processingtext classificationpa-rameterized quantum circuits

Guangxi LI、Xuanqiang ZHAO、Xin WANG

展开 >

Institute for Quantum Computing,Baidu Research,Beijing 100193,China

Centre for Quantum Software and Information,University of Technology Sydney,Sydney NSW 2007,Australia

QICI Quantum Information and Computation Initiative,Department of Computer Science,The University of Hong Kong,Hong Kong 999077,China

Thrust of Artificial Intelligence,Information Hub,Hong Kong University of Science and Technology(Guangzhou),Guangzhou 511453,China

展开 >

Guangdong Provincial Quantum Science Strategic InitiativeQuantum Science Center of Guangdong-Hong Kong-Macao Greater Bay AreaBaidu-UTS AI Meets Quantum project国家留学基金委项目Australian Research Council ProjectStartup Fund from The Hong Kong University of Science and Technology(Guangzhou)Innovation Program for Quantum Science and TechnologyEducation Bureau of Guangzhou Municipality

GDZX2303007201806070139DP180100691G01010001512021ZD0302901

2024

10.1007/s11432-023-3879-7

中国科学:信息科学(英文版)
中国科学院

中国科学:信息科学(英文版)

CSTPCDEI
影响因子：0.715
ISSN：1674-733X
年,卷(期)：2024.67(4)
  • 68