首页|面向业务需求的知识增强大模型生成框架技术研究

面向业务需求的知识增强大模型生成框架技术研究

扫码查看
近年来,大模型技术方兴未艾,在通用领域获得长足发展.然而,在军事、政务等关键领域训练数据不足导致专业领域的大模型应用能力难以满足用户的需求,特别是针对业务需求的多类型数据检索任务,通用大模型存在瓶颈.本文提出一种知识增强的大模型跨数据检索框架,设计一种知识融合生长的大模型检索能力演进机制,利用大模型的自监督信号驱动领域知识持续生成,同时利用积累的知识持续增强大模型检索能力,在典型业务场景下开展原型系统构建与试验验证,在典型场景下检验框架对用户业务信息的查询与结果生成能力,实验结果表明,高质量的知识有助于提高大模型生成结果的精准性与有效性.
Research on Knowledge-enhanced Large Model Generation Framework Technology for Business-oriented Requirements
In recent years,large language model technology has been flourishing and has made significant progress in general fields.However,the lack of training data in key areas such as military and government affairs has made it difficult for large models in specialized domains to meet user needs,particularly in terms of multi-type data retrieval tasks for business requirements,where general large models face bottlenecks.This paper proposes a knowledge-enhanced large model cross-data retrieval framework and designs an evolution mechanism for the retrieval capabilities of large models that integrate and grow knowledge.By utilizing the self-supervised signals of large language models to drive the continuous generation of domain knowledge and leveraging accumulated knowledge to continuously enhance the retrieval capabilities of large models,we conduct prototype system construction and experimental validation in typical business scenarios.The framework's ability to handle user business information queries and result generation is tested in these scenarios.Experimental results show that high-quality knowledge helps to improve the precision and effectiveness of the results generated by large models.

large language modelknowledge enhancementcross data retrieval

纪威宇、张永、姜巍

展开 >

中国电子科技集团公司信息科学研究院,北京 100042

大模型 知识增强 跨数据检索

2024

软件
中国电子学会 天津电子学会

软件

影响因子:1.51
ISSN:1003-6970
年,卷(期):2024.45(5)
  • 6