Research on Automatic Ancient Chinese Texts Segmentation Based on LATTICE
With the construction of socialist cultural power,the use of natural language processing technology to realize the processing and excavation of ancient Chinese classics has attracted more and more attention.In view of the task of automating sen-tence breaks in text,this paper proposes a deep learning model based on BERT-LATTICE-LAN network,which can realize the au-tomated break processing of text statements by integrating the pretrained model and the long-term memory network integrated into the word vector.Compared to traditional BiLSTM-CRF networks,the accuracy and F values are increased by 8.03 percent and 7.88 percent respectively.
deep learningBERTLATTICEsequence taggingautomatic segmentation
国家科技期刊平台
NSTL
万方数据
