近年来,深度学习在自然语言处理(NLP)领域获得了很大成功,尤其是语义识别方面优势突出.但是,深度学习在分析句法构成和识别句法成分方面的效果较差.其中序列标注是自然语言处理领域中历史最悠久的研究课题之一,包括词性标签(Part of speech tagging).对范畴语法标签这一任务进行研究,提出了一些技术,可以让赋予每个输入词的词法类别数目减少.研究目标是开发一个简单而准确的系统模型来解决范畴标签的挑战,同时利用神经网络后向传播算法必要的间接表示以避免复杂的人工特征选择.基于深度学习算法的研究,用Haskell语言设计并实现范畴语法系统,对词嵌入过程的监测,能更好地反映范畴的变化.
Research and implementation of categorical grammar system based on deep learning
In recent years,deep learning has achieved great success in the field of natural language processing(NLP),espe-cially in semantic recognition.However,deep learning is not effective in analyzing syntactic composition and identifying syntactic components.Sequence tagging is one of the oldest research topics in natural language processing,including Part of speech tagging.Research into the task of categorical syntax labeling has suggested techniques to reduce the number of lexical categories assigned to each input word.Research object is to develop a simple and accurate system model to solve the category labeling challenge,while utilizing the indirect representation necessary for neural network backpropagation algorithms to avoid complex artificial fea-ture selection.Based on the research of deep learning algorithm,Haskell language is used to design and implement categorical grammar system,which can monitor the process of word embedding and better reflect the change of category.
deep learningcategory grammarHaskell languagebackward propagation algorithm
万方数据
