In view of the significance of deep learning,this paper reviewed the research and development on deep learning.Firstly,this paper summarized the advantage of deep learning,and illustrated the necessity of introducing deep learning.Secondly,it described three kinds of typical deep learning models,included convolutional neural network model,deep belief network model,and stacked auto-encoder network model.Thirdly,it reviewed new research and development on deep learning in recent years,included the choice of initialization methods,the number of network layers,and activation function,model structure,learning algorithms,and practical application.Finally,it presented the problems to be solved in aspects of theoretical analysis,representation and model of data,feature extraction,training and optimization,and research extension.
deep learningneural networkmodelrepresentationstackingpre-training
国家科技期刊平台
NSTL
万方数据
维普
