Seal Recognition and Application Based on Multi-feature Fusion Deep Learning
[Objective]To inherit and promote seal culture and enhance the recognition of seals in complex scenarios,this study structurally displays the recognition results and related knowledge using knowledge graphs and visualization techniques.[Methods]We proposed a deep learning model integrating multiple features.First,we extracted the seal images'color,edge,and grayscale feature maps.Then,we input these feature maps into the deep learning model for recognition.Finally,we compared the recognition results with the nodes in the knowledge graph and visualized the related knowledge.[Results]The study collected and annotated seals from 13 calligraphy and painting works,including"The Cold Food Observance",with two selected works as the test set.Compared with the VGG16 model,our new model's precision(P),recall(R),and F1 score improved by 28.40％,28.67％,and 28.54％,respectively.Without integrating multiple features,the P,R,and F1 values decreased by 24.30％,20.16％,and 22.74％,respectively.[Limitations]The proposed model can only extract and recognize global features of seals,lacking the ability to identify and infer their local semantic information.[Conclusions]The proposed method has a good effect on seal recognition tasks,where multi-dimensional feature maps can enhance the model's recognition ability and robustness in complex cases.
Seal RecognitionDeep LearningKnowledge GraphDigital Humanities
NETL
NSTL
万方数据
