首页|基于BG-Net手写数学公式计算系统的实现

基于BG-Net手写数学公式计算系统的实现

扫码查看
针对手写数学公式识别难度大及计算量高的问题,提出一种基于BG-Net神经网络识别手写数学公式并自动计算的新方法.通过改进的最小外边框与投影法结合算法对数学公式进行分割,解决了数学公式切分不彻底的问题.在传统的VGGNet网络的基础上,引入零填充层控制特征图的大小,有效解决了模型无法获取边缘关键信息的问题.使用全局池化层替代全连接层,减少了网络参数.为了提高网络的训练速度,在卷积操作后添加批量标准化处理.采用较小的卷积核进行特征提取,根据各类型数学公式的二维空间特征和语法逻辑实现公式映射,利用"分组树"的思想实现系统在四则运算、定积分、方程、矩阵、微分及混合运算之间的计算.研究结果表明:BG-Net模型在CROHME 2016数据集上对公式整体识别率达到94.68%,数学公式各模块计算准确率均为95%以上,混合运算准确率为94.7%,验证了该方法的有效性.
The Realization of Handwritten Mathematical Formula Calculation System Based on BG-Net
In view of the difficulty and high computation of handwritten mathematical formula recogni-tion,a new method based on BG-Net neural network for handwritten mathematical formula recognition and automatic calculation is proposed.The problem of incomplete segmentation of mathematical formula is solved by combining the improved minimum outer border and projection method.On the basis of tradition-al VGGNet network,the zero filling layer is introduced to control the size of feature map,which effective-ly solves the problem that the model can not obtain the edge key information.The global pooling layer is used to replace the full connection layer to reduce the network parameters.It improves the training speed of the network,adds batch standardized processing after convolution operation,uses smaller convolution kernel for feature extraction,realizes formula mapping according to the two-dimensional spatial charac-teristics and grammatical logic of various types of mathematical formulas,and realizes the calculation a-mong four operations,definite integral,equation,matrix,differential and mixed operation by using the idea of"group tree".The results show that the overall recognition rate of BG-Net model on the CROHME 2016 dataset is 94.68%,the calculation accuracy of each module of mathematical formula is more than 95%,and the accuracy of hybrid operation is 94.7%,which verifies the effectiveness of the method.

handwritten formula recognitionBG-Net modelspatial analysismathematical formula mappingmodulecalculation

李大舟、张小明、高巍、沈雪雁、孟智慧

展开 >

沈阳化工大学计算机科学与技术学院,辽宁沈阳 110142

中国移动集团设计院有限公司河北分公司,山西太原 030000

手写公式识别 BG-Net模型 空间解析 数学公式映射 模块计算

2024

沈阳化工大学学报
沈阳化工大学

沈阳化工大学学报

影响因子:0.282
ISSN:2095-2198
年,卷(期):2024.38(3)