首页|基于多模态特征工程和TSNet的心脏异常检测算法

基于多模态特征工程和TSNet的心脏异常检测算法

Heart Anomaly Detection Algorithm Based on Multimodal Feature Engineering and TSNet

扫码查看
心电图(electrocardiogram,ECG)和心音图(phonocardiogram,PCG)是心脏疾病诊断中常用的图像,单一的方法进行心脏疾病诊断效果不佳.基于多模态特征工程,数据集经过切分和归一化预处理后,使用格拉姆角场(Gramian angle fields,GAF)进行时间序列数据重建,形成图像模型.提出一种适用于该图像模型的双流自融合网络(two-stream self-fusion network,TSNet),使用双流自融合(two-stream self-fusion,TS)模块替代底层卷积操作,更好地融合ECG和PCG的异构信息.经Physio Net Challenge 2016 a数据集测试,该算法的准确率、F1值、精确率和召回率最佳值分别达到95.3%,95.4%,96.2%,99.4%,相较其他心电和心音多模态卷积神经网络算法,精度更高.
Electrocardiogram(ECG)and Phonocardiogram(PCG)are commonly used diagrams in heart diseases diagnosis.While,using them alone for heart disease diagnosis is not effective.Based on multimodal feature engineering,after segmentation and normalization preprocess of the dataset,Gramiam angle fields(GAF)are used for time-series data reconstruction to form an image model.Additionally,a two-stream self-fusion network(TSNet)suitable for this image model is proposed,which replaces the bottom-layer convolution operations with a two-stream self-fusion(TS)module to better integrate the heterogeneous information of ECG and PCG.Tested on the PhysioNet Challenge 2016 a dataset,the proposed algorithm achieves best values of accuracy,F1 score,precision,and recall at 95.3%,95.4%,96.2%,and 99.4%,respectively.Compared to other multimodal convolutional neural network algorithms for ECG and PCG,it shows higher accuracy.

electrocardiogram(ECG)phonocardiogram(PCG)multimodal feature engineeringGramian angle fields(GAF)two-stream self-fusion network(TSNet)

刘纪红、薛维、徐超

展开 >

东北大学 信息科学与工程学院,辽宁 沈阳 110819

东北大学 计算机科学与工程学院,辽宁 沈阳 110169

心电图 心音图 多模态特征工程 格拉姆角场 双流自融合网络

2024

东北大学学报(自然科学版)
东北大学

东北大学学报(自然科学版)

CSTPCD北大核心
影响因子:0.507
ISSN:1005-3026
年,卷(期):2024.45(10)