首页|结合局部熵与梯度能量的双通道医学图像融合

结合局部熵与梯度能量的双通道医学图像融合

扫码查看
原文链接
  • NETL
  • NSTL
  • 万方数据
多模态医学图像融合已成为有效结合正常组织结构和异常改变信息、提高医学诊断效率的强有力辅助技术。针对空域融合技术在处理图像细节丢失、光谱退化等方面的缺陷，提出一种在联合双边滤波器(JBF)域内实现图像结构与细节信息增强的双通道频域多模态医学图像融合方法。该方法将源图像分解为结构和能量2个通道，分别处理图像纹理细节信息和边缘强度信息。在结构通道中，通过改进梯度能量得到局部梯度能量算子，进一步提升融合图像对小尺度细节信息的表达能力和对噪声的鲁棒性;在能量通道中，利用非下采样轮廓波变换提高模型的多方向多尺度特性，并提出一种局部熵细节增强算子和脉冲耦合神经网络结合的高频子带处理框架，达到增强能量通道中结构信息和细节信息的效果。在Atlas公开数据集上，与基于MST、稀疏表示、PCNN以及JBF的6种具有代表性的频域融合方法进行对比及消融实验的结果表明，所提方法的融合图像与源图像相似度提升35。0％，空间频率提升16。2％，边缘保持度提升12。5％，对比度提升11。2％;并在视觉方面有较好的效果，明显优于对比方法。
Two-Channel Medical Image Fusion Combining Local Entropy and Gradient Energy
Multi-modal medical image fusion has become a strong auxiliary technique that effectively com-bines normal tissue structure and abnormal alteration information to improve the efficiency of medical di-agnosis.To address the shortcomings of space-domain fusion in dealing with image detail loss and spectral degradation,a two-channel frequency-domain multimodal medical image fusion method is proposed in the JBF domain of joint bilateral filter.This method decomposes the source image into two parts,structure and energy channels,to process the image texture detail information and edge intensity information,respectively.In the structure channel,the local gradient energy operator is obtained by improving the gradient energy,which further enhances the representation ability of small-scale detail information and the robustness to noise.In the energy channel,non-subsampled contourlet transform improves the multi-directional and mul-ti-scale characteristics of the model.Meanwhile,the high-frequency sub-band processing framework that combining the local entropy detail enhancement operator and pulse coupled neural network is proposed to enhance the structural and detailed information in the energy channel.Experiments conducted on public da-taset Atlas were compared with six representative frequency domain baselines,including methods based on MST,sparse representation,PCNN and JBF,etc.The results show that the similarity between the fused im-age and the source image is improved by 35.0％,the spatial frequency,edge intensity,and contrast ratio of fused images are improved by 16.2％,12.5％and 11.2％,respectively.Meanwhile,the visual effect obtained by this method is also significantly better than others.

medical image fusionjoint bilateral filternon-subsampled contourlet transformpulse coupled neu-ral networkphase congruency

朱积成、刘慧、李珊珊、李攀、张彩明

展开 >

山东财经大学计算机科学与技术学院 济南 250014

山东省数字媒体技术重点实验室 济南 250014

重庆医科大学附属第二医院 重庆 400010

山东大学软件学院 济南 250101

展开 >

医学图像融合 联合双边滤波器 非下采样轮廓波变换 脉冲耦合神经网络 相位一致性

国家自然科学基金山东省科技成果转移转化项目重庆市科技局鲁渝科技协作项目

620722742021LYXZ011cstc2021jscxlyjsAX0003

2024

10.3724/SP.J.1089.2024.19899

计算机辅助设计与图形学学报
中国计算机学会

计算机辅助设计与图形学学报

CSTPCD北大核心
影响因子：0.892
ISSN：1003-9775
年,卷(期)：2024.36(6)