首页|基于Transformer的多麦克风融合降噪算法

基于Transformer的多麦克风融合降噪算法

扫码查看
多麦克风融合降噪技术旨在降低来自多种麦克风(声学麦克风、光学麦克风、骨传导麦克风)的语音噪声,提高信噪比,从而适应不同环境.针对传统多麦克风融合降噪算法在提取不同通道特征时效果不理想的问题,提出了一种基于Transformer的多麦克风融合降噪算法.该算法有3个主要步骤,首先采用多头注意力机制使每个通道能够学习到不同的权重,更好地学习通道间的空间特征;其次将获得的通道特征以及原始特征输入到Transformer模型中,生成时域滤波器;最后通过一维卷积操作获得每个通道增强后的语音数据.实验结果表明,提出的算法能够达到更好的降噪效果.
Transformer-based Multi-microphone Fusion Noise Reduction Algorithm
Transformer-Based Multi-Microphone Fusion Noise Reduction Technique aims to reduce speech noise from various microphones(acoustic,optical,bone-conduction)and improve the signal-to-noise ratio to adapt to different environments.To address the issue of suboptimal feature extraction from different channels in traditional multi-microphone fusion noise reduction algorithms,a Transformer-based approach is proposed.This algorithm consists of three main steps:Firstly,employing multi-head attention mechanism to enable each channel to learn different weights for better spatial feature learning between channels;Secondly,feeding the obtained channel features and original features into a Transformer model to generate time-domain filters;Finally,obtaining enhanced speech data for each channel through one-dimensional convolution operation.Experimental results demonstrate that the proposed algorithm achieves superior noise reduction performance.

Transformermulti-microphone fusion noise reductionattention mechanismfeature fusion

花嵘、张恒、刘元龙

展开 >

山东科技大学计算机科学与工程学院,山东青岛 266590

西兴(青岛)技术服务有限公司,山东青岛 266000

Transformer 多麦克风融合降噪 注意力机制 特征融合

&&

02030061003

2024

软件
中国电子学会 天津电子学会

软件

影响因子:1.51
ISSN:1003-6970
年,卷(期):2024.45(1)
  • 8