软件2024,Vol.45Issue(1) :53-55.DOI:10.3969/j.issn.1003-6970.2024.01.015

基于Transformer的多麦克风融合降噪算法

Transformer-based Multi-microphone Fusion Noise Reduction Algorithm

花嵘 张恒 刘元龙
软件2024,Vol.45Issue(1) :53-55.DOI:10.3969/j.issn.1003-6970.2024.01.015

基于Transformer的多麦克风融合降噪算法

Transformer-based Multi-microphone Fusion Noise Reduction Algorithm

花嵘 1张恒 2刘元龙1
扫码查看

作者信息

  • 1. 山东科技大学计算机科学与工程学院,山东青岛 266590
  • 2. 西兴(青岛)技术服务有限公司,山东青岛 266000
  • 折叠

摘要

多麦克风融合降噪技术旨在降低来自多种麦克风(声学麦克风、光学麦克风、骨传导麦克风)的语音噪声,提高信噪比,从而适应不同环境.针对传统多麦克风融合降噪算法在提取不同通道特征时效果不理想的问题,提出了一种基于Transformer的多麦克风融合降噪算法.该算法有3个主要步骤,首先采用多头注意力机制使每个通道能够学习到不同的权重,更好地学习通道间的空间特征;其次将获得的通道特征以及原始特征输入到Transformer模型中,生成时域滤波器;最后通过一维卷积操作获得每个通道增强后的语音数据.实验结果表明,提出的算法能够达到更好的降噪效果.

Abstract

Transformer-Based Multi-Microphone Fusion Noise Reduction Technique aims to reduce speech noise from various microphones(acoustic,optical,bone-conduction)and improve the signal-to-noise ratio to adapt to different environments.To address the issue of suboptimal feature extraction from different channels in traditional multi-microphone fusion noise reduction algorithms,a Transformer-based approach is proposed.This algorithm consists of three main steps:Firstly,employing multi-head attention mechanism to enable each channel to learn different weights for better spatial feature learning between channels;Secondly,feeding the obtained channel features and original features into a Transformer model to generate time-domain filters;Finally,obtaining enhanced speech data for each channel through one-dimensional convolution operation.Experimental results demonstrate that the proposed algorithm achieves superior noise reduction performance.

关键词

Transformer/多麦克风融合降噪/注意力机制/特征融合

Key words

Transformer/multi-microphone fusion noise reduction/attention mechanism/feature fusion

引用本文复制引用

基金项目

&&(02030061003)

出版年

2024
软件
中国电子学会 天津电子学会

软件

影响因子:1.51
ISSN:1003-6970
参考文献量8
段落导航相关论文