跳到主要导航 跳到搜索 跳到主要内容

DySiME: Dynamic Single-Source Multichannel Enhancement Using Time-Varying Directional Cues

  • Waseda University
  • Northwestern Polytechnical University Xian

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

摘要

Single-source multichannel speech enhancement involves extracting speech from a desired, target speaker in noisy, reverberant environments while maintaining spatial fidelity across multichannel outputs. A recent solution to this problem, multichannel-to-multichannel target sound extraction (M2MTSE), utilizes directional and temporal cues to perform end-toend complex spectrogram mapping in reverberant environments with static sources. However, its effectiveness is limited by heavy reliance on prior knowledge and handcrafted cyclic positional embeddings, reducing its practicality in real-world applications. To overcome these limitations in dynamic source scenarios where the target speaker is moving, we propose DySiME, dynamic single-source multichannel enhancement, an end-to-end framework tailored for moving sources. DySiME integrates a direction-of-arrival (DOA) estimation module based on full-band and narrow-band fusion for sound source localization (FN-SSL) to continuously track the target source direction. Furthermore, a learnable positional-information adapter incorporates intermediate features from the DOA estimator into the enhancement backbone, enabling the model to utilize time-varying spatial cues for more effective speech enhancement. This design reduces reliance on prior DOA knowledge during inference and enables robust, real-time enhancement of moving sources. We evaluate the system using a simulated 4 -channel circular microphone array, and the results show that DySiME consistently outperforms the baseline in both speech quality and spatial accuracy.

源语言英语
主期刊名2025 Asia Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2025
出版商Institute of Electrical and Electronics Engineers Inc.
页154-159
页数6
ISBN(电子版)9798331572068
DOI
出版状态已出版 - 2025
活动17th Asia Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2025 - Singapore, 新加坡
期限: 22 10月 2025 → 24 10月 2025

丛书

姓名2025 Asia Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2025

会议

会议17th Asia Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2025
国家/地区新加坡
市Singapore
时期22/10/25 → 24/10/25

学术指纹

探究 'DySiME: Dynamic Single-Source Multichannel Enhancement Using Time-Varying Directional Cues' 的科研主题。它们共同构成独一无二的学术指纹。

引用此