Audio and Speech Processing

Papers filed under eess.AS on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

721 to 780 of 1,641

Unsupervised speech representation learning using WaveNet autoencoders
Jan Chorowski, Ron J. Weiss, Samy Bengio +1
cs.LGeess.ASstat.MLarXiv:1901.08810v22019
ACE-Step: A Step Towards Music Generation Foundation Model
Junmin Gong, Sean Zhao, Sen Wang +2
cs.SDeess.ASarXiv:2506.00045v12025
Hierarchical Generative Modeling for Controllable Speech Synthesis
Wei-Ning Hsu, Yu Zhang, Ron J. Weiss +9
cs.CLcs.LGcs.SDarXiv:1810.07217v22018
ACCDOA: Activity-Coupled Cartesian Direction of Arrival Representation for Sound Event Localization and Detection
Kazuki Shimada, Yuichiro Koyama, Naoya Takahashi +2
eess.AScs.SDarXiv:2010.15306v22020
Any-to-Many Voice Conversion with Location-Relative Sequence-to-Sequence Modeling
Songxiang Liu, Yuewen Cao, Disong Wang +3
eess.AScs.CLcs.SDarXiv:2009.02725v32020
A Comparative Study on Transformer vs RNN in Speech Applications
Shigeki Karita, Nanxin Chen, Tomoki Hayashi +10
cs.CLcs.SDeess.ASarXiv:1909.06317v22019
Anatomy-aware cross-speaker adaptation of complete vocal-tract acoustic-to-articulatory inversion
Nhat-Nam Nguyen, Pierre-Andre Vuissoz, Yves Laprie
eess.AScs.AIarXiv:2609.29766v12026
Dual-branch Attention-In-Attention Transformer for single-channel speech enhancement
Guochen Yu, Andong Li, Chengshi Zheng +3
cs.SDcs.AIeess.ASarXiv:2110.06467v52021
DeepSonar: Towards Effective and Robust Detection of AI-Synthesized Fake Voices
Run Wang, Felix Juefei-Xu, Yihao Huang +4
eess.AScs.CRcs.MMarXiv:2005.13770v32020
DCCRN: Deep Complex Convolution Recurrent Network for Phase-Aware Speech Enhancement
Yanxin Hu, Yun Liu, Shubo Lv +6
eess.AScs.SDarXiv:2008.00264v42020
An Embarrassingly Simple Approach for LLM with Strong ASR Capacity
Ziyang Ma, Guanrou Yang, Yifan Yang +8
cs.CLcs.AIcs.MMarXiv:2402.08846v12024
SoulX-Singer: Towards High-Quality Zero-Shot Singing Voice Synthesis
Jiale Qian, Hao Meng, Tian Zheng +17
eess.AScs.AIcs.SDarXiv:2602.07803v22026
A neural attention model for speech command recognition
Douglas Coimbra de Andrade, Sabato Leo, Martin Loesener Da Silva Viana +1
eess.AScs.SDarXiv:1808.08929v12018
Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
Zhong Meng, Yashesh Gaur, Naoyuki Kanda +4
cs.CLcs.AIcs.LGarXiv:2110.05354v52021
Sound Event Detection of Weakly Labelled Data with CNN-Transformer and Automatic Threshold Optimization
Qiuqiang Kong, Yong Xu, Wenwu Wang +1
cs.SDeess.ASarXiv:1912.04761v22019
Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Search
Jaehyeon Kim, Sungwon Kim, Jungil Kong +1
eess.AScs.SDarXiv:2005.11129v22020
EmoMix: Emotion Mixing via Diffusion Models for Emotional Speech Synthesis
Haobin Tang, Xulong Zhang, Jianzong Wang +2
cs.SDeess.ASarXiv:2306.00648v12023
An Overview of Deep-Learning-Based Audio-Visual Speech Enhancement and Separation
Daniel Michelsanti, Zheng-Hua Tan, Shi-Xiong Zhang +4
eess.AScs.LGeess.IVarXiv:2008.09586v22020
TinyLSTMs: Efficient Neural Speech Enhancement for Hearing Aids
Igor Fedorov, Marko Stamenovic, Carl Jensen +5
eess.AScs.LGcs.SDarXiv:2005.11138v12020
StreamAlign: Streaming Text-Aligned Speech Tokenization
Kang-wook Kim, Jinyoung Park, Jinsoo Kim +3
cs.CLcs.SDeess.ASarXiv:2609.09719v12026
End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architectures
Gabriel Synnaeve, Qiantong Xu, Jacob Kahn +6
cs.CLcs.SDeess.ASarXiv:1911.08460v32019
Google USM: Scaling Automatic Speech Recognition Beyond 100 Languages
Yu Zhang, Wei Han, James Qin +24
cs.CLcs.SDeess.ASarXiv:2303.01037v32023
A Comprehensive Survey on Deep Music Generation: Multi-level Representations, Algorithms, Evaluations, and Future Directions
Shulei Ji, Jing Luo, Xinyu Yang
cs.SDcs.LGeess.ASarXiv:2011.06801v12020
WHAM!: Extending Speech Separation to Noisy Environments
Gordon Wichern, Joe Antognini, Michael Flynn +5
cs.SDcs.CLcs.LGarXiv:1907.01160v12019
Video Background Music Generation with Controllable Music Transformer
Shangzhe Di, Zeren Jiang, Si Liu +5
cs.MMcs.SDeess.ASarXiv:2111.08380v12021
Robust and fine-grained prosody control of end-to-end speech synthesis
Younggun Lee, Taesu Kim
cs.CLcs.LGcs.SDarXiv:1811.02122v22018
Investigating self-supervised front ends for speech spoofing countermeasures
Xin Wang, Junichi Yamagishi
eess.AScs.SDarXiv:2111.07725v32021
MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesis
Kundan Kumar, Rithesh Kumar, Thibault de Boissiere +6
eess.AScs.CLcs.LGarXiv:1910.06711v32019
Fairness Evaluation of Edge-AI Implementation for Cleft Lip and Palate Speech ASR
Susmita Bhattacharjee, Himashri Deka, H. S. Shekhawat +1
eess.ASarXiv:2609.03982v12026
AudioTETRIS: Token Elimination via Transitional Importance Signals for Efficient Audio LLMs
Shreya Sajid, Anna Vettoruzzo, Joaquin Vanschoren
cs.SDcs.AIeess.ASarXiv:2610.13600v12026
Minimum bias multiple taper spectral estimation
Kurt S. Riedel, Alexander Sidorenko
stat.MEeess.ASeess.SParXiv:1803.04078v22018
VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset
Jing Liu, Sihan Chen, Xingjian He +4
cs.LGcs.CLcs.CVarXiv:2304.08345v22023
TimbreTron: A WaveNet(CycleGAN(CQT(Audio))) Pipeline for Musical Timbre Transfer
Sicong Huang, Qiyang Li, Cem Anil +3
cs.SDcs.LGeess.ASarXiv:1811.09620v32018
Fine-tuning wav2vec2 for speaker recognition
Nik Vaessen, David A. van Leeuwen
cs.SDcs.LGeess.ASarXiv:2109.15053v22021
MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix
Ziyang Ma, Yinghao Ma, Yanqiao Zhu +31
cs.SDcs.CLcs.MMarXiv:2505.13032v12025
The LOCATA Challenge: Acoustic Source Localization and Tracking
Christine Evers, Heinrich Loellmann, Heinrich Mellmann +4
eess.AScs.SDeess.SParXiv:1909.01008v32019
AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head
Rongjie Huang, Mingze Li, Dongchao Yang +10
cs.CLcs.AIcs.SDarXiv:2304.12995v12023
Mask CTC: Non-Autoregressive End-to-End ASR with CTC and Mask Predict
Yosuke Higuchi, Shinji Watanabe, Nanxin Chen +2
eess.AScs.SDarXiv:2005.08700v22020
ADL-MVDR: All deep learning MVDR beamformer for target speech separation
Zhuohuang Zhang, Yong Xu, Meng Yu +3
eess.ASarXiv:2008.06994v32020
A Better Use of Audio-Visual Cues: Dense Video Captioning with Bi-modal Transformer
Vladimir Iashin, Esa Rahtu
cs.CVcs.CLcs.LGarXiv:2005.08271v22020
Dual-path RNN: efficient long sequence modeling for time-domain single-channel speech separation
Yi Luo, Zhuo Chen, Takuya Yoshioka
eess.AScs.LGcs.SDarXiv:1910.06379v22019
MossFormer: Pushing the Performance Limit of Monaural Speech Separation using Gated Single-Head Transformer with Convolution-Augmented Joint Self-Attentions
Shengkui Zhao, Bin Ma
cs.SDcs.LGeess.ASarXiv:2302.11824v12023
DDSP: Differentiable Digital Signal Processing
Jesse Engel, Lamtharn Hantrakul, Chenjie Gu +1
cs.LGcs.SDeess.ASarXiv:2001.04643v12020
MT3: Multi-Task Multitrack Music Transcription
Josh Gardner, Ian Simon, Ethan Manilow +2
cs.SDcs.LGeess.ASarXiv:2111.03017v42021
WaveFake: A Data Set to Facilitate Audio Deepfake Detection
Joel Frank, Lea Schönherr
cs.LGcs.CRcs.SDarXiv:2111.02813v12021
Two-Pass End-to-End Speech Recognition
Tara N. Sainath, Ruoming Pang, David Rybach +9
cs.CLcs.SDeess.ASarXiv:1908.10992v12019
Universal Phone Recognition with a Multilingual Allophone System
Xinjian Li, Siddharth Dalmia, Juncheng Li +8
cs.CLcs.SDeess.ASarXiv:2002.11800v12020
Asteroid: the PyTorch-based audio source separation toolkit for researchers
Manuel Pariente, Samuele Cornell, Joris Cosentino +11
eess.AScs.SDarXiv:2005.04132v12020
A Survey on Neural Speech Synthesis
Xu Tan, Tao Qin, Frank Soong +1
eess.AScs.CLcs.LGarXiv:2106.15561v32021
Spend Where It Matters: Particle Search with MH Refinement for Budget-Constrained Audio-Visual Alignment
Shivanshu Shekhar, Raghavendra Addanki, Tong Zhang +1
cs.CVcs.SDeess.ASarXiv:2610.12811v12026
Self-Training for End-to-End Speech Recognition
Jacob Kahn, Ann Lee, Awni Hannun
cs.CLcs.LGeess.ASarXiv:1909.09116v22019
Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentation
Yusong Wu, Ke Chen, Tianyu Zhang +4
cs.SDeess.ASarXiv:2211.06687v42022
Multi-Source Diffusion Models for Simultaneous Music Generation and Separation
Giorgio Mariani, Irene Tallini, Emilian Postolache +3
cs.SDcs.LGeess.ASarXiv:2302.02257v42023
SpEx: Multi-Scale Time Domain Speaker Extraction Network
Chenglin Xu, Wei Rao, Eng Siong Chng +1
eess.AScs.CLcs.SDarXiv:2004.08326v12020
Cross-lingual Multi-speaker Text-to-speech Synthesis for Voice Cloning without Using Parallel Corpus for Unseen Speakers
Zhaoyu Liu, Brian Mak
eess.ASarXiv:1911.11601v12019
Wavesplit: End-to-End Speech Separation by Speaker Clustering
Neil Zeghidour, David Grangier
eess.AScs.CLcs.LGarXiv:2002.08933v22020
AudioLDM: Text-to-Audio Generation with Latent Diffusion Models
Haohe Liu, Zehua Chen, Yi Yuan +5
cs.SDcs.AIcs.MMarXiv:2301.12503v32023
Summaries:简体中文
State-of-the-art Speech Recognition With Sequence-to-Sequence Models
Chung-Cheng Chiu, Tara N. Sainath, Yonghui Wu +11
cs.CLcs.SDeess.ASarXiv:1712.01769v62017
Hello Edge: Keyword Spotting on Microcontrollers
Yundong Zhang, Naveen Suda, Liangzhen Lai +1
cs.SDcs.CLcs.LGarXiv:1711.07128v32017
Characterizing Audio Adversarial Examples Using Temporal Dependency
Zhuolin Yang, Bo Li, Pin-Yu Chen +1
cs.LGcs.AIcs.CRarXiv:1809.10875v22018

Audio and Speech Processing

Unsupervised speech representation learning using WaveNet autoencoders

ACE-Step: A Step Towards Music Generation Foundation Model

Hierarchical Generative Modeling for Controllable Speech Synthesis

ACCDOA: Activity-Coupled Cartesian Direction of Arrival Representation for Sound Event Localization and Detection

Any-to-Many Voice Conversion with Location-Relative Sequence-to-Sequence Modeling

A Comparative Study on Transformer vs RNN in Speech Applications

Anatomy-aware cross-speaker adaptation of complete vocal-tract acoustic-to-articulatory inversion

Dual-branch Attention-In-Attention Transformer for single-channel speech enhancement

DeepSonar: Towards Effective and Robust Detection of AI-Synthesized Fake Voices

DCCRN: Deep Complex Convolution Recurrent Network for Phase-Aware Speech Enhancement

An Embarrassingly Simple Approach for LLM with Strong ASR Capacity

SoulX-Singer: Towards High-Quality Zero-Shot Singing Voice Synthesis

A neural attention model for speech command recognition

Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition

Sound Event Detection of Weakly Labelled Data with CNN-Transformer and Automatic Threshold Optimization

Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Search

EmoMix: Emotion Mixing via Diffusion Models for Emotional Speech Synthesis

An Overview of Deep-Learning-Based Audio-Visual Speech Enhancement and Separation

TinyLSTMs: Efficient Neural Speech Enhancement for Hearing Aids

StreamAlign: Streaming Text-Aligned Speech Tokenization

End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architectures

Google USM: Scaling Automatic Speech Recognition Beyond 100 Languages

A Comprehensive Survey on Deep Music Generation: Multi-level Representations, Algorithms, Evaluations, and Future Directions

WHAM!: Extending Speech Separation to Noisy Environments

Video Background Music Generation with Controllable Music Transformer

Robust and fine-grained prosody control of end-to-end speech synthesis

Investigating self-supervised front ends for speech spoofing countermeasures

MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesis

Fairness Evaluation of Edge-AI Implementation for Cleft Lip and Palate Speech ASR

AudioTETRIS: Token Elimination via Transitional Importance Signals for Efficient Audio LLMs

Minimum bias multiple taper spectral estimation

VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset

TimbreTron: A WaveNet(CycleGAN(CQT(Audio))) Pipeline for Musical Timbre Transfer

Fine-tuning wav2vec2 for speaker recognition

MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix

The LOCATA Challenge: Acoustic Source Localization and Tracking

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head

Mask CTC: Non-Autoregressive End-to-End ASR with CTC and Mask Predict

ADL-MVDR: All deep learning MVDR beamformer for target speech separation

A Better Use of Audio-Visual Cues: Dense Video Captioning with Bi-modal Transformer

Dual-path RNN: efficient long sequence modeling for time-domain single-channel speech separation

MossFormer: Pushing the Performance Limit of Monaural Speech Separation using Gated Single-Head Transformer with Convolution-Augmented Joint Self-Attentions

DDSP: Differentiable Digital Signal Processing

MT3: Multi-Task Multitrack Music Transcription

WaveFake: A Data Set to Facilitate Audio Deepfake Detection

Two-Pass End-to-End Speech Recognition

Universal Phone Recognition with a Multilingual Allophone System

Asteroid: the PyTorch-based audio source separation toolkit for researchers

A Survey on Neural Speech Synthesis

Spend Where It Matters: Particle Search with MH Refinement for Budget-Constrained Audio-Visual Alignment

Self-Training for End-to-End Speech Recognition

Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentation

Multi-Source Diffusion Models for Simultaneous Music Generation and Separation

SpEx: Multi-Scale Time Domain Speaker Extraction Network

Cross-lingual Multi-speaker Text-to-speech Synthesis for Voice Cloning without Using Parallel Corpus for Unseen Speakers

Wavesplit: End-to-End Speech Separation by Speaker Clustering

AudioLDM: Text-to-Audio Generation with Latent Diffusion Models

State-of-the-art Speech Recognition With Sequence-to-Sequence Models

Hello Edge: Keyword Spotting on Microcontrollers

Characterizing Audio Adversarial Examples Using Temporal Dependency