Audio and Speech Processing

Papers filed under eess.AS on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

61 to 120 of 1,641

Mask-Based Speech Enhancement for Spatial Audio: A Comparison of Ambisonics, Beamforming, and Microphone Channels
Sheli Hendel, Boaz Rafaely, Dorothea Kolossa
eess.ASarXiv:2609.18532v12026
Encoder Awakening via Adapters: Effective Domain-Adaptive Fine-tuning of Speech-LLMs
Mohan Shi, Zilai Wang, Natarajan Balaji Shankar +3
eess.AScs.CLarXiv:2609.17981v22026
Learning Delays in Spiking Neural Networks using Dilated Convolutions with Learnable Spacings
Ilyass Hammouamri, Ismail Khalfaoui-Hassani, Timothée Masquelier
cs.NEcs.AIcs.LGarXiv:2306.17670v32023
Theme Transformer: Symbolic Music Generation with Theme-Conditioned Transformer
Yi-Jen Shih, Shih-Lun Wu, Frank Zalkow +2
cs.SDcs.MMeess.ASarXiv:2111.04093v22021
Towards Fast and Accurate Streaming End-to-End ASR
Bo Li, Shuo-yiin Chang, Tara N. Sainath +4
eess.ASarXiv:2004.11544v22020
The Zero Resource Speech Challenge 2019: TTS without T
Ewan Dunbar, Robin Algayres, Julien Karadayi +10
cs.CLcs.SDeess.ASarXiv:1904.11469v22019
MIMO-SPEECH: End-to-End Multi-Channel Multi-Speaker Speech Recognition
Xuankai Chang, Wangyou Zhang, Yanmin Qian +2
eess.AScs.CLcs.SDarXiv:1910.06522v22019
Sound Event Detection and Time-Frequency Segmentation from Weakly Labelled Data
Qiuqiang Kong, Yong Xu, Iwona Sobieraj +2
cs.SDeess.ASarXiv:1804.04715v32018
Jointly Fine-Tuning "BERT-like" Self Supervised Models to Improve Multimodal Speech Emotion Recognition
Shamane Siriwardhana, Andrew Reis, Rivindu Weerasekera +1
eess.AScs.AIcs.CLarXiv:2008.06682v12020
Codified audio language modeling learns useful representations for music information retrieval
Rodrigo Castellon, Chris Donahue, Percy Liang
cs.SDcs.IRcs.LGarXiv:2107.05677v12021
musicnn: Pre-trained convolutional neural networks for music audio tagging
Jordi Pons, Xavier Serra
cs.SDcs.CLeess.ASarXiv:1909.06654v12019
Chat with the Environment: Interactive Multimodal Perception Using Large Language Models
Xufeng Zhao, Mengdi Li, Cornelius Weber +2
cs.ROcs.AIcs.CLarXiv:2303.08268v22023
Few-Shot Adaptation for Anomalous Sound Detection at Low False-Positive Rate
Simone Lugani, Christof Pichler, Hannes Wegleiter +3
cs.SDcs.LGeess.ASarXiv:2610.19893v12026
Full-Duplex Interaction with Speech, Expressions and Gestures
Siyin Wang, Wenyi Yu, Terumi Chiba +5
eess.AScs.AIcs.CVarXiv:2610.21452v12026
FD-VAD: Semantic Endpoint Detection for Streaming Full-Duplex Speech
Puneet Mathur, Dinesh Manocha
cs.CLeess.ASarXiv:2609.35791v12026
Frame-Wise Streaming for Efficient Learned Speech Compression
Yuhan Liu, Jun Xu, Fengxi Zhang +2
cs.SDeess.ASarXiv:2610.21998v12026
OneVoice: An Intermediate Representation for Agentic Speech Pipelines
Vipul Charugundla, Dancheng Liu, Jinjun Xiong
eess.AScs.MAcs.MMarXiv:2609.31673v12026
Absolute Quality Ratings of Speech Enhancement Systems by Listeners of Different Ages and Degrees of Hearing Loss
Matteo Torcoli, Chih-Wei Wu, Andrea Esposito +6
eess.ASarXiv:2609.18714v12026
A Survey on Speech Deepfake Detection
Menglu Li, Yasaman Ahmadiadli, Xiao-Ping Zhang
cs.SDcs.CRcs.MMarXiv:2404.13914v22024
Reviving Etter method for autoregressive inpainting: Generalization, evaluation, implementation
Ondřej Mokrý, Matěj Hrdlička, Pavel Rajmic
eess.ASeess.SParXiv:2609.18401v12026
Task-oriented neural FOA encoding for SELD from irregular microphone arrays
Jiachen Liu, Yin Cao, Ming Wu +1
eess.ASarXiv:2609.18040v12026
SNOAR: Self-training with Noise filtering, Observation adding, and Remixing for Speech Denoising Without Clean References
Samuele Cornell, Matthew Maciejewski
eess.AScs.LGcs.SDarXiv:2610.20863v12026
FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codec
Zhihao Du, Shiliang Zhang, Kai Hu +1
cs.SDcs.AIeess.ASarXiv:2309.07405v22023
High-Order Sinusoidal Modeling for Precise Parameter Refinement
Shaowen Chen, Tomoki Toda
eess.SPeess.ASarXiv:2610.21643v12026
Encypher: Shared Agency and Social Presence in Collaborative Music Generation for Dance Cyphers
Zhixing Chen, Cheng-Zhi Anna Huang
cs.HCcs.SDeess.ASarXiv:2609.18062v12026
Efficient Emotional Adaptation for Audio-Driven Talking-Head Generation
Yuan Gan, Zongxin Yang, Xihang Yue +2
cs.SDcs.CVcs.GRarXiv:2309.04946v22023
VoxTurn: Answering Several Turn-Taking Questions in One Pass with One Model
Yang Xiao
eess.AScs.SDarXiv:2610.21150v12026
Probing Neural Audio Codecs with Speaker Traits and Speech Characteristics
Jihwan Lee, Tiantian Feng, Minu Kim +6
eess.AScs.SDarXiv:2610.20955v12026
TTM-Bench: A Framework for Text-to-Music System Performance Benchmarking
Giorgia Adorni, Michela Papandrea, Battista Rimoldi +1
cs.SDcs.LGcs.MMarXiv:2609.18585v12026
Correlation-Guided Encoder Selection for Multi-Encoder Large Audio-Language Models
Pei-Jun Liao, Hung-Shin Lee, Wenze Ren +3
eess.AScs.CLcs.SDarXiv:2609.18041v12026
SG-Mamba: Sparse Graph-Guided Mamba for Audio-Visual Speech Enhancement
Guo-Ruei Tseng, Hung-Shin Lee, Hsin-Min Wang +1
eess.AScs.CLcs.SDarXiv:2609.18009v22026
Multi-modal Multi-channel Target Speech Separation
Rongzhi Gu, Shi-Xiong Zhang, Yong Xu +3
eess.AScs.SDeess.IVarXiv:2003.07032v22020
Parrotron: An End-to-End Speech-to-Speech Conversion Model and its Applications to Hearing-Impaired Speech and Speech Separation
Fadi Biadsy, Ron J. Weiss, Pedro J. Moreno +2
eess.AScs.SDarXiv:1904.04169v32019
Pre-trained Speech Processing Models Contain Human-Like Biases that Propagate to Speech Emotion Recognition
Isaac Slaughter, Craig Greenberg, Reva Schwartz +1
cs.CLcs.LGcs.SDarXiv:2310.18877v12023
ASR4REAL: An extended benchmark for speech models
Morgane Riviere, Jade Copet, Gabriel Synnaeve
eess.AScs.AIcs.CLarXiv:2110.08583v12021
SpecMaskFoley: Steering Pretrained Spectral Masked Generative Transformer Toward Synchronized Video-to-audio Synthesis via ControlNet
Zhi Zhong, Akira Takahashi, Shuyang Cui +3
cs.SDcs.AIcs.LGarXiv:2505.16195v22025
Quantifying Bias in Automatic Speech Recognition
Siyuan Feng, Olya Kudina, Bence Mark Halpern +1
eess.AScs.CLcs.SDarXiv:2103.15122v22021
OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer
Yifan Peng, Jinchuan Tian, William Chen +9
cs.CLeess.ASarXiv:2401.16658v32024
GrainSpeech: Less Context, More Detail for Compact Speech Synthesis
Zitao Liang, Chang Gao
eess.AScs.AIcs.SDarXiv:2609.18856v12026
SyncVoice: Simple and Effective Automatic Video Dubbing with Vision-Augmented TTS
Kaidi Wang, Yi He, Wenhao Guan +9
eess.AScs.AIcs.CLarXiv:2512.05126v22025
Vector-quantized neural networks for acoustic unit discovery in the ZeroSpeech 2020 challenge
Benjamin van Niekerk, Leanne Nortje, Herman Kamper
eess.AScs.CLarXiv:2005.09409v22020
VoiceTrace: A Benchmark and Retrieval Framework for Who-Said-What Speech Retrieval
Aaron Yee, Fengjie Lu, Jiarui Hai +5
cs.SDcs.AIeess.ASarXiv:2609.18521v12026
VioLA: Unified Codec Language Models for Speech Recognition, Synthesis, and Translation
Tianrui Wang, Long Zhou, Ziqiang Zhang +6
cs.CLcs.SDeess.ASarXiv:2305.16107v12023
Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesis
Sanyuan Chen, Min-Jae Hwang, Sho Inoue +12
cs.CLeess.ASarXiv:2609.03992v12026
Ming-Omni: A Unified Multimodal Model for Perception and Generation
Inclusion AI, Biao Gong, Cheng Zou +55
cs.AIcs.CLcs.CVarXiv:2506.09344v12025
Non-Autoregressive Neural Text-to-Speech
Kainan Peng, Wei Ping, Zhao Song +1
cs.CLcs.LGcs.SDarXiv:1905.08459v32019
FastSpeech: Fast, Robust and Controllable Text to Speech
Yi Ren, Yangjun Ruan, Xu Tan +4
cs.CLcs.LGcs.SDarXiv:1905.09263v52019
The Silent Thought: Modeling Internal Cognition in Full-Duplex Spoken Dialogue Models via Latent Reasoning
Donghang Wu, Tianyu Zhang, Yuxin Li +4
eess.AScs.CLarXiv:2603.17837v52026
Wave-Tacotron: Spectrogram-free end-to-end text-to-speech synthesis
Ron J. Weiss, RJ Skerry-Ryan, Eric Battenberg +2
cs.CLcs.SDeess.ASarXiv:2011.03568v22020
InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generation
Chong Zhang, Yukun Ma, Qian Chen +12
cs.SDcs.AIcs.CLarXiv:2503.00084v12025
textless-lib: a Library for Textless Spoken Language Processing
Eugene Kharitonov, Jade Copet, Kushal Lakhotia +8
cs.CLcs.LGcs.SDarXiv:2202.07359v12022
Continuous Learning for Children's ASR: Overcoming Catastrophic Forgetting with Elastic Weight Consolidation and Synaptic Intelligence
Edem Ahadzi, Vishwanath Pratap Singh, Tomi Kinnunen +1
eess.ASarXiv:2505.20216v12025
AudioGenie: A Training-Free Multi-Agent Framework for Diverse Multimodality-to-Multiaudio Generation
Yan Rong, Jinting Wang, Guangzhi Lei +2
cs.SDcs.MAcs.MMarXiv:2505.22053v22025
Location-Relative Attention Mechanisms For Robust Long-Form Speech Synthesis
Eric Battenberg, RJ Skerry-Ryan, Soroosh Mariooryad +4
cs.CLcs.LGcs.SDarXiv:1910.10288v22019
The Boombox: Visual Reconstruction from Acoustic Vibrations
Boyuan Chen, Mia Chiquier, Hod Lipson +1
cs.CVcs.MMcs.ROarXiv:2105.08052v22021
Hybrid Pruning: In-Situ Compression of Self-Supervised Speech Models for Speaker Verification and Anti-Spoofing
Junyi Peng, Lin Zhang, Jiangyu Han +5
eess.ASarXiv:2508.16232v22025
One TTS Alignment To Rule Them All
Rohan Badlani, Adrian Łancucki, Kevin J. Shih +3
cs.SDcs.CLcs.LGarXiv:2108.10447v12021
LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPT
Zhihao Du, Jiaming Wang, Qian Chen +12
cs.SDcs.AIcs.LGarXiv:2310.04673v42023
HQ-SVC: Towards High-Quality Zero-Shot Singing Voice Conversion in Low-Resource Scenarios
Bingsong Bai, Yizhong Geng, Fengping Wang +4
cs.SDcs.AIeess.ASarXiv:2511.08496v32025
VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment
Bing Han, Long Zhou, Shujie Liu +7
cs.CLcs.SDeess.ASarXiv:2406.07855v12024

Audio and Speech Processing

Mask-Based Speech Enhancement for Spatial Audio: A Comparison of Ambisonics, Beamforming, and Microphone Channels

Encoder Awakening via Adapters: Effective Domain-Adaptive Fine-tuning of Speech-LLMs

Learning Delays in Spiking Neural Networks using Dilated Convolutions with Learnable Spacings

Theme Transformer: Symbolic Music Generation with Theme-Conditioned Transformer

Towards Fast and Accurate Streaming End-to-End ASR

The Zero Resource Speech Challenge 2019: TTS without T

MIMO-SPEECH: End-to-End Multi-Channel Multi-Speaker Speech Recognition

Sound Event Detection and Time-Frequency Segmentation from Weakly Labelled Data

Jointly Fine-Tuning "BERT-like" Self Supervised Models to Improve Multimodal Speech Emotion Recognition

Codified audio language modeling learns useful representations for music information retrieval

musicnn: Pre-trained convolutional neural networks for music audio tagging

Chat with the Environment: Interactive Multimodal Perception Using Large Language Models

Few-Shot Adaptation for Anomalous Sound Detection at Low False-Positive Rate

Full-Duplex Interaction with Speech, Expressions and Gestures

FD-VAD: Semantic Endpoint Detection for Streaming Full-Duplex Speech

Frame-Wise Streaming for Efficient Learned Speech Compression

OneVoice: An Intermediate Representation for Agentic Speech Pipelines

Absolute Quality Ratings of Speech Enhancement Systems by Listeners of Different Ages and Degrees of Hearing Loss

A Survey on Speech Deepfake Detection

Reviving Etter method for autoregressive inpainting: Generalization, evaluation, implementation

Task-oriented neural FOA encoding for SELD from irregular microphone arrays

SNOAR: Self-training with Noise filtering, Observation adding, and Remixing for Speech Denoising Without Clean References

FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codec

High-Order Sinusoidal Modeling for Precise Parameter Refinement

Encypher: Shared Agency and Social Presence in Collaborative Music Generation for Dance Cyphers

Efficient Emotional Adaptation for Audio-Driven Talking-Head Generation

VoxTurn: Answering Several Turn-Taking Questions in One Pass with One Model

Probing Neural Audio Codecs with Speaker Traits and Speech Characteristics

TTM-Bench: A Framework for Text-to-Music System Performance Benchmarking

Correlation-Guided Encoder Selection for Multi-Encoder Large Audio-Language Models

SG-Mamba: Sparse Graph-Guided Mamba for Audio-Visual Speech Enhancement

Multi-modal Multi-channel Target Speech Separation

Parrotron: An End-to-End Speech-to-Speech Conversion Model and its Applications to Hearing-Impaired Speech and Speech Separation

Pre-trained Speech Processing Models Contain Human-Like Biases that Propagate to Speech Emotion Recognition

ASR4REAL: An extended benchmark for speech models

SpecMaskFoley: Steering Pretrained Spectral Masked Generative Transformer Toward Synchronized Video-to-audio Synthesis via ControlNet

Quantifying Bias in Automatic Speech Recognition

OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer

GrainSpeech: Less Context, More Detail for Compact Speech Synthesis

SyncVoice: Simple and Effective Automatic Video Dubbing with Vision-Augmented TTS

Vector-quantized neural networks for acoustic unit discovery in the ZeroSpeech 2020 challenge

VoiceTrace: A Benchmark and Retrieval Framework for Who-Said-What Speech Retrieval

VioLA: Unified Codec Language Models for Speech Recognition, Synthesis, and Translation

Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesis

Ming-Omni: A Unified Multimodal Model for Perception and Generation

Non-Autoregressive Neural Text-to-Speech

FastSpeech: Fast, Robust and Controllable Text to Speech

The Silent Thought: Modeling Internal Cognition in Full-Duplex Spoken Dialogue Models via Latent Reasoning

Wave-Tacotron: Spectrogram-free end-to-end text-to-speech synthesis

InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generation

textless-lib: a Library for Textless Spoken Language Processing

Continuous Learning for Children's ASR: Overcoming Catastrophic Forgetting with Elastic Weight Consolidation and Synaptic Intelligence

AudioGenie: A Training-Free Multi-Agent Framework for Diverse Multimodality-to-Multiaudio Generation

Location-Relative Attention Mechanisms For Robust Long-Form Speech Synthesis

The Boombox: Visual Reconstruction from Acoustic Vibrations

Hybrid Pruning: In-Situ Compression of Self-Supervised Speech Models for Speaker Verification and Anti-Spoofing

One TTS Alignment To Rule Them All

LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPT

HQ-SVC: Towards High-Quality Zero-Shot Singing Voice Conversion in Low-Resource Scenarios

VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment