Audio and Speech Processing

Papers filed under eess.AS on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

1,501 to 1,560 of 1,641

RawNet: Advanced end-to-end deep neural network using raw waveforms for text-independent speaker verification
Jee-weon Jung, Hee-Soo Heo, Ju-ho Kim +2
eess.AScs.LGcs.SDarXiv:1904.08104v22019
Dense CNN with Self-Attention for Time-Domain Speech Enhancement
Ashutosh Pandey, DeLiang Wang
eess.AScs.SDarXiv:2009.01941v22020
SoundStorm: Efficient Parallel Audio Generation
Zalán Borsos, Matt Sharifi, Damien Vincent +3
cs.SDcs.LGeess.ASarXiv:2305.09636v12023
A Comparison of Discrete and Soft Speech Units for Improved Voice Conversion
Benjamin van Niekerk, Marc-André Carbonneau, Julian Zaïdi +3
eess.AScs.SDarXiv:2111.02392v22021
Broadcasted Residual Learning for Efficient Keyword Spotting
Byeonggeun Kim, Simyung Chang, Jinkyu Lee +1
cs.SDcs.LGeess.ASarXiv:2106.04140v42021
A Comparison of Techniques for Language Model Integration in Encoder-Decoder Speech Recognition
Shubham Toshniwal, Anjuli Kannan, Chung-Cheng Chiu +3
eess.AScs.AIcs.CLarXiv:1807.10857v22018
TitaNet: Neural Model for speaker representation with 1D Depth-wise separable convolutions and global context
Nithin Rao Koluguri, Taejin Park, Boris Ginsburg
eess.AScs.SDarXiv:2110.04410v12021
Music Generation by Deep Learning - Challenges and Directions
Jean-Pierre Briot, François Pachet
cs.SDcs.LGeess.ASarXiv:1712.04371v22017
A Comprehensive Survey of Hallucination in Large Language, Image, Video and Audio Foundation Models
Pranab Sahoo, Prabhash Meharia, Akash Ghosh +3
cs.LGcs.AIcs.CLarXiv:2405.09589v42024
Very Deep Self-Attention Networks for End-to-End Speech Recognition
Ngoc-Quan Pham, Thai-Son Nguyen, Jan Niehues +3
cs.CLcs.LGcs.SDarXiv:1904.13377v22019
Acoustic scene classification in DCASE 2020 Challenge: generalization across devices and low complexity solutions
Toni Heittola, Annamaria Mesaros, Tuomas Virtanen
eess.ASarXiv:2005.14623v22020
Massively Multilingual ASR: 50 Languages, 1 Model, 1 Billion Parameters
Vineel Pratap, Anuroop Sriram, Paden Tomasello +4
eess.AScs.CLcs.SDarXiv:2007.03001v22020
Beyond SDR: How Music Source Separation Reshapes Rhythm-Relevant Signal Properties
Chuxin Ding
cs.SDeess.ASarXiv:2609.04224v12026
EffVOC: Low-Delay Efficient Speech Waveform Reconstruction from Spectral Representations Without Phase
Renzheng Shi, Simon Welker, Timo Gerkmann +1
eess.ASarXiv:2609.04226v12026
Automatic Speech Recognition for Multilingual Oral History Research
Sidney Wong, Chelsea Wong She, Eda Tang +3
eess.AScs.CLarXiv:2609.04232v12026
Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM
Xiong Wang, Yangze Li, Chaoyou Fu +5
cs.SDcs.AIcs.CLarXiv:2411.00774v52024
TidyVoice: A Curated Multilingual Dataset for Speaker Verification Derived from Common Voice
Aref Farhadipour, Jan Marquenie, Srikanth Madikeri +1
eess.AScs.SDarXiv:2601.16358v12026
Global birdsong embeddings enable superior transfer learning for bioacoustic classification
Burooj Ghani, Tom Denton, Stefan Kahl +1
eess.AScs.SDarXiv:2307.06292v22023
WAXAL: A Large-Scale Multilingual African Language Speech Corpus
Abdoulaye Diack, Perry Nelson, Kwaku Agbesi +40
eess.AScs.AIcs.CLarXiv:2602.02734v32026
Anomalous sound detection based on interpolation deep neural network
Kaori Suefusa, Tomoya Nishida, Harsh Purohit +3
eess.AScs.LGcs.SDarXiv:2005.09234v12020
ASSERT: Anti-Spoofing with Squeeze-Excitation and Residual neTworks
Cheng-I Lai, Nanxin Chen, Jesús Villalba +1
cs.CLcs.LGcs.SDarXiv:1904.01120v12019
MFA-Conformer: Multi-scale Feature Aggregation Conformer for Automatic Speaker Verification
Yang Zhang, Zhiqiang Lv, Haibin Wu +5
cs.SDeess.ASarXiv:2203.15249v22022
ImageBind-LLM: Multi-modality Instruction Tuning
Jiaming Han, Renrui Zhang, Wenqi Shao +14
cs.MMcs.CLcs.CVarXiv:2309.03905v22023
Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
Simian Luo, Chuanhao Yan, Chenxu Hu +1
cs.SDcs.CVcs.LGarXiv:2306.17203v12023
Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics
Siddhant Arora, Zhiyun Lu, Chung-Cheng Chiu +2
cs.CLcs.SDeess.ASarXiv:2503.01174v12025
Exploring Wav2vec 2.0 fine-tuning for improved speech emotion recognition
Li-Wei Chen, Alexander Rudnicky
eess.AScs.CLcs.LGarXiv:2110.06309v32021
Generative Pre-Training for Speech with Autoregressive Predictive Coding
Yu-An Chung, James Glass
eess.AScs.CLcs.LGarXiv:1910.12607v22019
VQMIVC: Vector Quantization and Mutual Information-Based Unsupervised Speech Representation Disentanglement for One-shot Voice Conversion
Disong Wang, Liqun Deng, Yu Ting Yeung +3
eess.AScs.CLcs.MMarXiv:2106.10132v12021
MiniMax-Speech: Intrinsic Zero-Shot Text-to-Speech with a Learnable Speaker Encoder
Bowen Zhang, Congchao Guo, Geng Yang +17
eess.AScs.SDarXiv:2505.07916v12025
E-Branchformer: Branchformer with Enhanced merging for speech recognition
Kwangyoun Kim, Felix Wu, Yifan Peng +4
eess.AScs.LGarXiv:2210.00077v22022
DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusion
Ziqian Ning, Huakang Chen, Yuepeng Jiang +5
eess.ASarXiv:2503.01183v12025
LibriTTS-R: A Restored Multi-Speaker Text-to-Speech Corpus
Yuma Koizumi, Heiga Zen, Shigeki Karita +7
eess.AScs.SDarXiv:2305.18802v12023
End-to-end learning for music audio tagging at scale
Jordi Pons, Oriol Nieto, Matthew Prockup +3
cs.SDeess.ASarXiv:1711.02520v42017
Temporal Convolution for Real-time Keyword Spotting on Mobile Devices
Seungwoo Choi, Seokjun Seo, Beomjun Shin +5
cs.SDcs.LGcs.NEarXiv:1904.03814v22019
Ola: Pushing the Frontiers of Omni-Modal Language Model
Zuyan Liu, Yuhao Dong, Jiahui Wang +4
cs.CVcs.CLcs.MMarXiv:2502.04328v32025
Improved Speech Enhancement with the Wave-U-Net
Craig Macartney, Tillman Weyde
cs.SDcs.LGcs.NEarXiv:1811.11307v12018
On The Landscape of Spoken Language Models: A Comprehensive Survey
Siddhant Arora, Kai-Wei Chang, Chung-Ming Chien +7
cs.CLcs.SDeess.ASarXiv:2504.08528v22025
LASE: Language-Adversarial Speaker Encoding for Indic Cross-Script Identity Preservation
Venkata Pushpak Teja Menta
cs.SDcs.CLeess.ASarXiv:2605.00777v12026
Deep Neural Network for Respiratory Sound Classification in Wearable Devices Enabled by Patient Specific Model Tuning
Jyotibdha Acharya, Arindam Basu
eess.AScs.LGcs.SDarXiv:2004.08287v12020
Hybrid Spectrogram and Waveform Source Separation
Alexandre Défossez
eess.AScs.SDstat.MLarXiv:2111.03600v32021
Entropy as a Structural Prior: How a Log-Barrier on DiT Belief Space Drives Musical Diversity and Development
Zixi Li, Youzhen Li
cs.SDcs.LGeess.ASarXiv:2606.07207v12026
Music Source Separation with Band-split RNN
Yi Luo, Jianwei Yu
eess.AScs.LGcs.SDarXiv:2209.15174v12022
Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Sound
Andros Tjandra, Yi-Chiao Wu, Baishan Guo +10
cs.SDcs.LGeess.ASarXiv:2502.05139v12025
LEAF: A Learnable Frontend for Audio Classification
Neil Zeghidour, Olivier Teboul, Félix de Chaumont Quitry +1
cs.SDcs.LGeess.ASarXiv:2101.08596v12021
Exploring Speech Enhancement with Generative Adversarial Networks for Robust Speech Recognition
Chris Donahue, Bo Li, Rohit Prabhavalkar
cs.SDcs.LGcs.NEarXiv:1711.05747v22017
VAANI Noise Event Dataset: A curated spontaneous speech dataset annotated with timestamps for noise events
Pavan Kumar J, Agneedh Basu, Pranav Bhat +3
eess.ASarXiv:2609.02474v12026
CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-training
Zhihao Du, Changfeng Gao, Yuxuan Wang +19
cs.SDcs.AIeess.ASarXiv:2505.17589v22025
Sound Event Detection: A Tutorial
Annamaria Mesaros, Toni Heittola, Tuomas Virtanen +1
eess.ASarXiv:2107.05463v12021
SoundStream: An End-to-End Neural Audio Codec
Neil Zeghidour, Alejandro Luebs, Ahmed Omran +2
cs.SDcs.LGeess.ASarXiv:2107.03312v12021
A Comparison of Five Multiple Instance Learning Pooling Functions for Sound Event Detection with Weak Labeling
Yun Wang, Juncheng Li, Florian Metze
cs.SDeess.ASarXiv:1810.09050v32018
Deep Neural Networks for Multiple Speaker Detection and Localization
Weipeng He, Petr Motlicek, Jean-Marc Odobez
cs.SDcs.AIcs.MMarXiv:1711.11565v32017
Qwen3-Omni Technical Report
Jin Xu, Zhifang Guo, Hangrui Hu +35
cs.CLcs.AIcs.CVarXiv:2509.17765v12025
Spot the conversation: speaker diarisation in the wild
Joon Son Chung, Jaesung Huh, Arsha Nagrani +2
cs.SDcs.CVeess.ASarXiv:2007.01216v32020
Qwen2.5-Omni Technical Report
Jin Xu, Zhifang Guo, Jinzheng He +11
cs.CLcs.CVcs.SDarXiv:2503.20215v12025
ARFT: A Synchronized Multimodal RF-Acoustic Dataset for Positioning in Distributed Environments
Daan Delabie, Jarne Van Mulders, Bert Pyck +2
eess.SPeess.ASarXiv:2609.02657v12026
Traceable TTS: Toward Watermark-Free TTS with Strong Traceability
Yuxiang Zhao, Yunchong Xiao, Yushen Chen +4
eess.AScs.AIarXiv:2507.03887v12025
Interspeech 2021 Deep Noise Suppression Challenge
Chandan K A Reddy, Harishchandra Dubey, Kazuhito Koishida +7
cs.SDcs.LGeess.ASarXiv:2101.01902v32021
VoiceBench: Benchmarking LLM-Based Voice Assistants
Yiming Chen, Xianghu Yue, Chen Zhang +3
cs.CLcs.AIcs.SDarXiv:2410.17196v32024
Universal Sound Separation
Ilya Kavalerov, Scott Wisdom, Hakan Erdogan +4
cs.SDcs.LGeess.ASarXiv:1905.03330v22019
WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling
Shengpeng Ji, Ziyue Jiang, Wen Wang +14
eess.AScs.LGcs.MMarXiv:2408.16532v32024

Audio and Speech Processing

RawNet: Advanced end-to-end deep neural network using raw waveforms for text-independent speaker verification

Dense CNN with Self-Attention for Time-Domain Speech Enhancement

SoundStorm: Efficient Parallel Audio Generation

A Comparison of Discrete and Soft Speech Units for Improved Voice Conversion

Broadcasted Residual Learning for Efficient Keyword Spotting

A Comparison of Techniques for Language Model Integration in Encoder-Decoder Speech Recognition

TitaNet: Neural Model for speaker representation with 1D Depth-wise separable convolutions and global context

Music Generation by Deep Learning - Challenges and Directions

A Comprehensive Survey of Hallucination in Large Language, Image, Video and Audio Foundation Models

Very Deep Self-Attention Networks for End-to-End Speech Recognition

Acoustic scene classification in DCASE 2020 Challenge: generalization across devices and low complexity solutions

Massively Multilingual ASR: 50 Languages, 1 Model, 1 Billion Parameters

Beyond SDR: How Music Source Separation Reshapes Rhythm-Relevant Signal Properties

EffVOC: Low-Delay Efficient Speech Waveform Reconstruction from Spectral Representations Without Phase

Automatic Speech Recognition for Multilingual Oral History Research

Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM

TidyVoice: A Curated Multilingual Dataset for Speaker Verification Derived from Common Voice

Global birdsong embeddings enable superior transfer learning for bioacoustic classification

WAXAL: A Large-Scale Multilingual African Language Speech Corpus

Anomalous sound detection based on interpolation deep neural network

ASSERT: Anti-Spoofing with Squeeze-Excitation and Residual neTworks

MFA-Conformer: Multi-scale Feature Aggregation Conformer for Automatic Speaker Verification

ImageBind-LLM: Multi-modality Instruction Tuning

Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models

Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics

Exploring Wav2vec 2.0 fine-tuning for improved speech emotion recognition

Generative Pre-Training for Speech with Autoregressive Predictive Coding

VQMIVC: Vector Quantization and Mutual Information-Based Unsupervised Speech Representation Disentanglement for One-shot Voice Conversion

MiniMax-Speech: Intrinsic Zero-Shot Text-to-Speech with a Learnable Speaker Encoder

E-Branchformer: Branchformer with Enhanced merging for speech recognition

DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusion

LibriTTS-R: A Restored Multi-Speaker Text-to-Speech Corpus

End-to-end learning for music audio tagging at scale

Temporal Convolution for Real-time Keyword Spotting on Mobile Devices

Ola: Pushing the Frontiers of Omni-Modal Language Model

Improved Speech Enhancement with the Wave-U-Net

On The Landscape of Spoken Language Models: A Comprehensive Survey

LASE: Language-Adversarial Speaker Encoding for Indic Cross-Script Identity Preservation

Deep Neural Network for Respiratory Sound Classification in Wearable Devices Enabled by Patient Specific Model Tuning

Hybrid Spectrogram and Waveform Source Separation

Entropy as a Structural Prior: How a Log-Barrier on DiT Belief Space Drives Musical Diversity and Development

Music Source Separation with Band-split RNN

Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Sound

LEAF: A Learnable Frontend for Audio Classification

Exploring Speech Enhancement with Generative Adversarial Networks for Robust Speech Recognition

VAANI Noise Event Dataset: A curated spontaneous speech dataset annotated with timestamps for noise events

CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-training

Sound Event Detection: A Tutorial

SoundStream: An End-to-End Neural Audio Codec

A Comparison of Five Multiple Instance Learning Pooling Functions for Sound Event Detection with Weak Labeling

Deep Neural Networks for Multiple Speaker Detection and Localization

Qwen3-Omni Technical Report

Spot the conversation: speaker diarisation in the wild

Qwen2.5-Omni Technical Report

ARFT: A Synchronized Multimodal RF-Acoustic Dataset for Positioning in Distributed Environments

Traceable TTS: Toward Watermark-Free TTS with Strong Traceability

Interspeech 2021 Deep Noise Suppression Challenge

VoiceBench: Benchmarking LLM-Based Voice Assistants

Universal Sound Separation

WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling