Audio and Speech Processing

Papers filed under eess.AS on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

601 to 660 of 1,648

Semi-Supervised Speech Recognition via Local Prior Matching
Wei-Ning Hsu, Ann Lee, Gabriel Synnaeve +1
cs.CLcs.LGeess.ASarXiv:2002.10336v12020
UniCATS: A Unified Context-Aware Text-to-Speech Framework with Contextual VQ-Diffusion and Vocoding
Chenpeng Du, Yiwei Guo, Feiyu Shen +6
cs.SDeess.ASarXiv:2306.07547v62023
VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretation
Changhan Wang, Morgane Rivière, Ann Lee +6
cs.CLeess.ASarXiv:2101.00390v22021
ASVspoof 2019: spoofing countermeasures for the detection of synthesized, converted and replayed speech
Andreas Nautsch, Xin Wang, Nicholas Evans +7
eess.AScs.CRcs.SDarXiv:2102.05889v12021
The Sound of Pixels
Hang Zhao, Chuang Gan, Andrew Rouditchenko +3
cs.CVcs.SDeess.ASarXiv:1804.03160v42018
Deep Networks for Direction-of-Arrival Estimation in Low SNR
Georgios K. Papageorgiou, Mathini Sellathurai, Yonina C. Eldar
eess.SPcs.LGcs.SDarXiv:2011.08848v12020
RMS-AQA: A Two-Stage Spatial Audio Question Answering Benchmark for Real-World Domestic Environments
Peihao Chen, Qing Wang, Lichun Fan +12
cs.SDeess.ASarXiv:2610.00935v12026
WanSong v1.0 Technical Report
Binghui Chen, Pandeng Li, Yu Liu +1
eess.AScs.CVarXiv:2607.14749v42026
Rethinking CNN Models for Audio Classification
Kamalesh Palanisamy, Dipika Singhania, Angela Yao
cs.CVcs.SDeess.ASarXiv:2007.11154v22020
Revisiting Modeling and Evaluation Approaches in Speech Emotion Recognition: Considering Subjectivity of Annotators and Ambiguity of Emotions
Huang-Cheng Chou, Chi-Chun Lee
eess.ASarXiv:2510.05934v12025
gpuRIR: A Python Library for Room Impulse Response Simulation with GPU Acceleration
David Diaz-Guerra, Antonio Miguel, Jose R. Beltran
eess.AScs.SDarXiv:1810.11359v42018
BASEN: Time-Domain Brain-Assisted Speech Enhancement Network with Convolutional Cross Attention in Multi-talker Conditions
Jie Zhang, Qing-Tian Xu, Qiu-Shi Zhu +1
eess.AScs.AIcs.SDarXiv:2305.09994v12023
Overview and Evaluation of Sound Event Localization and Detection in DCASE 2019
Archontis Politis, Annamaria Mesaros, Sharath Adavanne +2
eess.AScs.SDarXiv:2009.02792v22020
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders
Chen Xu, Bojie Hu, Yanyang Li +5
cs.CLcs.SDeess.ASarXiv:2105.05752v22021
Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing
Yapeng Tian, Dingzeyu Li, Chenliang Xu
cs.CVcs.MMcs.SDarXiv:2007.10558v12020
Anonymization, Not Elimination: Utility-Preserved Speech Anonymization
Yunchong Xiao, Yuxiang Zhao, Ziyang Ma +4
eess.AScs.AIarXiv:2604.17000v12026
Unsupervised Detection of Anomalous Sound based on Deep Learning and the Neyman-Pearson Lemma
Yuma Koizumi, Shoichiro Saito, Hisashi Uematsum Yuta Kawachi +1
stat.MLcs.LGcs.SDarXiv:1810.09133v12018
Visual Speech Recognition for Multiple Languages in the Wild
Pingchuan Ma, Stavros Petridis, Maja Pantic
cs.CVcs.SDeess.ASarXiv:2202.13084v22022
How Auditory Knowledge in LLM Backbones Shapes Audio Language Models: A Holistic Evaluation
Ke-Han Lu, Szu-Wei Fu, Chao-Han Huck Yang +13
eess.AScs.CLcs.SDarXiv:2603.19195v12026
Multi-modal Dense Video Captioning
Vladimir Iashin, Esa Rahtu
cs.CVcs.CLcs.LGarXiv:2003.07758v22020
CTC-Segmentation of Large Corpora for German End-to-end Speech Recognition
Ludwig Kürzinger, Dominik Winkelbauer, Lujun Li +2
eess.ASarXiv:2007.09127v22020
Hybrid Autoregressive Transducer (hat)
Ehsan Variani, David Rybach, Cyril Allauzen +1
eess.AScs.CLcs.LGarXiv:2003.07705v12020
Differentiable and Severity-invariant Discrete Tokens for Dysarthric Speech Recognition
Huimeng Wang, Xurong Xie, Mengzhe Geng +5
eess.ASarXiv:2609.16855v12026
AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection
Trevine Oorloff, Surya Koppisetti, Nicolò Bonettini +5
cs.CVcs.MMcs.SDarXiv:2406.02951v12024
Phone Segmentation and Recognition through Phonological Activation Mapping
Shikhar Bharadwaj, Kwanghee Choi, Stephen McIntosh +8
eess.AScs.AIcs.CLarXiv:2607.09020v12026
Why ML-based cough models do not generalize: a systematic cross-dataset evaluation for tuberculosis screening
Wensi Zhang, Tomas Teijeiro, Jérôme Thevenot +1
eess.AScs.AIcs.LGarXiv:2608.25846v12026
How Well Do Generative Music Models Follow Emotion Conditioning?
Morteza Heydari
cs.SDeess.ASarXiv:2608.29987v12026
X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages
Feilong Chen, Minglun Han, Haozhi Zhao +4
cs.CLcs.AIcs.CVarXiv:2305.04160v32023
ICASSP 2026 URGENT Speech Enhancement Challenge
Chenda Li, Wei Wang, Marvin Sach +8
eess.AScs.SDarXiv:2601.13531v12026
Speech Emotion Recognition Using Multi-hop Attention Mechanism
Seunghyun Yoon, Seokhyun Byun, Subhadeep Dey +1
eess.AScs.AIcs.CLarXiv:1904.10788v22019
Discriminative Flow Matching: Beyond Time-Conditioning in Generative Restoration via Flow-State Representations
Shrishti Saha Shetu, Emanuël A. P. Habets, Andreas Brendel
eess.AScs.SDarXiv:2609.04525v12026
Unified Audio Intelligence Without Regressing on Text Intelligence
Zhifeng Kong, Sang-gil Lee, Jaehyeon Kim +17
cs.CLcs.AIcs.LGarXiv:2607.05196v22026
Efficient Content-Based Sparse Attention with Routing Transformers
Aurko Roy, Mohammad Saffar, Ashish Vaswani +1
cs.LGeess.ASstat.MLarXiv:2003.05997v52020
Exploring the Design Space of Representation Learning for Audio Transformations
Sungho Lee, Marco Martínez-Ramírez, Junghyun Koo +3
cs.SDeess.ASarXiv:2608.28127v12026
Recent Advances in Speech Language Models: A Survey
Wenqian Cui, Dianzhi Yu, Xiaoqi Jiao +5
cs.CLcs.SDeess.ASarXiv:2410.03751v42024
SoundWeaver: Semantic Warm-Starting for Text-to-Audio Diffusion Serving
Ayush Barik, Sofia Stoica, Nikhil Sarda +4
cs.SDcs.CVeess.ASarXiv:2603.07865v12026
A Review of Speaker Diarization: Recent Advances with Deep Learning
Tae Jin Park, Naoyuki Kanda, Dimitrios Dimitriadis +3
eess.AScs.CLcs.SDarXiv:2101.09624v42021
A Mixed-Behavior Vote Model for Multimedia Subjective Quality Votes, Means, and Variances
Jaden Pieper, Stephen D. Voran
cs.MMcs.SDeess.ASarXiv:2608.27724v12026
FloWaveNet : A Generative Flow for Raw Audio
Sungwon Kim, Sang-gil Lee, Jongyoon Song +2
cs.SDeess.ASarXiv:1811.02155v32018
Who is Real Bob? Adversarial Attacks on Speaker Recognition Systems
Guangke Chen, Sen Chen, Lingling Fan +4
eess.AScs.CRcs.LGarXiv:1911.01840v22019
WaveGrad: Estimating Gradients for Waveform Generation
Nanxin Chen, Yu Zhang, Heiga Zen +3
eess.AScs.LGcs.SDarXiv:2009.00713v22020
Perch 2.0: The Bittern Lesson for Bioacoustics
Bart van Merriënboer, Vincent Dumoulin, Jenny Hamer +3
cs.LGcs.SDeess.ASarXiv:2508.04665v22025
STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events
Kazuki Shimada, Archontis Politis, Parthasaarathy Sudarsanam +9
cs.SDcs.CVcs.MMarXiv:2306.09126v22023
Deep Transfer Learning for Automatic Speech Recognition: Towards Better Generalization
Hamza Kheddar, Yassine Himeur, Somaya Al-Maadeed +2
cs.SDcs.CLcs.LGarXiv:2304.14535v22023
VoiceMem: Streaming Dual-Brain Memory for Real-Time Interaction
Zhifei Xie, Jiaqi Lang, Ze An +7
eess.AScs.AIcs.IRarXiv:2608.26005v12026
DPT-FSNet: Dual-path Transformer Based Full-band and Sub-band Fusion Network for Speech Enhancement
Feng Dang, Hangting Chen, Pengyuan Zhang
cs.SDeess.ASarXiv:2104.13002v22021
CSAVocoder: A Causal Spatial Audio Vocoder Towards Real-Time Spatial Audio Generation
Zhiyuan Zhu, Han Wang, Wenxiang Guo +4
eess.ASarXiv:2608.25404v12026
Mandarin Humorous Homophone Recognition and Disambiguation in Automatic Speech Recognition
Sicheng Jin, Jinghao Chen, Mostafa Shahin +2
eess.ASarXiv:2608.25384v12026
StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models
Yinghao Aaron Li, Cong Han, Vinay S. Raghavan +2
eess.AScs.AIcs.CLarXiv:2306.07691v22023
High-Fidelity Audio Compression with Improved RVQGAN
Rithesh Kumar, Prem Seetharaman, Alejandro Luebs +2
cs.SDcs.LGeess.ASarXiv:2306.06546v22023
Look, Listen, and Act: Towards Audio-Visual Embodied Navigation
Chuang Gan, Yiwei Zhang, Jiajun Wu +2
cs.CVcs.LGcs.ROarXiv:1912.11684v22019
SoundSpaces: Audio-Visual Navigation in 3D Environments
Changan Chen, Unnat Jain, Carl Schissler +5
cs.CVcs.HCcs.SDarXiv:1912.11474v32019
Conditional Diffusion Probabilistic Model for Speech Enhancement
Yen-Ju Lu, Zhong-Qiu Wang, Shinji Watanabe +3
eess.AScs.LGcs.SDarXiv:2202.05256v12022
Self-Supervised Learning of Audio-Visual Objects from Video
Triantafyllos Afouras, Andrew Owens, Joon Son Chung +1
cs.CVcs.SDeess.ASarXiv:2008.04237v12020
IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speech
Siyi Zhou, Yiquan Zhou, Yi He +4
cs.CLcs.AIcs.SDarXiv:2506.21619v22025
Better Retrieval, Worse Robustness:How Multi-hop RAG Amplifies Upstream ASR Errors
Zhenghua Bao
cs.CLcs.IReess.ASarXiv:2608.22872v12026
Recent Developments on ESPnet Toolkit Boosted by Conformer
Pengcheng Guo, Florian Boyer, Xuankai Chang +12
eess.AScs.SDarXiv:2010.13956v22020
COVID-19 Cough Classification using Machine Learning and Global Smartphone Recordings
Madhurananda Pahar, Marisa Klopper, Robin Warren +1
cs.SDcs.LGeess.ASarXiv:2012.01926v22020
A Functional Taxonomy of Music Generation Systems
Dorien Herremans, Ching-Hua Chuan, Elaine Chew
cs.SDcs.LGeess.ASarXiv:1812.04186v12018
Nord-Parl-TTS: Finnish and Swedish TTS Dataset from Parliament Speech
Zirui Li, Jens Edlund, Yicheng Gu +3
eess.AScs.CLarXiv:2509.17988v22025

Audio and Speech Processing

Semi-Supervised Speech Recognition via Local Prior Matching

UniCATS: A Unified Context-Aware Text-to-Speech Framework with Contextual VQ-Diffusion and Vocoding

VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretation

ASVspoof 2019: spoofing countermeasures for the detection of synthesized, converted and replayed speech

The Sound of Pixels

Deep Networks for Direction-of-Arrival Estimation in Low SNR

RMS-AQA: A Two-Stage Spatial Audio Question Answering Benchmark for Real-World Domestic Environments

WanSong v1.0 Technical Report

Rethinking CNN Models for Audio Classification

Revisiting Modeling and Evaluation Approaches in Speech Emotion Recognition: Considering Subjectivity of Annotators and Ambiguity of Emotions

gpuRIR: A Python Library for Room Impulse Response Simulation with GPU Acceleration

BASEN: Time-Domain Brain-Assisted Speech Enhancement Network with Convolutional Cross Attention in Multi-talker Conditions

Overview and Evaluation of Sound Event Localization and Detection in DCASE 2019

Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders

Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing

Anonymization, Not Elimination: Utility-Preserved Speech Anonymization

Unsupervised Detection of Anomalous Sound based on Deep Learning and the Neyman-Pearson Lemma

Visual Speech Recognition for Multiple Languages in the Wild

How Auditory Knowledge in LLM Backbones Shapes Audio Language Models: A Holistic Evaluation

Multi-modal Dense Video Captioning

CTC-Segmentation of Large Corpora for German End-to-end Speech Recognition

Hybrid Autoregressive Transducer (hat)

Differentiable and Severity-invariant Discrete Tokens for Dysarthric Speech Recognition

AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection

Phone Segmentation and Recognition through Phonological Activation Mapping

Why ML-based cough models do not generalize: a systematic cross-dataset evaluation for tuberculosis screening

How Well Do Generative Music Models Follow Emotion Conditioning?

X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages

ICASSP 2026 URGENT Speech Enhancement Challenge

Speech Emotion Recognition Using Multi-hop Attention Mechanism

Discriminative Flow Matching: Beyond Time-Conditioning in Generative Restoration via Flow-State Representations

Unified Audio Intelligence Without Regressing on Text Intelligence

Efficient Content-Based Sparse Attention with Routing Transformers

Exploring the Design Space of Representation Learning for Audio Transformations

Recent Advances in Speech Language Models: A Survey

SoundWeaver: Semantic Warm-Starting for Text-to-Audio Diffusion Serving

A Review of Speaker Diarization: Recent Advances with Deep Learning

A Mixed-Behavior Vote Model for Multimedia Subjective Quality Votes, Means, and Variances

FloWaveNet : A Generative Flow for Raw Audio

Who is Real Bob? Adversarial Attacks on Speaker Recognition Systems

WaveGrad: Estimating Gradients for Waveform Generation

Perch 2.0: The Bittern Lesson for Bioacoustics

STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events

Deep Transfer Learning for Automatic Speech Recognition: Towards Better Generalization

VoiceMem: Streaming Dual-Brain Memory for Real-Time Interaction

DPT-FSNet: Dual-path Transformer Based Full-band and Sub-band Fusion Network for Speech Enhancement

CSAVocoder: A Causal Spatial Audio Vocoder Towards Real-Time Spatial Audio Generation

Mandarin Humorous Homophone Recognition and Disambiguation in Automatic Speech Recognition

StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models

High-Fidelity Audio Compression with Improved RVQGAN

Look, Listen, and Act: Towards Audio-Visual Embodied Navigation

SoundSpaces: Audio-Visual Navigation in 3D Environments

Conditional Diffusion Probabilistic Model for Speech Enhancement

Self-Supervised Learning of Audio-Visual Objects from Video

IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speech

Better Retrieval, Worse Robustness:How Multi-hop RAG Amplifies Upstream ASR Errors

Recent Developments on ESPnet Toolkit Boosted by Conformer

COVID-19 Cough Classification using Machine Learning and Global Smartphone Recordings

A Functional Taxonomy of Music Generation Systems

Nord-Parl-TTS: Finnish and Swedish TTS Dataset from Parliament Speech