Audio and Speech Processing

Papers filed under eess.AS on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

781 to 840 of 1,641

Adapting Personalized Speech Enhancement for Low-Latency Audio-Visual Target-Speaker Extraction
Rayhan Rashed, Senja Filipi, Ross Cutler
eess.AScs.CVcs.SDarXiv:2609.30631v12026
The VoicePrivacy 2020 Challenge: Results and findings
Natalia Tomashenko, Xin Wang, Emmanuel Vincent +11
cs.CLcs.SDeess.ASarXiv:2109.00648v42021
Large-Scale Multilingual Speech Recognition with a Streaming End-to-End Model
Anjuli Kannan, Arindrima Datta, Tara N. Sainath +6
eess.AScs.LGcs.SDarXiv:1909.05330v12019
Exploring Automatic Diagnosis of COVID-19 from Crowdsourced Respiratory Sound Data
Chloë Brown, Jagmohan Chauhan, Andreas Grammenos +6
cs.SDcs.LGeess.ASarXiv:2006.05919v32020
ClariNet: Parallel Wave Generation in End-to-End Text-to-Speech
Wei Ping, Kainan Peng, Jitong Chen
cs.CLcs.AIcs.LGarXiv:1807.07281v32018
Contextualized Streaming End-to-End Speech Recognition with Trie-Based Deep Biasing and Shallow Fusion
Duc Le, Mahaveer Jain, Gil Keren +9
cs.CLcs.LGeess.ASarXiv:2104.02194v22021
Aligning Generative Music AI with Human Preferences: Methods and Challenges
Dorien Herremans, Abhinaba Roy
cs.SDcs.AIeess.ASarXiv:2511.15038v12025
The Trade-off Was in the Labels: Causal Supervision for Turn-Aware Streaming ASR
Bojie Li, Noah Shi
eess.AScs.SDarXiv:2609.04225v12026
Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios
Changhao Pan, Rui Yang, Han Wang +12
eess.ASarXiv:2605.28618v12026
Building and Evaluation of a Real Room Impulse Response Dataset
Igor Szoke, Miroslav Skacel, Ladislav Mosner +2
eess.ASarXiv:1811.06795v22018
VAANI: Capturing the language landscape for an inclusive digital India
Sujith Pulikodan, Abhayjeet Singh, Agneedh Basu +17
eess.ASarXiv:2603.28714v32026
Europarl-ST: A Multilingual Corpus For Speech Translation Of Parliamentary Debates
Javier Iranzo-Sánchez, Joan Albert Silvestre-Cerdà, Javier Jorge +5
cs.CLcs.SDeess.ASarXiv:1911.03167v32019
TalkPlay-Tools: Conversational Music Recommendation with LLM Tool Calling
Seungheon Doh, Keunwoo Choi, Juhan Nam
cs.IRcs.MMcs.SDarXiv:2510.01698v42025
Low-altitude aircraft will reshape noise exposure across global cities
Tianjing Feng, Jian Kang
eess.ASarXiv:2609.29763v12026
WhisperX: Time-Accurate Speech Transcription of Long-Form Audio
Max Bain, Jaesung Huh, Tengda Han +1
cs.SDeess.ASarXiv:2303.00747v22023
SHANKS: Simultaneous Hearing and Thinking for Spoken Language Models
Cheng-Han Chiang, Xiaofei Wang, Linjie Li +7
cs.CLeess.ASarXiv:2510.06917v22025
Powerset multi-class cross entropy loss for neural speaker diarization
Alexis Plaquet, Hervé Bredin
cs.SDcs.AIcs.CLarXiv:2310.13025v12023
Bin2Ambi: Learning Ambisonic Soundfield Reconstruction from Head-Tracked Binaural Audio
Gavin Milner, Nils Peters
eess.ASarXiv:2609.39732v12026
Interleaved Speech Language Models Latently Work In Text
Talia Sternberg, Gallil Maimon, Yossi Adi
cs.CLcs.LGcs.SDarXiv:2606.22473v12026
UNITE-AUDIO: Joint Learning of Continuous Tokenization and Latent Flow Matching for Text-to-Audio Generation
Runwu Shi, Kai Li, Yujin Wang +8
eess.AScs.SDarXiv:2609.28206v22026
Speaker Identity in Non-Verbal Vocalizations: Conditional Distillation and Mixture of Experts Approach
Tzu-Chieh Wei, Yi-Cheng Lin, Huang-Cheng Chou +4
eess.AScs.AIcs.SDarXiv:2606.21215v12026
Why Learning Rediscovers the Closed-Form Diagonal Regularizer
Jeahn Han, Pyojin Kim
stat.MLcs.LGcs.ROarXiv:2609.09656v12026
DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERT
Heng-Jui Chang, Shu-wen Yang, Hung-yi Lee
cs.CLeess.ASarXiv:2110.01900v42021
Detection of Glottal Closure Instants from Speech Signals: a Quantitative Review
Thomas Drugman, Mark Thomas, Jon Gudnason +2
cs.SDcs.CLeess.ASarXiv:2001.00473v12019
CloudEar: Integrating Perceptual, Diagnostic, and Cross-Modal Evidence for Music Evaluation
Qiqi He, Anqi Huang
eess.ASarXiv:2610.11672v12026
Better speech synthesis through scaling
James Betker
cs.SDcs.CLeess.ASarXiv:2305.07243v22023
Kymatio: Scattering Transforms in Python
Mathieu Andreux, Tomás Angles, Georgios Exarchakis +15
cs.LGcs.CVcs.SDarXiv:1812.11214v32018
HARP-Net: Hyper-Autoencoded Reconstruction Propagation for Scalable Neural Audio Coding
Darius Petermann, Seungkwon Beack, Minje Kim
eess.AScs.AIcs.SDarXiv:2107.10843v22021
WorldSonus: Bringing Sound to Worlds
Pengjun Fang, Jingyi Fa, Kam Man Wu +9
cs.SDcs.AIcs.CVarXiv:2610.08760v12026
StarGANv2-VC: A Diverse, Unsupervised, Non-parallel Framework for Natural-Sounding Voice Conversion
Yinghao Aaron Li, Ali Zare, Nima Mesgarani
cs.SDcs.LGeess.ASarXiv:2107.10394v22021
Statistical Speech Enhancement Based on Probabilistic Integration of Variational Autoencoder and Non-Negative Matrix Factorization
Yoshiaki Bando, Masato Mimura, Katsutoshi Itoyama +2
cs.SDcs.LGeess.ASarXiv:1710.11439v42017
FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Dataset
Hasam Khalid, Shahroz Tariq, Minha Kim +1
cs.CVcs.MMcs.SDarXiv:2108.05080v42021
Coupled Meta-Adaptive Filtering for Active Noise Control Under Time-Varying Acoustic Paths
Boxiang Wang, Zhengding Luo, Ziyi Yang +3
eess.ASarXiv:2609.30945v12026
Teacher-Free Self-Distilled Consistency Trajectory Learning for Fast Speech Enhancement
Shuubham Ojha, Carol Espy-Wilson
eess.ASarXiv:2609.10392v22026
AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
Qian Yang, Jin Xu, Wenrui Liu +8
eess.AScs.CLcs.LGarXiv:2402.07729v22024
Covo-Audio Technical Report
Wenfu Wang, Chenxing Li, Liqiang Zhang +23
cs.SDcs.CLeess.ASarXiv:2602.09823v22026
Pseudo2Real: Task Arithmetic for Pseudo-Label Correction in Automatic Speech Recognition
Yi-Cheng Lin, Yu-Hsuan Li Liang, Hsuan Su +4
eess.AScs.CLarXiv:2510.08047v22025
Bridging the Modality Gap in Long-Form Clinical Audio: A Comparative Study of Lightweight and Heavyweight End-to-End SOAP Generation
Ziyu Zhang, Mingchen Shao, Wenjie Tian +3
cs.SDcs.AIeess.ASarXiv:2609.14467v12026
Keyword Transformer: A Self-Attention Model for Keyword Spotting
Axel Berg, Mark O'Connor, Miguel Tairum Cruz
eess.AScs.CLcs.LGarXiv:2104.00769v32021
Anchoring Speech with Semantics: A Multimodal Adapter Mechanism for Automatic Speech Recognition in Low-Resource Languages
Kuan-Tang Huang, Cheng-Yeh Yang, Chien-Chun Wang +3
cs.CLcs.SDeess.ASarXiv:2608.29239v12026
Transcript-Supervised Post-Training of Generative Speech Enhancement on Real Recordings via Reinforce Adjoint Matching
Julius Richter, Christoph Boeddeker, Yoshiki Masuyama +4
eess.AScs.LGarXiv:2609.29405v12026
MIDI-VAE: Modeling Dynamics and Instrumentation of Music with Applications to Style Transfer
Gino Brunner, Andres Konrad, Yuyi Wang +1
cs.SDcs.LGeess.ASarXiv:1809.07600v12018
Echo Detection in Spatial Room Impulse Responses Measured with Spherical Microphone Arrays Using the Herglotz Wavefunction
Pierre Massé, Anthony Gallien, Wolfgang Kreuzer +1
eess.ASarXiv:2609.28068v12026
Extracting Domain Invariant Features by Unsupervised Learning for Robust Automatic Speech Recognition
Wei-Ning Hsu, James Glass
cs.CLcs.LGcs.SDarXiv:1803.02551v12018
Vision Transformers are Parameter-Efficient Audio-Visual Learners
Yan-Bo Lin, Yi-Lin Sung, Jie Lei +2
cs.CVcs.CLcs.LGarXiv:2212.07983v22022
Kimi-Audio Technical Report
KimiTeam, Ding Ding, Zeqian Ju +37
eess.AScs.AIcs.CLarXiv:2504.18425v12025
This Time with Feeling: Learning Expressive Musical Performance
Sageev Oore, Ian Simon, Sander Dieleman +2
cs.SDcs.LGeess.ASarXiv:1808.03715v12018
Speaker-Aware Temporal Aggregation Strategies on Segment Representations for Depression Detection in Dyadic Interaction: A Benchmark Study
Anisha Pattanayak, Huang-Cheng Chou, Shrikanth Narayanan +1
eess.ASarXiv:2607.02904v12026
Speech Enhancement and Dereverberation with Diffusion-based Generative Models
Julius Richter, Simon Welker, Jean-Marie Lemercier +2
eess.AScs.LGcs.SDarXiv:2208.05830v32022
Recognizing long-form speech using streaming end-to-end models
Arun Narayanan, Rohit Prabhavalkar, Chung-Cheng Chiu +3
eess.AScs.CLcs.SDarXiv:1910.11455v12019
Improved Noisy Student Training for Automatic Speech Recognition
Daniel S. Park, Yu Zhang, Ye Jia +5
eess.AScs.LGarXiv:2005.09629v22020
Improving Predicted MOS Scores, Not Perceived Quality: Multi-Predictor Test-Time Optimization of Enhanced Speech
Tsubasa Ochiai, Marc Delcroix, Nahomi Kusunoki +5
eess.AScs.SDarXiv:2609.39028v12026
Transformer-based Acoustic Modeling for Hybrid Speech Recognition
Yongqiang Wang, Abdelrahman Mohamed, Duc Le +10
cs.CLeess.ASarXiv:1910.09799v22019
Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognition
Felix Wu, Kwangyoun Kim, Jing Pan +3
cs.CLcs.LGcs.SDarXiv:2109.06870v12021
LPCNet: Improving Neural Speech Synthesis Through Linear Prediction
Jean-Marc Valin, Jan Skoglund
eess.AScs.LGcs.SDarXiv:1810.11846v22018
OmniAudio: Generating Spatial Audio from 360-Degree Video
Huadai Liu, Tianyi Luo, Kaicheng Luo +11
eess.AScs.CVcs.SDarXiv:2504.14906v32025
SECap: Speech Emotion Captioning with Large Language Model
Yaoxun Xu, Hangting Chen, Jianwei Yu +6
cs.SDeess.ASarXiv:2312.10381v32023
CoVoST 2 and Massively Multilingual Speech-to-Text Translation
Changhan Wang, Anne Wu, Juan Pino
cs.CLcs.SDeess.ASarXiv:2007.10310v32020
Sortformer: A Novel Approach for Permutation-Resolved Speaker Supervision in Speech-to-Text Systems
Taejin Park, Ivan Medennikov, Kunal Dhawan +6
eess.AScs.CLcs.LGarXiv:2409.06656v32024
Artificial Intelligence, speech and language processing approaches to monitoring Alzheimer's Disease: a systematic review
Sofia de la Fuente Garcia, Craig Ritchie, Saturnino Luz
cs.AIcs.CLeess.ASarXiv:2010.06047v12020

Audio and Speech Processing

Adapting Personalized Speech Enhancement for Low-Latency Audio-Visual Target-Speaker Extraction

The VoicePrivacy 2020 Challenge: Results and findings

Large-Scale Multilingual Speech Recognition with a Streaming End-to-End Model

Exploring Automatic Diagnosis of COVID-19 from Crowdsourced Respiratory Sound Data

ClariNet: Parallel Wave Generation in End-to-End Text-to-Speech

Contextualized Streaming End-to-End Speech Recognition with Trie-Based Deep Biasing and Shallow Fusion

Aligning Generative Music AI with Human Preferences: Methods and Challenges

The Trade-off Was in the Labels: Causal Supervision for Turn-Aware Streaming ASR

Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios

Building and Evaluation of a Real Room Impulse Response Dataset

VAANI: Capturing the language landscape for an inclusive digital India

Europarl-ST: A Multilingual Corpus For Speech Translation Of Parliamentary Debates

TalkPlay-Tools: Conversational Music Recommendation with LLM Tool Calling

Low-altitude aircraft will reshape noise exposure across global cities

WhisperX: Time-Accurate Speech Transcription of Long-Form Audio

SHANKS: Simultaneous Hearing and Thinking for Spoken Language Models

Powerset multi-class cross entropy loss for neural speaker diarization

Bin2Ambi: Learning Ambisonic Soundfield Reconstruction from Head-Tracked Binaural Audio

Interleaved Speech Language Models Latently Work In Text

UNITE-AUDIO: Joint Learning of Continuous Tokenization and Latent Flow Matching for Text-to-Audio Generation

Speaker Identity in Non-Verbal Vocalizations: Conditional Distillation and Mixture of Experts Approach

Why Learning Rediscovers the Closed-Form Diagonal Regularizer

DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERT

Detection of Glottal Closure Instants from Speech Signals: a Quantitative Review

CloudEar: Integrating Perceptual, Diagnostic, and Cross-Modal Evidence for Music Evaluation

Better speech synthesis through scaling

Kymatio: Scattering Transforms in Python

HARP-Net: Hyper-Autoencoded Reconstruction Propagation for Scalable Neural Audio Coding

WorldSonus: Bringing Sound to Worlds

StarGANv2-VC: A Diverse, Unsupervised, Non-parallel Framework for Natural-Sounding Voice Conversion

Statistical Speech Enhancement Based on Probabilistic Integration of Variational Autoencoder and Non-Negative Matrix Factorization

FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Dataset

Coupled Meta-Adaptive Filtering for Active Noise Control Under Time-Varying Acoustic Paths

Teacher-Free Self-Distilled Consistency Trajectory Learning for Fast Speech Enhancement

AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension

Covo-Audio Technical Report

Pseudo2Real: Task Arithmetic for Pseudo-Label Correction in Automatic Speech Recognition

Bridging the Modality Gap in Long-Form Clinical Audio: A Comparative Study of Lightweight and Heavyweight End-to-End SOAP Generation

Keyword Transformer: A Self-Attention Model for Keyword Spotting

Anchoring Speech with Semantics: A Multimodal Adapter Mechanism for Automatic Speech Recognition in Low-Resource Languages

Transcript-Supervised Post-Training of Generative Speech Enhancement on Real Recordings via Reinforce Adjoint Matching

MIDI-VAE: Modeling Dynamics and Instrumentation of Music with Applications to Style Transfer

Echo Detection in Spatial Room Impulse Responses Measured with Spherical Microphone Arrays Using the Herglotz Wavefunction

Extracting Domain Invariant Features by Unsupervised Learning for Robust Automatic Speech Recognition

Vision Transformers are Parameter-Efficient Audio-Visual Learners

Kimi-Audio Technical Report

This Time with Feeling: Learning Expressive Musical Performance

Speaker-Aware Temporal Aggregation Strategies on Segment Representations for Depression Detection in Dyadic Interaction: A Benchmark Study

Speech Enhancement and Dereverberation with Diffusion-based Generative Models

Recognizing long-form speech using streaming end-to-end models

Improved Noisy Student Training for Automatic Speech Recognition

Improving Predicted MOS Scores, Not Perceived Quality: Multi-Predictor Test-Time Optimization of Enhanced Speech

Transformer-based Acoustic Modeling for Hybrid Speech Recognition

Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognition

LPCNet: Improving Neural Speech Synthesis Through Linear Prediction

OmniAudio: Generating Spatial Audio from 360-Degree Video

SECap: Speech Emotion Captioning with Large Language Model

CoVoST 2 and Massively Multilingual Speech-to-Text Translation

Sortformer: A Novel Approach for Permutation-Resolved Speaker Supervision in Speech-to-Text Systems

Artificial Intelligence, speech and language processing approaches to monitoring Alzheimer's Disease: a systematic review