Audio and Speech Processing

Papers filed under eess.AS on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

181 to 240 of 1,641

MeanVoiceFlow2: Joint Optimization of Mean Flow and Content Encoder for Fast One-Step Zero-Shot Voice Conversion
Takuhiro Kaneko, Hirokazu Kameoka, Kou Tanaka +1
cs.SDcs.AIcs.LGarXiv:2609.40087v12026
Pronunciation Editing for Finnish Speech using Phonetic Posteriorgrams
Zirui Li, Lauri Juvela, Mikko Kurimo
eess.AScs.CLarXiv:2507.02115v32025
Achieving Human Parity in Conversational Speech Recognition
W. Xiong, J. Droppo, X. Huang +5
cs.CLeess.ASarXiv:1610.05256v22016
AcoustiClaim: A Numeric Claim Benchmark with Instrument Ground Truth
Sheng-Tse Lin, Siyuan Zhai, Chien-Liang Kuo +2
cs.SDcs.CLcs.LGarXiv:2609.30483v12026
Conversation Is a Two-Body Problem: Dyadic Evaluation of Full-Duplex Dialogue Models
Sungnyun Kim, Sungwoo Cho, Jihwan Oh +1
eess.AScs.CLarXiv:2610.08125v12026
An Optical Pathway to Movable Rydberg Atomic Quantum Receivers
Qihao Peng, Qu Luo, Lixia Xiao +6
eess.ASarXiv:2608.30718v12026
Rethinking Automated Voice Similarity by Shifting from EER to Embedding Geometry
Szu-Chi Chen, Jia-Kai Dong, Yi-Cheng Lin +2
eess.AScs.SDarXiv:2609.33999v12026
VoiceSculptor: Your Voice, Designed By You
Jingbin Hu, Huakang Chen, Linhan Ma +19
eess.ASarXiv:2601.10629v22026
MI-Fuse: Label Fusion for Unsupervised Domain Adaptation with Closed-Source Large-Audio Language Model
Hsiao-Ying Huang, Yi-Cheng Lin, Hung-yi Lee
cs.CLcs.SDeess.ASarXiv:2509.20706v12025
When Text Misleads: Inconsistent-Aware Reasoning for Audio-Grounded Dialogue
Yen-Ju Lu, Yuzhe Wang, Yaohan Guan +8
cs.CLcs.AIcs.LGarXiv:2608.27176v12026
Beyond Token Revision: Investigating Mask-and-Replace Diffusion for Zero-Shot Text-to-Speech
Hounsu Kim, Joonyong Park, Yuki Saito +2
eess.AScs.SDarXiv:2610.09448v12026
Talker-T2AV: Joint Talking Audio-Video Generation with Autoregressive Diffusion Modeling
Zhen Ye, Xu Tan, Aoxiong Yin +8
cs.CVcs.CLcs.MMarXiv:2604.23586v22026
Duplex-MPE: Benchmarking Multi-Party Interaction in Full-Duplex Dialogue
Chengqian Ma, Wenhao Feng, Weixuan Jin +7
cs.SDeess.ASarXiv:2609.31948v12026
StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberation
Jean-Marie Lemercier, Julius Richter, Simon Welker +1
eess.AScs.LGcs.SDarXiv:2212.11851v22022
Discrete Audio Tokens: More Than a Survey!
Pooneh Mousavi, Gallil Maimon, Adel Moumen +18
cs.SDcs.AIcs.CLarXiv:2506.10274v32025
Mitigating Accent-Language Confusion in Self-Supervised Speech Representations for Language Identification
Minu Kim, Jihwan Lee, David R. Mortensen +1
eess.AScs.CLcs.SDarXiv:2610.09486v12026
Pushing the Frontier of Full-Song Generation: Hierarchical Autoregressive Planning Meets Flow-Matching Rendering
Junyu Dai, Xinyue Fan, Weiqin Li +14
cs.SDcs.AIeess.ASarXiv:2607.20253v32026
Perceptually Better, Semantically Worse: Measuring Speech Enhancement Impact on LLM-Based Voice Systems
Randy Frans Fela, Pejman Mowlaee
cs.SDeess.ASarXiv:2608.30348v12026
Beyond Dyadic Memory: Interaction-Aware Multimodal Memory with Adaptive Agentic Retrieval for Multi-Party Spoken Conversations
Wenxu Jia, Xize Cheng, Zihan Zhang +5
cs.AIcs.IRcs.SDarXiv:2609.32522v12026
The Evolving Bottleneck in Speech Generation: Interface Co-design and Staged Alignment from CosyVoice to Qwen-Audio-3.0-TTS
Qian Chen, Xiangang Li, Xiang Lv +2
eess.ASarXiv:2609.16514v12026
MiMo-Audio: Audio Language Models are Few-Shot Learners
Xiaomi LLM-Core Team, :, Dong Zhang +98
cs.CLcs.SDeess.ASarXiv:2512.23808v12025
What Selects, What Reconstructs: Repairing Exemplar-Based Complex-Spectrum Separation
Maxime Baelde
eess.SPcs.SDeess.ASarXiv:2609.04756v12026
NarraScore: Bridging Visual Narrative and Musical Dynamics via Hierarchical Affective Control
Yufan Wen, Zhaocheng Liu, YeGuo Hua +4
cs.SDcs.AIeess.ASarXiv:2602.09070v22026
MP-Bench: Evaluating Voice Agents as a Multiparty Conversation Participant
Yi-Jen Shih, Shih-Yun Shan Kuan, Guan-Ting Lin +7
eess.AScs.AIcs.CLarXiv:2609.13076v12026
Learning from Between-class Examples for Deep Sound Recognition
Yuji Tokozume, Yoshitaka Ushiku, Tatsuya Harada
cs.LGcs.SDeess.ASarXiv:1711.10282v22017
Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Prediction
Bowen Shi, Wei-Ning Hsu, Kushal Lakhotia +1
eess.AScs.CVcs.SDarXiv:2201.02184v22022
VoxServe: Streaming-Centric Serving System for Speech Language Models
Keisuke Kamahori, Wei-Tzu Lee, Atindra Jha +4
cs.LGcs.AIcs.DCarXiv:2602.00269v12026
JavisDiT: Joint Audio-Video Diffusion Transformer with Hierarchical Spatio-Temporal Prior Synchronization
Kai Liu, Wei Li, Lai Chen +8
cs.CVcs.AIcs.SDarXiv:2503.23377v22025
SURE-Challenge: Evaluating Speech Evidence Before Speech-LLM Generation
Mengzhe Geng
eess.AScs.CLcs.SDarXiv:2608.27783v12026
ParaCalib: Semantically Calibrated Paralinguistic Modeling for Depression Detection
Yuxin Li, Yifei Li, Yi-Wen Chao +3
eess.ASarXiv:2610.01103v12026
MoonCast: High-Quality Zero-Shot Podcast Generation
Zeqian Ju, Dongchao Yang, Jianwei Yu +7
eess.AScs.AIcs.CLarXiv:2503.14345v22025
SCNet: Enhancing GAN-based Speech Generation with Subband Condition Network and Magnitude-aware Phase Loss
Nan Xu, Mingxue Yang
eess.ASarXiv:2609.10025v12026
Masked Autoencoders that Listen
Po-Yao Huang, Hu Xu, Juncheng Li +5
cs.SDcs.AIcs.LGarXiv:2207.06405v32022
Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairs
Gio Paik, Hyunseo Shin, Soungmin Lee
cs.CLeess.ASarXiv:2606.05846v22026
Code-Switching Spoken Language Identification as Multi-Label Set Prediction
Shunsuke Mitsumori, Matthew Wiesner, Shigeo Morishima +1
eess.AScs.CLarXiv:2610.01450v12026
From Metrics to Natural Dialogue: French Full-Duplex Benchmark for Spoken Dialogue Models
Hamid Soltani, Gilles Boulianne
eess.ASarXiv:2609.10765v12026
Step-Audio 2 Technical Report
Boyong Wu, Chao Yan, Chen Hu +106
cs.CLcs.SDeess.ASarXiv:2507.16632v32025
Closing the Modality Reasoning Gap for Speech Large Language Models
Chaoren Wang, Heng Lu, Xueyao Zhang +4
cs.CLcs.SDeess.ASarXiv:2601.05543v22026
Shared-State Local Translations for Training-Free Voice Conversion
Yangyang Qu, Michele Panariello, Massimiliano Todisco +1
eess.ASarXiv:2610.01952v12026
Learning Sound Event Classifiers from Web Audio with Noisy Labels
Eduardo Fonseca, Manoj Plakal, Daniel P. W. Ellis +3
cs.SDcs.LGeess.ASarXiv:1901.01189v22019
Voice Anonymization Made Simple: Training-Free Anonymization with Projected Classifier-Free Guidance
Xiang Shi, Han Zhu, Ming Li +1
eess.ASarXiv:2610.08276v12026
TAG-Bench: Benchmarking Temporal Audio Grounding in Large Audio Language Models
Yuhang Dai, Xin Shu, Zengxi Li +3
eess.ASarXiv:2609.01542v22026
A Federated Deepfake Speech Detection Method Based on Layer-Wise Center-Guided Weighting Aggregation
Yingjian Yu, Haiyan Guo, Tianshun Wang +2
eess.ASarXiv:2610.01259v12026
Phoneme-Aware Pronunciation Representations for L2-English L1-Background Accent Identification
Yangyang Qu, Massimiliano Todisco, Nicholas Evans
eess.ASarXiv:2609.10466v12026
OmniVChat: Synthesizing, Benchmarking, and Training for Native Audio-Visual Dialogue
Haolin He, Yunfei Chu, Qi Chen +15
eess.AScs.AIeess.IVarXiv:2609.21465v12026
SAM Audio: Segment Anything in Audio
Bowen Shi, Andros Tjandra, John Hoffman +11
eess.AScs.CVarXiv:2512.18099v12025
Multi-sample Synthetic Supervision for Accent Conversion
Yangyang Qu, Michele Panariello, Massimiliano Todisco +1
eess.ASarXiv:2610.01961v12026
SpeechAnnotator: A Context-Aware Multi-Agent Framework and Benchmark for Multidimensional Speech Annotation
Qirui Zhan, Shuiyuan Wang, Jingbin Hu +10
eess.AScs.SDarXiv:2609.09947v12026
X-Pred MeanFlow for Streaming Token-to-Mel Speech Decoding
Hanke Xie, Xiaming Ren, Qirui Zhan +9
eess.ASarXiv:2609.12728v12026
Conjoint Audio-to-Spikes Encoding and Processing for Efficient Neuromorphic Speech Recognition
Valentin M. Meunier, Amélie Gruel, Pierre Lewden +2
cs.NEcs.AIcs.LGarXiv:2608.30792v12026
GPT-4o System Card
OpenAI, :, Aaron Hurst +417
cs.CLcs.AIcs.CVarXiv:2410.21276v12024
Seed-TTS: A Family of High-Quality Versatile Speech Generation Models
Philip Anastassiou, Jiawei Chen, Jitong Chen +43
eess.AScs.SDarXiv:2406.02430v12024
SEANet: A Multi-modal Speech Enhancement Network
Marco Tagliasacchi, Yunpeng Li, Karolis Misiunas +1
eess.AScs.LGcs.SDarXiv:2009.02095v22020
Pitch Smoothing Using Relative Interval Networks
Chin-Yun Yu, Chi-Jen Peng, Li Su +1
eess.AScs.SDarXiv:2609.39852v12026
Do Audio LLMs Listen Before They Act? Diagnosing Acoustic-Context Gating in Voice Agents
Yanjie Zhang, Nanchen Hu, Yushi Sun
cs.SDcs.AIcs.CLarXiv:2609.32536v12026
Robust Audio Adversarial Example for a Physical Attack
Hiromu Yakura, Jun Sakuma
cs.LGcs.CRcs.SDarXiv:1810.11793v42018
TinyAudio: Compact and Efficient Text-to-Audio Generation for Low-Resource Deployment
Junxi Liu, Xiquan Li, Wenhao Guan +5
cs.SDeess.ASarXiv:2609.31525v12026
E3-System: Expressive EmoData, Explicitly Controllable, Easy-to-Use TTS
Yiqiao Huang, Xiaolong Lin, Zhenpeng Zhan +1
eess.AScs.SDarXiv:2610.12993v12026
Spooftral: Can Voxtral Audio-Language Model Detect Speech Spoofing?
Avishai Weizman, Yehuda Ben-Shimol, Itshak Lapidot
eess.AScs.CLarXiv:2609.28713v12026
COSED: Setting the Bar for Open-Vocabulary Sound Event Detection
Florian Schmid, Sanjeel Parekh, Chi Ian Tang +5
eess.ASarXiv:2609.30083v12026

Audio and Speech Processing

MeanVoiceFlow2: Joint Optimization of Mean Flow and Content Encoder for Fast One-Step Zero-Shot Voice Conversion

Pronunciation Editing for Finnish Speech using Phonetic Posteriorgrams

Achieving Human Parity in Conversational Speech Recognition

AcoustiClaim: A Numeric Claim Benchmark with Instrument Ground Truth

Conversation Is a Two-Body Problem: Dyadic Evaluation of Full-Duplex Dialogue Models

An Optical Pathway to Movable Rydberg Atomic Quantum Receivers

Rethinking Automated Voice Similarity by Shifting from EER to Embedding Geometry

VoiceSculptor: Your Voice, Designed By You

MI-Fuse: Label Fusion for Unsupervised Domain Adaptation with Closed-Source Large-Audio Language Model

When Text Misleads: Inconsistent-Aware Reasoning for Audio-Grounded Dialogue

Beyond Token Revision: Investigating Mask-and-Replace Diffusion for Zero-Shot Text-to-Speech

Talker-T2AV: Joint Talking Audio-Video Generation with Autoregressive Diffusion Modeling

Duplex-MPE: Benchmarking Multi-Party Interaction in Full-Duplex Dialogue

StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberation

Discrete Audio Tokens: More Than a Survey!

Mitigating Accent-Language Confusion in Self-Supervised Speech Representations for Language Identification

Pushing the Frontier of Full-Song Generation: Hierarchical Autoregressive Planning Meets Flow-Matching Rendering

Perceptually Better, Semantically Worse: Measuring Speech Enhancement Impact on LLM-Based Voice Systems

Beyond Dyadic Memory: Interaction-Aware Multimodal Memory with Adaptive Agentic Retrieval for Multi-Party Spoken Conversations

The Evolving Bottleneck in Speech Generation: Interface Co-design and Staged Alignment from CosyVoice to Qwen-Audio-3.0-TTS

MiMo-Audio: Audio Language Models are Few-Shot Learners

What Selects, What Reconstructs: Repairing Exemplar-Based Complex-Spectrum Separation

NarraScore: Bridging Visual Narrative and Musical Dynamics via Hierarchical Affective Control

MP-Bench: Evaluating Voice Agents as a Multiparty Conversation Participant

Learning from Between-class Examples for Deep Sound Recognition

Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Prediction

VoxServe: Streaming-Centric Serving System for Speech Language Models

JavisDiT: Joint Audio-Video Diffusion Transformer with Hierarchical Spatio-Temporal Prior Synchronization

SURE-Challenge: Evaluating Speech Evidence Before Speech-LLM Generation

ParaCalib: Semantically Calibrated Paralinguistic Modeling for Depression Detection

MoonCast: High-Quality Zero-Shot Podcast Generation

SCNet: Enhancing GAN-based Speech Generation with Subband Condition Network and Magnitude-aware Phase Loss

Masked Autoencoders that Listen

Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairs

Code-Switching Spoken Language Identification as Multi-Label Set Prediction

From Metrics to Natural Dialogue: French Full-Duplex Benchmark for Spoken Dialogue Models

Step-Audio 2 Technical Report

Closing the Modality Reasoning Gap for Speech Large Language Models

Shared-State Local Translations for Training-Free Voice Conversion

Learning Sound Event Classifiers from Web Audio with Noisy Labels

Voice Anonymization Made Simple: Training-Free Anonymization with Projected Classifier-Free Guidance

TAG-Bench: Benchmarking Temporal Audio Grounding in Large Audio Language Models

A Federated Deepfake Speech Detection Method Based on Layer-Wise Center-Guided Weighting Aggregation

Phoneme-Aware Pronunciation Representations for L2-English L1-Background Accent Identification

OmniVChat: Synthesizing, Benchmarking, and Training for Native Audio-Visual Dialogue

SAM Audio: Segment Anything in Audio

Multi-sample Synthetic Supervision for Accent Conversion

SpeechAnnotator: A Context-Aware Multi-Agent Framework and Benchmark for Multidimensional Speech Annotation

X-Pred MeanFlow for Streaming Token-to-Mel Speech Decoding

Conjoint Audio-to-Spikes Encoding and Processing for Efficient Neuromorphic Speech Recognition

GPT-4o System Card

Seed-TTS: A Family of High-Quality Versatile Speech Generation Models

SEANet: A Multi-modal Speech Enhancement Network

Pitch Smoothing Using Relative Interval Networks

Do Audio LLMs Listen Before They Act? Diagnosing Acoustic-Context Gating in Voice Agents

Robust Audio Adversarial Example for a Physical Attack

TinyAudio: Compact and Efficient Text-to-Audio Generation for Low-Resource Deployment

E3-System: Expressive EmoData, Explicitly Controllable, Easy-to-Use TTS

Spooftral: Can Voxtral Audio-Language Model Detect Speech Spoofing?

COSED: Setting the Bar for Open-Vocabulary Sound Event Detection