Audio and Speech Processing

Papers filed under eess.AS on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

841 to 900 of 1,641

EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting
Guanrou Yang, Chen Yang, Qian Chen +12
eess.AScs.AIcs.CLarXiv:2504.12867v42025
AVTok: 1D Unified Tokenization for Holistic Audio-Video Generation
Kien T. Pham, I Chieh Chen, Qifeng Chen +1
cs.CVcs.MMcs.SDarXiv:2606.30811v12026
Voices Obscured in Complex Environmental Settings (VOICES) corpus
Colleen Richey, Maria A. Barrios, Zeb Armstrong +11
cs.SDeess.ASarXiv:1804.05053v22018
Taming Visually Guided Sound Generation
Vladimir Iashin, Esa Rahtu
cs.CVcs.AIcs.LGarXiv:2110.08791v12021
A Comparative Study on End-to-end Speech to Text Translation
Parnia Bahar, Tobias Bieschke, Hermann Ney
cs.CLcs.LGeess.ASarXiv:1911.08870v12019
Neural Target Speech Extraction: An Overview
Katerina Zmolikova, Marc Delcroix, Tsubasa Ochiai +3
eess.AScs.SDarXiv:2301.13341v12023
ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speech
Rongjie Huang, Zhou Zhao, Huadai Liu +3
eess.AScs.LGcs.SDarXiv:2207.06389v12022
M3ER: Multiplicative Multimodal Emotion Recognition Using Facial, Textual, and Speech Cues
Trisha Mittal, Uttaran Bhattacharya, Rohan Chandra +2
eess.SPcs.CLcs.LGarXiv:1911.05659v22019
MOSS Transcribe Diarize Technical Report
MOSI. AI, :, Donghua Yu +23
cs.SDcs.AIeess.ASarXiv:2601.01554v72026
Differentiable Consistency Constraints for Improved Deep Speech Enhancement
Scott Wisdom, John R. Hershey, Kevin Wilson +4
cs.SDeess.ASarXiv:1811.08521v12018
End-to-End Neural Speaker Diarization with Permutation-Free Objectives
Yusuke Fujita, Naoyuki Kanda, Shota Horiguchi +2
eess.AScs.CLcs.SDarXiv:1909.05952v12019
AlignDPO: Preference-Gated Alignment for Reducing Hallucination in Decoder-Only TTS
Xiao Zhou, Oisín Turbitt, Kit Bower-Morris +3
eess.ASarXiv:2609.12855v12026
Sequence-to-Sequence Acoustic Modeling for Voice Conversion
Jing-Xuan Zhang, Zhen-Hua Ling, Li-Juan Liu +2
cs.SDeess.ASarXiv:1810.06865v52018
Libri-Light: A Benchmark for ASR with Limited or No Supervision
Jacob Kahn, Morgane Rivière, Weiyi Zheng +12
cs.CLcs.SDeess.ASarXiv:1912.07875v12019
Large-scale Self-Supervised Speech Representation Learning for Automatic Speaker Verification
Zhengyang Chen, Sanyuan Chen, Yu Wu +5
cs.SDeess.ASarXiv:2110.05777v22021
WavLLM: Towards Robust and Adaptive Speech Large Language Model
Shujie Hu, Long Zhou, Shujie Liu +9
cs.CLcs.AIcs.SDarXiv:2404.00656v32024
Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidance
Heeseung Kim, Sungwon Kim, Sungroh Yoon
cs.SDcs.AIeess.ASarXiv:2111.11755v42021
AutoMV: An Automatic Multi-Agent System for Music Video Generation
Xiaoxuan Tang, Xinping Lei, Chaoran Zhu +10
cs.MMcs.CVcs.SDarXiv:2512.12196v12025
Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling
Ziqiang Zhang, Long Zhou, Chengyi Wang +10
cs.CLcs.AIcs.SDarXiv:2303.03926v12023
TF-GridNet: Integrating Full- and Sub-Band Modeling for Speech Separation
Zhong-Qiu Wang, Samuele Cornell, Shukjae Choi +3
cs.SDeess.ASarXiv:2211.12433v22022
Motion-Omni: End-to-End Joint Speech and Full-Body Motion for Spoken Dialogue
Chengqian Ma, Wei Tao, Haoyu Zhang +1
cs.SDcs.CVeess.ASarXiv:2609.04250v12026
End-to-End Speech Recognition: A Survey
Rohit Prabhavalkar, Takaaki Hori, Tara N. Sainath +2
eess.AScs.CLcs.SDarXiv:2303.03329v12023
Robust Speech Emotion Recognition under Tone-Word Conflict: A Benchmark and Framework
Xiaojiang Peng, Dawei Huang, Yongjie Lv +5
eess.AScs.SDarXiv:2609.04236v12026
Efficiently Trainable Text-to-Speech System Based on Deep Convolutional Networks with Guided Attention
Hideyuki Tachibana, Katsuya Uenoyama, Shunsuke Aihara
cs.SDcs.AIcs.LGarXiv:1710.08969v22017
Tandem Assessment of Spoofing Countermeasures and Automatic Speaker Verification: Fundamentals
Tomi Kinnunen, Héctor Delgado, Nicholas Evans +8
eess.AScs.LGcs.SDarXiv:2007.05979v22020
Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labelling
Sanchit Gandhi, Patrick von Platen, Alexander M. Rush
cs.CLcs.SDeess.ASarXiv:2311.00430v12023
Efficient Audio-Visual Speech Enhancement via Reinforcement Learning-Based Neural Architecture Search
Khubaib Ahmed, Ahsan Adeel, Nasir Saleem +3
cs.SDcs.AIeess.ASarXiv:2610.12796v12026
ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scale
Xin Wang, Hector Delgado, Hemlata Tak +10
eess.AScs.AIcs.SDarXiv:2408.08739v12024
Auditing Bias and Safety in Voice AI Customer Care
Vignesh Ethiraj, Ashwath David
eess.AScs.CLcs.CYarXiv:2609.04206v12026
Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal Models
Zhiqiu Lin, Samuel Yu, Zhiyi Kuang +2
cs.CVcs.AIcs.LGarXiv:2301.06267v52023
MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantization
Haina Zhu, Yizhi Zhou, Hangting Chen +6
cs.SDcs.AIcs.CLarXiv:2501.01108v22025
AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
Xilin Jiang, Qiaolin Wang, Junkai Wu +30
cs.SDcs.CLcs.CVarXiv:2601.17645v12026
CIF: Continuous Integrate-and-Fire for End-to-End Speech Recognition
Linhao Dong, Bo Xu
cs.CLcs.LGcs.NEarXiv:1905.11235v42019
YuE2: Unifying Symbolic and Audio Music Generation at Frontier Quality
Ruibin Yuan, Jiahao Pan, Junyan Jiang +32
eess.AScs.LGcs.SDarXiv:2609.33757v12026
Crafting Adversarial Examples For Speech Paralinguistics Applications
Yuan Gong, Christian Poellabauer
cs.LGcs.CRcs.SDarXiv:1711.03280v22017
Speech Enhancement with Score-Based Generative Models in the Complex STFT Domain
Simon Welker, Julius Richter, Timo Gerkmann
eess.AScs.LGcs.SDarXiv:2203.17004v22022
Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
Chengyi Wang, Sanyuan Chen, Yu Wu +10
cs.CLcs.SDeess.ASarXiv:2301.02111v12023
POWSM: A Phonetic Open Whisper-Style Speech Foundation Model
Chin-Jou Li, Kalvin Chang, Shikhar Bharadwaj +5
cs.CLeess.ASarXiv:2510.24992v22025
Interpretable Destination-Aware synthesizer Modulation Recovery
David Liu, Giulio Cengarle, David Cooper +2
eess.ASarXiv:2610.00642v12026
Flowtron: an Autoregressive Flow-based Generative Network for Text-to-Speech Synthesis
Rafael Valle, Kevin Shih, Ryan Prenger +1
cs.SDcs.CLcs.LGarXiv:2005.05957v32020
TSTNN: Two-stage Transformer based Neural Network for Speech Enhancement in the Time Domain
Kai Wang, Bengbeng He, Wei-Ping Zhu
eess.AScs.LGcs.SDarXiv:2103.09963v12021
RawBoost: A Raw Data Boosting and Augmentation Method applied to Automatic Speaker Verification Anti-Spoofing
Hemlata Tak, Madhu Kamble, Jose Patino +2
eess.AScs.CRcs.SDarXiv:2111.04433v22021
Multi-agent Auditory Scene Analysis: Improved Localization Speed and Robustness by Multi-beamformed Speech Quality Feedback
Caleb Rascon
eess.AScs.AIcs.MAarXiv:2610.00538v12026
Simple and Controllable Music Generation
Jade Copet, Felix Kreuk, Itai Gat +5
cs.SDcs.AIcs.LGarXiv:2306.05284v32023
DriftSE: Speech Enhancement with Generative Drifting
Liang Xu, Diego Caviedes-Nozal, W. Bastiaan Kleijn +2
cs.SDcs.AIeess.ASarXiv:2609.12252v12026
On Loss Functions for Supervised Monaural Time-Domain Speech Enhancement
Morten Kolbæk, Zheng-Hua Tan, Søren Holdt Jensen +1
cs.SDcs.LGeess.ASarXiv:1909.01019v22019
Domain Adversarial for Acoustic Emotion Recognition
Mohammed Abdelwahab, Carlos Busso
eess.AScs.SDarXiv:1804.07690v12018
Qwen3-TTS Technical Report
Hangrui Hu, Xinfa Zhu, Ting He +13
cs.SDcs.CLeess.ASarXiv:2601.15621v12026
Summaries:简体中文
PromptTTS 2: Describing and Generating Voices with Text Prompt
Yichong Leng, Zhifang Guo, Kai Shen +12
eess.AScs.CLcs.LGarXiv:2309.02285v22023
MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompaniment
Hao-Wen Dong, Wen-Yi Hsiao, Li-Chia Yang +1
eess.AScs.AIcs.LGarXiv:1709.06298v22017
Patch-Mix Contrastive Learning with Audio Spectrogram Transformer on Respiratory Sound Classification
Sangmin Bae, June-Woo Kim, Won-Yang Cho +7
eess.AScs.LGcs.SDarXiv:2305.14032v52023
AQAScore: Evaluating Semantic Alignment in Text-to-Audio Generation via Audio Question Answering
Chun-Yi Kuan, Kai-Wei Chang, Hung-yi Lee
eess.AScs.AIcs.CLarXiv:2601.14728v12026
Learning latent representations for style control and transfer in end-to-end speech synthesis
Ya-Jie Zhang, Shifeng Pan, Lei He +1
cs.CLcs.SDeess.ASarXiv:1812.04342v22018
Reference-Free Singing Pitch Correction via Music-Constrained Sequence Editing
Biao Dong, Jiajun Li, Binzhen Zhu +5
cs.SDeess.ASarXiv:2610.11524v12026
Diffusion-Link: Diffusion Probabilistic Model for Bridging the Audio-Text Modality Gap
KiHyun Nam, Jongmin Choi, Hyeongkeun Lee +2
cs.SDcs.AIcs.CLarXiv:2510.11330v12025
FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generation
Ronghui Li, Junfan Zhao, Yachao Zhang +5
cs.CVcs.SDeess.ASarXiv:2212.03741v42022
FeatureSense: Protecting Speaker Attributes in Always-On Audio Sensing System
Bhawana Chhaglani, Sarmistha Sarna Gomasta, Yuvraj Agarwal +2
cs.SDcs.HCeess.ASarXiv:2505.24115v12025
Using the enrollment gallery as evidence: affine-invariant score calibration for target speaker tagging
Hee-Soo Heo, Minjae Lee, Youngki Kwon +1
eess.ASarXiv:2610.11272v12026
BEATs: Audio Pre-Training with Acoustic Tokenizers
Sanyuan Chen, Yu Wu, Chengyi Wang +4
eess.AScs.AIcs.CLarXiv:2212.09058v12022
SmoothConv and DuplexConv: Complementary Mandarin Multi-Party Conversational Speech Corpora for Speech Interaction
Chengyou Wang, Mingchen Shao, Chunjiang He +8
eess.ASarXiv:2610.11150v12026

Audio and Speech Processing

EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting

AVTok: 1D Unified Tokenization for Holistic Audio-Video Generation

Voices Obscured in Complex Environmental Settings (VOICES) corpus

Taming Visually Guided Sound Generation

A Comparative Study on End-to-end Speech to Text Translation

Neural Target Speech Extraction: An Overview

ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speech

M3ER: Multiplicative Multimodal Emotion Recognition Using Facial, Textual, and Speech Cues

MOSS Transcribe Diarize Technical Report

Differentiable Consistency Constraints for Improved Deep Speech Enhancement

End-to-End Neural Speaker Diarization with Permutation-Free Objectives

AlignDPO: Preference-Gated Alignment for Reducing Hallucination in Decoder-Only TTS

Sequence-to-Sequence Acoustic Modeling for Voice Conversion

Libri-Light: A Benchmark for ASR with Limited or No Supervision

Large-scale Self-Supervised Speech Representation Learning for Automatic Speaker Verification

WavLLM: Towards Robust and Adaptive Speech Large Language Model

Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidance

AutoMV: An Automatic Multi-Agent System for Music Video Generation

Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling

TF-GridNet: Integrating Full- and Sub-Band Modeling for Speech Separation

Motion-Omni: End-to-End Joint Speech and Full-Body Motion for Spoken Dialogue

End-to-End Speech Recognition: A Survey

Robust Speech Emotion Recognition under Tone-Word Conflict: A Benchmark and Framework

Efficiently Trainable Text-to-Speech System Based on Deep Convolutional Networks with Guided Attention

Tandem Assessment of Spoofing Countermeasures and Automatic Speaker Verification: Fundamentals

Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labelling

Efficient Audio-Visual Speech Enhancement via Reinforcement Learning-Based Neural Architecture Search

ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scale

Auditing Bias and Safety in Voice AI Customer Care

Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal Models

MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantization

AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking

CIF: Continuous Integrate-and-Fire for End-to-End Speech Recognition

YuE2: Unifying Symbolic and Audio Music Generation at Frontier Quality

Crafting Adversarial Examples For Speech Paralinguistics Applications

Speech Enhancement with Score-Based Generative Models in the Complex STFT Domain

Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers

POWSM: A Phonetic Open Whisper-Style Speech Foundation Model

Interpretable Destination-Aware synthesizer Modulation Recovery

Flowtron: an Autoregressive Flow-based Generative Network for Text-to-Speech Synthesis

TSTNN: Two-stage Transformer based Neural Network for Speech Enhancement in the Time Domain

RawBoost: A Raw Data Boosting and Augmentation Method applied to Automatic Speaker Verification Anti-Spoofing

Multi-agent Auditory Scene Analysis: Improved Localization Speed and Robustness by Multi-beamformed Speech Quality Feedback

Simple and Controllable Music Generation

DriftSE: Speech Enhancement with Generative Drifting

On Loss Functions for Supervised Monaural Time-Domain Speech Enhancement

Domain Adversarial for Acoustic Emotion Recognition

Qwen3-TTS Technical Report

PromptTTS 2: Describing and Generating Voices with Text Prompt

MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompaniment

Patch-Mix Contrastive Learning with Audio Spectrogram Transformer on Respiratory Sound Classification

AQAScore: Evaluating Semantic Alignment in Text-to-Audio Generation via Audio Question Answering

Learning latent representations for style control and transfer in end-to-end speech synthesis

Reference-Free Singing Pitch Correction via Music-Constrained Sequence Editing

Diffusion-Link: Diffusion Probabilistic Model for Bridging the Audio-Text Modality Gap

FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generation

FeatureSense: Protecting Speaker Attributes in Always-On Audio Sensing System

Using the enrollment gallery as evidence: affine-invariant score calibration for target speaker tagging

BEATs: Audio Pre-Training with Acoustic Tokenizers

SmoothConv and DuplexConv: Complementary Mandarin Multi-Party Conversational Speech Corpora for Speech Interaction