Sound

Papers filed under cs.SD on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

1 to 60 of 1,662

MoonCast: High-Quality Zero-Shot Podcast Generation
Zeqian Ju, Dongchao Yang, Jianwei Yu +7
eess.AScs.AIcs.CLarXiv:2503.14345v22025
OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversation
Qinglin Zhang, Luyao Cheng, Chong Deng +8
cs.CLcs.AIcs.SDarXiv:2410.17799v22024
OSUM: Advancing Open Speech Understanding Models with Limited Resources in Academia
Xuelong Geng, Kun Wei, Qijie Shao +18
cs.SDcs.CLeess.ASarXiv:2501.13306v22025
Sonic-AMG: Streaming Human Motion Generation from Spatial Audio
Jingcheng Ni, Zekun Li, Zhiyang Dou +6
cs.CVcs.GRcs.LGarXiv:2610.13300v12026
E3-System: Expressive EmoData, Explicitly Controllable, Easy-to-Use TTS
Yiqiao Huang, Xiaolong Lin, Zhenpeng Zhan +1
eess.AScs.SDarXiv:2610.12993v12026
EEG-informed attended speaker extraction from recorded speech mixtures with application in neuro-steered hearing prostheses
Simon Van Eyndhoven, Tom Francart, Alexander Bertrand
cs.SDcs.SYeess.SYarXiv:1602.05702v42016
Multilingual sequence-to-sequence speech recognition: architecture, transfer learning, and language modeling
Jaejin Cho, Murali Karthick Baskar, Ruizhi Li +6
cs.CLcs.LGcs.SDarXiv:1810.03459v12018
AudioTETRIS: Token Elimination via Transitional Importance Signals for Efficient Audio LLMs
Shreya Sajid, Anna Vettoruzzo, Joaquin Vanschoren
cs.SDcs.AIeess.ASarXiv:2610.13600v12026
Does Location Matter? A Black-Box Causal Audit Reveals Model-Dependent Audio Grounding in LALM Hallucination
Mohammad Khalooei, Mohammad Sabokrou
cs.AIcs.LGcs.SDarXiv:2610.13112v12026
Fully-hierarchical fine-grained prosody modeling for interpretable speech synthesis
Guangzhi Sun, Yu Zhang, Ron J. Weiss +3
eess.AScs.LGcs.SDarXiv:2002.03785v12020
RDSE: Real-Time Directional Speech Enhancement Framework for Dual-Mic Commodity Smartphones
Chinmay Deo, Danish Mahajan, Soudeep Ghoshal +1
cs.SDeess.ASarXiv:2610.12476v12026
Efficient Audio-Visual Speech Enhancement via Reinforcement Learning-Based Neural Architecture Search
Khubaib Ahmed, Ahsan Adeel, Nasir Saleem +3
cs.SDcs.AIeess.ASarXiv:2610.12796v12026
CoDi-2: In-Context, Interleaved, and Interactive Any-to-Any Generation
Zineng Tang, Ziyi Yang, Mahmoud Khademi +3
cs.CVcs.AIcs.CLarXiv:2311.18775v12023
TTS-Q: Perception-Guided Post-Training Quantization of Text-to-Speech Diffusion Transformers
Xiaoqin Feng, Yuqi Li, Weilun Feng +9
cs.SDcs.LGeess.ASarXiv:2610.12474v12026
How Should We Evaluate Naturalness for Synthetic Speech with a Foreign Accent?
Kentaro Onda, Satoru Fukayama, Daisuke Saito +1
cs.SDeess.ASarXiv:2610.13175v12026
Adaptive Feature Selection for End-to-End Speech Translation
Biao Zhang, Ivan Titov, Barry Haddow +1
cs.CLcs.LGcs.SDarXiv:2010.08518v22020
Speech Quality Assessment through MOS using Non-Matching References
Pranay Manocha, Anurag Kumar
eess.AScs.SDarXiv:2206.12285v12022
MossFormer: Pushing the Performance Limit of Monaural Speech Separation using Gated Single-Head Transformer with Convolution-Augmented Joint Self-Attentions
Shengkui Zhao, Bin Ma
cs.SDcs.LGeess.ASarXiv:2302.11824v12023
Exploring Phoneme-Level Speech Representations for End-to-End Speech Translation
Elizabeth Salesky, Matthias Sperber, Alan W Black
cs.CLcs.SDeess.ASarXiv:1906.01199v12019
RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition
Peiyan Dong, Siyue Wang, Wei Niu +8
cs.SDcs.LGeess.ASarXiv:2002.11474v12020
Simple and Effective Unsupervised Speech Synthesis
Alexander H. Liu, Cheng-I Jeff Lai, Wei-Ning Hsu +3
cs.SDcs.CLeess.ASarXiv:2204.02524v32022
Improving Speech-to-Speech Translation Through Unlabeled Text
Xuan-Phi Nguyen, Sravya Popuri, Changhan Wang +3
cs.CLcs.SDeess.ASarXiv:2210.14514v12022
ISCSLP 2026 CoT-TTS Challenge: Chain-of-Thought Reasoning for Context-Aware Text-to-Speech
Wei Xue, Junlan Feng, Shilei Zhang +9
cs.SDarXiv:2606.21933v12026
Listen As You Wish: Audio based Event Detection via Text-to-Audio Grounding in Smart Cities
Haoyu Tang, Yunxiao Wang, Jihua Zhu +4
cs.SDcs.MMeess.ASarXiv:2106.14136v32021
Pushing the Frontier of Full-Song Generation: Hierarchical Autoregressive Planning Meets Flow-Matching Rendering
Junyu Dai, Xinyue Fan, Weiqin Li +14
cs.SDcs.AIeess.ASarXiv:2607.20253v32026
NELS -- Never-Ending Learner of Sounds
Benjamin Elizalde, Rohan Badlani, Ankit Shah +2
cs.SDeess.ASarXiv:1801.05544v22018
DiTTo-TTS: Diffusion Transformers for Scalable Text-to-Speech without Domain-Specific Factors
Keon Lee, Dong Won Kim, Jaehyeon Kim +2
eess.AScs.AIcs.CLarXiv:2406.11427v22024
FireRedTTS: A Foundation Text-To-Speech Framework for Industry-Level Generative Speech Applications
Hao-Han Guo, Yao Hu, Kun Liu +6
cs.SDeess.ASarXiv:2409.03283v22024
TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching and Clap-Ranked Preference Optimization
Chia-Yu Hung, Navonil Majumder, Zhifeng Kong +6
cs.SDcs.AIcs.CLarXiv:2412.21037v22024
FocalCodec: Low-Bitrate Speech Coding via Focal Modulation Networks
Luca Della Libera, Francesco Paissan, Cem Subakan +1
cs.LGcs.AIcs.SDarXiv:2502.04465v22025
Multi-Source Diffusion Models for Simultaneous Music Generation and Separation
Giorgio Mariani, Irene Tallini, Emilian Postolache +3
cs.SDcs.LGeess.ASarXiv:2302.02257v42023
Cross-domain Neural Pitch and Periodicity Estimation
Max Morrison, Caedon Hsieh, Nathan Pruyne +1
eess.AScs.SDarXiv:2301.12258v32023
S-JEPA : Soft Clustering Anchors for Self-Supervised Speech Representation Learning
Georgios Ioannides, Adrian Kieback, Judah Goldfeder +5
cs.SDeess.ASeess.SParXiv:2606.19398v12026
Privacy against Real-Time Speech Emotion Detection via Acoustic Adversarial Evasion of Machine Learning
Brian Testa, Yi Xiao, Harshit Sharma +2
cs.LGcs.CRcs.SDarXiv:2211.09273v42022
Fr\'echet Distance Loss on Speech Representations for Text-to-Speech Synthesis
Ho-Lam Chung, Kuan-Po Huang, Bo-Ru Lu +1
cs.SDarXiv:2607.06027v32026
LLM can Read Spectrogram: Encoder-free Speech-Language Modeling
Ruchao Fan, Yiming Wang, Yuxuan Hu +6
eess.AScs.SDarXiv:2606.10231v42026
From Sounds to Scenes: A Benchmark for Evaluating Context-Aware Auditory Scene Understanding in Large Audio Language Models
Pengfei Zhang, Hoang H Nguyen, Kazi Shaharair Sharif +6
cs.SDcs.AIcs.MMarXiv:2606.25391v12026
Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embedding
Hongning Zhu, Kong Aik Lee, Haizhou Li
cs.SDcs.CLeess.ASarXiv:2107.06493v12021
NAS-VAD: Neural Architecture Search for Voice Activity Detection
Daniel Rho, Jinhyeok Park, Jong Hwan Ko
cs.SDcs.LGeess.ASarXiv:2201.09032v22022
Nonparallel High-Quality Audio Super Resolution with Domain Adaptation and Resampling CycleGANs
Reo Yoneyama, Ryuichi Yamamoto, Kentaro Tachibana
eess.AScs.LGcs.SDarXiv:2210.15887v22022
AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarios
Yihan Wu, Xu Tan, Bohan Li +5
eess.AScs.AIcs.CLarXiv:2204.00436v12022
A Pyramid Recurrent Network for Predicting Crowdsourced Speech-Quality Ratings of Real-World Signals
Xuan Dong, Donald S. Williamson
eess.AScs.CLcs.LGarXiv:2007.15797v12020
Cold Diffusion for Speech Enhancement
Hao Yen, François G. Germain, Gordon Wichern +1
eess.AScs.SDarXiv:2211.02527v32022
CoVoST 2 and Massively Multilingual Speech-to-Text Translation
Changhan Wang, Anne Wu, Juan Pino
cs.CLcs.SDeess.ASarXiv:2007.10310v32020
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders
Chen Xu, Bojie Hu, Yanyang Li +5
cs.CLcs.SDeess.ASarXiv:2105.05752v22021
Evaluating Parameter-Efficient Transfer Learning Approaches on SURE Benchmark for Speech Understanding
Yingting Li, Ambuj Mehrish, Shuai Zhao +5
cs.CLcs.SDeess.ASarXiv:2303.03267v12023
UniCATS: A Unified Context-Aware Text-to-Speech Framework with Contextual VQ-Diffusion and Vocoding
Chenpeng Du, Yiwei Guo, Feiyu Shen +6
cs.SDeess.ASarXiv:2306.07547v62023
Improved Language Identification Through Cross-Lingual Self-Supervised Learning
Andros Tjandra, Diptanu Gon Choudhury, Frank Zhang +6
cs.CLcs.SDeess.ASarXiv:2107.04082v42021
PromptTTS++: Controlling Speaker Identity in Prompt-Based Text-to-Speech Using Natural Language Descriptions
Reo Shimizu, Ryuichi Yamamoto, Masaya Kawamura +4
eess.AScs.CLcs.LGarXiv:2309.08140v22023
Mask, Sample, Revise: A Revisable CTMC Inference Stack for Guided Discrete Flow Matching Text-to-Speech
Alef Iury Siqueira Ferreira, Lucas Rafael Stefanel Gris, Luiz Fernando de Araújo Vidal +4
cs.SDcs.AIarXiv:2606.13989v22026
From Generation to Attribution: Music AI Agent Architectures for the Post-Streaming Era
Wonil Kim, Hyeongseok Wi, Seungsoon Park +12
cs.IRcs.HCcs.MAarXiv:2510.20276v22025
Efficient Streaming LLM for Speech Recognition
Junteng Jia, Gil Keren, Wei Zhou +6
cs.SDcs.AIcs.CLarXiv:2410.03752v12024
OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching
Hieu-Nghia Huynh-Nguyen, Ngoc Son Nguyen, Huynh Nguyen Dang +3
cs.SDcs.AIeess.ASarXiv:2505.12800v12025
SoulX-Podcast: Towards Realistic Long-form Podcasts with Dialectal and Paralinguistic Diversity
Hanke Xie, Haopeng Lin, Wenxiao Cao +17
eess.AScs.SDarXiv:2510.23541v22025
AzeroS: Extending LLM to Speech with Self-Generated Instruction-Free Tuning
Yiwen Shao, Wei Liu, Jiahong Li +4
cs.CLcs.SDeess.ASarXiv:2601.06086v12025
Audio MultiChallenge: A Multi-Turn Evaluation of Spoken Dialogue Systems on Natural Human Interaction
Advait Gosai, Tyler Vuong, Utkarsh Tyagi +8
cs.SDcs.CLcs.LGarXiv:2512.14865v12025
DiarizationLM: Speaker Diarization Post-Processing with Large Language Models
Quan Wang, Yiling Huang, Guanlong Zhao +3
eess.AScs.LGcs.SDarXiv:2401.03506v122024
Modelling Symbolic Music: Beyond the Piano Roll
Christian Walder
cs.SDarXiv:1606.01368v12016
TimbreTron: A WaveNet(CycleGAN(CQT(Audio))) Pipeline for Musical Timbre Transfer
Sicong Huang, Qiyang Li, Cem Anil +3
cs.SDcs.LGeess.ASarXiv:1811.09620v32018
Music Generation with Deep Learning
Vasanth Kalingeri, Srikanth Grandhe
cs.SDarXiv:1612.04928v12016

Sound

MoonCast: High-Quality Zero-Shot Podcast Generation

OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversation

OSUM: Advancing Open Speech Understanding Models with Limited Resources in Academia

Sonic-AMG: Streaming Human Motion Generation from Spatial Audio

E3-System: Expressive EmoData, Explicitly Controllable, Easy-to-Use TTS

EEG-informed attended speaker extraction from recorded speech mixtures with application in neuro-steered hearing prostheses

Multilingual sequence-to-sequence speech recognition: architecture, transfer learning, and language modeling

AudioTETRIS: Token Elimination via Transitional Importance Signals for Efficient Audio LLMs

Does Location Matter? A Black-Box Causal Audit Reveals Model-Dependent Audio Grounding in LALM Hallucination

Fully-hierarchical fine-grained prosody modeling for interpretable speech synthesis

RDSE: Real-Time Directional Speech Enhancement Framework for Dual-Mic Commodity Smartphones

Efficient Audio-Visual Speech Enhancement via Reinforcement Learning-Based Neural Architecture Search

CoDi-2: In-Context, Interleaved, and Interactive Any-to-Any Generation

TTS-Q: Perception-Guided Post-Training Quantization of Text-to-Speech Diffusion Transformers

How Should We Evaluate Naturalness for Synthetic Speech with a Foreign Accent?

Adaptive Feature Selection for End-to-End Speech Translation

Speech Quality Assessment through MOS using Non-Matching References

MossFormer: Pushing the Performance Limit of Monaural Speech Separation using Gated Single-Head Transformer with Convolution-Augmented Joint Self-Attentions

Exploring Phoneme-Level Speech Representations for End-to-End Speech Translation

RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition

Simple and Effective Unsupervised Speech Synthesis

Improving Speech-to-Speech Translation Through Unlabeled Text

ISCSLP 2026 CoT-TTS Challenge: Chain-of-Thought Reasoning for Context-Aware Text-to-Speech

Listen As You Wish: Audio based Event Detection via Text-to-Audio Grounding in Smart Cities

Pushing the Frontier of Full-Song Generation: Hierarchical Autoregressive Planning Meets Flow-Matching Rendering

NELS -- Never-Ending Learner of Sounds

DiTTo-TTS: Diffusion Transformers for Scalable Text-to-Speech without Domain-Specific Factors

FireRedTTS: A Foundation Text-To-Speech Framework for Industry-Level Generative Speech Applications

TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching and Clap-Ranked Preference Optimization

FocalCodec: Low-Bitrate Speech Coding via Focal Modulation Networks

Multi-Source Diffusion Models for Simultaneous Music Generation and Separation

Cross-domain Neural Pitch and Periodicity Estimation

S-JEPA : Soft Clustering Anchors for Self-Supervised Speech Representation Learning

Privacy against Real-Time Speech Emotion Detection via Acoustic Adversarial Evasion of Machine Learning

Fr\'echet Distance Loss on Speech Representations for Text-to-Speech Synthesis

LLM can Read Spectrogram: Encoder-free Speech-Language Modeling

From Sounds to Scenes: A Benchmark for Evaluating Context-Aware Auditory Scene Understanding in Large Audio Language Models

Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embedding

NAS-VAD: Neural Architecture Search for Voice Activity Detection

Nonparallel High-Quality Audio Super Resolution with Domain Adaptation and Resampling CycleGANs

AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarios

A Pyramid Recurrent Network for Predicting Crowdsourced Speech-Quality Ratings of Real-World Signals

Cold Diffusion for Speech Enhancement

CoVoST 2 and Massively Multilingual Speech-to-Text Translation

Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders

Evaluating Parameter-Efficient Transfer Learning Approaches on SURE Benchmark for Speech Understanding

UniCATS: A Unified Context-Aware Text-to-Speech Framework with Contextual VQ-Diffusion and Vocoding

Improved Language Identification Through Cross-Lingual Self-Supervised Learning

PromptTTS++: Controlling Speaker Identity in Prompt-Based Text-to-Speech Using Natural Language Descriptions

Mask, Sample, Revise: A Revisable CTMC Inference Stack for Guided Discrete Flow Matching Text-to-Speech

From Generation to Attribution: Music AI Agent Architectures for the Post-Streaming Era

Efficient Streaming LLM for Speech Recognition

OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching

SoulX-Podcast: Towards Realistic Long-form Podcasts with Dialectal and Paralinguistic Diversity

AzeroS: Extending LLM to Speech with Self-Generated Instruction-Free Tuning

Audio MultiChallenge: A Multi-Turn Evaluation of Spoken Dialogue Systems on Natural Human Interaction

DiarizationLM: Speaker Diarization Post-Processing with Large Language Models

Modelling Symbolic Music: Beyond the Piano Roll

TimbreTron: A WaveNet(CycleGAN(CQT(Audio))) Pipeline for Musical Timbre Transfer

Music Generation with Deep Learning