Sound

Papers filed under cs.SD on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

1,321 to 1,380 of 1,947

OpenPA: Forced-alignment-free Multi-granular Pronunciation Assessment with Mixed-transcript Adaptation
Fu-An Chao, Bi-Cheng Yan, Berlin Chen
eess.AScs.CLcs.SDarXiv:2610.13826v12026
Lossless Inference Acceleration for ASR via EAGLE-Style Speculative Decoding
Sen Zhang, Xianghu Yue, Yiming Chen +3
cs.SDeess.ASarXiv:2610.13506v12026
Translatotron 2: High-quality direct speech-to-speech translation with voice preservation
Ye Jia, Michelle Tadmor Ramanovich, Tal Remez +1
cs.CLcs.LGcs.SDarXiv:2107.08661v52021
Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module
Yihe Liu, Ziqi Yuan, Huisheng Mao +7
cs.MMcs.AIcs.CVarXiv:2209.02604v12022
AURA: Unified Multimodal Framework for Conversational Music Editing
Quoc-Huy Trinh, Minh-Van Nguyen, Debesh Jha
cs.SDcs.AIeess.ASarXiv:2609.14344v12026
Vector-Quantized Autoregressive Predictive Coding
Yu-An Chung, Hao Tang, James Glass
eess.AScs.CLcs.LGarXiv:2005.08392v12020
VoxAnon: A balanced dataset for a fair evaluation of speech anonymization
Orane Dufour, Paul Magron, Mickael Rouvier
cs.SDeess.ASarXiv:2610.13313v12026
OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversation
Qinglin Zhang, Luyao Cheng, Chong Deng +8
cs.CLcs.AIcs.SDarXiv:2410.17799v22024
OSUM: Advancing Open Speech Understanding Models with Limited Resources in Academia
Xuelong Geng, Kun Wei, Qijie Shao +18
cs.SDcs.CLeess.ASarXiv:2501.13306v22025
Fully-hierarchical fine-grained prosody modeling for interpretable speech synthesis
Guangzhi Sun, Yu Zhang, Ron J. Weiss +3
eess.AScs.LGcs.SDarXiv:2002.03785v12020
RDSE: Real-Time Directional Speech Enhancement Framework for Dual-Mic Commodity Smartphones
Chinmay Deo, Danish Mahajan, Soudeep Ghoshal +1
cs.SDeess.ASarXiv:2610.12476v12026
CoDi-2: In-Context, Interleaved, and Interactive Any-to-Any Generation
Zineng Tang, Ziyi Yang, Mahmoud Khademi +3
cs.CVcs.AIcs.CLarXiv:2311.18775v12023
How Should We Evaluate Naturalness for Synthetic Speech with a Foreign Accent?
Kentaro Onda, Satoru Fukayama, Daisuke Saito +1
cs.SDeess.ASarXiv:2610.13175v12026
RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition
Peiyan Dong, Siyue Wang, Wei Niu +8
cs.SDcs.LGeess.ASarXiv:2002.11474v12020
Improving Speech-to-Speech Translation Through Unlabeled Text
Xuan-Phi Nguyen, Sravya Popuri, Changhan Wang +3
cs.CLcs.SDeess.ASarXiv:2210.14514v12022
NELS -- Never-Ending Learner of Sounds
Benjamin Elizalde, Rohan Badlani, Ankit Shah +2
cs.SDeess.ASarXiv:1801.05544v22018
DiTTo-TTS: Diffusion Transformers for Scalable Text-to-Speech without Domain-Specific Factors
Keon Lee, Dong Won Kim, Jaehyeon Kim +2
eess.AScs.AIcs.CLarXiv:2406.11427v22024
FireRedTTS: A Foundation Text-To-Speech Framework for Industry-Level Generative Speech Applications
Hao-Han Guo, Yao Hu, Kun Liu +6
cs.SDeess.ASarXiv:2409.03283v22024
FocalCodec: Low-Bitrate Speech Coding via Focal Modulation Networks
Luca Della Libera, Francesco Paissan, Cem Subakan +1
cs.LGcs.AIcs.SDarXiv:2502.04465v22025
Privacy against Real-Time Speech Emotion Detection via Acoustic Adversarial Evasion of Machine Learning
Brian Testa, Yi Xiao, Harshit Sharma +2
cs.LGcs.CRcs.SDarXiv:2211.09273v42022
LLM can Read Spectrogram: Encoder-free Speech-Language Modeling
Ruchao Fan, Yiming Wang, Yuxuan Hu +6
eess.AScs.SDarXiv:2606.10231v42026
From Sounds to Scenes: A Benchmark for Evaluating Context-Aware Auditory Scene Understanding in Large Audio Language Models
Pengfei Zhang, Hoang H Nguyen, Kazi Shaharair Sharif +6
cs.SDcs.AIcs.MMarXiv:2606.25391v12026
Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embedding
Hongning Zhu, Kong Aik Lee, Haizhou Li
cs.SDcs.CLeess.ASarXiv:2107.06493v12021
NAS-VAD: Neural Architecture Search for Voice Activity Detection
Daniel Rho, Jinhyeok Park, Jong Hwan Ko
cs.SDcs.LGeess.ASarXiv:2201.09032v22022
Nonparallel High-Quality Audio Super Resolution with Domain Adaptation and Resampling CycleGANs
Reo Yoneyama, Ryuichi Yamamoto, Kentaro Tachibana
eess.AScs.LGcs.SDarXiv:2210.15887v22022
AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarios
Yihan Wu, Xu Tan, Bohan Li +5
eess.AScs.AIcs.CLarXiv:2204.00436v12022
A Pyramid Recurrent Network for Predicting Crowdsourced Speech-Quality Ratings of Real-World Signals
Xuan Dong, Donald S. Williamson
eess.AScs.CLcs.LGarXiv:2007.15797v12020
Cold Diffusion for Speech Enhancement
Hao Yen, François G. Germain, Gordon Wichern +1
eess.AScs.SDarXiv:2211.02527v32022
Evaluating Parameter-Efficient Transfer Learning Approaches on SURE Benchmark for Speech Understanding
Yingting Li, Ambuj Mehrish, Shuai Zhao +5
cs.CLcs.SDeess.ASarXiv:2303.03267v12023
Improved Language Identification Through Cross-Lingual Self-Supervised Learning
Andros Tjandra, Diptanu Gon Choudhury, Frank Zhang +6
cs.CLcs.SDeess.ASarXiv:2107.04082v42021
PromptTTS++: Controlling Speaker Identity in Prompt-Based Text-to-Speech Using Natural Language Descriptions
Reo Shimizu, Ryuichi Yamamoto, Masaya Kawamura +4
eess.AScs.CLcs.LGarXiv:2309.08140v22023
Mask, Sample, Revise: A Revisable CTMC Inference Stack for Guided Discrete Flow Matching Text-to-Speech
Alef Iury Siqueira Ferreira, Lucas Rafael Stefanel Gris, Luiz Fernando de Araújo Vidal +4
cs.SDcs.AIarXiv:2606.13989v22026
From Generation to Attribution: Music AI Agent Architectures for the Post-Streaming Era
Wonil Kim, Hyeongseok Wi, Seungsoon Park +12
cs.IRcs.HCcs.MAarXiv:2510.20276v22025
Efficient Streaming LLM for Speech Recognition
Junteng Jia, Gil Keren, Wei Zhou +6
cs.SDcs.AIcs.CLarXiv:2410.03752v12024
SoulX-Podcast: Towards Realistic Long-form Podcasts with Dialectal and Paralinguistic Diversity
Hanke Xie, Haopeng Lin, Wenxiao Cao +17
eess.AScs.SDarXiv:2510.23541v22025
AzeroS: Extending LLM to Speech with Self-Generated Instruction-Free Tuning
Yiwen Shao, Wei Liu, Jiahong Li +4
cs.CLcs.SDeess.ASarXiv:2601.06086v12025
Audio MultiChallenge: A Multi-Turn Evaluation of Spoken Dialogue Systems on Natural Human Interaction
Advait Gosai, Tyler Vuong, Utkarsh Tyagi +8
cs.SDcs.CLcs.LGarXiv:2512.14865v12025
DiarizationLM: Speaker Diarization Post-Processing with Large Language Models
Quan Wang, Yiling Huang, Guanlong Zhao +3
eess.AScs.LGcs.SDarXiv:2401.03506v122024
Modelling Symbolic Music: Beyond the Piano Roll
Christian Walder
cs.SDarXiv:1606.01368v12016
Music Generation with Deep Learning
Vasanth Kalingeri, Srikanth Grandhe
cs.SDarXiv:1612.04928v12016
NONOTO: A Model-agnostic Web Interface for Interactive Music Composition by Inpainting
Théis Bazin, Gaëtan Hadjeres
cs.HCcs.LGcs.SDarXiv:1907.10380v12019
NVMOS: Non-Verbal Vocalization Quality Assessment in Speech
Jialong Mai, Jinxin Ji, Xiaofen Xing +2
cs.SDcs.AIeess.ASarXiv:2606.15888v12026
Explainable Attribute-Based Speaker Verification
Xiaoliang Wu, Chau Luu, Peter Bell +1
cs.SDcs.AIeess.ASarXiv:2405.19796v12024
A Transformer-based Audio Captioning Model with Keyword Estimation
Yuma Koizumi, Ryo Masumura, Kyosuke Nishida +2
eess.AScs.LGcs.SDarXiv:2007.00222v22020
CS-YODAS: A Mined Dataset of In-the-Wild Code-Switched Speech
Brian Yan, Qingzheng Wang, Matthew Wiesner +9
cs.SDarXiv:2606.11514v12026
DiffRhythm+: Controllable and Flexible Full-Length Song Generation with Preference Optimization
Huakang Chen, Yuepeng Jiang, Guobin Ma +7
eess.AScs.SDarXiv:2507.12890v22025
Spatio-Temporal Audio Language Modeling for Dynamic Sound Sources
Oh Hyun-Bin, Kazuki Shimada, Yuhta Takida +6
cs.SDcs.AIcs.CLarXiv:2606.14141v12026
In-Context Learning Boosts Speech Recognition via Human-like Adaptation to Speakers and Language Varieties
Nathan Roll, Calbert Graham, Yuka Tatsumi +3
cs.CLcs.SDeess.ASarXiv:2505.14887v12025
Can Large Audio Language Models Understand Audio Well? Speech, Scene and Events Understanding Benchmark for LALMs
Han Yin, Jung-Woo Choi
cs.SDarXiv:2509.13148v32025
Generating Synthetic Doctor-Patient Conversations for Long-form Audio Summarization
Yanis Labrak, David Grünert, Séverin Baroudi +11
cs.SDcs.AIarXiv:2604.06138v12026
Multilingual and Multi-Accent Jailbreaking of Audio LLMs
Jaechul Roh, Virat Shejwalkar, Amir Houmansadr
cs.SDcs.AIcs.CLarXiv:2504.01094v12025
A New Transformer-Based Approach for Audio-Based Kinship Verification and a New Uncontrolled Mandarin Kinship Speech Dataset
Qiyang Sun, Langqing Zhang, Yupei Li +1
cs.SDcs.AIcs.LGarXiv:2609.14145v22026
DiTAR+: Dual Optimization for Robust Autoregressive Diffusion Speech Synthesis
Ziyu Zhang, Tianlun Zuo, Hanzhao Li +2
cs.SDcs.AIeess.ASarXiv:2609.13909v12026
CRAF: Cross-View Residual-Aware Fusion for Deepfake Speech Detection
Minh-Xuan Phan, Khalid Zaman, Candy Olivia Mawalim +1
cs.SDcs.AIeess.ASarXiv:2609.13842v12026
Long-form music generation with latent diffusion
Zach Evans, Julian D. Parker, CJ Carr +3
cs.SDcs.LGeess.ASarXiv:2404.10301v22024
Music Understanding LLaMA: Advancing Text-to-Music Generation with Question Answering and Captioning
Shansong Liu, Atin Sakkeer Hussain, Chenshuo Sun +1
cs.SDcs.AIcs.CLarXiv:2308.11276v12023
Vid2speech: Speech Reconstruction from Silent Video
Ariel Ephrat, Shmuel Peleg
cs.CVcs.SDarXiv:1701.00495v22017
Unsupervised Maneuver-Aware Acoustic Fault Detection for Autonomous Drones
Ali M Ali, Ziyi Tang, Nurdaulet Nazarbay +1
cs.SDcs.SYeess.SYarXiv:2610.10517v12026
AGAIN-VC: A One-shot Voice Conversion using Activation Guidance and Adaptive Instance Normalization
Yen-Hao Chen, Da-Yi Wu, Tsung-Han Wu +1
eess.AScs.SDarXiv:2011.00316v12020
PhaseGAN: High-Fidelity Vocoder via Decoupled Amplitude and GAN-Driven Phase Reconstruction
Wenzheng Zhang, Xueliang Zhang, Shulin He +7
cs.SDarXiv:2609.12918v12026

Sound

OpenPA: Forced-alignment-free Multi-granular Pronunciation Assessment with Mixed-transcript Adaptation

Lossless Inference Acceleration for ASR via EAGLE-Style Speculative Decoding

Translatotron 2: High-quality direct speech-to-speech translation with voice preservation

Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module

AURA: Unified Multimodal Framework for Conversational Music Editing

Vector-Quantized Autoregressive Predictive Coding

VoxAnon: A balanced dataset for a fair evaluation of speech anonymization

OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversation

OSUM: Advancing Open Speech Understanding Models with Limited Resources in Academia

Fully-hierarchical fine-grained prosody modeling for interpretable speech synthesis

RDSE: Real-Time Directional Speech Enhancement Framework for Dual-Mic Commodity Smartphones

CoDi-2: In-Context, Interleaved, and Interactive Any-to-Any Generation

How Should We Evaluate Naturalness for Synthetic Speech with a Foreign Accent?

RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition

Improving Speech-to-Speech Translation Through Unlabeled Text

NELS -- Never-Ending Learner of Sounds

DiTTo-TTS: Diffusion Transformers for Scalable Text-to-Speech without Domain-Specific Factors

FireRedTTS: A Foundation Text-To-Speech Framework for Industry-Level Generative Speech Applications

FocalCodec: Low-Bitrate Speech Coding via Focal Modulation Networks

Privacy against Real-Time Speech Emotion Detection via Acoustic Adversarial Evasion of Machine Learning

LLM can Read Spectrogram: Encoder-free Speech-Language Modeling

From Sounds to Scenes: A Benchmark for Evaluating Context-Aware Auditory Scene Understanding in Large Audio Language Models

Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embedding

NAS-VAD: Neural Architecture Search for Voice Activity Detection

Nonparallel High-Quality Audio Super Resolution with Domain Adaptation and Resampling CycleGANs

AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarios

A Pyramid Recurrent Network for Predicting Crowdsourced Speech-Quality Ratings of Real-World Signals

Cold Diffusion for Speech Enhancement

Evaluating Parameter-Efficient Transfer Learning Approaches on SURE Benchmark for Speech Understanding

Improved Language Identification Through Cross-Lingual Self-Supervised Learning

PromptTTS++: Controlling Speaker Identity in Prompt-Based Text-to-Speech Using Natural Language Descriptions

Mask, Sample, Revise: A Revisable CTMC Inference Stack for Guided Discrete Flow Matching Text-to-Speech

From Generation to Attribution: Music AI Agent Architectures for the Post-Streaming Era

Efficient Streaming LLM for Speech Recognition

SoulX-Podcast: Towards Realistic Long-form Podcasts with Dialectal and Paralinguistic Diversity

AzeroS: Extending LLM to Speech with Self-Generated Instruction-Free Tuning

Audio MultiChallenge: A Multi-Turn Evaluation of Spoken Dialogue Systems on Natural Human Interaction

DiarizationLM: Speaker Diarization Post-Processing with Large Language Models

Modelling Symbolic Music: Beyond the Piano Roll

Music Generation with Deep Learning

NONOTO: A Model-agnostic Web Interface for Interactive Music Composition by Inpainting

NVMOS: Non-Verbal Vocalization Quality Assessment in Speech

Explainable Attribute-Based Speaker Verification

A Transformer-based Audio Captioning Model with Keyword Estimation

CS-YODAS: A Mined Dataset of In-the-Wild Code-Switched Speech

DiffRhythm+: Controllable and Flexible Full-Length Song Generation with Preference Optimization

Spatio-Temporal Audio Language Modeling for Dynamic Sound Sources

In-Context Learning Boosts Speech Recognition via Human-like Adaptation to Speakers and Language Varieties

Can Large Audio Language Models Understand Audio Well? Speech, Scene and Events Understanding Benchmark for LALMs

Generating Synthetic Doctor-Patient Conversations for Long-form Audio Summarization

Multilingual and Multi-Accent Jailbreaking of Audio LLMs

A New Transformer-Based Approach for Audio-Based Kinship Verification and a New Uncontrolled Mandarin Kinship Speech Dataset

DiTAR+: Dual Optimization for Robust Autoregressive Diffusion Speech Synthesis

CRAF: Cross-View Residual-Aware Fusion for Deepfake Speech Detection

Long-form music generation with latent diffusion

Music Understanding LLaMA: Advancing Text-to-Music Generation with Question Answering and Captioning

Vid2speech: Speech Reconstruction from Silent Video

Unsupervised Maneuver-Aware Acoustic Fault Detection for Autonomous Drones

AGAIN-VC: A One-shot Voice Conversion using Activation Guidance and Adaptive Instance Normalization

PhaseGAN: High-Fidelity Vocoder via Decoupled Amplitude and GAN-Driven Phase Reconstruction