Sound

Papers filed under cs.SD on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

1,681 to 1,740 of 1,935

Can we steal your vocal identity from the Internet?: Initial investigation of cloning Obama's voice using GAN, WaveNet and low-quality found data
Jaime Lorenzo-Trueba, Fuming Fang, Xin Wang +3
eess.AScs.CLcs.SDarXiv:1803.00860v12018
A Stem-Agnostic Approach to Hybrid AI Music Detection
Richa Namballa, François Rigaud, Romain Hennequin
cs.SDeess.ASarXiv:2609.26956v12026
On Covert Acoustical Mesh Networks in Air
Michael Hanspach, Michael Goetz
cs.CRcs.NIcs.SDarXiv:1406.1213v12014
Reward-Tilted On-Policy Distillation for Acoustic Grounding in Audio-Language Models
Kaiyang Li, Shaobo Han, Yue Tian +1
cs.SDcs.CLarXiv:2609.28778v12026
Mizar: A 159M-Parameter Audio-Language Model for Audio Understanding
Kaiyang Li, Shaobo Han, Yue Tian +1
cs.SDcs.CLarXiv:2609.28344v12026
AEGIS: Audio Endogenous Guarding via Internal Signals Against Large Audio-Language Model Jailbreaks
Yu-Ling Liao, Tzu-Chin Chiu, Zong-You Chen +2
cs.SDcs.CRarXiv:2609.29287v12026
SpeechDPR: End-to-End Spoken Passage Retrieval for Open-Domain Spoken Question Answering
Chyi-Jiunn Lin, Guan-Ting Lin, Yung-Sung Chuang +5
cs.CLcs.IRcs.SDarXiv:2401.13463v32024
The Vicomtech Audio Deepfake Detection System based on Wav2Vec2 for the 2022 ADD Challenge
Juan M. Martín-Doñas, Aitor Álvarez
eess.AScs.SDarXiv:2203.01573v12022
speechocean762: An Open-Source Non-native English Speech Corpus For Pronunciation Assessment
Junbo Zhang, Zhiwen Zhang, Yongqing Wang +6
cs.CLcs.SDeess.ASarXiv:2104.01378v22021
Passing: An Endless Journey through Reconstructed Spacetime with AI-Generated Sound
Akira Takahashi, Chihiro Nagashima, Zhi Zhong +2
cs.SDcs.AIarXiv:2609.27489v12026
The Second MLC-SLM Challenge: Multilingual Conversational Speech Diarization, Recognition, and Understanding
Bingshen Mu, Mingchen Shao, Zhennan Lin +7
eess.AScs.SDarXiv:2609.27514v12026
Do Audio Representations Compose Additively?
Chenhao Xue, Zhijin Guo, Joyraj Chakraborty +2
cs.SDcs.MMarXiv:2609.27187v12026
Advancing Speech Understanding in Speech-Aware Language Models with GRPO
Avishai Elmakies, Hagai Aronowitz, Nimrod Shabtay +3
cs.CLcs.AIcs.LGarXiv:2509.16990v12025
Attention Based Fully Convolutional Network for Speech Emotion Recognition
Yuanyuan Zhang, Jun Du, Zirui Wang +1
cs.SDcs.LGeess.ASarXiv:1806.01506v22018
The Vulnerability of Neural Audio Watermarks under Speech Enhancement
Xincong Zhong, Shengyao Wang, Lingfeng Yao +4
cs.SDcs.CRarXiv:2609.29040v12026
Voice Evaluation of Reasoning Ability: Diagnosing the Modality-Induced Performance Gap
Yueqian Lin, Zhengmian Hu, Qinsi Wang +6
eess.AScs.MMcs.SDarXiv:2509.26542v12025
To Trust or Not to Trust: Retrieval-Augmented Fact Checking in Speech
Debajyoti Mazumder, Mamta, Abhirama Subramanyam Penamakuri
cs.LGcs.AIcs.CLarXiv:2609.30227v12026
Statistical Models for Automatic Fingering-Annotated Piano Sheet Music Transcription
Daniel Penner, Abram Hindle
cs.SDarXiv:2609.28787v12026
Joint Analysis of Latent Dimensionality and Frame Rate in Continuous Audio Encoders
Kyudan Jung, Sehyun Lee, Son-ha Jo +2
cs.SDarXiv:2609.29780v12026
Spot, Separate, and Enhance: Fully Generative Approach for Audio Mixing
Ilpo Viertola, Giulio Cengarle, Gouthaman KV +2
cs.SDcs.AIarXiv:2609.29169v12026
Libriheavy: a 50,000 hours ASR corpus with punctuation casing and context
Wei Kang, Xiaoyu Yang, Zengwei Yao +5
eess.AScs.SDarXiv:2309.08105v22023
"What's That Sound?": A Versatile, Robust, and Lightweight Convolutional Transformer for Environment Sound Recognition
Julia Huang
cs.SDcs.LGarXiv:2609.27762v12026
FRAUDSkill: Structured Frozen-Weight Skill Optimization for Audio Anti-Fraud Detection
Chengxian Hu, Zhiming Ma, Mingjun Pan +9
cs.SDcs.CLarXiv:2609.18766v32026
SHAS: Approaching optimal Segmentation for End-to-End Speech Translation
Ioannis Tsiamas, Gerard I. Gállego, José A. R. Fonollosa +1
cs.SDcs.CLeess.ASarXiv:2202.04774v32022
Squeezeformer: An Efficient Transformer for Automatic Speech Recognition
Sehoon Kim, Amir Gholami, Albert Shaw +5
eess.AScs.CLcs.SDarXiv:2206.00888v22022
AdaptDuplex: from static to adaptive full-duplex spoken dialogue
Zhiyang Zhou, Yingxin Shang, Zhou Wang +9
cs.SDarXiv:2609.29217v12026
VoxCPM: Tokenizer-Free TTS for Context-Aware Speech Generation and True-to-Life Voice Cloning
Yixuan Zhou, Guoyang Zeng, Xin Liu +9
cs.SDarXiv:2509.24650v12025
SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning
Changan Chen, Carl Schissler, Sanchit Garg +6
cs.SDcs.CVcs.MMarXiv:2206.08312v22022
Audio Self-supervised Learning: A Survey
Shuo Liu, Adria Mallol-Ragolta, Emilia Parada-Cabeleiro +5
cs.SDcs.AIeess.ASarXiv:2203.01205v12022
SCAPES: Semantically Conditioned Autoregressive Prior for Environmental Sounds
Esteban Gutiérrez, Lonce Wyse, Frederic Font +1
cs.SDcs.AIcs.LGarXiv:2609.04634v12026
Enabling Proactive Spoken Turns via a Generalized Style-Aware Full-Duplex Framework
Tianrui Pan, Qinglin Zhang, Chong Deng +6
cs.CLcs.AIcs.SDarXiv:2608.28630v12026
Accurate Plate Reverb Parameter Estimation Using Two-Stage Evolutionary Search
Byunghoo Park, Jayeon Yi, Takyoung Kim +1
eess.AScs.SDeess.SParXiv:2608.28818v12026
Rethinking Speech Codecs: From Compression to Autoregressive Generative Modeling
Yazheng Yang, Yao Qiu, Hui Su +1
eess.AScs.MMcs.SDarXiv:2609.04237v12026
SpeechSense: A Paralinguistic-Focused Dataset for Fine-Grained Speech Sentiment Analysis
Shicheng Ma, Wenqian Cui, Irwin King
cs.CLcs.MMcs.SDarXiv:2608.17931v12026
ToyADMOS: A Dataset of Miniature-Machine Operating Sounds for Anomalous Sound Detection
Yuma Koizumi, Shoichiro Saito, Hisashi Uematsu +2
eess.AScs.LGcs.SDarXiv:1908.03299v12019
Multi-scale Multi-band DenseNets for Audio Source Separation
Naoya Takahashi, Yuki Mitsufuji
cs.SDcs.CLcs.MMarXiv:1706.09588v12017
SingOMD: Singing Oriented Multi-resolution Discrete Representation Construction from Speech Models
Yuxun Tang, Yuning Wu, Jiatong Shi +1
cs.SDeess.ASarXiv:2406.08905v22024
FireRedChat: A Pluggable, Full-Duplex Voice Interaction System with Cascaded and Semi-Cascaded Implementations
Junjie Chen, Yao Hu, Junjie Li +12
cs.SDcs.HCarXiv:2509.06502v12025
CLAP: Learning Audio Concepts From Natural Language Supervision
Benjamin Elizalde, Soham Deshmukh, Mahmoud Al Ismail +1
cs.SDeess.ASarXiv:2206.04769v12022
Augmenting Generative Adversarial Networks for Speech Emotion Recognition
Siddique Latif, Muhammad Asim, Rajib Rana +3
cs.SDeess.ASarXiv:2005.08447v32020
BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec
Detai Xin, Xu Tan, Shinnosuke Takamichi +1
eess.AScs.SDarXiv:2409.05377v12024
SyncSpeech: Efficient and Low-Latency Text-to-Speech based on Temporal Masked Transformer
Zhengyan Sheng, Zhihao Du, Shiliang Zhang +2
cs.SDcs.AIarXiv:2502.11094v22025
AdaDurIAN: Few-shot Adaptation for Neural Text-to-Speech with DurIAN
Zewang Zhang, Qiao Tian, Heng Lu +2
cs.SDcs.CLeess.ASarXiv:2005.05642v12020
Robust Sequence-to-Sequence Acoustic Modeling with Stepwise Monotonic Attention for Neural TTS
Mutian He, Yan Deng, Lei He
cs.CLcs.LGcs.SDarXiv:1906.00672v32019
Masked Spectrogram Modeling using Masked Autoencoders for Learning General-purpose Audio Representation
Daisuke Niizumi, Daiki Takeuchi, Yasunori Ohishi +2
eess.AScs.SDarXiv:2204.12260v12022
Taming Data and Transformers for Audio Generation
Moayed Haji-Ali, Willi Menapace, Aliaksandr Siarohin +2
cs.SDcs.CLcs.CVarXiv:2406.19388v42024
Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training
Dading Chong, Helin Wang, Peilin Zhou +1
cs.SDeess.ASarXiv:2204.12768v12022
Sketch2Sound: Controllable Audio Generation via Time-Varying Signals and Sonic Imitations
Hugo Flores García, Oriol Nieto, Justin Salamon +2
cs.SDeess.ASarXiv:2412.08550v22024
MAE-AST: Masked Autoencoding Audio Spectrogram Transformer
Alan Baade, Puyuan Peng, David Harwath
eess.AScs.AIcs.CLarXiv:2203.16691v12022
Generating Visually Aligned Sound from Videos
Peihao Chen, Yang Zhang, Mingkui Tan +3
cs.CVcs.SDeess.ASarXiv:2008.00820v12020
Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generation
Jinlong Xue, Yayue Deng, Yingming Gao +1
cs.SDcs.AIcs.CLarXiv:2401.01044v12024
Time Domain Neural Audio Style Transfer
Parag K. Mital
cs.SDarXiv:1711.11160v12017
Music generation with variational recurrent autoencoder supported by history
Ivan P. Yamshchikov, Alexey Tikhonov
cs.SDarXiv:1705.05458v42017
HunyuanVideo-Foley: Multimodal Diffusion with Representation Alignment for High-Fidelity Foley Audio Generation
Sizhe Shan, Qiulin Li, Yutao Cui +5
eess.AScs.CVcs.SDarXiv:2508.16930v12025
Summary on The Multilingual Conversational Speech Language Model Challenge: Datasets, Tasks, Baselines, and Methods
Bingshen Mu, Pengcheng Guo, Zhaokai Sun +8
eess.AScs.SDarXiv:2509.13785v12025
When Creators Meet the Metaverse: A Survey on Computational Arts
Lik-Hang Lee, Zijun Lin, Rui Hu +5
cs.CYcs.AIcs.LGarXiv:2111.13486v12021
Seed-ASR: Understanding Diverse Speech and Contexts with LLM-based Speech Recognition
Ye Bai, Jingping Chen, Jitong Chen +52
eess.AScs.SDarXiv:2407.04675v22024
JALMBench: Benchmarking Jailbreak Vulnerabilities in Audio Language Models
Zifan Peng, Yule Liu, Zhen Sun +9
cs.CRcs.AIcs.SDarXiv:2505.17568v32025
Decoupling Magnitude and Phase Estimation with Deep ResUNet for Music Source Separation
Qiuqiang Kong, Yin Cao, Haohe Liu +2
cs.SDeess.ASarXiv:2109.05418v12021
Training Neural Speech Recognition Systems with Synthetic Speech Augmentation
Jason Li, Ravi Gadde, Boris Ginsburg +1
cs.CLcs.LGcs.SDarXiv:1811.00707v12018

Sound

Can we steal your vocal identity from the Internet?: Initial investigation of cloning Obama's voice using GAN, WaveNet and low-quality found data

A Stem-Agnostic Approach to Hybrid AI Music Detection

On Covert Acoustical Mesh Networks in Air

Reward-Tilted On-Policy Distillation for Acoustic Grounding in Audio-Language Models

Mizar: A 159M-Parameter Audio-Language Model for Audio Understanding

AEGIS: Audio Endogenous Guarding via Internal Signals Against Large Audio-Language Model Jailbreaks

SpeechDPR: End-to-End Spoken Passage Retrieval for Open-Domain Spoken Question Answering

The Vicomtech Audio Deepfake Detection System based on Wav2Vec2 for the 2022 ADD Challenge

speechocean762: An Open-Source Non-native English Speech Corpus For Pronunciation Assessment

Passing: An Endless Journey through Reconstructed Spacetime with AI-Generated Sound

The Second MLC-SLM Challenge: Multilingual Conversational Speech Diarization, Recognition, and Understanding

Do Audio Representations Compose Additively?

Advancing Speech Understanding in Speech-Aware Language Models with GRPO

Attention Based Fully Convolutional Network for Speech Emotion Recognition

The Vulnerability of Neural Audio Watermarks under Speech Enhancement

Voice Evaluation of Reasoning Ability: Diagnosing the Modality-Induced Performance Gap

To Trust or Not to Trust: Retrieval-Augmented Fact Checking in Speech

Statistical Models for Automatic Fingering-Annotated Piano Sheet Music Transcription

Joint Analysis of Latent Dimensionality and Frame Rate in Continuous Audio Encoders

Spot, Separate, and Enhance: Fully Generative Approach for Audio Mixing

Libriheavy: a 50,000 hours ASR corpus with punctuation casing and context

"What's That Sound?": A Versatile, Robust, and Lightweight Convolutional Transformer for Environment Sound Recognition

FRAUDSkill: Structured Frozen-Weight Skill Optimization for Audio Anti-Fraud Detection

SHAS: Approaching optimal Segmentation for End-to-End Speech Translation

Squeezeformer: An Efficient Transformer for Automatic Speech Recognition

AdaptDuplex: from static to adaptive full-duplex spoken dialogue

VoxCPM: Tokenizer-Free TTS for Context-Aware Speech Generation and True-to-Life Voice Cloning

SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning

Audio Self-supervised Learning: A Survey

SCAPES: Semantically Conditioned Autoregressive Prior for Environmental Sounds

Enabling Proactive Spoken Turns via a Generalized Style-Aware Full-Duplex Framework

Accurate Plate Reverb Parameter Estimation Using Two-Stage Evolutionary Search

Rethinking Speech Codecs: From Compression to Autoregressive Generative Modeling

SpeechSense: A Paralinguistic-Focused Dataset for Fine-Grained Speech Sentiment Analysis

ToyADMOS: A Dataset of Miniature-Machine Operating Sounds for Anomalous Sound Detection

Multi-scale Multi-band DenseNets for Audio Source Separation

SingOMD: Singing Oriented Multi-resolution Discrete Representation Construction from Speech Models

FireRedChat: A Pluggable, Full-Duplex Voice Interaction System with Cascaded and Semi-Cascaded Implementations

CLAP: Learning Audio Concepts From Natural Language Supervision

Augmenting Generative Adversarial Networks for Speech Emotion Recognition

BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec

SyncSpeech: Efficient and Low-Latency Text-to-Speech based on Temporal Masked Transformer

AdaDurIAN: Few-shot Adaptation for Neural Text-to-Speech with DurIAN

Robust Sequence-to-Sequence Acoustic Modeling with Stepwise Monotonic Attention for Neural TTS

Masked Spectrogram Modeling using Masked Autoencoders for Learning General-purpose Audio Representation

Taming Data and Transformers for Audio Generation

Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training

Sketch2Sound: Controllable Audio Generation via Time-Varying Signals and Sonic Imitations

MAE-AST: Masked Autoencoding Audio Spectrogram Transformer

Generating Visually Aligned Sound from Videos

Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generation

Time Domain Neural Audio Style Transfer

Music generation with variational recurrent autoencoder supported by history

HunyuanVideo-Foley: Multimodal Diffusion with Representation Alignment for High-Fidelity Foley Audio Generation

Summary on The Multilingual Conversational Speech Language Model Challenge: Datasets, Tasks, Baselines, and Methods

When Creators Meet the Metaverse: A Survey on Computational Arts

Seed-ASR: Understanding Diverse Speech and Contexts with LLM-based Speech Recognition

JALMBench: Benchmarking Jailbreak Vulnerabilities in Audio Language Models

Decoupling Magnitude and Phase Estimation with Deep ResUNet for Music Source Separation

Training Neural Speech Recognition Systems with Synthetic Speech Augmentation