Sound

Papers filed under cs.SD on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

1,801 to 1,860 of 1,947

SoundStorm: Efficient Parallel Audio Generation
Zalán Borsos, Matt Sharifi, Damien Vincent +3
cs.SDcs.LGeess.ASarXiv:2305.09636v12023
A Comparison of Discrete and Soft Speech Units for Improved Voice Conversion
Benjamin van Niekerk, Marc-André Carbonneau, Julian Zaïdi +3
eess.AScs.SDarXiv:2111.02392v22021
Broadcasted Residual Learning for Efficient Keyword Spotting
Byeonggeun Kim, Simyung Chang, Jinkyu Lee +1
cs.SDcs.LGeess.ASarXiv:2106.04140v42021
A Comparison of Techniques for Language Model Integration in Encoder-Decoder Speech Recognition
Shubham Toshniwal, Anjuli Kannan, Chung-Cheng Chiu +3
eess.AScs.AIcs.CLarXiv:1807.10857v22018
TitaNet: Neural Model for speaker representation with 1D Depth-wise separable convolutions and global context
Nithin Rao Koluguri, Taejin Park, Boris Ginsburg
eess.AScs.SDarXiv:2110.04410v12021
StrixAE: An Intelligent Agent for Audio Enhancement under Complex Distortion Coupling in Real-World Scenarios
Chenglin Wu, Junjie Wu, Jinhang Chen +5
cs.SDcs.AIarXiv:2609.03414v12026
Music Generation by Deep Learning - Challenges and Directions
Jean-Pierre Briot, François Pachet
cs.SDcs.LGeess.ASarXiv:1712.04371v22017
A Comprehensive Survey of Hallucination in Large Language, Image, Video and Audio Foundation Models
Pranab Sahoo, Prabhash Meharia, Akash Ghosh +3
cs.LGcs.AIcs.CLarXiv:2405.09589v42024
Very Deep Self-Attention Networks for End-to-End Speech Recognition
Ngoc-Quan Pham, Thai-Son Nguyen, Jan Niehues +3
cs.CLcs.LGcs.SDarXiv:1904.13377v22019
Massively Multilingual ASR: 50 Languages, 1 Model, 1 Billion Parameters
Vineel Pratap, Anuroop Sriram, Paden Tomasello +4
eess.AScs.CLcs.SDarXiv:2007.03001v22020
Beyond SDR: How Music Source Separation Reshapes Rhythm-Relevant Signal Properties
Chuxin Ding
cs.SDeess.ASarXiv:2609.04224v12026
Audio Spectrogram Representations for Processing with Convolutional Neural Networks
L. Wyse
cs.SDcs.LGcs.MMarXiv:1706.09559v12017
Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM
Xiong Wang, Yangze Li, Chaoyou Fu +5
cs.SDcs.AIcs.CLarXiv:2411.00774v52024
TidyVoice: A Curated Multilingual Dataset for Speaker Verification Derived from Common Voice
Aref Farhadipour, Jan Marquenie, Srikanth Madikeri +1
eess.AScs.SDarXiv:2601.16358v12026
Global birdsong embeddings enable superior transfer learning for bioacoustic classification
Burooj Ghani, Tom Denton, Stefan Kahl +1
eess.AScs.SDarXiv:2307.06292v22023
Omni2Sound: Towards Unified Video-Text-to-Audio Generation
Yusheng Dai, Zehua Chen, Yuxuan Jiang +4
cs.SDcs.CVcs.MMarXiv:2601.02731v32026
Anomalous sound detection based on interpolation deep neural network
Kaori Suefusa, Tomoya Nishida, Harsh Purohit +3
eess.AScs.LGcs.SDarXiv:2005.09234v12020
Neural Multichannel Distant Speaker Diarization and Source Separation with Beta Speaker Activity Prior
Sicheng Mao, Mathieu Fontaine, Anthony Larcher +1
cs.SDarXiv:2608.28661v12026
Ouroboros: Self-Referential Backdoor Attacks on Speech Enhancement via Clean Audio Triggers
Yunjie Zhou, Yuheng Huang, Diqun Yan
cs.SDcs.CRarXiv:2608.30329v12026
ASSERT: Anti-Spoofing with Squeeze-Excitation and Residual neTworks
Cheng-I Lai, Nanxin Chen, Jesús Villalba +1
cs.CLcs.LGcs.SDarXiv:1904.01120v12019
Evoking Harmony via Convolution
Michael Gogins
cs.SDarXiv:2608.28851v12026
MFA-Conformer: Multi-scale Feature Aggregation Conformer for Automatic Speaker Verification
Yang Zhang, Zhiqiang Lv, Haibin Wu +5
cs.SDeess.ASarXiv:2203.15249v22022
ImageBind-LLM: Multi-modality Instruction Tuning
Jiaming Han, Renrui Zhang, Wenqi Shao +14
cs.MMcs.CLcs.CVarXiv:2309.03905v22023
Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
Simian Luo, Chuanhao Yan, Chenxu Hu +1
cs.SDcs.CVcs.LGarXiv:2306.17203v12023
TristouNet: Triplet Loss for Speaker Turn Embedding
Hervé Bredin
cs.SDstat.MLarXiv:1609.04301v32016
What Are You Listening to? Temporal Music Grounding for Audio-to-Text Large Language Models
Kun Fang, Ziyu Wang, Ichiro Fujinaga
cs.SDcs.IRarXiv:2608.29480v12026
Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics
Siddhant Arora, Zhiyun Lu, Chung-Cheng Chiu +2
cs.CLcs.SDeess.ASarXiv:2503.01174v12025
Exploring Wav2vec 2.0 fine-tuning for improved speech emotion recognition
Li-Wei Chen, Alexander Rudnicky
eess.AScs.CLcs.LGarXiv:2110.06309v32021
Generative Pre-Training for Speech with Autoregressive Predictive Coding
Yu-An Chung, James Glass
eess.AScs.CLcs.LGarXiv:1910.12607v22019
VQMIVC: Vector Quantization and Mutual Information-Based Unsupervised Speech Representation Disentanglement for One-shot Voice Conversion
Disong Wang, Liqun Deng, Yu Ting Yeung +3
eess.AScs.CLcs.MMarXiv:2106.10132v12021
MiniMax-Speech: Intrinsic Zero-Shot Text-to-Speech with a Learnable Speaker Encoder
Bowen Zhang, Congchao Guo, Geng Yang +17
eess.AScs.SDarXiv:2505.07916v12025
LibriTTS-R: A Restored Multi-Speaker Text-to-Speech Corpus
Yuma Koizumi, Heiga Zen, Shigeki Karita +7
eess.AScs.SDarXiv:2305.18802v12023
A Unified Uncertainty-Aware Back-End for Speaker Verification: Scoring, Normalization, and Calibration
Junjie Li, Kong Aik Lee
cs.SDarXiv:2609.01221v12026
End-to-end learning for music audio tagging at scale
Jordi Pons, Oriol Nieto, Matthew Prockup +3
cs.SDeess.ASarXiv:1711.02520v42017
Temporal Convolution for Real-time Keyword Spotting on Mobile Devices
Seungwoo Choi, Seokjun Seo, Beomjun Shin +5
cs.SDcs.LGcs.NEarXiv:1904.03814v22019
Ola: Pushing the Frontiers of Omni-Modal Language Model
Zuyan Liu, Yuhao Dong, Jiahui Wang +4
cs.CVcs.CLcs.MMarXiv:2502.04328v32025
Improved Speech Enhancement with the Wave-U-Net
Craig Macartney, Tillman Weyde
cs.SDcs.LGcs.NEarXiv:1811.11307v12018
SPHERE: Automatic Music Upmixing via Audio Language Model Post-Training with Spatial Heuristic Rewards
Zixun Guo, Calvin Murdock, Sanjeel Parekh +4
cs.SDarXiv:2608.30559v12026
Understanding Automatic Mixing: A Subtask-Oriented Analysis of Two-Stage Mixing System
Jinjie Shi, Wei Hua, Kunzhu Xie +3
cs.SDeess.SParXiv:2609.02835v12026
On The Landscape of Spoken Language Models: A Comprehensive Survey
Siddhant Arora, Kai-Wei Chang, Chung-Ming Chien +7
cs.CLcs.SDeess.ASarXiv:2504.08528v22025
LASE: Language-Adversarial Speaker Encoding for Indic Cross-Script Identity Preservation
Venkata Pushpak Teja Menta
cs.SDcs.CLeess.ASarXiv:2605.00777v12026
Deep Neural Network for Respiratory Sound Classification in Wearable Devices Enabled by Patient Specific Model Tuning
Jyotibdha Acharya, Arindam Basu
eess.AScs.LGcs.SDarXiv:2004.08287v12020
Hybrid Spectrogram and Waveform Source Separation
Alexandre Défossez
eess.AScs.SDstat.MLarXiv:2111.03600v32021
Entropy as a Structural Prior: How a Log-Barrier on DiT Belief Space Drives Musical Diversity and Development
Zixi Li, Youzhen Li
cs.SDcs.LGeess.ASarXiv:2606.07207v12026
Music Source Separation with Band-split RNN
Yi Luo, Jianwei Yu
eess.AScs.LGcs.SDarXiv:2209.15174v12022
Personalized Speech recognition on mobile devices
Ian McGraw, Rohit Prabhavalkar, Raziel Alvarez +8
cs.CLcs.LGcs.SDarXiv:1603.03185v22016
Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Sound
Andros Tjandra, Yi-Chiao Wu, Baishan Guo +10
cs.SDcs.LGeess.ASarXiv:2502.05139v12025
TUTTI: Toward generalizable audio-to-score transcription via fully synthesized data
Jianhuai Hu, Yashan Wang, Shangda Wu +7
cs.SDcs.AIarXiv:2609.00640v12026
LEAF: A Learnable Frontend for Audio Classification
Neil Zeghidour, Olivier Teboul, Félix de Chaumont Quitry +1
cs.SDcs.LGeess.ASarXiv:2101.08596v12021
Exploring Speech Enhancement with Generative Adversarial Networks for Robust Speech Recognition
Chris Donahue, Bo Li, Rohit Prabhavalkar
cs.SDcs.LGcs.NEarXiv:1711.05747v22017
UniSwap: Streaming Audio-Visual Identity Swapping for Talking Videos
Yuxuan Zhang, Haozhong Xiong, Jiayi Song +5
cs.CVcs.SDarXiv:2608.11752v22026
CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-training
Zhihao Du, Changfeng Gao, Yuxuan Wang +19
cs.SDcs.AIeess.ASarXiv:2505.17589v22025
SoundStream: An End-to-End Neural Audio Codec
Neil Zeghidour, Alejandro Luebs, Ahmed Omran +2
cs.SDcs.LGeess.ASarXiv:2107.03312v12021
A Comparison of Five Multiple Instance Learning Pooling Functions for Sound Event Detection with Weak Labeling
Yun Wang, Juncheng Li, Florian Metze
cs.SDeess.ASarXiv:1810.09050v32018
Cleaner Speech, Weaker Generalization: Revisiting Pitt-Derived Benchmarks for Alzheimer's Disease Detection
Luqi Sun, Shreeram Suresh Chandra, Lin Zhang +5
cs.SDcs.AIarXiv:2609.00276v12026
Deep Neural Networks for Multiple Speaker Detection and Localization
Weipeng He, Petr Motlicek, Jean-Marc Odobez
cs.SDcs.AIcs.MMarXiv:1711.11565v32017
Spot the conversation: speaker diarisation in the wild
Joon Son Chung, Jaesung Huh, Arsha Nagrani +2
cs.SDcs.CVeess.ASarXiv:2007.01216v32020
Qwen2.5-Omni Technical Report
Jin Xu, Zhifang Guo, Jinzheng He +11
cs.CLcs.CVcs.SDarXiv:2503.20215v12025
Interspeech 2021 Deep Noise Suppression Challenge
Chandan K A Reddy, Harishchandra Dubey, Kazuhito Koishida +7
cs.SDcs.LGeess.ASarXiv:2101.01902v32021
VoiceBench: Benchmarking LLM-Based Voice Assistants
Yiming Chen, Xianghu Yue, Chen Zhang +3
cs.CLcs.AIcs.SDarXiv:2410.17196v32024

Sound

SoundStorm: Efficient Parallel Audio Generation

A Comparison of Discrete and Soft Speech Units for Improved Voice Conversion

Broadcasted Residual Learning for Efficient Keyword Spotting

A Comparison of Techniques for Language Model Integration in Encoder-Decoder Speech Recognition

TitaNet: Neural Model for speaker representation with 1D Depth-wise separable convolutions and global context

StrixAE: An Intelligent Agent for Audio Enhancement under Complex Distortion Coupling in Real-World Scenarios

Music Generation by Deep Learning - Challenges and Directions

A Comprehensive Survey of Hallucination in Large Language, Image, Video and Audio Foundation Models

Very Deep Self-Attention Networks for End-to-End Speech Recognition

Massively Multilingual ASR: 50 Languages, 1 Model, 1 Billion Parameters

Beyond SDR: How Music Source Separation Reshapes Rhythm-Relevant Signal Properties

Audio Spectrogram Representations for Processing with Convolutional Neural Networks

Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM

TidyVoice: A Curated Multilingual Dataset for Speaker Verification Derived from Common Voice

Global birdsong embeddings enable superior transfer learning for bioacoustic classification

Omni2Sound: Towards Unified Video-Text-to-Audio Generation

Anomalous sound detection based on interpolation deep neural network

Neural Multichannel Distant Speaker Diarization and Source Separation with Beta Speaker Activity Prior

Ouroboros: Self-Referential Backdoor Attacks on Speech Enhancement via Clean Audio Triggers

ASSERT: Anti-Spoofing with Squeeze-Excitation and Residual neTworks

Evoking Harmony via Convolution

MFA-Conformer: Multi-scale Feature Aggregation Conformer for Automatic Speaker Verification

ImageBind-LLM: Multi-modality Instruction Tuning

Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models

TristouNet: Triplet Loss for Speaker Turn Embedding

What Are You Listening to? Temporal Music Grounding for Audio-to-Text Large Language Models

Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics

Exploring Wav2vec 2.0 fine-tuning for improved speech emotion recognition

Generative Pre-Training for Speech with Autoregressive Predictive Coding

VQMIVC: Vector Quantization and Mutual Information-Based Unsupervised Speech Representation Disentanglement for One-shot Voice Conversion

MiniMax-Speech: Intrinsic Zero-Shot Text-to-Speech with a Learnable Speaker Encoder

LibriTTS-R: A Restored Multi-Speaker Text-to-Speech Corpus

A Unified Uncertainty-Aware Back-End for Speaker Verification: Scoring, Normalization, and Calibration

End-to-end learning for music audio tagging at scale

Temporal Convolution for Real-time Keyword Spotting on Mobile Devices

Ola: Pushing the Frontiers of Omni-Modal Language Model

Improved Speech Enhancement with the Wave-U-Net

SPHERE: Automatic Music Upmixing via Audio Language Model Post-Training with Spatial Heuristic Rewards

Understanding Automatic Mixing: A Subtask-Oriented Analysis of Two-Stage Mixing System

On The Landscape of Spoken Language Models: A Comprehensive Survey

LASE: Language-Adversarial Speaker Encoding for Indic Cross-Script Identity Preservation

Deep Neural Network for Respiratory Sound Classification in Wearable Devices Enabled by Patient Specific Model Tuning

Hybrid Spectrogram and Waveform Source Separation

Entropy as a Structural Prior: How a Log-Barrier on DiT Belief Space Drives Musical Diversity and Development

Music Source Separation with Band-split RNN

Personalized Speech recognition on mobile devices

Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Sound

TUTTI: Toward generalizable audio-to-score transcription via fully synthesized data

LEAF: A Learnable Frontend for Audio Classification

Exploring Speech Enhancement with Generative Adversarial Networks for Robust Speech Recognition

UniSwap: Streaming Audio-Visual Identity Swapping for Talking Videos

CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-training

SoundStream: An End-to-End Neural Audio Codec

A Comparison of Five Multiple Instance Learning Pooling Functions for Sound Event Detection with Weak Labeling

Cleaner Speech, Weaker Generalization: Revisiting Pitt-Derived Benchmarks for Alzheimer's Disease Detection

Deep Neural Networks for Multiple Speaker Detection and Localization

Spot the conversation: speaker diarisation in the wild

Qwen2.5-Omni Technical Report

Interspeech 2021 Deep Noise Suppression Challenge

VoiceBench: Benchmarking LLM-Based Voice Assistants