Sound

Papers filed under cs.SD on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

1,561 to 1,620 of 1,947

Llasa: Scaling Train-Time and Inference-Time Compute for Llama-based Speech Synthesis
Zhen Ye, Xinfa Zhu, Chi-Min Chan +17
eess.AScs.AIcs.CLarXiv:2502.04128v22025
Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model
Ziyang Ma, Zhuo Chen, Yuping Wang +2
cs.SDcs.CLcs.MMarXiv:2501.07246v12025
Wespeaker: A Research and Production oriented Speaker Embedding Learning Toolkit
Hongji Wang, Chengdong Liang, Shuai Wang +5
cs.SDeess.ASarXiv:2210.17016v22022
Comparative layer-wise analysis of self-supervised speech models
Ankita Pasad, Bowen Shi, Karen Livescu
cs.CLcs.LGcs.SDarXiv:2211.03929v32022
Can Large Language Models Aid in Annotating Speech Emotional Data? Uncovering New Frontiers
Siddique Latif, Muhammad Usama, Mohammad Ibrahim Malik +1
cs.SDeess.ASarXiv:2307.06090v32023
AudioGen: Textually Guided Audio Generation
Felix Kreuk, Gabriel Synnaeve, Adam Polyak +6
cs.SDcs.CLcs.LGarXiv:2209.15352v22022
ADD 2023: the Second Audio Deepfake Detection Challenge
Jiangyan Yi, Jianhua Tao, Ruibo Fu +15
cs.SDeess.ASarXiv:2305.13774v12023
Fast Conformer with Linearly Scalable Attention for Efficient Speech Recognition
Dima Rekesh, Nithin Rao Koluguri, Samuel Kriman +8
eess.AScs.SDarXiv:2305.05084v62023
Zipformer: A faster and better encoder for automatic speech recognition
Zengwei Yao, Liyong Guo, Xiaoyu Yang +6
eess.AScs.LGcs.SDarXiv:2310.11230v42023
Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labels
Pingchuan Ma, Alexandros Haliassos, Adriana Fernandez-Lopez +3
cs.CVcs.SDeess.ASarXiv:2303.14307v32023
ECHO: Dyadic 3D Facial Motion Generation with Asymmetric Deterministic Articulation and Stochastic Reaction
Zhuoqiang Cai, Yujie Sun, Chaoyue Niu +4
cs.GRcs.CVcs.SDarXiv:2609.05506v12026
Robust Speech Recognition via Large-Scale Weak Supervision
Alec Radford, Jong Wook Kim, Tao Xu +3
eess.AScs.CLcs.LGarXiv:2212.04356v12022
Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models
Rongjie Huang, Jiawei Huang, Dongchao Yang +7
cs.SDcs.LGcs.MMarXiv:2301.12661v12023
The Benefit Of Temporally-Strong Labels In Audio Event Classification
Shawn Hershey, Daniel P W Ellis, Eduardo Fonseca +4
cs.SDeess.ASarXiv:2105.07031v12021
Dawn of the transformer era in speech emotion recognition: closing the valence gap
Johannes Wagner, Andreas Triantafyllopoulos, Hagen Wierstorf +4
eess.AScs.LGcs.SDarXiv:2203.07378v42022
ADD 2022: the First Audio Deep Synthesis Detection Challenge
Jiangyan Yi, Ruibo Fu, Jianhua Tao +17
cs.SDcs.LGeess.ASarXiv:2202.08433v32022
Automatic Depression Detection: An Emotional Audio-Textual Corpus and a GRU/BiLSTM-based Model
Ying Shen, Huiyu Yang, Lin Lin
eess.AScs.AIcs.SDarXiv:2202.08210v12022
DNSMOS P.835: A Non-Intrusive Perceptual Objective Speech Quality Metric to Evaluate Noise Suppressors
Chandan K A Reddy, Vishak Gopal, Ross Cutler
eess.AScs.SDarXiv:2110.01763v42021
Summaries:한국어
Speech Emotion Recognition using Self-Supervised Features
Edmilson Morais, Ron Hoory, Weizhong Zhu +3
cs.SDcs.AIcs.LGarXiv:2202.03896v12022
FLEURS: Few-shot Learning Evaluation of Universal Representations of Speech
Alexis Conneau, Min Ma, Simran Khanuja +6
cs.CLcs.LGcs.SDarXiv:2205.12446v12022
Everything at Once -- Multi-modal Fusion Transformer for Video Retrieval
Nina Shvetsova, Brian Chen, Andrew Rouditchenko +6
cs.CVcs.CLcs.SDarXiv:2112.04446v22021
Does Audio Deepfake Detection Generalize?
Nicolas M. Müller, Pavel Czempin, Franziska Dieckmann +2
cs.SDcs.LGeess.ASarXiv:2203.16263v52022
Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesis
Yu Wang, Xinsheng Wang, Pengcheng Zhu +6
cs.SDcs.DBeess.ASarXiv:2201.07429v22022
Multi-band MelGAN: Faster Waveform Generation for High-Quality Text-to-Speech
Geng Yang, Shan Yang, Kai Liu +3
cs.SDeess.ASarXiv:2005.05106v22020
TorchAudio: Building Blocks for Audio and Speech Processing
Yao-Yuan Yang, Moto Hira, Zhaoheng Ni +20
eess.AScs.SDarXiv:2110.15018v22021
WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognition
Binbin Zhang, Hang Lv, Pengcheng Guo +9
cs.SDcs.CLarXiv:2110.03370v52021
Wav2CLIP: Learning Robust Audio Representations From CLIP
Ho-Hsiang Wu, Prem Seetharaman, Kundan Kumar +1
cs.SDcs.LGeess.ASarXiv:2110.11499v22021
AST: Audio Spectrogram Transformer
Yuan Gong, Yu-An Chung, James Glass
cs.SDcs.AIarXiv:2104.01778v32021
UnivNet: A Neural Vocoder with Multi-Resolution Spectrogram Discriminators for High-Fidelity Waveform Generation
Won Jang, Dan Lim, Jaesam Yoon +2
eess.AScs.SDarXiv:2106.07889v12021
Multi-task self-supervised learning for Robust Speech Recognition
Mirco Ravanelli, Jianyuan Zhong, Santiago Pascual +4
eess.AScs.CLcs.LGarXiv:2001.09239v22020
PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognition
Qiuqiang Kong, Yin Cao, Turab Iqbal +3
cs.SDeess.ASarXiv:1912.10211v52019
SEP-28k: A Dataset for Stuttering Event Detection From Podcasts With People Who Stutter
Colin Lea, Vikramjit Mitra, Aparna Joshi +2
eess.AScs.SDarXiv:2102.12394v12021
Emotion Recognition from Speech Using Wav2vec 2.0 Embeddings
Leonardo Pepino, Pablo Riera, Luciana Ferrer
cs.SDcs.LGeess.ASarXiv:2104.03502v12021
Using IPA-Based Tacotron for Data Efficient Cross-Lingual Speaker Adaptation and Pronunciation Enhancement
Hamed Hemati, Damian Borth
cs.SDcs.LGeess.ASarXiv:2011.06392v22020
VisualVoice: Audio-Visual Speech Separation with Cross-Modal Consistency
Ruohan Gao, Kristen Grauman
cs.CVcs.SDeess.IVarXiv:2101.03149v22021
AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselines
Yao Shi, Hui Bu, Xin Xu +2
cs.SDeess.ASarXiv:2010.11567v22020
Contrastive Learning of General-Purpose Audio Representations
Aaqib Saeed, David Grangier, Neil Zeghidour
cs.SDcs.LGeess.ASarXiv:2010.10915v12020
BiMamba2 Masked Discrete-Unit Prediction for Multilingual Speech Representation for Unsupervised Speech in the Wild Challenge
Prakriti Subedi, Howard Prioleau, Saurav K Aryal
cs.SDcs.CLarXiv:2609.28758v12026
Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantity
Ethan Manilow, Gordon Wichern, Prem Seetharaman +1
cs.SDcs.LGeess.ASarXiv:1909.08494v12019
DiffWave: A Versatile Diffusion Model for Audio Synthesis
Zhifeng Kong, Wei Ping, Jiaji Huang +2
eess.AScs.CLcs.LGarXiv:2009.09761v32020
Exploring wav2vec 2.0 on speaker verification and language identification
Zhiyun Fan, Meng Li, Shiyu Zhou +1
cs.SDcs.CLeess.ASarXiv:2012.06185v22020
Unified Mandarin TTS Front-end Based on Distilled BERT Model
Yang Zhang, Liqun Deng, Yasheng Wang
cs.SDcs.CLarXiv:2012.15404v12020
One-class Learning Towards Synthetic Voice Spoofing Detection
You Zhang, Fei Jiang, Zhiyao Duan
eess.AScs.SDarXiv:2010.13995v22020
Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis
K R Prajwal, Rudrabha Mukhopadhyay, Vinay Namboodiri +1
cs.CVcs.LGcs.SDarXiv:2005.08209v12020
LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speech
Heiga Zen, Viet Dang, Rob Clark +5
cs.SDeess.ASarXiv:1904.02882v12019
Decentralizing Feature Extraction with Quantum Convolutional Neural Network for Automatic Speech Recognition
Chao-Han Huck Yang, Jun Qi, Samuel Yen-Chi Chen +4
cs.SDcs.LGcs.NEarXiv:2010.13309v22020
Clova Baseline System for the VoxCeleb Speaker Recognition Challenge 2020
Hee Soo Heo, Bong-Jin Lee, Jaesung Huh +1
eess.AScs.SDarXiv:2009.14153v12020
Voice Conversion Challenge 2020: Intra-lingual semi-parallel and cross-lingual voice conversion
Yi Zhao, Wen-Chin Huang, Xiaohai Tian +5
eess.AScs.SDarXiv:2008.12527v12020
Real Time Speech Enhancement in the Waveform Domain
Alexandre Defossez, Gabriel Synnaeve, Yossi Adi
eess.AScs.LGcs.SDarXiv:2006.12847v32020
HiFi-GAN: High-Fidelity Denoising and Dereverberation Based on Speech Deep Features in Adversarial Networks
Jiaqi Su, Zeyu Jin, Adam Finkelstein
eess.AScs.LGcs.SDarXiv:2006.05694v22020
Unsupervised Cross-lingual Representation Learning for Speech Recognition
Alexis Conneau, Alexei Baevski, Ronan Collobert +2
cs.CLcs.LGcs.SDarXiv:2006.13979v22020
Transformer Transducer: A Streamable Speech Recognition Model with Transformer Encoders and RNN-T Loss
Qian Zhang, Han Lu, Hasim Sak +4
eess.AScs.CLcs.SDarXiv:2002.02562v22020
ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verification
Brecht Desplanques, Jenthe Thienpondt, Kris Demuynck
eess.AScs.SDarXiv:2005.07143v32020
Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation
Po-Han Chi, Pei-Hung Chung, Tsung-Han Wu +4
eess.AScs.CLcs.SDarXiv:2005.08575v52020
VGGSound: A Large-scale Audio-Visual Dataset
Honglie Chen, Weidi Xie, Andrea Vedaldi +1
cs.CVcs.SDeess.ASarXiv:2004.14368v22020
Conformer: Convolution-augmented Transformer for Speech Recognition
Anmol Gulati, James Qin, Chung-Cheng Chiu +8
eess.AScs.LGcs.SDarXiv:2005.08100v12020
Deep Contextualized Acoustic Representations For Semi-Supervised Speech Recognition
Shaoshi Ling, Yuzong Liu, Julian Salazar +1
eess.AScs.CLcs.LGarXiv:1912.01679v22019
Coswara -- A Database of Breathing, Cough, and Voice Sounds for COVID-19 Diagnosis
Neeraj Sharma, Prashant Krishnan, Rohit Kumar +5
eess.AScs.SDarXiv:2005.10548v22020
End-to-end Microphone Permutation and Number Invariant Multi-channel Speech Separation
Yi Luo, Zhuo Chen, Nima Mesgarani +1
eess.AScs.LGcs.SDarXiv:1910.14104v32019
Speaker Recognition from Raw Waveform with SincNet
Mirco Ravanelli, Yoshua Bengio
eess.AScs.LGcs.SDarXiv:1808.00158v32018

Sound

Llasa: Scaling Train-Time and Inference-Time Compute for Llama-based Speech Synthesis

Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model

Wespeaker: A Research and Production oriented Speaker Embedding Learning Toolkit

Comparative layer-wise analysis of self-supervised speech models

Can Large Language Models Aid in Annotating Speech Emotional Data? Uncovering New Frontiers

AudioGen: Textually Guided Audio Generation

ADD 2023: the Second Audio Deepfake Detection Challenge

Fast Conformer with Linearly Scalable Attention for Efficient Speech Recognition

Zipformer: A faster and better encoder for automatic speech recognition

Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labels

ECHO: Dyadic 3D Facial Motion Generation with Asymmetric Deterministic Articulation and Stochastic Reaction

Robust Speech Recognition via Large-Scale Weak Supervision

Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models

The Benefit Of Temporally-Strong Labels In Audio Event Classification

Dawn of the transformer era in speech emotion recognition: closing the valence gap

ADD 2022: the First Audio Deep Synthesis Detection Challenge

Automatic Depression Detection: An Emotional Audio-Textual Corpus and a GRU/BiLSTM-based Model

DNSMOS P.835: A Non-Intrusive Perceptual Objective Speech Quality Metric to Evaluate Noise Suppressors

Speech Emotion Recognition using Self-Supervised Features

FLEURS: Few-shot Learning Evaluation of Universal Representations of Speech

Everything at Once -- Multi-modal Fusion Transformer for Video Retrieval

Does Audio Deepfake Detection Generalize?

Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesis

Multi-band MelGAN: Faster Waveform Generation for High-Quality Text-to-Speech

TorchAudio: Building Blocks for Audio and Speech Processing

WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognition

Wav2CLIP: Learning Robust Audio Representations From CLIP

AST: Audio Spectrogram Transformer

UnivNet: A Neural Vocoder with Multi-Resolution Spectrogram Discriminators for High-Fidelity Waveform Generation

Multi-task self-supervised learning for Robust Speech Recognition

PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognition

SEP-28k: A Dataset for Stuttering Event Detection From Podcasts With People Who Stutter

Emotion Recognition from Speech Using Wav2vec 2.0 Embeddings

Using IPA-Based Tacotron for Data Efficient Cross-Lingual Speaker Adaptation and Pronunciation Enhancement

VisualVoice: Audio-Visual Speech Separation with Cross-Modal Consistency

AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselines

Contrastive Learning of General-Purpose Audio Representations

BiMamba2 Masked Discrete-Unit Prediction for Multilingual Speech Representation for Unsupervised Speech in the Wild Challenge

Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantity

DiffWave: A Versatile Diffusion Model for Audio Synthesis

Exploring wav2vec 2.0 on speaker verification and language identification

Unified Mandarin TTS Front-end Based on Distilled BERT Model

One-class Learning Towards Synthetic Voice Spoofing Detection

Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis

LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speech

Decentralizing Feature Extraction with Quantum Convolutional Neural Network for Automatic Speech Recognition

Clova Baseline System for the VoxCeleb Speaker Recognition Challenge 2020

Voice Conversion Challenge 2020: Intra-lingual semi-parallel and cross-lingual voice conversion

Real Time Speech Enhancement in the Waveform Domain

HiFi-GAN: High-Fidelity Denoising and Dereverberation Based on Speech Deep Features in Adversarial Networks

Unsupervised Cross-lingual Representation Learning for Speech Recognition

Transformer Transducer: A Streamable Speech Recognition Model with Transformer Encoders and RNN-T Loss

ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verification

Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation

VGGSound: A Large-scale Audio-Visual Dataset

Conformer: Convolution-augmented Transformer for Speech Recognition

Deep Contextualized Acoustic Representations For Semi-Supervised Speech Recognition

Coswara -- A Database of Breathing, Cough, and Voice Sounds for COVID-19 Diagnosis

End-to-end Microphone Permutation and Number Invariant Multi-channel Speech Separation

Speaker Recognition from Raw Waveform with SincNet