Audio and Speech Processing

Papers filed under eess.AS on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

1,321 to 1,380 of 1,641

Everything at Once -- Multi-modal Fusion Transformer for Video Retrieval
Nina Shvetsova, Brian Chen, Andrew Rouditchenko +6
cs.CVcs.CLcs.SDarXiv:2112.04446v22021
Does Audio Deepfake Detection Generalize?
Nicolas M. Müller, Pavel Czempin, Franziska Dieckmann +2
cs.SDcs.LGeess.ASarXiv:2203.16263v52022
Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesis
Yu Wang, Xinsheng Wang, Pengcheng Zhu +6
cs.SDcs.DBeess.ASarXiv:2201.07429v22022
Multi-band MelGAN: Faster Waveform Generation for High-Quality Text-to-Speech
Geng Yang, Shan Yang, Kai Liu +3
cs.SDeess.ASarXiv:2005.05106v22020
TorchAudio: Building Blocks for Audio and Speech Processing
Yao-Yuan Yang, Moto Hira, Zhaoheng Ni +20
eess.AScs.SDarXiv:2110.15018v22021
Wav2CLIP: Learning Robust Audio Representations From CLIP
Ho-Hsiang Wu, Prem Seetharaman, Kundan Kumar +1
cs.SDcs.LGeess.ASarXiv:2110.11499v22021
Generalization Ability of MOS Prediction Networks
Erica Cooper, Wen-Chin Huang, Tomoki Toda +1
eess.ASarXiv:2110.02635v32021
UnivNet: A Neural Vocoder with Multi-Resolution Spectrogram Discriminators for High-Fidelity Waveform Generation
Won Jang, Dan Lim, Jaesam Yoon +2
eess.AScs.SDarXiv:2106.07889v12021
Layer-wise Analysis of a Self-supervised Speech Representation Model
Ankita Pasad, Ju-Chieh Chou, Karen Livescu
cs.CLcs.LGeess.ASarXiv:2107.04734v32021
Multi-task self-supervised learning for Robust Speech Recognition
Mirco Ravanelli, Jianyuan Zhong, Santiago Pascual +4
eess.AScs.CLcs.LGarXiv:2001.09239v22020
PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognition
Qiuqiang Kong, Yin Cao, Turab Iqbal +3
cs.SDeess.ASarXiv:1912.10211v52019
SEP-28k: A Dataset for Stuttering Event Detection From Podcasts With People Who Stutter
Colin Lea, Vikramjit Mitra, Aparna Joshi +2
eess.AScs.SDarXiv:2102.12394v12021
Emotion Recognition from Speech Using Wav2vec 2.0 Embeddings
Leonardo Pepino, Pablo Riera, Luciana Ferrer
cs.SDcs.LGeess.ASarXiv:2104.03502v12021
ToyADMOS2: Another dataset of miniature-machine operating sounds for anomalous sound detection under domain shift conditions
Noboru Harada, Daisuke Niizumi, Daiki Takeuchi +3
eess.ASarXiv:2106.02369v12021
Using IPA-Based Tacotron for Data Efficient Cross-Lingual Speaker Adaptation and Pronunciation Enhancement
Hamed Hemati, Damian Borth
cs.SDcs.LGeess.ASarXiv:2011.06392v22020
AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselines
Yao Shi, Hui Bu, Xin Xu +2
cs.SDeess.ASarXiv:2010.11567v22020
Contrastive Learning of General-Purpose Audio Representations
Aaqib Saeed, David Grangier, Neil Zeghidour
cs.SDcs.LGeess.ASarXiv:2010.10915v12020
Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantity
Ethan Manilow, Gordon Wichern, Prem Seetharaman +1
cs.SDcs.LGeess.ASarXiv:1909.08494v12019
DiffWave: A Versatile Diffusion Model for Audio Synthesis
Zhifeng Kong, Wei Ping, Jiaji Huang +2
eess.AScs.CLcs.LGarXiv:2009.09761v32020
Exploring wav2vec 2.0 on speaker verification and language identification
Zhiyun Fan, Meng Li, Shiyu Zhou +1
cs.SDcs.CLeess.ASarXiv:2012.06185v22020
One-class Learning Towards Synthetic Voice Spoofing Detection
You Zhang, Fei Jiang, Zhiyao Duan
eess.AScs.SDarXiv:2010.13995v22020
Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis
K R Prajwal, Rudrabha Mukhopadhyay, Vinay Namboodiri +1
cs.CVcs.LGcs.SDarXiv:2005.08209v12020
End-to-end anti-spoofing with RawNet2
Hemlata Tak, Jose Patino, Massimiliano Todisco +3
eess.ASarXiv:2011.01108v32020
LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speech
Heiga Zen, Viet Dang, Rob Clark +5
cs.SDeess.ASarXiv:1904.02882v12019
Decentralizing Feature Extraction with Quantum Convolutional Neural Network for Automatic Speech Recognition
Chao-Han Huck Yang, Jun Qi, Samuel Yen-Chi Chen +4
cs.SDcs.LGcs.NEarXiv:2010.13309v22020
Clova Baseline System for the VoxCeleb Speaker Recognition Challenge 2020
Hee Soo Heo, Bong-Jin Lee, Jaesung Huh +1
eess.AScs.SDarXiv:2009.14153v12020
Voice Conversion Challenge 2020: Intra-lingual semi-parallel and cross-lingual voice conversion
Yi Zhao, Wen-Chin Huang, Xiaohai Tian +5
eess.AScs.SDarXiv:2008.12527v12020
Real Time Speech Enhancement in the Waveform Domain
Alexandre Defossez, Gabriel Synnaeve, Yossi Adi
eess.AScs.LGcs.SDarXiv:2006.12847v32020
HiFi-GAN: High-Fidelity Denoising and Dereverberation Based on Speech Deep Features in Adversarial Networks
Jiaqi Su, Zeyu Jin, Adam Finkelstein
eess.AScs.LGcs.SDarXiv:2006.05694v22020
Unsupervised Cross-lingual Representation Learning for Speech Recognition
Alexis Conneau, Alexei Baevski, Ronan Collobert +2
cs.CLcs.LGcs.SDarXiv:2006.13979v22020
Transformer Transducer: A Streamable Speech Recognition Model with Transformer Encoders and RNN-T Loss
Qian Zhang, Han Lu, Hasim Sak +4
eess.AScs.CLcs.SDarXiv:2002.02562v22020
ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verification
Brecht Desplanques, Jenthe Thienpondt, Kris Demuynck
eess.AScs.SDarXiv:2005.07143v32020
Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation
Po-Han Chi, Pei-Hung Chung, Tsung-Han Wu +4
eess.AScs.CLcs.SDarXiv:2005.08575v52020
VGGSound: A Large-scale Audio-Visual Dataset
Honglie Chen, Weidi Xie, Andrea Vedaldi +1
cs.CVcs.SDeess.ASarXiv:2004.14368v22020
Conformer: Convolution-augmented Transformer for Speech Recognition
Anmol Gulati, James Qin, Chung-Cheng Chiu +8
eess.AScs.LGcs.SDarXiv:2005.08100v12020
Alzheimer's Dementia Recognition through Spontaneous Speech: The ADReSS Challenge
Saturnino Luz, Fasih Haider, Sofia de la Fuente +2
eess.AScs.LGstat.MLarXiv:2004.06833v32020
Deep Contextualized Acoustic Representations For Semi-Supervised Speech Recognition
Shaoshi Ling, Yuzong Liu, Julian Salazar +1
eess.AScs.CLcs.LGarXiv:1912.01679v22019
LibriMix: An Open-Source Dataset for Generalizable Speech Separation
Joris Cosentino, Manuel Pariente, Samuele Cornell +2
eess.ASarXiv:2005.11262v12020
Coswara -- A Database of Breathing, Cough, and Voice Sounds for COVID-19 Diagnosis
Neeraj Sharma, Prashant Krishnan, Rohit Kumar +5
eess.AScs.SDarXiv:2005.10548v22020
End-to-end Microphone Permutation and Number Invariant Multi-channel Speech Separation
Yi Luo, Zhuo Chen, Nima Mesgarani +1
eess.AScs.LGcs.SDarXiv:1910.14104v32019
Speaker Recognition from Raw Waveform with SincNet
Mirco Ravanelli, Yoshua Bengio
eess.AScs.LGcs.SDarXiv:1808.00158v32018
Continuous speech separation: dataset and analysis
Zhuo Chen, Takuya Yoshioka, Liang Lu +6
cs.SDcs.LGeess.ASarXiv:2001.11482v32020
Towards Learning a Universal Non-Semantic Representation of Speech
Joel Shor, Aren Jansen, Ronnie Maor +7
eess.AScs.LGcs.SDarXiv:2002.12764v62020
Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogram
Ryuichi Yamamoto, Eunwoo Song, Jae-Min Kim
eess.AScs.LGcs.SDarXiv:1910.11480v22019
Leveraging BERT for Extractive Text Summarization on Lectures
Derek Miller
cs.CLcs.LGcs.SDarXiv:1906.04165v12019
Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoders
Andy T. Liu, Shu-wen Yang, Po-Han Chi +2
eess.AScs.CLcs.LGarXiv:1910.12638v22019
A scalable noisy speech dataset and online subjective test framework
Chandan K. A. Reddy, Ebrahim Beyrami, Jamie Pool +3
cs.SDcs.LGeess.ASarXiv:1909.08050v12019
Self-supervised Moving Vehicle Tracking with Stereo Sound
Chuang Gan, Hang Zhao, Peihao Chen +2
cs.CVcs.LGcs.SDarXiv:1910.11760v12019
QuartzNet: Deep Automatic Speech Recognition with 1D Time-Channel Separable Convolutions
Samuel Kriman, Stanislav Beliaev, Boris Ginsburg +6
eess.ASarXiv:1910.10261v12019
MIMII Dataset: Sound Dataset for Malfunctioning Industrial Machine Investigation and Inspection
Harsh Purohit, Ryo Tanabe, Kenji Ichige +4
cs.SDcs.LGeess.ASarXiv:1909.09347v12019
Speaker Anonymization Using X-vector and Neural Waveform Models
Fuming Fang, Xin Wang, Junichi Yamagishi +4
eess.AScs.CLcs.LGarXiv:1905.13561v12019
Survey on Deep Neural Networks in Speech and Vision Systems
Mahbubul Alam, Manar D. Samad, Lasitha Vidyaratne +2
cs.CVcs.LGcs.NEarXiv:1908.07656v22019
Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloning
Yu Zhang, Ron J. Weiss, Heiga Zen +6
cs.CLcs.SDeess.ASarXiv:1907.04448v22019
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Daniel S. Park, William Chan, Yu Zhang +4
eess.AScs.CLcs.LGarXiv:1904.08779v32019
ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Massimiliano Todisco, Xin Wang, Ville Vestman +7
eess.AScs.CRcs.SDarXiv:1904.05441v22019
Learning Individual Styles of Conversational Gesture
Shiry Ginosar, Amir Bar, Gefen Kohavi +3
cs.CVcs.LGeess.ASarXiv:1906.04160v12019
Margin Matters: Towards More Discriminative Deep Neural Network Embeddings for Speaker Recognition
Xu Xiang, Shuai Wang, Houjun Huang +2
eess.AScs.CLcs.SDarXiv:1906.07317v12019
Practical Hidden Voice Attacks against Speech and Speaker Recognition Systems
Hadi Abdullah, Washington Garcia, Christian Peeters +3
cs.CRcs.LGcs.SDarXiv:1904.05734v12019
A spelling correction model for end-to-end speech recognition
Jinxi Guo, Tara N. Sainath, Ron J. Weiss
eess.AScs.AIcs.CLarXiv:1902.07178v12019
Speech Model Pre-training for End-to-End Spoken Language Understanding
Loren Lugosch, Mirco Ravanelli, Patrick Ignoto +2
eess.AScs.CLcs.LGarXiv:1904.03670v22019

Audio and Speech Processing

Everything at Once -- Multi-modal Fusion Transformer for Video Retrieval

Does Audio Deepfake Detection Generalize?

Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesis

Multi-band MelGAN: Faster Waveform Generation for High-Quality Text-to-Speech

TorchAudio: Building Blocks for Audio and Speech Processing

Wav2CLIP: Learning Robust Audio Representations From CLIP

Generalization Ability of MOS Prediction Networks

UnivNet: A Neural Vocoder with Multi-Resolution Spectrogram Discriminators for High-Fidelity Waveform Generation

Layer-wise Analysis of a Self-supervised Speech Representation Model

Multi-task self-supervised learning for Robust Speech Recognition

PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognition

SEP-28k: A Dataset for Stuttering Event Detection From Podcasts With People Who Stutter

Emotion Recognition from Speech Using Wav2vec 2.0 Embeddings

ToyADMOS2: Another dataset of miniature-machine operating sounds for anomalous sound detection under domain shift conditions

Using IPA-Based Tacotron for Data Efficient Cross-Lingual Speaker Adaptation and Pronunciation Enhancement

AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselines

Contrastive Learning of General-Purpose Audio Representations

Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantity

DiffWave: A Versatile Diffusion Model for Audio Synthesis

Exploring wav2vec 2.0 on speaker verification and language identification

One-class Learning Towards Synthetic Voice Spoofing Detection

Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis

End-to-end anti-spoofing with RawNet2

LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speech

Decentralizing Feature Extraction with Quantum Convolutional Neural Network for Automatic Speech Recognition

Clova Baseline System for the VoxCeleb Speaker Recognition Challenge 2020

Voice Conversion Challenge 2020: Intra-lingual semi-parallel and cross-lingual voice conversion

Real Time Speech Enhancement in the Waveform Domain

HiFi-GAN: High-Fidelity Denoising and Dereverberation Based on Speech Deep Features in Adversarial Networks

Unsupervised Cross-lingual Representation Learning for Speech Recognition

Transformer Transducer: A Streamable Speech Recognition Model with Transformer Encoders and RNN-T Loss

ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verification

Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation

VGGSound: A Large-scale Audio-Visual Dataset

Conformer: Convolution-augmented Transformer for Speech Recognition

Alzheimer's Dementia Recognition through Spontaneous Speech: The ADReSS Challenge

Deep Contextualized Acoustic Representations For Semi-Supervised Speech Recognition

LibriMix: An Open-Source Dataset for Generalizable Speech Separation

Coswara -- A Database of Breathing, Cough, and Voice Sounds for COVID-19 Diagnosis

End-to-end Microphone Permutation and Number Invariant Multi-channel Speech Separation

Speaker Recognition from Raw Waveform with SincNet

Continuous speech separation: dataset and analysis

Towards Learning a Universal Non-Semantic Representation of Speech

Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogram

Leveraging BERT for Extractive Text Summarization on Lectures

Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoders

A scalable noisy speech dataset and online subjective test framework

Self-supervised Moving Vehicle Tracking with Stereo Sound

QuartzNet: Deep Automatic Speech Recognition with 1D Time-Channel Separable Convolutions

MIMII Dataset: Sound Dataset for Malfunctioning Industrial Machine Investigation and Inspection

Speaker Anonymization Using X-vector and Neural Waveform Models

Survey on Deep Neural Networks in Speech and Vision Systems

Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloning

SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition

ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection

Learning Individual Styles of Conversational Gesture

Margin Matters: Towards More Discriminative Deep Neural Network Embeddings for Speaker Recognition

Practical Hidden Voice Attacks against Speech and Speaker Recognition Systems

A spelling correction model for end-to-end speech recognition

Speech Model Pre-training for End-to-End Spoken Language Understanding