Audio and Speech Processing

Papers filed under eess.AS on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

1,561 to 1,620 of 1,641

MusicBERT: Symbolic Music Understanding with Large-Scale Pre-Training
Mingliang Zeng, Xu Tan, Rui Wang +3
cs.SDcs.CLcs.IRarXiv:2106.05630v12021
A Fine-tuned Wav2vec 2.0/HuBERT Benchmark For Speech Emotion Recognition, Speaker Verification and Spoken Language Understanding
Yingzhi Wang, Abdelmoumene Boumadane, Abdelwahab Heba
cs.CLcs.NEcs.SDarXiv:2111.02735v32021
Conditional Generative Adversarial Networks for Speech Enhancement and Noise-Robust Speaker Verification
Daniel Michelsanti, Zheng-Hua Tan
eess.AScs.LGcs.SDarXiv:1709.01703v22017
On decoder-only architecture for speech-to-text and large language model integration
Jian Wu, Yashesh Gaur, Zhuo Chen +8
eess.AScs.CLcs.SDarXiv:2307.03917v32023
Acoustic effects of medical, cloth, and transparent face masks on speech signals
Ryan M. Corey, Uriah Jones, Andrew C. Singer
eess.AScs.SDarXiv:2008.04521v12020
Prompting Large Language Models with Speech Recognition Abilities
Yassir Fathullah, Chunyang Wu, Egor Lakomkin +9
eess.AScs.AIcs.CLarXiv:2307.11795v12023
Towards Balanced Spectral Reconstruction: Spectrally Adaptive Loss for Streaming Speech Enhancement
Haixin Zhao, Nilesh Madhu
eess.ASarXiv:2608.30739v12026
Beyond Speech: Dual-Domain SSL Fusion for Unified All-Type Audio Deepfake Detection
Cunhang Fan, Junqin Cao, Tian Gao +4
eess.ASarXiv:2608.29021v12026
ESPnet-TTS: Unified, Reproducible, and Integratable Open Source End-to-End Text-to-Speech Toolkit
Tomoki Hayashi, Ryuichi Yamamoto, Katsuki Inoue +6
cs.CLeess.ASarXiv:1910.10909v22019
Effects of HRTF Augmentation on Predicted Spatial Release from Masking in Music
Jack Webb, Christophe Lesimple, Volker Kuehnel +1
eess.ASarXiv:2608.28422v12026
Multirate State Space Models for End-to-End Processing of Pulse Density Modulated Speech Signals
Ludovic Boulanger, Sean U. N. Wood
cs.SDeess.ASarXiv:2608.28472v12026
Symbolic Music Generation with Diffusion Models
Gautam Mittal, Jesse Engel, Curtis Hawthorne +1
cs.SDcs.LGeess.ASarXiv:2103.16091v22021
HiFi-Codec: Group-residual Vector quantization for High Fidelity Audio Codec
Dongchao Yang, Songxiang Liu, Rongjie Huang +3
cs.SDeess.ASarXiv:2305.02765v22023
Diff-TTS: A Denoising Diffusion Model for Text-to-Speech
Myeonghun Jeong, Hyeongju Kim, Sung Jun Cheon +2
eess.AScs.AIcs.SDarXiv:2104.01409v12021
ICASSP 2022 Deep Noise Suppression Challenge
Harishchandra Dubey, Vishak Gopal, Ross Cutler +8
eess.AScs.SDarXiv:2202.13288v12022
ViSQOL v3: An Open Source Production Ready Objective Speech and Audio Metric
Michael Chinen, Felicia S. C. Lim, Jan Skoglund +3
eess.AScs.SDeess.SParXiv:2004.09584v12020
The PyTorch-Kaldi Speech Recognition Toolkit
Mirco Ravanelli, Titouan Parcollet, Yoshua Bengio
eess.AScs.CLcs.LGarXiv:1811.07453v22018
Direct speech-to-speech translation with discrete units
Ann Lee, Peng-Jen Chen, Changhan Wang +9
cs.CLcs.LGeess.ASarXiv:2107.05604v22021
Target-Speaker Voice Activity Detection: a Novel Approach for Multi-Speaker Diarization in a Dinner Party Scenario
Ivan Medennikov, Maxim Korenevsky, Tatiana Prisyach +9
eess.AScs.CLcs.SDarXiv:2005.07272v22020
CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Masking
Hui Wang, Siqi Zheng, Yafeng Chen +2
cs.SDeess.ASarXiv:2303.00332v32023
Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphs
Wen-Yi Hsiao, Jen-Yu Liu, Yin-Cheng Yeh +1
cs.SDcs.AIeess.ASarXiv:2101.02402v12021
Matcha-TTS: A fast TTS architecture with conditional flow matching
Shivam Mehta, Ruibo Tu, Jonas Beskow +2
eess.AScs.HCcs.LGarXiv:2309.03199v22023
Learning Problem-agnostic Speech Representations from Multiple Self-supervised Tasks
Santiago Pascual, Mirco Ravanelli, Joan Serrà +2
cs.LGcs.SDeess.ASarXiv:1904.03416v12019
Stable Audio Open
Zach Evans, Julian D. Parker, CJ Carr +3
cs.SDcs.AIeess.ASarXiv:2407.14358v22024
High Fidelity Speech Synthesis with Adversarial Networks
Mikołaj Bińkowski, Jeff Donahue, Sander Dieleman +5
cs.SDcs.LGeess.ASarXiv:1909.11646v22019
Auditing Generative Audio Calls for Known-Task Audio-LLM Evaluation
Mengzhe Geng
cs.SDcs.CLeess.ASarXiv:2608.27817v12026
FullSubNet: A Full-Band and Sub-Band Fusion Model for Real-Time Single-Channel Speech Enhancement
Xiang Hao, Xiangdong Su, Radu Horaud +1
eess.AScs.SDeess.SParXiv:2010.15508v22020
Seen and Unseen emotional style transfer for voice conversion with a new emotional speech dataset
Kun Zhou, Berrak Sisman, Rui Liu +1
cs.SDcs.CLeess.ASarXiv:2010.14794v22020
GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbot
Aohan Zeng, Zhengxiao Du, Mingdao Liu +5
cs.CLcs.SDeess.ASarXiv:2412.02612v12024
The Microsoft 2016 Conversational Speech Recognition System
W. Xiong, J. Droppo, X. Huang +5
cs.CLeess.ASarXiv:1609.03528v22016
Decoding speech perception from non-invasive brain recordings
Alexandre Défossez, Charlotte Caucheteux, Jérémy Rapin +2
eess.AScs.AIcs.LGarXiv:2208.12266v22022
Hybrid Transformers for Music Source Separation
Simon Rouard, Francisco Massa, Alexandre Défossez
eess.AScs.SDarXiv:2211.08553v12022
ContextNet: Improving Convolutional Neural Networks for Automatic Speech Recognition with Global Context
Wei Han, Zhengdong Zhang, Yu Zhang +6
eess.AScs.CLcs.LGarXiv:2005.03191v32020
STC Antispoofing Systems for the ASVspoof2019 Challenge
Galina Lavrentyeva, Sergey Novoselov, Andzhukaev Tseren +3
cs.SDcs.CLcs.CRarXiv:1904.05576v12019
The COUGHVID crowdsourcing dataset: A corpus for the study of large-scale cough analysis algorithms
Lara Orlandic, Tomas Teijeiro, David Atienza
cs.SDeess.ASarXiv:2009.11644v12020
Lipreading using Temporal Convolutional Networks
Brais Martinez, Pingchuan Ma, Stavros Petridis +1
cs.CVcs.SDeess.ASarXiv:2001.08702v12020
XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Model
Edresson Casanova, Kelly Davis, Eren Gölge +8
eess.AScs.CLcs.SDarXiv:2406.04904v12024
WeNet: Production oriented Streaming and Non-streaming End-to-End Speech Recognition Toolkit
Zhuoyuan Yao, Di Wu, Xiong Wang +7
cs.SDcs.CLeess.ASarXiv:2102.01547v52021
Realistic Speech-Driven Facial Animation with GANs
Konstantinos Vougioukas, Stavros Petridis, Maja Pantic
cs.CVcs.LGeess.ASarXiv:1906.06337v12019
Pushing the Limits of Semi-Supervised Learning for Automatic Speech Recognition
Yu Zhang, James Qin, Daniel S. Park +5
eess.AScs.LGcs.SDarXiv:2010.10504v22020
Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentation
Hemlata Tak, Massimiliano Todisco, Xin Wang +3
eess.AScs.SDarXiv:2202.12233v22022
Speaker Diarization with LSTM
Quan Wang, Carlton Downey, Li Wan +2
eess.AScs.LGcs.SDarXiv:1710.10468v72017
Onsets and Frames: Dual-Objective Piano Transcription
Curtis Hawthorne, Erich Elsen, Jialin Song +6
cs.SDcs.LGeess.ASarXiv:1710.11153v22017
Dual-Path Transformer Network: Direct Context-Aware Modeling for End-to-End Monaural Speech Separation
Jingjing Chen, Qirong Mao, Dong Liu
eess.AScs.SDarXiv:2007.13975v32020
Fréchet Audio Distance: A Metric for Evaluating Music Enhancement Algorithms
Kevin Kilgour, Mauricio Zuluaga, Dominik Roblek +1
eess.AScs.SDarXiv:1812.08466v42018
Light Gated Recurrent Units for Speech Recognition
Mirco Ravanelli, Philemon Brakel, Maurizio Omologo +1
eess.AScs.NEcs.SDarXiv:1803.10225v12018
Utterance-level Aggregation For Speaker Recognition In The Wild
Weidi Xie, Arsha Nagrani, Joon Son Chung +1
eess.AScs.LGcs.MMarXiv:1902.10107v22019
MOSNet: Deep Learning based Objective Assessment for Voice Conversion
Chen-Chou Lo, Szu-Wei Fu, Wen-Chin Huang +4
cs.SDcs.LGeess.ASarXiv:1904.08352v32019
AudioSpan: Spanning the Duration and Depth of Audio Comprehension
Wen Huang, Yunfei Chu, Meng Gao +2
cs.SDeess.ASarXiv:2608.26431v12026
CHiME-6 Challenge:Tackling Multispeaker Speech Recognition for Unsegmented Recordings
Shinji Watanabe, Michael Mandel, Jon Barker +18
cs.SDcs.CLeess.ASarXiv:2004.09249v22020
NeMo: a toolkit for building AI applications using Neural Modules
Oleksii Kuchaiev, Jason Li, Huyen Nguyen +11
cs.LGcs.CLcs.SDarXiv:1909.09577v12019
EDGE: Editable Dance Generation From Music
Jonathan Tseng, Rodrigo Castellon, C. Karen Liu
cs.SDcs.CVcs.GRarXiv:2211.10658v22022
An Unsupervised Autoregressive Model for Speech Representation Learning
Yu-An Chung, Wei-Ning Hsu, Hao Tang +1
cs.CLcs.LGcs.SDarXiv:1904.03240v22019
Towards Interpretable Depression Detection: Linking Acoustic Features to DSM-5 Indicators
Jonas Länzlinger, Katharina O. E. Müller, Burkhard Stiller +1
cs.CLcs.SDeess.ASarXiv:2608.26148v12026
Refusal Is Not Robustness: Auditing Confident Fabrication in Large Language Models on a Provably Uninformative Clinical Pain Speech Transcript
Sagnik De, Sreenija Pavuluri
cs.AIcs.ETcs.LGarXiv:2608.26167v12026
The INTERSPEECH 2020 Deep Noise Suppression Challenge: Datasets, Subjective Testing Framework, and Challenge Results
Chandan K. A. Reddy, Vishak Gopal, Ross Cutler +10
eess.AScs.LGcs.SDarXiv:2005.13981v32020
pyannote.audio: neural building blocks for speaker diarization
Hervé Bredin, Ruiqing Yin, Juan Manuel Coria +7
eess.AScs.SDarXiv:1911.01255v12019
CREPE: A Convolutional Representation for Pitch Estimation
Jong Wook Kim, Justin Salamon, Peter Li +1
eess.AScs.LGcs.SDarXiv:1802.06182v12018
Acoustic Echo Control Based on Sound Object Identification for Suppressing Howling Caused by Complicated Acoustic Paths
Osamu Hoshuyama
eess.AScs.SDarXiv:2608.25413v12026
NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasets
Gabriel Mittag, Babak Naderi, Assmaa Chehadi +1
eess.AScs.AIcs.LGarXiv:2104.09494v12021

Audio and Speech Processing

MusicBERT: Symbolic Music Understanding with Large-Scale Pre-Training

A Fine-tuned Wav2vec 2.0/HuBERT Benchmark For Speech Emotion Recognition, Speaker Verification and Spoken Language Understanding

Conditional Generative Adversarial Networks for Speech Enhancement and Noise-Robust Speaker Verification

On decoder-only architecture for speech-to-text and large language model integration

Acoustic effects of medical, cloth, and transparent face masks on speech signals

Prompting Large Language Models with Speech Recognition Abilities

Towards Balanced Spectral Reconstruction: Spectrally Adaptive Loss for Streaming Speech Enhancement

Beyond Speech: Dual-Domain SSL Fusion for Unified All-Type Audio Deepfake Detection

ESPnet-TTS: Unified, Reproducible, and Integratable Open Source End-to-End Text-to-Speech Toolkit

Effects of HRTF Augmentation on Predicted Spatial Release from Masking in Music

Multirate State Space Models for End-to-End Processing of Pulse Density Modulated Speech Signals

Symbolic Music Generation with Diffusion Models

HiFi-Codec: Group-residual Vector quantization for High Fidelity Audio Codec

Diff-TTS: A Denoising Diffusion Model for Text-to-Speech

ICASSP 2022 Deep Noise Suppression Challenge

ViSQOL v3: An Open Source Production Ready Objective Speech and Audio Metric

The PyTorch-Kaldi Speech Recognition Toolkit

Direct speech-to-speech translation with discrete units

Target-Speaker Voice Activity Detection: a Novel Approach for Multi-Speaker Diarization in a Dinner Party Scenario

CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Masking

Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphs

Matcha-TTS: A fast TTS architecture with conditional flow matching

Learning Problem-agnostic Speech Representations from Multiple Self-supervised Tasks

Stable Audio Open

High Fidelity Speech Synthesis with Adversarial Networks

Auditing Generative Audio Calls for Known-Task Audio-LLM Evaluation

FullSubNet: A Full-Band and Sub-Band Fusion Model for Real-Time Single-Channel Speech Enhancement

Seen and Unseen emotional style transfer for voice conversion with a new emotional speech dataset

GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbot

The Microsoft 2016 Conversational Speech Recognition System

Decoding speech perception from non-invasive brain recordings

Hybrid Transformers for Music Source Separation

ContextNet: Improving Convolutional Neural Networks for Automatic Speech Recognition with Global Context

STC Antispoofing Systems for the ASVspoof2019 Challenge

The COUGHVID crowdsourcing dataset: A corpus for the study of large-scale cough analysis algorithms

Lipreading using Temporal Convolutional Networks

XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Model

WeNet: Production oriented Streaming and Non-streaming End-to-End Speech Recognition Toolkit

Realistic Speech-Driven Facial Animation with GANs

Pushing the Limits of Semi-Supervised Learning for Automatic Speech Recognition

Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentation

Speaker Diarization with LSTM

Onsets and Frames: Dual-Objective Piano Transcription

Dual-Path Transformer Network: Direct Context-Aware Modeling for End-to-End Monaural Speech Separation

Fréchet Audio Distance: A Metric for Evaluating Music Enhancement Algorithms

Light Gated Recurrent Units for Speech Recognition

Utterance-level Aggregation For Speaker Recognition In The Wild

MOSNet: Deep Learning based Objective Assessment for Voice Conversion

AudioSpan: Spanning the Duration and Depth of Audio Comprehension

CHiME-6 Challenge:Tackling Multispeaker Speech Recognition for Unsegmented Recordings

NeMo: a toolkit for building AI applications using Neural Modules

EDGE: Editable Dance Generation From Music

An Unsupervised Autoregressive Model for Speech Representation Learning

Towards Interpretable Depression Detection: Linking Acoustic Features to DSM-5 Indicators

Refusal Is Not Robustness: Auditing Confident Fabrication in Large Language Models on a Provably Uninformative Clinical Pain Speech Transcript

The INTERSPEECH 2020 Deep Noise Suppression Challenge: Datasets, Subjective Testing Framework, and Challenge Results

pyannote.audio: neural building blocks for speaker diarization

CREPE: A Convolutional Representation for Pitch Estimation

Acoustic Echo Control Based on Sound Object Identification for Suppressing Howling Caused by Complicated Acoustic Paths

NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasets