Audio and Speech Processing

Papers filed under eess.AS on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

1,381 to 1,440 of 1,641

Leveraging Weakly Supervised Data to Improve End-to-End Speech-to-Text Translation
Ye Jia, Melvin Johnson, Wolfgang Macherey +6
cs.CLcs.LGcs.SDarXiv:1811.02050v22018
AVA-ActiveSpeaker: An Audio-Visual Dataset for Active Speaker Detection
Joseph Roth, Sourish Chaudhuri, Ondrej Klejch +8
cs.CVcs.MMcs.SDarXiv:1901.01342v22019
VoiceFilter: Targeted Voice Separation by Speaker-Conditioned Spectrogram Masking
Quan Wang, Hannah Muckenhirn, Kevin Wilson +7
eess.AScs.LGeess.SParXiv:1810.04826v62018
Few-Shot Calibration for Sim-to-Real Single-Channel Speaker Distance Estimation
Michael Neri, Archontis Politis, Tuomas Virtanen
eess.AScs.SDeess.SParXiv:2609.29203v12026
Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis
Ye Jia, Yu Zhang, Ron J. Weiss +8
cs.CLcs.LGcs.SDarXiv:1806.04558v42018
Personalized Korean Lipreading as Visual Speech Recognition: Transfer, Census and Adaptation on OLKAVS
Se Un Park, Hakjun Kim, Taehoon Roh +1
eess.AScs.CLcs.CVarXiv:2609.28988v12026
WaveGlow: A Flow-based Generative Network for Speech Synthesis
Ryan Prenger, Rafael Valle, Bryan Catanzaro
cs.SDcs.AIcs.LGarXiv:1811.00002v12018
Whisper-Based Speech Transcription from Videos Across Multiple Languages for Cross-Cultural Understanding
Michael Picheny
eess.AScs.CLarXiv:2609.11772v12026
General-purpose Tagging of Freesound Audio with AudioSet Labels: Task Description, Dataset, and Baseline
Eduardo Fonseca, Manoj Plakal, Frederic Font +4
cs.SDcs.LGeess.ASarXiv:1807.09902v32018
A multi-device dataset for urban acoustic scene classification
Annamaria Mesaros, Toni Heittola, Tuomas Virtanen
eess.AScs.SDarXiv:1807.09840v22018
Full-Duplex Interaction in Spoken Dialogue Systems: A Comprehensive Study from the ICASSP 2026 HumDial Challenge
Chengyou Wang, Hongfei Xue, Guojian Li +6
eess.ASarXiv:2604.21406v22026
Audio to Body Dynamics
Eli Shlizerman, Lucio M. Dery, Hayden Schoen +1
eess.AScs.CVcs.SDarXiv:1712.09382v12017
Exploring the Encoding Layer and Loss Function in End-to-End Speaker and Language Recognition System
Weicheng Cai, Jinkun Chen, Ming Li
eess.AScs.LGcs.SDarXiv:1804.05160v12018
VoxCeleb2: Deep Speaker Recognition
Joon Son Chung, Arsha Nagrani, Andrew Zisserman
cs.SDcs.CVeess.ASarXiv:1806.05622v22018
Attentive Statistics Pooling for Deep Speaker Embedding
Koji Okabe, Takafumi Koshinaka, Koichi Shinoda
eess.AScs.SDarXiv:1803.10963v22018
TurboBias 2.0: Streaming Context-Biasing for Production-Efficient ASR Systems
Vladimir Bataev, Lilit Grigoryan, Andrei Andrusenko +3
eess.AScs.AIcs.CLarXiv:2608.21343v12026
A Hierarchical Latent Vector Model for Learning Long-Term Structure in Music
Adam Roberts, Jesse Engel, Colin Raffel +2
cs.LGcs.SDeess.ASarXiv:1803.05428v52018
Multilingual Speech Recognition With A Single End-To-End Model
Shubham Toshniwal, Tara N. Sainath, Ron J. Weiss +4
eess.AScs.AIcs.CLarXiv:1711.01694v22017
The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methods
Jaime Lorenzo-Trueba, Junichi Yamagishi, Tomoki Toda +4
eess.AScs.CLcs.SDarXiv:1804.04262v12018
Objects that Sound
Relja Arandjelović, Andrew Zisserman
cs.CVcs.LGcs.MMarXiv:1712.06651v22017
Exploring Architectures, Data and Units For Streaming End-to-End Speech Recognition with RNN-Transducer
Kanishka Rao, Haşim Sak, Rohit Prabhavalkar
cs.CLcs.SDeess.ASarXiv:1801.00841v12018
Large-scale weakly supervised audio classification using gated convolutional neural network
Yong Xu, Qiuqiang Kong, Wenwu Wang +1
cs.SDeess.ASarXiv:1710.00343v12017
Parallel-Data-Free Voice Conversion Using Cycle-Consistent Adversarial Networks
Takuhiro Kaneko, Hirokazu Kameoka
stat.MLcs.SDeess.ASarXiv:1711.11293v22017
FoleyCrafter: Bring Silent Videos to Life with Lifelike and Synchronized Sounds
Yiming Zhang, Yicheng Gu, Yanhong Zeng +4
cs.CVcs.SDeess.ASarXiv:2407.01494v12024
EARS: An Anechoic Fullband Speech Dataset Benchmarked for Speech Enhancement and Dereverberation
Julius Richter, Yi-Chiao Wu, Steven Krenn +5
eess.AScs.LGcs.SDarXiv:2406.06185v22024
The VoiceMOS Challenge 2022
Wen-Chin Huang, Erica Cooper, Yu Tsao +3
cs.SDeess.ASarXiv:2203.11389v32022
GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audio
Guoguo Chen, Shuzhou Chai, Guanbo Wang +18
cs.SDcs.CLeess.ASarXiv:2106.06909v12021
Hi-Fi Multi-Speaker English TTS Dataset
Evelina Bakhturina, Vitaly Lavrukhin, Boris Ginsburg +1
eess.ASarXiv:2104.01497v32021
HiFiSinger: Towards High-Fidelity Neural Singing Voice Synthesis
Jiawei Chen, Xu Tan, Jian Luan +2
eess.AScs.CLcs.LGarXiv:2009.01776v12020
Permutation Invariant Training of Deep Models for Speaker-Independent Multi-talker Speech Separation
Dong Yu, Morten Kolbæk, Zheng-Hua Tan +1
cs.CLcs.LGcs.SDarXiv:1607.00325v22016
GANSynth: Adversarial Neural Audio Synthesis
Jesse Engel, Kumar Krishna Agrawal, Shuo Chen +3
cs.SDcs.LGeess.ASarXiv:1902.08710v22019
SDR - half-baked or well done?
Jonathan Le Roux, Scott Wisdom, Hakan Erdogan +1
cs.SDeess.ASarXiv:1811.02508v12018
RWTH ASR Systems for LibriSpeech: Hybrid vs Attention -- w/o Data Augmentation
Christoph Lüscher, Eugen Beck, Kazuki Irie +5
cs.CLcs.SDeess.ASarXiv:1905.03072v32019
Can we steal your vocal identity from the Internet?: Initial investigation of cloning Obama's voice using GAN, WaveNet and low-quality found data
Jaime Lorenzo-Trueba, Fuming Fang, Xin Wang +3
eess.AScs.CLcs.SDarXiv:1803.00860v12018
A Stem-Agnostic Approach to Hybrid AI Music Detection
Richa Namballa, François Rigaud, Romain Hennequin
cs.SDeess.ASarXiv:2609.26956v12026
A multi-resolution spectrogram approach for estimating the physical parameters of a plate reverb
Jared Lipkin, Meiying Chen, Benjamin R. Thompson +3
eess.ASarXiv:2609.28320v12026
SpeechDPR: End-to-End Spoken Passage Retrieval for Open-Domain Spoken Question Answering
Chyi-Jiunn Lin, Guan-Ting Lin, Yung-Sung Chuang +5
cs.CLcs.IRcs.SDarXiv:2401.13463v32024
The Vicomtech Audio Deepfake Detection System based on Wav2Vec2 for the 2022 ADD Challenge
Juan M. Martín-Doñas, Aitor Álvarez
eess.AScs.SDarXiv:2203.01573v12022
speechocean762: An Open-Source Non-native English Speech Corpus For Pronunciation Assessment
Junbo Zhang, Zhiwen Zhang, Yongqing Wang +6
cs.CLcs.SDeess.ASarXiv:2104.01378v22021
Game-Time: Evaluating Temporal Dynamics in Spoken Language Models
Kai-Wei Chang, En-Pei Hu, Chun-Yi Kuan +7
eess.AScs.AIcs.CLarXiv:2509.26388v42025
Configurable-Bandwidth Time-Frequency Modeling for Efficient Full-Band Speech Enhancement Across Sampling Rates
Ui-Hyeop Shin, Wooseok Kim, Hyung-Min Park
eess.ASarXiv:2609.29463v12026
The Second MLC-SLM Challenge: Multilingual Conversational Speech Diarization, Recognition, and Understanding
Bingshen Mu, Mingchen Shao, Zhennan Lin +7
eess.AScs.SDarXiv:2609.27514v12026
Advancing Speech Understanding in Speech-Aware Language Models with GRPO
Avishai Elmakies, Hagai Aronowitz, Nimrod Shabtay +3
cs.CLcs.AIcs.LGarXiv:2509.16990v12025
Attention Based Fully Convolutional Network for Speech Emotion Recognition
Yuanyuan Zhang, Jun Du, Zirui Wang +1
cs.SDcs.LGeess.ASarXiv:1806.01506v22018
Voice Evaluation of Reasoning Ability: Diagnosing the Modality-Induced Performance Gap
Yueqian Lin, Zhengmian Hu, Qinsi Wang +6
eess.AScs.MMcs.SDarXiv:2509.26542v12025
Depth through recurrence: Looped transformers for flow-matching TTS
Jiabao Ai, Peng Han, Yuchen Song +1
eess.ASarXiv:2609.29768v12026
Is Broader Better? A Controlled Study of Multilingual Coverage and Pretraining Objective in Frozen SSL Encoders for Speech Deepfake Detection
Benjamin Hurt, Oscar O'Donnell
eess.ASarXiv:2609.29138v12026
Voice Agents under Acoustic Stress: From Signal Degradation to Interaction and Action
Amir Ivry, Kai-Wei Chang, Lin Zhang +2
eess.AScs.HCarXiv:2609.29452v12026
Libriheavy: a 50,000 hours ASR corpus with punctuation casing and context
Wei Kang, Xiaoyu Yang, Zengwei Yao +5
eess.AScs.SDarXiv:2309.08105v22023
AsyncVoice Agent: Real-Time Explanation for LLM Planning and Reasoning
Yueqian Lin, Zhengmian Hu, Jayakumar Subramanian +4
eess.AScs.AIcs.MMarXiv:2510.16156v12025
SHAS: Approaching optimal Segmentation for End-to-End Speech Translation
Ioannis Tsiamas, Gerard I. Gállego, José A. R. Fonollosa +1
cs.SDcs.CLeess.ASarXiv:2202.04774v32022
MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation
Mohamed Anwar, Bowen Shi, Vedanuj Goswami +3
cs.CLeess.ASarXiv:2303.00628v22023
Squeezeformer: An Efficient Transformer for Automatic Speech Recognition
Sehoon Kim, Amir Gholami, Albert Shaw +5
eess.AScs.CLcs.SDarXiv:2206.00888v22022
Not Quite My Tempo: Voice Activity-aware Speech Synthesis for Lip-Synchronous Dubbing
Alejandro Pérez-González-de-Martos, Florian Lux, Angelina Elizarova +3
eess.AScs.AIarXiv:2609.26486v12026
SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning
Changan Chen, Carl Schissler, Sanchit Garg +6
cs.SDcs.CVcs.MMarXiv:2206.08312v22022
Audio Self-supervised Learning: A Survey
Shuo Liu, Adria Mallol-Ragolta, Emilia Parada-Cabeleiro +5
cs.SDcs.AIeess.ASarXiv:2203.01205v12022
VākQA: A Benchmark and Evaluation Study for Telugu Spoken Factoid Question Answering
Bhavana Akkiraju, Ravi Sastry Kolluru, Sri Charan D +3
cs.CLeess.ASarXiv:2609.19879v12026
Accurate Plate Reverb Parameter Estimation Using Two-Stage Evolutionary Search
Byunghoo Park, Jayeon Yi, Takyoung Kim +1
eess.AScs.SDeess.SParXiv:2608.28818v12026
Rethinking Speech Codecs: From Compression to Autoregressive Generative Modeling
Yazheng Yang, Yao Qiu, Hui Su +1
eess.AScs.MMcs.SDarXiv:2609.04237v12026
PolyMap: A 64-Channel Polyphonic Guitar Pickup System
David Wieland, Jonas Roth, Christoph Studer
eess.ASeess.SParXiv:2608.27522v12026

Audio and Speech Processing

Leveraging Weakly Supervised Data to Improve End-to-End Speech-to-Text Translation

AVA-ActiveSpeaker: An Audio-Visual Dataset for Active Speaker Detection

VoiceFilter: Targeted Voice Separation by Speaker-Conditioned Spectrogram Masking

Few-Shot Calibration for Sim-to-Real Single-Channel Speaker Distance Estimation

Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis

Personalized Korean Lipreading as Visual Speech Recognition: Transfer, Census and Adaptation on OLKAVS

WaveGlow: A Flow-based Generative Network for Speech Synthesis

Whisper-Based Speech Transcription from Videos Across Multiple Languages for Cross-Cultural Understanding

General-purpose Tagging of Freesound Audio with AudioSet Labels: Task Description, Dataset, and Baseline

A multi-device dataset for urban acoustic scene classification

Full-Duplex Interaction in Spoken Dialogue Systems: A Comprehensive Study from the ICASSP 2026 HumDial Challenge

Audio to Body Dynamics

Exploring the Encoding Layer and Loss Function in End-to-End Speaker and Language Recognition System

VoxCeleb2: Deep Speaker Recognition

Attentive Statistics Pooling for Deep Speaker Embedding

TurboBias 2.0: Streaming Context-Biasing for Production-Efficient ASR Systems

A Hierarchical Latent Vector Model for Learning Long-Term Structure in Music

Multilingual Speech Recognition With A Single End-To-End Model

The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methods

Objects that Sound

Exploring Architectures, Data and Units For Streaming End-to-End Speech Recognition with RNN-Transducer

Large-scale weakly supervised audio classification using gated convolutional neural network

Parallel-Data-Free Voice Conversion Using Cycle-Consistent Adversarial Networks

FoleyCrafter: Bring Silent Videos to Life with Lifelike and Synchronized Sounds

EARS: An Anechoic Fullband Speech Dataset Benchmarked for Speech Enhancement and Dereverberation

The VoiceMOS Challenge 2022

GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audio

Hi-Fi Multi-Speaker English TTS Dataset

HiFiSinger: Towards High-Fidelity Neural Singing Voice Synthesis

Permutation Invariant Training of Deep Models for Speaker-Independent Multi-talker Speech Separation

GANSynth: Adversarial Neural Audio Synthesis

SDR - half-baked or well done?

RWTH ASR Systems for LibriSpeech: Hybrid vs Attention -- w/o Data Augmentation

Can we steal your vocal identity from the Internet?: Initial investigation of cloning Obama's voice using GAN, WaveNet and low-quality found data

A Stem-Agnostic Approach to Hybrid AI Music Detection

A multi-resolution spectrogram approach for estimating the physical parameters of a plate reverb

SpeechDPR: End-to-End Spoken Passage Retrieval for Open-Domain Spoken Question Answering

The Vicomtech Audio Deepfake Detection System based on Wav2Vec2 for the 2022 ADD Challenge

speechocean762: An Open-Source Non-native English Speech Corpus For Pronunciation Assessment

Game-Time: Evaluating Temporal Dynamics in Spoken Language Models

Configurable-Bandwidth Time-Frequency Modeling for Efficient Full-Band Speech Enhancement Across Sampling Rates

The Second MLC-SLM Challenge: Multilingual Conversational Speech Diarization, Recognition, and Understanding

Advancing Speech Understanding in Speech-Aware Language Models with GRPO

Attention Based Fully Convolutional Network for Speech Emotion Recognition

Voice Evaluation of Reasoning Ability: Diagnosing the Modality-Induced Performance Gap

Depth through recurrence: Looped transformers for flow-matching TTS

Is Broader Better? A Controlled Study of Multilingual Coverage and Pretraining Objective in Frozen SSL Encoders for Speech Deepfake Detection

Voice Agents under Acoustic Stress: From Signal Degradation to Interaction and Action

Libriheavy: a 50,000 hours ASR corpus with punctuation casing and context

AsyncVoice Agent: Real-Time Explanation for LLM Planning and Reasoning

SHAS: Approaching optimal Segmentation for End-to-End Speech Translation

MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation

Squeezeformer: An Efficient Transformer for Automatic Speech Recognition

Not Quite My Tempo: Voice Activity-aware Speech Synthesis for Lip-Synchronous Dubbing

SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning

Audio Self-supervised Learning: A Survey

VākQA: A Benchmark and Evaluation Study for Telugu Spoken Factoid Question Answering

Accurate Plate Reverb Parameter Estimation Using Two-Stage Evolutionary Search

Rethinking Speech Codecs: From Compression to Autoregressive Generative Modeling

PolyMap: A 64-Channel Polyphonic Guitar Pickup System