Audio and Speech Processing

Papers filed under eess.AS on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

541 to 600 of 1,642

Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech
Jaehyeon Kim, Jungil Kong, Juhee Son
cs.SDeess.ASarXiv:2106.06103v12021
Exemplar-Free Analytic Learning for Multi-Label Audio Class-Incremental Learning
Siyuan Luo, Yang Xiao, Ting Dang
eess.ASarXiv:2609.29777v12026
Perceiver: General Perception with Iterative Attention
Andrew Jaegle, Felix Gimeno, Andrew Brock +3
cs.CVcs.AIcs.LGarXiv:2103.03206v22021
Adaptive Feature Selection for End-to-End Speech Translation
Biao Zhang, Ivan Titov, Barry Haddow +1
cs.CLcs.LGcs.SDarXiv:2010.08518v22020
Mapping Written Words to Spoken Words in a Different Language Using Only Visual Grounding
Gabriel Pirlogeanu, Dan Oneata, Horia Cucu +1
cs.CLeess.ASarXiv:2608.26925v12026
SwanTale: Unified Multi-Speaker Speech and Audio Generation for Instruct and Zero-Shot Tasks
Yu Zhang, Ruiqi Li, Changhao Pan +3
eess.AScs.SDarXiv:2608.02023v22026
EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesis
Tu Anh Nguyen, Wei-Ning Hsu, Antony D'Avirro +10
cs.CLcs.LGcs.SDarXiv:2308.05725v12023
WST-Graph: Topology-Preserving Wavelet Scattering Front-End for Speech Deepfake Detection
Kwok-Ho Ng, Tingting Song, Bingwen Feng +1
eess.AScs.AIcs.SDarXiv:2609.29372v12026
Canary-1B-v2 & Parakeet-TDT-0.6B-v3: Efficient and High-Performance Models for Multilingual ASR and AST
Monica Sekoyan, Nithin Rao Koluguri, Nune Tadevosyan +5
cs.CLeess.ASarXiv:2509.14128v22025
On Mean Absolute Error for Deep Neural Network Based Vector-to-Vector Regression
Jun Qi, Jun Du, Sabato Marco Siniscalchi +2
eess.AScs.LGcs.SDarXiv:2008.07281v12020
Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis
Hubert Siuzdak
cs.SDcs.LGeess.ASarXiv:2306.00814v32023
PSLA: Improving Audio Tagging with Pretraining, Sampling, Labeling, and Aggregation
Yuan Gong, Yu-An Chung, James Glass
cs.SDcs.LGeess.ASarXiv:2102.01243v32021
Multilingual and code-switching ASR challenges for low resource Indian languages
Anuj Diwan, Rakesh Vaideeswaran, Sanket Shah +19
cs.CLeess.ASarXiv:2104.00235v12021
How Private is Low-Frequency Speech Audio in the Wild? An Analysis of Verbal Intelligibility by Humans and Machines
Ailin Liu, Pepijn Vunderink, Jose Vargas Quiros +2
cs.SDcs.HCeess.ASarXiv:2407.13266v12024
Learning New Words from Unlabeled Test Data in Automatic Speech Recognition
Mengqi Wang, Mark A. Hasegawa-Johnson, Haolong Zheng +1
eess.AScs.CLarXiv:2609.28877v12026
Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognition
Zhifu Gao, Shiliang Zhang, Ian McLoughlin +1
cs.SDcs.CLeess.ASarXiv:2206.08317v32022
NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Quality
Xu Tan, Jiawei Chen, Haohe Liu +11
eess.AScs.AIcs.CLarXiv:2205.04421v22022
SoundReactor: Frame-level Online Video-to-Audio Generation
Koichi Saito, Julian Tanke, Christian Simon +7
cs.SDcs.LGeess.ASarXiv:2510.02110v12025
AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenario
Yihui Fu, Luyao Cheng, Shubo Lv +10
cs.SDeess.ASarXiv:2104.03603v42021
Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forward
Momina Masood, Marriam Nawaz, Khalid Mahmood Malik +2
cs.CRcs.LGcs.SDarXiv:2103.00484v22021
MiDashengLM-Spatial: Unifying General Audio Understanding and Spatial Awareness
Jinbo Hu, Hang Su, Lichun Fan +10
cs.SDeess.ASarXiv:2610.11156v12026
Neural Field-of-View for Binaural Signal Matching with Wearable Microphone Arrays
Matan Yifrach, Boaz Rafaely
eess.ASarXiv:2609.28343v12026
Edit Who Speaks, Control How They Speak: Global Timbre Editing and Local Instruction Control for TTS
Junchuan Zhao, Chenglin Xu, Wei Zeng +3
cs.SDeess.ASarXiv:2610.11437v12026
OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Models
Han Zhu, Lingxuan Ye, Wei Kang +7
cs.CLeess.ASarXiv:2604.00688v32026
MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategies
Ke Chen, Yusong Wu, Haohe Liu +3
cs.SDcs.AIcs.LGarXiv:2308.01546v12023
Discriminative Sounding Objects Localization via Self-supervised Audiovisual Matching
Di Hu, Rui Qian, Minyue Jiang +5
cs.CVcs.LGcs.MMarXiv:2010.05466v12020
Spatial Audio Signal Enhancement: A Multi-output MVDR Method in The Spherical Harmonic-domain
Huawei Zhang, Jihui Zhang, Huiyuan Sun +1
eess.ASarXiv:2409.03269v22024
Feature Learning in Deep Neural Networks - Studies on Speech Recognition Tasks
Dong Yu, Michael L. Seltzer, Jinyu Li +2
cs.LGcs.CLcs.NEarXiv:1301.3605v32013
M2MeT: The ICASSP 2022 Multi-Channel Multi-Party Meeting Transcription Challenge
Fan Yu, Shiliang Zhang, Yihui Fu +9
cs.SDeess.ASarXiv:2110.07393v32021
An Empirical Recipe for Universal Phone Recognition
Shikhar Bharadwaj, Chin-Jou Li, Kwanghee Choi +4
cs.CLcs.LGcs.SDarXiv:2603.29042v22026
Adversarial adaptive 1-D convolutional neural networks for bearing fault diagnosis under varying working condition
Bo Zhang, Wei Li, Jie Hao +2
eess.SPcs.LGcs.SDarXiv:1805.00778v32018
An Overview of Voice Conversion and its Challenges: From Statistical Modeling to Deep Learning
Berrak Sisman, Junichi Yamagishi, Simon King +1
eess.AScs.SDarXiv:2008.03648v22020
Alias-Free Oscillator Synchronization via Additive Synthesis
Jonas Roth, Domenic Keller, Oscar Castañeda +1
eess.ASeess.SParXiv:2608.27648v12026
Towards efficient models for real-time deep noise suppression
Sebastian Braun, Hannes Gamper, Chandan K. A. Reddy +1
eess.AScs.SDarXiv:2101.09249v22021
CycleGAN-VC2: Improved CycleGAN-based Non-parallel Voice Conversion
Takuhiro Kaneko, Hirokazu Kameoka, Kou Tanaka +1
cs.SDcs.LGeess.ASarXiv:1904.04631v12019
E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS
Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker +10
eess.AScs.SDarXiv:2406.18009v22024
MBNet: MOS Prediction for Synthesized Speech with Mean-Bias Network
Yichong Leng, Xu Tan, Sheng Zhao +3
cs.SDeess.ASarXiv:2103.00110v12021
AU-Harness: An Open-Source Toolkit for Holistic Evaluation of Audio LLMs
Hoang Nguyen, Sidharth Surapaneni, Akshay Kalkunte +9
cs.SDcs.AIcs.LGarXiv:2509.08031v32025
The Sound of Motions
Hang Zhao, Chuang Gan, Wei-Chiu Ma +1
cs.CVcs.SDeess.ASarXiv:1904.05979v12019
Adaptive pooling operators for weakly labeled sound event detection
Brian McFee, Justin Salamon, Juan Pablo Bello
cs.SDcs.LGeess.ASarXiv:1804.10070v22018
CharDuplex: Building Character-Consistent Full-Duplex Spoken Dialogue Models
Donghang Wu, Yisi Liu, Chen Chen +2
eess.ASarXiv:2609.34461v12026
Physiologically Informed Digital Auscultation for Pneumonia Detection in Long-term Care Residents
Nicholas Rasmussen, Oleg Zaslavsky, Zih-Ling Wang +5
cs.SDcs.CVcs.LGarXiv:2609.27222v12026
Minimum Word Error Rate Training for Attention-based Sequence-to-Sequence Models
Rohit Prabhavalkar, Tara N. Sainath, Yonghui Wu +4
cs.CLeess.ASstat.MLarXiv:1712.01818v12017
TTSlow: Slow Down Text-to-Speech with Efficiency Robustness Evaluations
Xiaoxue Gao, Yiming Chen, Xianghu Yue +2
eess.ASeess.SParXiv:2407.01927v12024
Pushing the limits of raw waveform speaker recognition
Jee-weon Jung, You Jin Kim, Hee-Soo Heo +3
eess.AScs.AIarXiv:2203.08488v22022
High-resolution Piano Transcription with Pedals by Regressing Onset and Offset Times
Qiuqiang Kong, Bochen Li, Xuchen Song +2
cs.SDeess.ASarXiv:2010.01815v32020
SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities
Hsiang-Sheng Tsai, Heng-Jui Chang, Wen-Chin Huang +14
cs.CLcs.SDeess.ASarXiv:2203.06849v12022
MFCC-based Recurrent Neural Network for Automatic Clinical Depression Recognition and Assessment from Speech
Emna Rejaibi, Ali Komaty, Fabrice Meriaudeau +2
cs.HCcs.AIcs.LGarXiv:1909.07208v22019
Transformers and Large Language Models for Efficient Intrusion Detection Systems: A Comprehensive Survey
Hamza Kheddar
cs.CRcs.AIcs.CLarXiv:2408.07583v22024
Towards End-to-End Prosody Transfer for Expressive Speech Synthesis with Tacotron
RJ Skerry-Ryan, Eric Battenberg, Ying Xiao +6
cs.CLcs.LGcs.SDarXiv:1803.09047v12018
MMAU-Pro: A Challenging and Comprehensive Benchmark for Holistic Evaluation of Audio General Intelligence
Sonal Kumar, Šimon Sedláček, Vaibhavi Lokegaonkar +31
eess.AScs.SDarXiv:2508.13992v12025
HEAR: Holistic Evaluation of Audio Representations
Joseph Turian, Jordie Shier, Humair Raj Khan +20
cs.SDcs.AIcs.LGarXiv:2203.03022v32022
Any-to-Any Generation via Composable Diffusion
Zineng Tang, Ziyi Yang, Chenguang Zhu +2
cs.CVcs.CLcs.LGarXiv:2305.11846v12023
Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generation
Xian Liu, Yinghao Xu, Qianyi Wu +3
cs.CVcs.GRcs.LGarXiv:2201.07786v12022
Semi-Supervised Speech Recognition via Local Prior Matching
Wei-Ning Hsu, Ann Lee, Gabriel Synnaeve +1
cs.CLcs.LGeess.ASarXiv:2002.10336v12020
UniCATS: A Unified Context-Aware Text-to-Speech Framework with Contextual VQ-Diffusion and Vocoding
Chenpeng Du, Yiwei Guo, Feiyu Shen +6
cs.SDeess.ASarXiv:2306.07547v62023
VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretation
Changhan Wang, Morgane Rivière, Ann Lee +6
cs.CLeess.ASarXiv:2101.00390v22021
ASVspoof 2019: spoofing countermeasures for the detection of synthesized, converted and replayed speech
Andreas Nautsch, Xin Wang, Nicholas Evans +7
eess.AScs.CRcs.SDarXiv:2102.05889v12021
The Sound of Pixels
Hang Zhao, Chuang Gan, Andrew Rouditchenko +3
cs.CVcs.SDeess.ASarXiv:1804.03160v42018
Deep Networks for Direction-of-Arrival Estimation in Low SNR
Georgios K. Papageorgiou, Mathini Sellathurai, Yonina C. Eldar
eess.SPcs.LGcs.SDarXiv:2011.08848v12020

Audio and Speech Processing

Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech

Exemplar-Free Analytic Learning for Multi-Label Audio Class-Incremental Learning

Perceiver: General Perception with Iterative Attention

Adaptive Feature Selection for End-to-End Speech Translation

Mapping Written Words to Spoken Words in a Different Language Using Only Visual Grounding

SwanTale: Unified Multi-Speaker Speech and Audio Generation for Instruct and Zero-Shot Tasks

EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesis

WST-Graph: Topology-Preserving Wavelet Scattering Front-End for Speech Deepfake Detection

Canary-1B-v2 & Parakeet-TDT-0.6B-v3: Efficient and High-Performance Models for Multilingual ASR and AST

On Mean Absolute Error for Deep Neural Network Based Vector-to-Vector Regression

Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis

PSLA: Improving Audio Tagging with Pretraining, Sampling, Labeling, and Aggregation

Multilingual and code-switching ASR challenges for low resource Indian languages

How Private is Low-Frequency Speech Audio in the Wild? An Analysis of Verbal Intelligibility by Humans and Machines

Learning New Words from Unlabeled Test Data in Automatic Speech Recognition

Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognition

NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Quality

SoundReactor: Frame-level Online Video-to-Audio Generation

AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenario

Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forward

MiDashengLM-Spatial: Unifying General Audio Understanding and Spatial Awareness

Neural Field-of-View for Binaural Signal Matching with Wearable Microphone Arrays

Edit Who Speaks, Control How They Speak: Global Timbre Editing and Local Instruction Control for TTS

OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Models

MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategies

Discriminative Sounding Objects Localization via Self-supervised Audiovisual Matching

Spatial Audio Signal Enhancement: A Multi-output MVDR Method in The Spherical Harmonic-domain

Feature Learning in Deep Neural Networks - Studies on Speech Recognition Tasks

M2MeT: The ICASSP 2022 Multi-Channel Multi-Party Meeting Transcription Challenge

An Empirical Recipe for Universal Phone Recognition

Adversarial adaptive 1-D convolutional neural networks for bearing fault diagnosis under varying working condition

An Overview of Voice Conversion and its Challenges: From Statistical Modeling to Deep Learning

Alias-Free Oscillator Synchronization via Additive Synthesis

Towards efficient models for real-time deep noise suppression

CycleGAN-VC2: Improved CycleGAN-based Non-parallel Voice Conversion

E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS

MBNet: MOS Prediction for Synthesized Speech with Mean-Bias Network

AU-Harness: An Open-Source Toolkit for Holistic Evaluation of Audio LLMs

The Sound of Motions

Adaptive pooling operators for weakly labeled sound event detection

CharDuplex: Building Character-Consistent Full-Duplex Spoken Dialogue Models

Physiologically Informed Digital Auscultation for Pneumonia Detection in Long-term Care Residents

Minimum Word Error Rate Training for Attention-based Sequence-to-Sequence Models

TTSlow: Slow Down Text-to-Speech with Efficiency Robustness Evaluations

Pushing the limits of raw waveform speaker recognition

High-resolution Piano Transcription with Pedals by Regressing Onset and Offset Times

SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities

MFCC-based Recurrent Neural Network for Automatic Clinical Depression Recognition and Assessment from Speech

Transformers and Large Language Models for Efficient Intrusion Detection Systems: A Comprehensive Survey

Towards End-to-End Prosody Transfer for Expressive Speech Synthesis with Tacotron

MMAU-Pro: A Challenging and Comprehensive Benchmark for Holistic Evaluation of Audio General Intelligence

HEAR: Holistic Evaluation of Audio Representations

Any-to-Any Generation via Composable Diffusion

Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generation

Semi-Supervised Speech Recognition via Local Prior Matching

UniCATS: A Unified Context-Aware Text-to-Speech Framework with Contextual VQ-Diffusion and Vocoding

VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretation

ASVspoof 2019: spoofing countermeasures for the detection of synthesized, converted and replayed speech

The Sound of Pixels

Deep Networks for Direction-of-Arrival Estimation in Low SNR