Audio and Speech Processing

Papers filed under eess.AS on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

961 to 1,020 of 1,641

Pruned CTC for Memory-Efficient Large-Vocabulary ASR Training
Yifan Yang, Xiaoyu Yang, Zengrui Jin +10
eess.ASarXiv:2609.33645v12026
Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners
Yazhou Xing, Yingqing He, Zeyue Tian +2
cs.CVcs.MMcs.SDarXiv:2402.17723v12024
Light Convolutional Neural Network with Feature Genuinization for Detection of Synthetic Speech Attacks
Zhenzong Wu, Rohan Kumar Das, Jichen Yang +1
eess.ASarXiv:2009.09637v12020
GhostWord: A Fine-Grained Backdoor Attack on Automatic Speech Recognition
Mojtaba Nafez, Mobina Poulaei, Kiarash Kiani Feriz +4
eess.AScs.SDarXiv:2609.04260v12026
A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild
K R Prajwal, Rudrabha Mukhopadhyay, Vinay Namboodiri +1
cs.CVcs.LGcs.SDarXiv:2008.10010v12020
VoxMem: Benchmarking Multimodal Memory in Large Audio Language Models
Yang Xiao, Vidhyasaharan Sethu, Eun-Jung Holden +1
eess.AScs.SDarXiv:2609.32607v12026
BeepBank-500: A Synthetic Earcon Mini-Corpus for UI Sound Research and Psychoacoustics Research
Mandip Goswami
eess.AScs.SDarXiv:2509.17277v12025
CAD: Conflict-Aware Decoding to Mitigate Cross-Modal Hallucinations in Omnimodal Large Language Models
Yuchen Deng, Chang Sun, Hai-Tao Zheng +2
eess.AScs.SDarXiv:2609.04247v12026
FuseCodec: Semantic-Contextual Fusion and Supervision for Neural Codecs
Md Mubtasim Ahasan, Rafat Hasan Khan, Tasnim Mohiuddin +6
cs.SDcs.AIcs.CLarXiv:2509.11425v22025
HINTT Submission to the 2nd MLC-SLM Challenge: Comparing Cascaded and Unified Approaches to Diarization and ASR
Takanori Ashihara, Kohei Matsuura, Masato Mimura
eess.AScs.CLarXiv:2610.08063v12026
Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generation
Dongchan Min, Dong Bok Lee, Eunho Yang +1
eess.AScs.CLcs.LGarXiv:2106.03153v32021
Dialogue-Based Streaming Audio-Visual Target Speaker Extraction with Predictive Dialogue Information
Shuhan Zhang, Wenxuan Wu, Haizhou Li
cs.SDeess.ASarXiv:2609.30774v12026
Robust Sound Source Tracking Using SRP-PHAT and 3D Convolutional Neural Networks
David Diaz-Guerra, Antonio Miguel, Jose R. Beltran
eess.AScs.LGcs.SDarXiv:2006.09006v22020
DeCoAR 2.0: Deep Contextualized Acoustic Representations with Vector Quantization
Shaoshi Ling, Yuzong Liu
eess.AScs.CLcs.LGarXiv:2012.06659v12020
Seamless: Multilingual Expressive and Streaming Speech Translation
Seamless Communication, Loïc Barrault, Yu-An Chung +62
cs.CLcs.SDeess.ASarXiv:2312.05187v12023
SE-DiCoW: Self-Enrolled Diarization-Conditioned Whisper
Alexander Polok, Dominik Klement, Samuele Cornell +4
eess.AScs.LGarXiv:2601.19194v12026
Dual-Signal Transformation LSTM Network for Real-Time Noise Suppression
Nils L. Westhausen, Bernd T. Meyer
eess.AScs.SDarXiv:2005.07551v22020
A Novel Sentence Stress Detection Framework Leveraging Auxiliary Word-Stress Modeling and Loss Optimization
Tien-Hong Lo, Fong-Chun Tsai, Ting-An Hung +3
eess.AScs.CLarXiv:2610.07626v12026
AVLnet: Learning Audio-Visual Language Representations from Instructional Videos
Andrew Rouditchenko, Angie Boggust, David Harwath +11
cs.CVcs.CLcs.MMarXiv:2006.09199v22020
A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Filling
Haihong E, Peiqing Niu, Zhongfu Chen +1
cs.CLcs.AIeess.ASarXiv:1907.00390v12019
Federated Learning for Keyword Spotting
David Leroy, Alice Coucke, Thibaut Lavril +2
eess.AScs.CLcs.LGarXiv:1810.05512v42018
Multilogue-Net: A Context Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in Conversation
Aman Shenoy, Ashish Sardana
cs.CLcs.LGcs.SDarXiv:2002.08267v32020
Multilingual sequence-to-sequence speech recognition: architecture, transfer learning, and language modeling
Jaejin Cho, Murali Karthick Baskar, Ruizhi Li +6
cs.CLcs.LGcs.SDarXiv:1810.03459v12018
Sudo rm -rf: Efficient Networks for Universal Audio Source Separation
Efthymios Tzinis, Zhepei Wang, Paris Smaragdis
eess.AScs.CLcs.LGarXiv:2007.06833v12020
VIBEVOICE-ASR Technical Report
Zhiliang Peng, Jianwei Yu, Yaoyao Chang +21
cs.SDcs.AIeess.ASarXiv:2601.18184v22026
Predictive audio representations for early detection and tracking of hidden dynamic objects
Katerina Vinciguerra, Moritz Brandes, Danilo Hollosi +1
cs.SDcs.AIeess.ASarXiv:2609.13595v12026
Improving GANs for Speech Enhancement
Huy Phan, Ian V. McLoughlin, Lam Pham +4
cs.LGcs.SDeess.ASarXiv:2001.05532v32020
Acoustivision Pro: An Open-Source Interactive Platform for Room Impulse Response Analysis and Acoustic Characterization
Mandip Goswami
eess.AScs.SDeess.SParXiv:2602.12299v12026
ToxicTone: A Mandarin Audio Dataset Annotated for Toxicity and Toxic Utterance Tonality
Yu-Xiang Luo, Yi-Cheng Lin, Ming-To Chuang +9
eess.AScs.CLcs.SDarXiv:2505.15773v12025
OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching
Hieu-Nghia Huynh-Nguyen, Ngoc Son Nguyen, Huynh Nguyen Dang +3
cs.SDcs.AIeess.ASarXiv:2505.12800v12025
TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech
Andy T. Liu, Shang-Wen Li, Hung-yi Lee
eess.AScs.CLcs.LGarXiv:2007.06028v32020
Low Bit-Rate Speech Coding with VQ-VAE and a WaveNet Decoder
Cristina Gârbacea, Aäron van den Oord, Yazhe Li +4
cs.LGcs.SDeess.ASarXiv:1910.06464v12019
SAID: Semantic Acoustic Imaging Detector for Sound Event Localization and Detection
Runbang Wang, Zining Liang, Yin Cao +1
eess.AScs.SDarXiv:2609.31492v12026
End-to-End Joint ASR and Speaker Role Diarization with Child-Adult Interactions
Anfeng Xu, Tiantian Feng, Somer Bishop +2
eess.AScs.SDarXiv:2601.17640v22026
Divide and Conquer: A Deep CASA Approach to Talker-independent Monaural Speaker Separation
Yuzhou Liu, DeLiang Wang
cs.SDcs.LGeess.ASarXiv:1904.11148v12019
Improving RNN Transducer Modeling for End-to-End Speech Recognition
Jinyu Li, Rui Zhao, Hu Hu +1
cs.CLeess.ASarXiv:1909.12415v12019
Separating Voice from Age in COPD Screening
George P. Kafentzis, Nikoletta Arvaniti
eess.AScs.LGcs.SDarXiv:2608.21599v12026
Overview and Meta-Analysis of DCASE 2026 Challenge Task 6: Audio Moment Retrieval from Long Audio
Hokuto Munakata, Tatsuya Komatsu, Keisuke Imoto +3
eess.AScs.SDarXiv:2609.12484v22026
Improving Cross-Corpus Speech Emotion Recognition with Adversarial Discriminative Domain Generalization (ADDoG)
John Gideon, Melvin G McInnis, Emily Mower Provost
cs.LGcs.SDeess.ASarXiv:1903.12094v22019
Augmented Ultrasonic Data for Machine Learning
Iikka Virkkunen, Tuomas Koskinen, Oskari Jessen-Juhler +1
eess.SPcs.LGcs.SDarXiv:1903.11399v12019
Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale
Matthew Le, Apoorv Vyas, Bowen Shi +8
eess.AScs.CLcs.LGarXiv:2306.15687v22023
Unsupervised Learning of Disentangled and Interpretable Representations from Sequential Data
Wei-Ning Hsu, Yu Zhang, James Glass
cs.LGcs.CLcs.SDarXiv:1709.07902v12017
Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Models
Arushi Goel, Sreyan Ghosh, Jaehyeon Kim +8
cs.SDcs.AIcs.CLarXiv:2507.08128v22025
Bytes are All You Need: End-to-End Multilingual Speech Recognition and Synthesis with Bytes
Bo Li, Yu Zhang, Tara Sainath +2
eess.AScs.CLcs.LGarXiv:1811.09021v12018
Speech Robust Bench: A Robustness Benchmark For Speech Recognition
Muhammad A. Shah, David Solans Noguero, Mikko A. Heikkila +2
eess.AScs.CLcs.LGarXiv:2403.07937v32024
Adversarial Attacks Against Automatic Speech Recognition Systems via Psychoacoustic Hiding
Lea Schönherr, Katharina Kohls, Steffen Zeiler +2
cs.CRcs.SDeess.ASarXiv:1808.05665v22018
LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesis
Qingkai Fang, Yan Zhou, Shoutao Guo +2
cs.CLcs.AIcs.SDarXiv:2505.02625v12025
StarGAN-VC2: Rethinking Conditional Methods for StarGAN-Based Voice Conversion
Takuhiro Kaneko, Hirokazu Kameoka, Kou Tanaka +1
cs.SDcs.LGeess.ASarXiv:1907.12279v22019
X-Translator: A Real-Time Multilingual Speaker-Aware Speech-to-Speech Translation System
Yuxiang Zhao, Yichi Zhang, Yanjie An +10
eess.AScs.AIarXiv:2607.17544v12026
AudioLM: a Language Modeling Approach to Audio Generation
Zalán Borsos, Raphaël Marinier, Damien Vincent +8
cs.SDcs.LGeess.ASarXiv:2209.03143v22022
Description and Discussion on DCASE2020 Challenge Task2: Unsupervised Anomalous Sound Detection for Machine Condition Monitoring
Yuma Koizumi, Yohei Kawaguchi, Keisuke Imoto +8
eess.AScs.LGcs.SDarXiv:2006.05822v22020
Domain-Incremental Learning for Multi-Channel Replay Speech Detection
Michael Neri
eess.AScs.CRcs.SDarXiv:2609.11194v12026
Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos
Sreyan Ghosh, Arushi Goel, Kaousheik Jayakumar +19
eess.AScs.CVarXiv:2607.16107v12026
The T05 System for The VoiceMOS Challenge 2024: Transfer Learning from Deep Image Classifier to Naturalness MOS Prediction of High-Quality Synthetic Speech
Kaito Baba, Wataru Nakata, Yuki Saito +1
cs.SDcs.AIcs.LGarXiv:2409.09305v12024
Unsupervised Learning of Semantic Audio Representations
Aren Jansen, Manoj Plakal, Ratheet Pandya +5
cs.SDeess.ASstat.MLarXiv:1711.02209v12017
Masked Audio Generation using a Single Non-Autoregressive Transformer
Alon Ziv, Itai Gat, Gael Le Lan +6
cs.SDcs.AIcs.LGarXiv:2401.04577v22024
Less can be More: What Aspects of Speech Drive End-of-Turn Detection
Rini Sharon, Manickavela A, Kadri Hacioglu +1
eess.AScs.AIcs.SDarXiv:2609.11066v12026
Diarization Error Decomposition Under Pause Annotation Ambiguity
Shota Horiguchi, Marc Delcroix, Naohiro Tawara +1
eess.AScs.SDarXiv:2609.11007v22026
MuLan: A Joint Embedding of Music Audio and Natural Language
Qingqing Huang, Aren Jansen, Joonseok Lee +3
eess.AScs.CLcs.SDarXiv:2208.12415v12022
Qwen-Audio-3.1-Realtime: Towards Reliable Agentic Voice Interaction
Lujia Bao, Qian Chen, Luyao Cheng +15
eess.AScs.AIcs.CLarXiv:2609.25176v22026

Audio and Speech Processing

Pruned CTC for Memory-Efficient Large-Vocabulary ASR Training

Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners

Light Convolutional Neural Network with Feature Genuinization for Detection of Synthetic Speech Attacks

GhostWord: A Fine-Grained Backdoor Attack on Automatic Speech Recognition

A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild

VoxMem: Benchmarking Multimodal Memory in Large Audio Language Models

BeepBank-500: A Synthetic Earcon Mini-Corpus for UI Sound Research and Psychoacoustics Research

CAD: Conflict-Aware Decoding to Mitigate Cross-Modal Hallucinations in Omnimodal Large Language Models

FuseCodec: Semantic-Contextual Fusion and Supervision for Neural Codecs

HINTT Submission to the 2nd MLC-SLM Challenge: Comparing Cascaded and Unified Approaches to Diarization and ASR

Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generation

Dialogue-Based Streaming Audio-Visual Target Speaker Extraction with Predictive Dialogue Information

Robust Sound Source Tracking Using SRP-PHAT and 3D Convolutional Neural Networks

DeCoAR 2.0: Deep Contextualized Acoustic Representations with Vector Quantization

Seamless: Multilingual Expressive and Streaming Speech Translation

SE-DiCoW: Self-Enrolled Diarization-Conditioned Whisper

Dual-Signal Transformation LSTM Network for Real-Time Noise Suppression

A Novel Sentence Stress Detection Framework Leveraging Auxiliary Word-Stress Modeling and Loss Optimization

AVLnet: Learning Audio-Visual Language Representations from Instructional Videos

A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Filling

Federated Learning for Keyword Spotting

Multilogue-Net: A Context Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in Conversation

Multilingual sequence-to-sequence speech recognition: architecture, transfer learning, and language modeling

Sudo rm -rf: Efficient Networks for Universal Audio Source Separation

VIBEVOICE-ASR Technical Report

Predictive audio representations for early detection and tracking of hidden dynamic objects

Improving GANs for Speech Enhancement

Acoustivision Pro: An Open-Source Interactive Platform for Room Impulse Response Analysis and Acoustic Characterization

ToxicTone: A Mandarin Audio Dataset Annotated for Toxicity and Toxic Utterance Tonality

OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching

TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech

Low Bit-Rate Speech Coding with VQ-VAE and a WaveNet Decoder

SAID: Semantic Acoustic Imaging Detector for Sound Event Localization and Detection

End-to-End Joint ASR and Speaker Role Diarization with Child-Adult Interactions

Divide and Conquer: A Deep CASA Approach to Talker-independent Monaural Speaker Separation

Improving RNN Transducer Modeling for End-to-End Speech Recognition

Separating Voice from Age in COPD Screening

Overview and Meta-Analysis of DCASE 2026 Challenge Task 6: Audio Moment Retrieval from Long Audio

Improving Cross-Corpus Speech Emotion Recognition with Adversarial Discriminative Domain Generalization (ADDoG)

Augmented Ultrasonic Data for Machine Learning

Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale

Unsupervised Learning of Disentangled and Interpretable Representations from Sequential Data

Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Models

Bytes are All You Need: End-to-End Multilingual Speech Recognition and Synthesis with Bytes

Speech Robust Bench: A Robustness Benchmark For Speech Recognition

Adversarial Attacks Against Automatic Speech Recognition Systems via Psychoacoustic Hiding

LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesis

StarGAN-VC2: Rethinking Conditional Methods for StarGAN-Based Voice Conversion

X-Translator: A Real-Time Multilingual Speaker-Aware Speech-to-Speech Translation System

AudioLM: a Language Modeling Approach to Audio Generation

Description and Discussion on DCASE2020 Challenge Task2: Unsupervised Anomalous Sound Detection for Machine Condition Monitoring

Domain-Incremental Learning for Multi-Channel Replay Speech Detection

Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos

The T05 System for The VoiceMOS Challenge 2024: Transfer Learning from Deep Image Classifier to Naturalness MOS Prediction of High-Quality Synthetic Speech

Unsupervised Learning of Semantic Audio Representations

Masked Audio Generation using a Single Non-Autoregressive Transformer

Less can be More: What Aspects of Speech Drive End-of-Turn Detection

Diarization Error Decomposition Under Pause Annotation Ambiguity

MuLan: A Joint Embedding of Music Audio and Natural Language

Qwen-Audio-3.1-Realtime: Towards Reliable Agentic Voice Interaction