Audio and Speech Processing

Papers filed under eess.AS on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

661 to 720 of 1,641

Attention-Based Models for Text-Dependent Speaker Verification
F A Rezaur Rahman Chowdhury, Quan Wang, Ignacio Lopez Moreno +1
eess.AScs.LGcs.SDarXiv:1710.10470v32017
MusicLM: Generating Music From Text
Andrea Agostinelli, Timo I. Denk, Zalán Borsos +10
cs.SDcs.LGeess.ASarXiv:2301.11325v12023
Multimodal Speaker Verification as a Threat to Speaker Anonymization
Ashi Garg, Cristina Aggazzotti, Leibny Paola García-Perera +1
eess.ASarXiv:2607.19636v12026
Emformer: Efficient Memory Transformer Based Acoustic Model For Low Latency Streaming Speech Recognition
Yangyang Shi, Yongqiang Wang, Chunyang Wu +5
cs.SDcs.CLcs.LGarXiv:2010.10759v42020
W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Training
Yu-An Chung, Yu Zhang, Wei Han +4
cs.LGcs.SDeess.ASarXiv:2108.06209v22021
Bayesian HMM clustering of x-vector sequences (VBx) in speaker diarization: theory, implementation and analysis on standard tasks
Federico Landini, Ján Profant, Mireia Diez +1
eess.AScs.SDarXiv:2012.14952v12020
MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Training
Yizhi Li, Ruibin Yuan, Ge Zhang +17
cs.SDcs.AIcs.CLarXiv:2306.00107v52023
Encoding Musical Style with Transformer Autoencoders
Kristy Choi, Curtis Hawthorne, Ian Simon +2
cs.SDcs.LGeess.ASarXiv:1912.05537v22019
Clotho: An Audio Captioning Dataset
Konstantinos Drossos, Samuel Lipping, Tuomas Virtanen
cs.SDcs.CLcs.LGarXiv:1910.09387v12019
WaveFlow: A Compact Flow-based Model for Raw Audio
Wei Ping, Kainan Peng, Kexin Zhao +1
cs.SDcs.CLcs.LGarXiv:1912.01219v42019
Speech Emotion Recognition with Dual-Sequence LSTM Architecture
Jianyou Wang, Michael Xue, Ryan Culhane +3
eess.AScs.LGcs.SDarXiv:1910.08874v42019
Audio-Based Activities of Daily Living (ADL) Recognition with Large-Scale Acoustic Embeddings from Online Videos
Dawei Liang, Edison Thomaz
cs.HCcs.LGcs.SDarXiv:1810.08691v22018
Weighted Speech Distortion Losses for Neural-network-based Real-time Speech Enhancement
Yangyang Xia, Sebastian Braun, Chandan K. A. Reddy +3
eess.AScs.SDarXiv:2001.10601v22020
PopMAG: Pop Music Accompaniment Generation
Yi Ren, Jinzheng He, Xu Tan +3
cs.SDcs.CLcs.IRarXiv:2008.07703v12020
Baichuan-Omni-1.5 Technical Report
Yadong Li, Jun Liu, Tao Zhang +90
cs.CLcs.SDeess.ASarXiv:2501.15368v12025
Music Source Separation in the Waveform Domain
Alexandre Défossez, Nicolas Usunier, Léon Bottou +1
cs.SDcs.LGeess.ASarXiv:1911.13254v22019
POP909: A Pop-song Dataset for Music Arrangement Generation
Ziyu Wang, Ke Chen, Junyan Jiang +5
cs.SDcs.IRcs.LGarXiv:2008.07142v12020
SC-GlowTTS: an Efficient Zero-Shot Multi-Speaker Text-To-Speech Model
Edresson Casanova, Christopher Shulby, Eren Gölge +6
eess.AScs.SDarXiv:2104.05557v22021
Large Margin Softmax Loss for Speaker Verification
Yi Liu, Liang He, Jia Liu
cs.SDeess.ASarXiv:1904.03479v12019
Spatial Audio Coding Through Relative Room Impulse Response Estimation
Nour Bouayed, Adrien Llave, Jérôme Daniel +1
eess.ASarXiv:2609.08542v12026
Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generation
Lingting Zhu, Xian Liu, Xuanyu Liu +3
cs.CVcs.SDeess.ASarXiv:2303.09119v22023
Multi-Speaker DOA Estimation Using Deep Convolutional Networks Trained with Noise Signals
Soumitro Chakrabarty, Emanuël A. P. Habets
eess.AScs.LGcs.SDarXiv:1807.11722v12018
AudioDec: An Open-source Streaming High-fidelity Neural Audio Codec
Yi-Chiao Wu, Israel D. Gebru, Dejan Marković +1
eess.ASarXiv:2305.16608v12023
VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
Sanyuan Chen, Shujie Liu, Long Zhou +6
cs.CLcs.SDeess.ASarXiv:2406.05370v22024
FireRedTTS-2: Towards Long Conversational Speech Generation for Podcast and Chatbot
Kun Xie, Feiyu Shen, Junjie Li +3
cs.SDeess.ASarXiv:2509.02020v22025
Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language
Alexei Baevski, Arun Babu, Wei-Ning Hsu +1
cs.LGcs.CLcs.SDarXiv:2212.07525v22022
Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection
Ruijie Tao, Zexu Pan, Rohan Kumar Das +3
eess.AScs.SDeess.IVarXiv:2107.06592v22021
Semantic Audio-Visual Navigation
Changan Chen, Ziad Al-Halah, Kristen Grauman
cs.CVcs.LGcs.ROarXiv:2012.11583v22020
Streaming automatic speech recognition with the transformer model
Niko Moritz, Takaaki Hori, Jonathan Le Roux
cs.SDcs.CLcs.LGarXiv:2001.02674v52020
Contrastive Audio-Visual Masked Autoencoder
Yuan Gong, Andrew Rouditchenko, Alexander H. Liu +4
cs.MMcs.CVcs.SDarXiv:2210.07839v42022
MADS: A Multiview Acoustic Descriptor Set Beyond Standard Spectral Summaries
Utsab Ghosh, Roshni Chakraborty
cs.SDcs.AIeess.ASarXiv:2609.00792v12026
MegaTTS 3: Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesis
Ziyue Jiang, Yi Ren, Ruiqi Li +11
eess.AScs.LGcs.SDarXiv:2502.18924v42025
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale
Arun Babu, Changhan Wang, Andros Tjandra +10
cs.CLcs.SDeess.ASarXiv:2111.09296v32021
FSD50K: An Open Dataset of Human-Labeled Sound Events
Eduardo Fonseca, Xavier Favory, Jordi Pons +2
cs.SDcs.LGeess.ASarXiv:2010.00475v22020
Scaling Speech Technology to 1,000+ Languages
Vineel Pratap, Andros Tjandra, Bowen Shi +13
cs.CLcs.SDeess.ASarXiv:2305.13516v12023
MARBLE: Music Audio Representation Benchmark for Universal Evaluation
Ruibin Yuan, Yinghao Ma, Yizhi Li +22
cs.SDcs.AIcs.LGarXiv:2306.10548v42023
Zero-Shot Multi-Speaker Text-To-Speech with State-of-the-art Neural Speaker Embeddings
Erica Cooper, Cheng-I Lai, Yusuke Yasuda +4
eess.ASarXiv:1910.10838v22019
MinMo: A Multimodal Large Language Model for Seamless Voice Interaction
Qian Chen, Yafeng Chen, Yanni Chen +33
cs.CLcs.AIcs.HCarXiv:2501.06282v12025
FaSNet: Low-latency Adaptive Beamforming for Multi-microphone Audio Processing
Yi Luo, Enea Ceolini, Cong Han +2
eess.AScs.LGcs.SDarXiv:1909.13387v22019
A Review of Machine Learning Methods Applied to Structural Dynamics and Vibroacoustic
Barbara Cunha, Christophe Droz, Abdelmalek Zine +2
cs.LGcs.SDeess.ASarXiv:2204.06362v22022
Fully Supervised Speaker Diarization
Aonan Zhang, Quan Wang, Zhenyao Zhu +2
eess.AScs.LGstat.MLarXiv:1810.04719v72018
Pengi: An Audio Language Model for Audio Tasks
Soham Deshmukh, Benjamin Elizalde, Rita Singh +1
eess.AScs.SDarXiv:2305.11834v22023
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations
Alexei Baevski, Henry Zhou, Abdelrahman Mohamed +1
cs.CLcs.LGcs.SDarXiv:2006.11477v32020
Recent Advances in End-to-End Automatic Speech Recognition
Jinyu Li
eess.AScs.AIcs.CLarXiv:2111.01690v22021
ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
Peng Wang, Shijie Wang, Junyang Lin +5
cs.CVcs.CLcs.SDarXiv:2305.11172v12023
FunASR: A Fundamental End-to-End Speech Recognition Toolkit
Zhifu Gao, Zerui Li, Jiaming Wang +8
cs.SDcs.CLeess.ASarXiv:2305.11013v12023
Imperceptible, Robust, and Targeted Adversarial Examples for Automatic Speech Recognition
Yao Qin, Nicholas Carlini, Ian Goodfellow +2
eess.AScs.LGcs.SDarXiv:1903.10346v22019
Listen, Think, and Understand
Yuan Gong, Hongyin Luo, Alexander H. Liu +2
eess.AScs.SDarXiv:2305.10790v32023
MTR-DuplexBench: Towards a Comprehensive Evaluation of Multi-Round Conversations for Full-Duplex Speech Language Models
He Zhang, Wenqian Cui, Haoning Xu +5
cs.CLcs.AIeess.ASarXiv:2511.10262v32025
Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memory
Li Siyao, Weijiang Yu, Tianpei Gu +5
cs.SDcs.CVeess.ASarXiv:2203.13055v22022
FastDiff: A Fast Conditional Diffusion Model for High-Quality Speech Synthesis
Rongjie Huang, Max W. Y. Lam, Jun Wang +4
eess.AScs.LGcs.SDarXiv:2204.09934v12022
MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound
Rowan Zellers, Jiasen Lu, Ximing Lu +7
cs.CVcs.CLcs.LGarXiv:2201.02639v42022
Computational bioacoustics with deep learning: a review and roadmap
Dan Stowell
cs.SDeess.ASq-bio.QMarXiv:2112.06725v12021
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Sanyuan Chen, Chengyi Wang, Zhengyang Chen +16
cs.CLcs.SDeess.ASarXiv:2110.13900v52021
FastSpeech 2: Fast and High-Quality End-to-End Text to Speech
Yi Ren, Chenxu Hu, Xu Tan +4
eess.AScs.CLcs.LGarXiv:2006.04558v82020
EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animation
Ziqiao Peng, Haoyu Wu, Zhenbo Song +5
cs.CVcs.SDeess.ASarXiv:2303.11089v22023
Counterpoint by Convolution
Cheng-Zhi Anna Huang, Tim Cooijmans, Adam Roberts +2
cs.LGcs.SDeess.ASarXiv:1903.07227v12019
Efficient Training of Audio Transformers with Patchout
Khaled Koutini, Jan Schlüter, Hamid Eghbal-zadeh +1
cs.SDcs.LGeess.ASarXiv:2110.05069v32021
MOSS-Audio-Tokenizer: Scaling Audio Tokenizers for Future Audio Foundation Models
Yitian Gong, Kuangwei Chen, Zhaoye Fei +9
cs.SDeess.ASarXiv:2602.10934v22026
Speaker Recognition Based on Deep Learning: An Overview
Zhongxin Bai, Xiao-Lei Zhang
eess.ASarXiv:2012.00931v22020

Audio and Speech Processing

Attention-Based Models for Text-Dependent Speaker Verification

MusicLM: Generating Music From Text

Multimodal Speaker Verification as a Threat to Speaker Anonymization

Emformer: Efficient Memory Transformer Based Acoustic Model For Low Latency Streaming Speech Recognition

W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Training

Bayesian HMM clustering of x-vector sequences (VBx) in speaker diarization: theory, implementation and analysis on standard tasks

MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Training

Encoding Musical Style with Transformer Autoencoders

Clotho: An Audio Captioning Dataset

WaveFlow: A Compact Flow-based Model for Raw Audio

Speech Emotion Recognition with Dual-Sequence LSTM Architecture

Audio-Based Activities of Daily Living (ADL) Recognition with Large-Scale Acoustic Embeddings from Online Videos

Weighted Speech Distortion Losses for Neural-network-based Real-time Speech Enhancement

PopMAG: Pop Music Accompaniment Generation

Baichuan-Omni-1.5 Technical Report

Music Source Separation in the Waveform Domain

POP909: A Pop-song Dataset for Music Arrangement Generation

SC-GlowTTS: an Efficient Zero-Shot Multi-Speaker Text-To-Speech Model

Large Margin Softmax Loss for Speaker Verification

Spatial Audio Coding Through Relative Room Impulse Response Estimation

Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generation

Multi-Speaker DOA Estimation Using Deep Convolutional Networks Trained with Noise Signals

AudioDec: An Open-source Streaming High-fidelity Neural Audio Codec

VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers

FireRedTTS-2: Towards Long Conversational Speech Generation for Podcast and Chatbot

Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language

Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection

Semantic Audio-Visual Navigation

Streaming automatic speech recognition with the transformer model

Contrastive Audio-Visual Masked Autoencoder

MADS: A Multiview Acoustic Descriptor Set Beyond Standard Spectral Summaries

MegaTTS 3: Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesis

XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale

FSD50K: An Open Dataset of Human-Labeled Sound Events

Scaling Speech Technology to 1,000+ Languages

MARBLE: Music Audio Representation Benchmark for Universal Evaluation

Zero-Shot Multi-Speaker Text-To-Speech with State-of-the-art Neural Speaker Embeddings

MinMo: A Multimodal Large Language Model for Seamless Voice Interaction

FaSNet: Low-latency Adaptive Beamforming for Multi-microphone Audio Processing

A Review of Machine Learning Methods Applied to Structural Dynamics and Vibroacoustic

Fully Supervised Speaker Diarization

Pengi: An Audio Language Model for Audio Tasks

wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations

Recent Advances in End-to-End Automatic Speech Recognition

ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

FunASR: A Fundamental End-to-End Speech Recognition Toolkit

Imperceptible, Robust, and Targeted Adversarial Examples for Automatic Speech Recognition

Listen, Think, and Understand

MTR-DuplexBench: Towards a Comprehensive Evaluation of Multi-Round Conversations for Full-Duplex Speech Language Models

Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memory

FastDiff: A Fast Conditional Diffusion Model for High-Quality Speech Synthesis

MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound

Computational bioacoustics with deep learning: a review and roadmap

WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing

FastSpeech 2: Fast and High-Quality End-to-End Text to Speech

EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animation

Counterpoint by Convolution

Efficient Training of Audio Transformers with Patchout

MOSS-Audio-Tokenizer: Scaling Audio Tokenizers for Future Audio Foundation Models

Speaker Recognition Based on Deep Learning: An Overview