Audio and Speech Processing

Papers filed under eess.AS on arXiv, each one already summarized by Paperlayer. Open any of them to read the summary beside the original PDF, with every point linked to the line, figure, or table it came from.

Search paper metadata (including unsummarized papers)

901 to 960 of 1,641

  1. emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation

    Ziyang Ma, Zhisheng Zheng, Jiaxin Ye +4

    cs.CLcs.HCcs.MMarXiv:2312.15185v12023
  2. Contextual Expressive Text-to-Speech

    Jianhong Tu, Zeyu Cui, Xiaohuan Zhou +4

    eess.AScs.CLcs.LGarXiv:2211.14548v12022
  3. Probing Warmth-Mediated Harm in Speech-Enabled LLMs for Mental-Health Conversations

    Eugenia Kim, Bolor-Erdene Jagdagdorj, Dina Pekelis +2

    eess.AScs.SDarXiv:2609.04256v12026
  4. ESPnet-Codec: Comprehensive Training and Evaluation of Neural Codecs for Audio, Music, and Speech

    Jiatong Shi, Jinchuan Tian, Yihan Wu +17

    eess.AScs.SDarXiv:2409.15897v22024
  5. How Reliable Are Predicted MOS for Reproducing Human System-Level Preferences in Speech Enhancement?

    Nahomi Kusunoki, Tsubasa Ochiai, Naohiro Tawara +4

    cs.SDeess.ASarXiv:2609.39032v12026
  6. High Fidelity Neural Audio Compression

    Alexandre Défossez, Jade Copet, Gabriel Synnaeve +1

    eess.AScs.AIcs.SDarXiv:2210.13438v12022
  7. FRCRN: Boosting Feature Representation using Frequency Recurrence for Monaural Speech Enhancement

    Shengkui Zhao, Bin Ma, Karn N. Watcharasupat +1

    cs.SDeess.ASarXiv:2206.07293v32022
  8. MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark

    S Sakshi, Utkarsh Tyagi, Sonal Kumar +6

    eess.AScs.AIcs.CLarXiv:2410.19168v12024
  9. Knowledge Distillation for Efficient Acoustic Echo Control

    Ernst Seidel, Pejman Mowlaee, Tim Fingscheidt

    eess.ASarXiv:2608.25596v12026
  10. StreamWSR: Streamable and Lightweight Waveform-Domain Neural Speech Super-Resolution

    Yuan Tian, Yang Ai, Hui-Peng Du +1

    eess.ASarXiv:2609.03381v12026
  11. The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterance

    Lin Zhang, Xin Wang, Erica Cooper +2

    eess.AScs.CRcs.SDarXiv:2204.05177v32022
  12. Variable-Rate Harmonic-Percussive Time-Scale Modification with Real-Time Playback in Python

    Sayema Lubis, Clark Peng, Jared Carreño +1

    cs.SDeess.ASarXiv:2609.18999v12026
  13. Voice2Series: Reprogramming Acoustic Models for Time Series Classification

    Chao-Han Huck Yang, Yun-Yun Tsai, Pin-Yu Chen

    cs.LGcs.AIcs.NEarXiv:2106.09296v32021
  14. WeNet 2.0: More Productive End-to-End Speech Recognition Toolkit

    Binbin Zhang, Di Wu, Zhendong Peng +7

    cs.SDcs.CLeess.ASarXiv:2203.15455v22022
  15. Perceiver IO: A General Architecture for Structured Inputs & Outputs

    Andrew Jaegle, Sebastian Borgeaud, Jean-Baptiste Alayrac +12

    cs.LGcs.CLcs.CVarXiv:2107.14795v32021
  16. MusPyExpress: Extending MusPy with Enhanced Expression Text Support

    Phillip Long, Hao-Wen Dong, Julian McAuley +1

    cs.SDcs.LGeess.ASarXiv:2608.21678v12026
  17. Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset

    Curtis Hawthorne, Andriy Stasyuk, Adam Roberts +6

    cs.SDcs.LGeess.ASarXiv:1810.12247v52018
  18. The Third VoicePrivacy Challenge: Preserving Emotional Expressiveness and Linguistic Content in Voice Anonymization

    Natalia Tomashenko, Xiaoxiao Miao, Pierre Champion +7

    cs.CLcs.SDeess.ASarXiv:2601.11846v12026
  19. Robust Self-Supervised Audio-Visual Speech Recognition

    Bowen Shi, Wei-Ning Hsu, Abdelrahman Mohamed

    cs.SDcs.CVcs.LGarXiv:2201.01763v32022
  20. Generalized End-to-End Loss for Speaker Verification

    Li Wan, Quan Wang, Alan Papir +1

    eess.AScs.CLcs.LGarXiv:1710.10467v52017
  21. FlashLabs Chroma 1.0: A Real-Time End-to-End Spoken Dialogue Model with Personalized Voice Cloning

    Tanyu Chen, Tairan Chen, Kai Shen +4

    cs.SDcs.CLeess.ASarXiv:2601.11141v12026
  22. CrossEdit: Cross-Modal Training Enables Rich Audio-Visual Editing

    William Chen, Prem Seetharaman, Ke Chen +10

    cs.SDeess.ASeess.IVarXiv:2610.10264v12026
  23. GLaS-JEPA: Gaussian-Regularized Speech SSL without Engineered Prediction Targets

    Gaspard Botté, Séverin Baroudi, Samir Sadok +5

    eess.AScs.AIcs.LGarXiv:2609.37798v12026
  24. End-to-End Spectro-Temporal Graph Attention Networks for Speaker Verification Anti-Spoofing and Speech Deepfake Detection

    Hemlata Tak, Jee-weon Jung, Jose Patino +3

    eess.AScs.SDarXiv:2107.12710v22021
  25. Geometric Ceilings on Time-Frequency Masking for Single-Channel Separation

    Maxime Baelde

    eess.SPcs.SDeess.ASarXiv:2609.03481v12026
  26. Speak, Read and Prompt: High-Fidelity Text-to-Speech with Minimal Supervision

    Eugene Kharitonov, Damien Vincent, Zalán Borsos +6

    cs.SDeess.ASarXiv:2302.03540v12023
  27. PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Prior

    Sang-gil Lee, Heeseung Kim, Chaehun Shin +7

    stat.MLcs.LGcs.SDarXiv:2106.06406v22021
  28. Silent Speech Interfaces for Speech Restoration: A Review

    Jose A. Gonzalez-Lopez, Alejandro Gomez-Alanis, Juan M. Martín-Doñas +2

    eess.AScs.HCcs.LGarXiv:2009.02110v32020
  29. Cross-domain Neural Pitch and Periodicity Estimation

    Max Morrison, Caedon Hsieh, Nathan Pruyne +1

    eess.AScs.SDarXiv:2301.12258v32023
  30. MusicRL: Aligning Music Generation to Human Preferences

    Geoffrey Cideron, Sertan Girgin, Mauro Verzetti +11

    cs.LGcs.SDeess.ASarXiv:2402.04229v12024
  31. ZeroPrompt: Streaming Acoustic Encoders are Zero-Shot Masked LMs

    Xingchen Song, Di Wu, Binbin Zhang +4

    cs.SDcs.CLeess.ASarXiv:2305.10649v12023
  32. Beyond Unified Models: A Service-Oriented Approach to Low Latency, Context Aware Phonemization for Real Time TTS

    Mahta Fetrat, Donya Navabi, Zahra Dehghanian +2

    cs.SDcs.CLeess.ASarXiv:2512.08006v12025
  33. LiVeAction: a Lightweight, Versatile, and Asymmetric Neural Codec Design for Real-time Operation

    Dan Jacobellis, Neeraja J. Yadwadkar

    eess.IVcs.LGcs.MMarXiv:2605.06628v12026
  34. Direction-preserving Spatial Audio Signal Enhancement in The Spherical Harmonic Domain

    Huawei Zhang, Jihui Aimee Zhang, Huiyuan June Sun +1

    eess.ASarXiv:2610.09701v12026
  35. A Lightweight Hybrid Framework for Acoustic Echo Cancellation and Suppression via Constrained Recursive Training

    Huawei Zhang, Rilin Chen, Hao Zhang +2

    eess.ASarXiv:2610.09655v12026
  36. Towards End-to-End Synthetic Speech Detection

    Guang Hua, Andrew Beng Jin Teoh, Haijian Zhang

    eess.ASarXiv:2106.06341v12021
  37. TTS-Q: Perception-Guided Post-Training Quantization of Text-to-Speech Diffusion Transformers

    Xiaoqin Feng, Yuqi Li, Weilun Feng +9

    cs.SDcs.LGeess.ASarXiv:2610.12474v12026
  38. Tracing Inputs, Verifying Outputs: Validating Attribution in Music Generation

    Taejun Kim, Wonil Kim, Jongmin Jung +10

    cs.SDcs.LGeess.ASarXiv:2610.09637v12026
  39. GEPARD - Generative, Prosody-aware, Autoregressive text-to-speech model for Realtime Dialogue

    Denis Pavlov, Ulanbek Abdurazakov, Nursultan Bakashov

    eess.AScs.CLcs.LGarXiv:2609.04222v12026
  40. End-to-End Neural Speaker Diarization with Self-attention

    Yusuke Fujita, Naoyuki Kanda, Shota Horiguchi +3

    eess.AScs.CLcs.SDarXiv:1909.06247v12019
  41. Machine learning in acoustics: theory and applications

    Michael J. Bianco, Peter Gerstoft, James Traer +4

    eess.SPcs.LGcs.SDarXiv:1905.04418v42019
  42. Federated Self-Learning with Weak Supervision for Speech Recognition

    Milind Rao, Gopinath Chennupati, Gautam Tiwari +4

    eess.AScs.SDarXiv:2306.12015v12023
  43. Proactive Hearing Assistants that Isolate Egocentric Conversations

    Guilin Hu, Malek Itani, Tuochao Chen +1

    cs.CLcs.SDeess.ASarXiv:2511.11473v12025
  44. Boundary-Free Contextual Biasing: Depth-Adaptive Gating and Reading-Space Matching for Unsegmented Languages

    Muhammad Huzaifah, Yu Pan, Zachary Yeo +2

    eess.AScs.CLcs.SDarXiv:2610.09467v12026
  45. Automatic Speech Recognition using Advanced Deep Learning Approaches: A survey

    Hamza Kheddar, Mustapha Hemis, Yassine Himeur

    cs.SDcs.AIeess.ASarXiv:2403.01255v22024
  46. Pyroomacoustics: A Python package for audio room simulations and array processing algorithms

    Robin Scheibler, Eric Bezzam, Ivan Dokmanić

    cs.SDeess.ASarXiv:1710.04196v12017
  47. Downstream-Task-Aware Unified Source Separation

    Yoshiki Mitsui, Ryo Aihara, Tatsuhiko Saito +5

    eess.ASarXiv:2609.11092v12026
  48. Interpreting Dolphin Vocal Sequences via Multiple Sequence Alignment

    Daniel Kohlsdorf, Denise Herzing, Thad Starner

    eess.ASarXiv:2609.08795v12026
  49. ASVspoof 2021: accelerating progress in spoofed and deepfake speech detection

    Junichi Yamagishi, Xin Wang, Massimiliano Todisco +8

    eess.AScs.CRcs.LGarXiv:2109.00537v12021
  50. InstructTTS: Modelling Expressive TTS in Discrete Latent Space with Natural Language Style Prompt

    Dongchao Yang, Songxiang Liu, Rongjie Huang +2

    cs.SDeess.ASarXiv:2301.13662v22023
  51. SwanVoice: Expressive Long-Form Zero-Shot Speech Synthesis for Both Monologue and Dialogue

    Ruiqi Li, Yu Zhang, Changhao Pan +3

    eess.ASarXiv:2605.30993v12026
  52. Unsupervised Speech Decomposition via Triple Information Bottleneck

    Kaizhi Qian, Yang Zhang, Shiyu Chang +2

    eess.AScs.LGcs.SDarXiv:2004.11284v62020
  53. OpenSTBench: Beyond Semantic Evaluation for Speech Translation

    Yanjie An, Yuxiang Zhao, Yichi Zhang +5

    eess.AScs.AIarXiv:2605.30792v12026
  54. Unsupervised Speech Enhancement via Drifting

    Diego Caviedes-Nozal, Liang Xu, Rasmus Kongsgaard Olsson +1

    cs.SDeess.ASarXiv:2609.34662v12026
  55. Description and Discussion on DCASE 2021 Challenge Task 2: Unsupervised Anomalous Sound Detection for Machine Condition Monitoring under Domain Shifted Conditions

    Yohei Kawaguchi, Keisuke Imoto, Yuma Koizumi +6

    eess.AScs.LGcs.SDarXiv:2106.04492v22021
  56. Scalable Context Orchestration for Serving LLMs Over Voice

    Linyi Jiang, Silvery D. Fu, Yifei Zhu

    cs.SDcs.AIeess.ASarXiv:2609.04288v12026
  57. BACHI: Boundary-Aware Symbolic Chord Recognition Through Masked Iterative Decoding on Pop and Classical Music

    Mingyang Yao, Ke Chen, Shlomo Dubnov +1

    cs.SDcs.LGeess.ASarXiv:2510.06528v22025
  58. PromptTTS: Controllable Text-to-Speech with Text Descriptions

    Zhifang Guo, Yichong Leng, Yihan Wu +2

    eess.AScs.CLcs.LGarXiv:2211.12171v12022
  59. Learning to Separate Object Sounds by Watching Unlabeled Video

    Ruohan Gao, Rogerio Feris, Kristen Grauman

    cs.CVcs.MMcs.SDarXiv:1804.01665v22018
  60. TagSpeech: End-to-End Multi-Speaker ASR and Diarization with Fine-Grained Temporal Grounding

    Mingyue Huo, Yiwen Shao, Yuheng Zhang

    eess.AScs.CLarXiv:2601.06896v22026