Skip to content

Source paper

TADA: A Generative Framework for Speech Modeling via Text-Acoustic Dual Alignment

Trung Dang, Sharath Rao, Ananya Gupta and 6 more

Trung Dang, Sharath Rao, Ananya Gupta, Christopher Gagne, Panagiotis Tzirakis, Alice Baird, Jakub Piotr Cłapa, Peter Chin, Alan Cowen

arXiv 2602.23068 · 2026

Research ideas from this paper (3)

Generated by AI. The paper’s authors did not write these.

AI summary

This paper introduces TADA, a generative framework that unifies text and speech modeling within a Large Language Model by establishing a one-to-one synchronization between continuous acoustic features and discrete text tokens. This approach addresses the frequency mismatch between text and audio, virtually eliminating content hallucinations and enabling highly efficient, single-stream autoregressive speech synthesis.

How it works (AI summary)

The framework utilizes an alignment-aware Variational Autoencoder (VAE) to compress high-frequency acoustic features into latent vectors that map directly to text tokens via Connectionist Temporal Classification (CTC) and Viterbi forced alignment. A Llama-based LLM is then augmented with a flow-matching head to autoregressively predict these synchronized continuous acoustic latents and their temporal durations in a unified stream.