One-Step Consistency Distillation for Binary Diffusion Heads
Apply consistency distillation or adversarial diffusion distillation to binary diffusion heads so student models map hidden states directly to token distributions in one or two steps, bypassing iterative Euler solvers.