Skip to content

Source paper

Flavors of Moonshine: Tiny Specialized ASR Models for Edge Devices

Evan King, Adam Sabra, Manjunath Kudlur and 2 more

Evan King, Adam Sabra, Manjunath Kudlur, James Wang, Pete Warden

arXiv 2509.02523 · 20259 upvotes on Hugging Face

Research ideas from this paper (3)

Generated by AI. The paper’s authors did not write these.

AI summary

This paper introduces 'Moonshine,' a family of tiny (27M parameter) monolingual ASR models optimized for edge devices, specifically targeting underrepresented languages like Arabic, Vietnamese, and Ukrainian. By leveraging a data strategy that combines public datasets, pseudo-labeling, and synthetic data generation, the authors demonstrate that specialized tiny models can significantly outperform comparably sized multilingual models (like Whisper Tiny) and match larger ones (Whisper Medium).

How it works (AI summary)

The authors utilize the Moonshine architecture, an encoder-decoder transformer using Rotary Position Embeddings (RoPE) and variable-length input processing to avoid unnecessary padding computation. They employ a three-stage data approach: aggregating public ASR data, pseudo-labeling raw audio from the web, and synthesizing speech from text-only datasets using TTS models.