Researchers led by Saikiran Bathula released a pre‑print on 15 Oct 2026 describing a tiny, frozen vocabulary for small language models. They swapped the usual learned embedding table in a Gemma‑style 270 M model with a 512‑bit codebook that is only 16 MB and has no trainable parameters. The model trained with this table matches or exceeds the original on benchmarks like LAMBADA and PIQA, while using far less memory and running 5–6× faster on a laptop CPU.
Why it matters
Developers can deploy tiny, fast language models on edge devices without sacrificing performance on common tasks.
