← All AI terms
What does Token mean?
Token
The small piece of text a language model reads and writes, often part of a word. Prices and limits are usually counted in tokens.
News that mentions Token
- Vertiv and NVIDIA unveil AI‑factory method promising up to 30% more token output
- llama.cpp release b11813 adds Tekken tokenizer and new binaries
- Inception launches Mercury 3 diffusion LLM with 1,068 tokens per second
- llama.cpp b11782 release fixes token count bug
- llama.cpp adds per‑expert token scaling for MoE models
- Anthropic claims 90‑99% drop in Claude reasoning token theft