# llama.cpp adds realtime transcription API

> The open‑source llama.cpp server now supports a live speech‑to‑text endpoint, handling API keys and websocket handshakes.

Oossa · 2026-10-21 · https://oossa.com/en/llama-cpp-adds-realtime-transcription-api

The ggml‑org/llama.cpp project released version b11780 on Oct 21 2026. It introduces a realtime transcription API that runs over websockets. The API checks an API key during the websocket handshake and returns 401 if the key is missing or wrong. Audio streams are now started as soon as the server slot is live, preventing dead‑locks that previously held the session open. The implementation follows the Google‑Assistant‑style Realtime schema, so clients must send audio at the model’s native sample rate.

## The facts

- Release date: Oct 21 2026 ("Wed Oct 21 2026 06:11:52 GMT+0200")
- Feature: realtime transcription API with websocket and API‑key authentication

## Why it matters

Developers can now add live speech‑to‑text to apps using llama.cpp without building their own server infrastructure.

## Sources & references

1. [ggml-org/llama.cpp b11780](https://github.com/ggml-org/llama.cpp/releases/tag/b11780) – llama.cpp, 2026-10-21

Last updated: 2026-10-21