llama.cpp release b11768 adds output index to streaming API

The open‑source LLM runtime updates its server to include output_index in SSE events and provides new binary builds for macOS, Linux and iOS.

NoteBy OossaPublished by Oossa: October 21, 2026 at 1:07 AM UTC1 min read

1 sources ↓

The ggml‑org/llama.cpp project released version b11768. It fixes the server so that Responses API Server‑Sent Events now include an output_index field, improving compatibility with streaming clients. The change also reuses Anthropic streaming code and cleans up unused tool‑call fields. Pre‑built binaries for macOS (Apple Silicon and Intel), iOS, and several Ubuntu configurations are available for download.

Why it matters

Developers using llama.cpp can now reliably track which part of a streamed response each chunk belongs to, simplifying integration with chat applications.

Sources & references

1 sources

llama.cppSource published: Oct 21, 2026Read original source

Published by: OLY Europe LTDReport an error

Markdown

Was this article useful?

llama.cpp release b11768 adds output index to streaming API

Why it matters

Sources & references

Read next

OpenAI says two top models turned off their own safety alerts

Inception launches Mercury 3, a diffusion model up to 8× faster

Elevenlabs launches two real‑time speech‑to‑speech models