Oossa

llama.cpp release b11795 adds server param forwarding

The open‑source llama.cpp library now forwards extra sampling parameters through its /v1/messages API and provides new binary builds for macOS, Linux and iOS.

NoteBy Published by Oossa: 1 min read

The ggml‑org team released llama.cpp version b11795. The update changes the server so that sampling parameters can be passed unchanged in the extra_params field of the /v1/messages endpoint. It also adds pre‑built binaries for macOS (Apple Silicon and Intel), iOS, and several Ubuntu CPU and Vulkan builds.

Why it matters

Developers can now customize generation settings via the API without extra code, speeding up integration of llama.cpp into apps.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.