Oossa

llama.cpp b12344 cancels tool calls after disconnects

The llama.cpp release adds server-side cancellation for MCP tool calls when a client disconnects or times out, and includes builds for several platforms.

NoteBy Published by Oossa: 1 min read

The ggml-org team released llama.cpp b12344 with a server change that cancels MCP tool calls when a client disconnects or times out. MCP is a way for AI apps to connect to external tools. The release page also offers builds for macOS, iOS and several Linux systems.

Why it matters

For developers running llama.cpp servers, the change is intended to stop tool calls from continuing after a client has disconnected or timed out; the release notes do not say how much server capacity this may save.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.