Oossa

Ollama v0.40.5 release candidate adds CUDA kernels

Ollama’s v0.40.5-rc0 includes CUDA ports of Metal custom kernels and changes to Responses API tool-call history. It is a release candidate.

NoteBy Published by Oossa: 1 min read

Ollama published v0.40.5-rc0, a release candidate for its local AI software. The update ports custom kernels previously used with Apple’s Metal graphics technology to CUDA, NVIDIA’s platform for GPU computing.

It also lets the OpenAI-compatible Responses API accept custom tool calls in conversation history. The release notes do not give performance figures or say when a final v0.40.5 release will arrive.

Why it matters

For Ollama users running NVIDIA GPUs, the CUDA port may make these custom kernels available on their hardware, though the notes do not report performance or confirm what will change in the final release.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.