Ollama published v0.40.5-rc0, a release candidate for its local AI software. The update ports custom kernels previously used with Apple’s Metal graphics technology to CUDA, NVIDIA’s platform for GPU computing.
It also lets the OpenAI-compatible Responses API accept custom tool calls in conversation history. The release notes do not give performance figures or say when a final v0.40.5 release will arrive.
Why it matters
For Ollama users running NVIDIA GPUs, the CUDA port may make these custom kernels available on their hardware, though the notes do not report performance or confirm what will change in the final release.