Oossa

Ollama releases version 0.40.17-rc0

The open‑source AI runtime adds GPU memory mapping, concurrent generation, and a smoother ChatGPT CLI restart.

NoteBy Published by Oossa: 1 min read

Ollama announced version 0.40.17‑rc0. The update adds mmap support for Vulkan GPUs, letting the model use GPU memory more efficiently. It also enables concurrent text generation in the MLX backend and improves how the ChatGPT command‑line interface restores after a crash. The llama.cpp library was upgraded to commit b12257, and a new contributor made their first pull request.

Why it matters

Developers can run larger models faster on compatible GPUs, reducing latency for local AI applications.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.