Ollama announced version 0.40.17‑rc0. The update adds mmap support for Vulkan GPUs, letting the model use GPU memory more efficiently. It also enables concurrent text generation in the MLX backend and improves how the ChatGPT command‑line interface restores after a crash. The llama.cpp library was upgraded to commit b12257, and a new contributor made their first pull request.
Why it matters
Developers can run larger models faster on compatible GPUs, reducing latency for local AI applications.