The llama.cpp release adds Q2_0 row dequantization and matrix multiplication to its WebGPU backend. The release notes give no performance figures.
NoteBy OossaPublished by Oossa: 1 min read
The ggml-org team has released llama.cpp b11809, adding support for Q2_0 to its WebGPU backend. The change covers both row dequantization and matrix multiplication, the release notes say. They provide no speed, hardware-compatibility or memory-use results, so the practical performance impact is unclear.
Developers using llama.cpp with WebGPU can try Q2_0 models, but the release notes do not say how well they will run on specific devices.
Models
Canva's new AI creates up to 2K images with detailed layouts and editable text, available to all users via Dream Lab and the API.
Models
The update adds 14 voices, including Hindi and Finnish, and reaches existing generative-voice users without code changes or a price increase.
Models
Uber says its global workforce will use ChatGPT Work after an earlier 1,000-person pilot. The company has not disclosed the rollout’s cost.
Oossa · Newsletter
The week in AI, explained
Every Monday: the stories worth knowing, in plain language. Free, no spam.
