The open‑source llama.cpp project released a new version that adds support for classifier_pooling, a setting used by ModernBERT rerankers. The change lets the library read and write the pooling type, defaulting to mean when unspecified. It also renames the internal field to pooling_type_cls. The update is available for a wide range of OSes and hardware, from Apple Silicon Macs to Linux GPUs and Android devices.
Why it matters
It makes llama.cpp more usable for search and ranking tasks across many devices.