OpenBMB has added a GGUF‑quantized version of MiniCPM‑V‑4.7‑35B‑A3B‑DSpark to Hugging Face. The draft checkpoint works with the matching MiniCPM‑V target model for speculative decoding, allowing up to 15 draft tokens per forward pass. It can be run with llama.cpp or vLLM using the provided command‑line flags. The model supports vision‑text inputs and runs with BF16 precision in the original weights.
Why it matters
Developers can now run a large multimodal model faster on consumer hardware by using the lightweight GGUF draft.
