# Open‑source Jevstiller lets you run Jev queries locally

> The community tool creates a small on‑device model that handles familiar Jev requests, cutting token costs and latency.

Oossa · 2026-09-29 · https://oossa.com/en/open-source-jevstiller-lets-you-run-jev-queries-locally

Jevstiller is an open‑source project that builds a tiny local model to answer routine Jev queries on your own hardware. The local model learns from Jev responses and only forwards uncertain requests to Jev’s cloud service. Its creators say it can answer familiar queries in about 15 ms and avoid the $42 per billion token fee. They claim the tool matches Jev’s answers 98 % of the time while keeping the rest of the traffic in the cloud for safety.

The system continuously audits a fixed 2 % of requests against Jev to keep the agreement rate in check and retrains itself when the rate drops.

## The facts

- Target agreement with Jev: 98 %
- Local response latency: ~15 ms

## Why it matters

Running Jev locally can slash AI usage costs and speed up response times for common tasks.

## Sources & references

1. [Open source tool distills Jev so you can run it locally](https://www.theregister.com/ai-and-ml/2026/09/29/open-source-tool-distills-jev-so-you-can-run-it-locally/5299856) – The Register, 2026-09-29

Last updated: 2026-09-29