Oossa

Architect introduces Liquid Inference auction platform for LLM requests

Architect Financial Technologies launches Liquid Inference, a marketplace where providers bid in real time to handle each LLM prompt.

NoteBy Published by Oossa: 1 min read

Architect Financial Technologies has rolled out Liquid Inference, an LLM router that runs a live auction for every request. Providers submit bids to serve each prompt, and the buyer pays the lowest offer that meets its rules. Developers only need to change the base URL in their code to use the service.

Why it matters

Developers can potentially lower inference costs by automatically selecting the cheapest provider that meets their criteria.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.