Oossa

Iterate.ai launches Lifeboat engine that fits up to six‑times more AI agent sessions per GPU

The new inference engine claims 2,048 concurrent sessions on a single RTX PRO 6000, letting enterprises run more agents without buying extra hardware.

NoteBy Published by Oossa: 1 min read

Iterate Studio Inc. released Lifeboat, an inference engine for large language models that includes confidential computing. The company says Lifeboat can host two to six times as many concurrent AI‑agent sessions on each GPU. In its own test a single Nvidia RTX PRO 6000 Blackwell card handled 2,048 sessions, double the baseline. Lifeboat uses fair scheduling, a larger key‑value cache and per‑session security capsules. A free developer license is available, with a paid Standard tier at $49.99 / month and a Confidential Computing tier at $499.99 / month.

Why it matters

Banks, insurers and health systems can run more AI agents on existing GPUs, avoiding extra hardware purchases.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.