Oossa

ALTK‑Evolve pushes retail customer‑service agent to top of τ²‑bench leaderboard

Using GPT‑4.1 and learned prompt guidelines, IBM Research’s agent hits 67.5% Pass⁴ on the retail benchmark, beating all frontier models.

NoteBy Published by Oossa: 1 min read

IBM Research released ALTK‑Evolve, a method that adds a short playbook of learned guidelines to a basic ReAct customer‑service agent that runs on GPT‑4.1. The added rules raise the agent’s Pass⁴ score on the τ²‑bench retail task to 67.5%, the highest reported in the October 12 2026 leaderboard snapshot. No model weights are changed and no human labeling is required.

Why it matters

Retail companies can achieve top‑ranking, reliable automated support using only prompt tweaks rather than expensive model fine‑tuning.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.