# New benchmark tests AI agents on open scientific research problems

> The 'Into the Unknown' benchmark gives AI agents a paper and a research direction, asking them to write a follow‑up study.

Oossa · 2026-10-16 · https://oossa.com/en/new-benchmark-tests-ai-agents-on-open-scientific-research-problems

Researchers released the Into the Unknown benchmark on 15 Oct 2026. It hands an AI agent a science paper plus a DOE lab‑provided research direction and asks it to draft a follow‑up paper. Nine frontier agents each produced 15 drafts across fields like quantum computing and materials science. None met all the scientists’ conditions, and 114 failed an integrity check for claims or data inconsistencies. The code and data are open for others to use.

## The facts

- Benchmark name: Into the Unknown
- 135 AI‑written follow‑up papers evaluated

## Why it matters

It shows current AI agents can generate plausible research drafts but still fall short of scientific standards, highlighting the gap for future tool development.

## Sources & references

1. [Into the Unknown: Benchmarking AI agents on open scientific research problems](https://arxiv.org/abs/2610.19159) – arXiv, 2026-10-15

Last updated: 2026-10-16
