Oossa

Study Finds Web-Search LLMs Can Repeat Data-Void Content

Researchers tested ChatGPT, Gemini and Sonar Pro, finding attacker-controlled pages in answers 31% of the time across their test conditions.

NoteBy Published by Oossa: 1 min read

A study posted on arXiv reports that a single strategically placed webpage can influence answers from web-searching AI systems. The researchers tested ChatGPT, Gemini and Sonar Pro with prompts on topics where reliable online information was scarce, varying prompt tone and other attacker-controlled factors.

Across the tested conditions, content controlled by an attacker appeared in responses 31% of the time. Skeptical prompts slightly reduced success and increased warnings, but the study found no large effects from prompt tone or model choice. The paper is an extended version slated to appear at the NDSS Symposium 2027.

Why it matters

People using these systems for information on topics with few reliable sources may encounter strategically published material, while the study found that skeptical wording offered only limited protection.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.