# AI chatbots miss key facts in financial counseling tests

> Vals AI and NextLadder Ventures found 28 models often give advice without gathering essential client details.

Oossa · 2026-11-13 · https://oossa.com/en/ai-chatbots-miss-key-facts-in-financial-counseling-tests

Vals AI and NextLadder Ventures released a benchmark on Nov 13, 2026 that tested 28 general‑purpose AI models in 256 simulated low‑income financial counseling scenarios. The models frequently gave advice before collecting basic facts like income or household size. Even the strongest models left out about one‑fifth of key client information, and in one out of ten chats they relied on wrong assumptions. Free versions of ChatGPT and Gemini missed critical points in roughly half of crisis conversations.

## The facts

- 28 AI models from 11 developers were evaluated between Sep 14 and Oct 12, 2026.
- In about 10% of conversations the advice was based on an incorrect assumption about the client.

## Why it matters

Low‑income families could receive incomplete or harmful financial guidance from popular chatbots.

## Sources & references

1. [Leading AI Models Still Missing Critical Details When Giving Financial Advice, New Research Finds](https://www.prnewswire.com/news-releases/leading-ai-models-still-missing-critical-details-when-giving-financial-advice-new-research-finds-302938452.html) – PR Newswire RSS, 2026-11-13

Last updated: 2026-11-13