The “Are You Sure?” Problem: Why Your AI Keeps Changing Its Mind
The large language models that millions of people rely on for advice – ChatGPT, Claude, Gemini – will change their answers nearly 60% of the time when a user simply pushes back by asking “are you sure?,” according to a study by Fanous et al. that tested GPT-4o, Claude Sonnet, and Gemini 1.5 Pro across math and medical domains.

The behavior, known in the … ⌘ Read more