AI & Tech··1 sources verified
Informal Test Finds ChatGPT and Google AI Mode Avoided Inventing Facts About Fake Software Firms
Summarised by Relevant News AI · Read time: 3 min
A Reddit user queried ChatGPT and Google AI Mode about nine invented software companies and got 18 answers with no fabricated prices or founders. Both tools typically said they couldn't verify the company, and Google's tool often pointed to real companies with similar names. On 26 real companies and 8 SaaS pricing pages, the answers matched Wikipedia and vendor sites in most cases, and the misses came from contradictory sources or from monthly-versus-annual pricing toggles.
Why it matters: The small, self-run sample suggests that verifiable lookups are a narrower failure mode than general hallucination benchmarks imply, but errors still come from source conflicts and billing-plan ambiguity, so teams should verify pricing and founding facts before relying on them.
All sources