AI accuracy check · for businesses
Is your chatbot telling your customers the truth?
I check the AI chat assistant on your website against your own information, and show you every answer it gets wrong before your customers see it.
What we found · October 2026
17 of 30 dental practice chatbots got a patient's question wrong, or couldn't answer it.
Our own test
We asked dental practices' chatbots the questions patients ask, each one answered on the practice's own website. Of the 30, 6 gave an answer their own website contradicts, and 11 more couldn't answer at least one.
Since then: 56 of 120 chatbots got at least one of their own facts wrong or only half right.
And for 296 of 566 businesses without a chatbot, ChatGPT, Perplexity or Gemini told a customer something wrong or half right about them.
See the dental results → What AI tells customers about businesses →Caught live · our own screenshots
Three wrong answers, straight from the chat box.
It quoted last year's NHS price.
Their own website saysBand 2 – £76.60
A UK dental practice · 24 Oct 2026
It said the price isn't listed. It is.
Their own website saysInvisalign® Lite (14 Aligners) from £3000
A UK dental practice · 23 Oct 2026
It offered a slot after they close.
Their own website saysFriday: 9.00am – 4.00pm
A UK dental practice · 23 Oct 2026
Practice names and logos blocked out. Answers exactly as they appeared.
No chatbot? AI still answers for you
Recently, AI got it wrong.
- A private clinic Gemini said a 50-year-old can book Its own website says the service is only for people aged 65 and over
- A firm of solicitors Gemini said funds clear by next working day Its own website says cheques take 4 working days to clear
- A private clinic Gemini said assessment fees are typically not deducted Its own website says the £50 is deducted from further treatment costs
- A dental practice Perplexity said it will acknowledge a complaint within 7 working days Its own website says normally 3 working days
- A dental practice Perplexity said the charge is £20 per 10 minutes, so £60 for 30 minutes Its own website says £1 per minute, about £30 for a 30-minute appointment
No chatbot? £295.
I check what ChatGPT, Perplexity, Gemini and Copilot tell your customers about you, against your own website.
Book this checkIt has already cost businesses
What the chatbot says, the business said.
Air Canada · Chat November 2022, ruling February 2024
“If you need to travel immediately or have already travelled and would like to submit your ticket for a reduced bereavement rate, kindly do so within 90 days of the date your ticket was issued…”
The airline's real policy said otherwise. The tribunal made it pay the customer back: "It should be obvious to Air Canada that it is responsible for all the information on its website."
Source: Tribunal decision, 2024 BCCRT 149New York City's business advice chatbot · 2024 to 2026
“Yes, you can make your restaurant cash-free.”
That's illegal in New York City. Reporters caught it telling businesses to break the law, and the city shut it down.
Source: The MarkupHow a check works
You don't have to do anything. I do the checking.
-
I start from your website
Your own prices, hours and policies, plus anything you tell me your customers ask. Nothing to install, no logins, no customer data.
-
I put your assistant through my system
The same system I use to test the big AI assistants every month, in public, with every answer on record.
See the latest public results → -
Every answer is checked against your own rules
Independently, and checked again, so no verdict rests on one opinion.
-
You see everything
The full results, every wrong answer beside the right one, and what it should say, in a list you can send to whoever provides your chatbot. Then I test it again to make sure it's put right.
Who's checking
Marking AI's homework.
I'm Ben Dixon, and I came at this the sceptic's way round. I wanted to use AI for real work, didn't quite trust it, so I started marking its homework. Ask a model a plain question and it will hand you a fact that never happened, footnote it, and cite a source that doesn't exist, all with a perfectly straight face. Watch that once and you can't unsee it.
Who it's for
Any bot that answers your customers.
- Dental practices
- Clinics
- Care providers
- Schools
- Letting agents
- Shops
Anywhere a confident wrong answer about prices, pay, rules, refunds or bookings becomes a complaint, a wage claim or worse.
The check
£495 fixed
- Turnaround 5 working days
- You pay when the report arrives. Nothing to fix, nothing to pay
- Re-test included, once within 30 days of the report
- You keep the full results, every answer on record
- Keep it right Your prices and hours change; your chatbot doesn't notice. For £149 a month I check it every month and tell you the moment it slips. Cancel any time
- Includes what ChatGPT, Perplexity, Gemini and Copilot tell your customers about you
Get in touch
Ask your chatbot before your customers do.
Tell me what your customers ask, and I'll show you what your bot tells them.
- The full check Every question your customers really ask, a full report, and a re-test. £495. Book a check
- Not sure yet? I'll ask your chatbot three of your customers' questions, or ChatGPT or Perplexity if you don't have one, and email you what it said. Free. Free check
- Build chatbots for clients? I'll check them independently before they go live. Talk to me