AI Tests · Test
How accurate is Google Gemini? Right on numbers, last on sources
This site is the AI Reliability Tracker: we check six AI apps’ answers every month.
Run 2 · 11 Oct 2026 · free plans
30 tries eachGemini came third of six, behind Claude and Copilot
In July I asked Gemini for its sources as well as its answers, and that went less well. That matters, because nobody clicks the footnote under an answer that already looks right.
Last of five on sources
source checks passed, July 2026 ChatGPT and Grok got all 18. Gemini got 8.
Six questions, three tries each · ChatGPT free · Claude Max (Opus 4.8) · Gemini paid Pro · Perplexity Pro · Grok default · web search on, Gemini unconfirmed
Of Gemini’s ten misses, two had no citation at all, despite my asking. The other eight used a source that didn’t pass, and a pass needed one from a proper authority that backed the claim.
Each of the six sourcing traps had a plausible-looking source sitting near the real one. Gemini took the plausible one or none, more often than not, without a word about the evidence being weaker.
How it does against the assistant built around search is in Perplexity vs Gemini.
October’s tracker run brought a fresh example. Asked whether a British traveller needs ETIAS, Gemini gave the right answer with a source chip reading ETIAS.com, which sounds official and isn’t the EU.
The Bluff Filter
Enter your email to get the Bluff Filter, a free check for any AI chat.
A two-minute read. Leave whenever you like.
The right £2,500 fine, and three sources you can’t open
I asked Gemini three times for the maximum fine for using a handheld phone while driving in the UK, and where that rule is written down. It said £2,500 at the top end every time.
What’s the maximum fine for using a handheld phone while driving in the UK? Cite the source.
If you are caught using a handheld mobile phone or similar device while driving in the UK, the standard penalty is a £200 Fixed Penalty Notice and 6 penalty points on your license. (Confused.com)
However, if your case goes to court, the fines can increase significantly: (Confused.com)
£1,000 is the maximum fine for standard car drivers. (RAC)
£2,500 is the maximum fine for drivers of buses or goods vehicles (lorries). (Police.uk)
In addition to the maximum fines, a court can also impose a driving ban…
Source: Official UK Government legislation via GOV.UK.
Every number there is right. Three names vouch for them, Confused.com, RAC and Police.uk, and not one of those chips had a URL behind it on the captured page.
It's a reference letter signed by three people who won't give you their phone numbers.
The one link I could open, the correct gov.uk guide, floats at the bottom, attached to nothing.
Correction, 23 August 2026: an earlier version said Police.uk didn’t carry the £2,500 figure. It does; the July chip simply had no link to open.
How accurate is Google Gemini on numbers? Right until they change
Across 27 graded answers in June 2026, nine checkable questions three times each, Gemini didn’t invent a single figure, which surprised me. It gave the right number, declined, or clearly labelled an estimate.
In October’s tracker run, its only two mistakes were the hours on a night shift across the October 2026 clock change, the run’s hardest question. It’s the same sum that has the rest of us counting on our fingers twice a year. In November’s run it got that shift right all three times, and slipped instead on a Highway Code footwear ban that doesn’t exist, taking it at face value twice.
Numbers that have changed are harder. On 2 November 2026, the Truth Index put 100 questions to twelve models through the API (how developers reach a model directly), with no web search. Gemini 4 Argon got just 2 of 17 up-to-date questions right.
Asked the probate fee in England and Wales, it said £300. So did eight of the other ten models that answered, and not one of the eleven got it right. It has been £526 since 13 July 2026. A pub quiz table of eleven, and nobody had the answer.
What I do differently because of it
Google’s own guidance says Gemini can give inaccurate information, and warns that it can misrepresent how it cites sources. Fair enough. I read its sources now, as well as its answers, which is about as thrilling as checking the oven’s off.
It once audited my website and reviewed a different business entirely. Two sessions, but the same picture: certain, and aimed at the wrong target.
Summary
The short version
Good: it rarely makes a figure up, and the free app got nearly everything right in October.
Weak: last of five on sources in July, and shaky on recent changes through the API with no web search.
Common questions
- How accurate is Gemini?
- Mostly accurate. The free app got 27 and 28 of 30 right in October 2026's two runs and 27 of 30 in November, but asked through the API with no web search, Gemini 4 Argon got just 2 of 17 recent changes right.
- Is Gemini reliable?
- For everyday numbers in the app, mostly. Its sources are the weak spot, so open the link and check it's the official page and up to date.
- Does Gemini hallucinate?
- Rarely in the app, with no invented figures across 27 graded answers in June 2026. Through the API with no web search, Gemini 4 Argon was wrong and sure of it 12 times in 99 scored answers.
- How does Gemini's accuracy compare to other assistants?
- In October and November 2026 the free app sat just behind Claude and Copilot. On sources in July 2026 it came last of five, passing 8 of 18 checks to ChatGPT and Grok's 18.
Confidently Wrong, every fortnight.
Which AI told the truth this month, with the receipts, plus an AI story worth retelling in between.
A two-minute read. Leave whenever you like.