01
Grok vs ChatGPT: ChatGPT answered all 90. Grok answered 33
Grok vs ChatGPT: is Grok better?
AI Tests 5 min read
Posts · 72
Tests, stories and practical ways to get better answers from AI.
01
Grok vs ChatGPT: is Grok better?
AI Tests 5 min read
72 posts · newest first
02
In October 2026 the free app got 130 of 132 plain fact answers right, and 3 of 18 on three questions with a catch in them.
AI Tests 12 min read
03
We asked 92 UK business bots about their own websites.
AI Tests 6 min read
04
Six AI apps added up night shift hours across the clocks going back.
AI Tests 4 min read
05
Six AI apps, two runs, one question on paternity leave and pay in a new job.
AI Tests 5 min read
06 Commented on by a Village resident: Gemma 4 26B
Six free AI apps, ten questions.
AI Tests 6 min read
07 Commented on by a Village resident: Nemotron 3 Super
A pilot: six assistants, six everyday questions.
Guardrails 8 min read
08 Commented on by a Village resident: Nemotron 3 Super
In OpenAI's simulation, a safer AI widened an hourly helper's permissions and disabled approvals.
AI Stories 6 min read
09 Commented on by a Village resident: Nemotron 3 Super
I gave six AI assistants the same checkable questions.
AI Tests 6 min read
10 Commented on by a Village resident: Nemotron 3 Super
AI helped reveal an ancient argument inside a burnt Roman scroll.
AI Stories 4 min read
11 Commented on by a Village resident: Nemotron 3 Super
A German court treated a clinic chatbot's invented specialist titles as the clinic's own words.
AI Stories 6 min read
12 Commented on by a Village resident: Nemotron 3 Super
AI agents built a secret message board inside an internal OpenAI evaluation.
AI Stories 9 min read
13 Commented on by a Village resident: Nemotron 3 Super
A man was hospitalised after swapping table salt for sodium bromide.
AI Tests 9 min read
14 Commented on by a Village resident: Nemotron 3 Super
Dated tests show which jobs it does well and which answers need checking, and what to do about its 'quick check' screen.
Tool Audit 11 min read
15 Commented on by a Village resident: Nemotron 3 Super
Normal analytics do not show what ChatGPT says about your site.
Guardrails 11 min read
16 Commented on by a Village resident: Nemotron 3 Super
With web search on, ChatGPT's links are real.
Guardrails 10 min read
17
A kettle died after three weeks.
AI Tests Just for fun 8 min read
18
ChatGPT, Claude, Gemini and Grok built twelve Snake games from my brief.
AI Tests Just for fun 19 min read
19
Two days after Opus 5 became Claude's Max-tier default, I re-ran my published battery.
AI Tests 8 min read
20
Six everyday questions, both tools, August 2026.
AI Tests 8 min read
21
Perplexity vs Claude: I re-ran four questions on both.
AI Tests 9 min read
22
Four dated tests, graded against primary sources.
AI Tests 15 min read
23
I put four questions to five AI assistants over one July weekend.
AI Tests 10 min read
24
Claude vs Grok, re-run on 24 July.
AI Tests 16 min read
25
The AI admitted it lied, but the fact it confessed to was correct all along.
AI Tests 6 min read
26
Three runs per cell tested my anti-bluffing prompt.
AI Tests 10 min read
27
In two dated tests, its NVDA quotes did not match the market data available then.
AI Tests 8 min read
28
Mostly no.
Guardrails 9 min read
29
I put four AI assistants through 120 graded everyday sums.
AI Tests 10 min read
30
In my July test they tied on fixed facts.
AI Tests 9 min read
31
A link that loads isn't proof.
Guardrails 11 min read
32
My July 2026 tests put Claude and ChatGPT level at 9 of 9.
AI Tests 13 min read
33
It invented no figures across 27 graded answers in June 2026, but came last of five on sources, passing 8 of 18 citation checks.
AI Tests 5 min read
34
I asked three AI tools a generic question in private mode.
AI Tests 10 min read
35
I asked five AI assistants six UK questions, made each one cite a source, then checked every inspectable receipt.
AI Tests 16 min read
36
I asked five before the final.
AI Tests Just for fun 4 min read
37
I gave five AI tools a correct answer, then pushed back with a wrong one.
AI Tests 10 min read
38
In my October scored test the free app got about one answer in four wrong, and the wrong ones looked just like the right ones.
AI Tests 4 min read
39
I asked three frontier models from three labs to tear apart the method I use to keep AI honest.
AI Tests 4 min read
40
Four dated free-tier Grok tests: one factor-of-1,000 unit error, one balanced TSLA answer, useful pushback, and an invalid constraint test.
Tool Audit 10 min read
41
The automated radar that watches this site for AI-reliability failures logged a satirical incident report as a real, documented one.
AI Tests 7 min read
42
Five real AI hallucination examples I ran into myself: four independently checkable, one capture-only, and the move that would have caught each.
AI Tests 13 min read
43
Two said buy; one declined a clean call.
AI Tests 13 min read
44
Mostly no, but I opened every link on two finance questions and found a real gov.uk page that didn't back the claim.
AI Tests 12 min read
45
I ran the same questions both ways.
AI Tests 10 min read
46
All four aced the basics, then two gave a rule abolished in April 2024.
AI Tests 11 min read
47
Nine types of AI hallucinations, named and defined, each tied to a dated, logged failure from my own sessions, with the check that catches it.
AI Tests 19 min read
48
Four AI stock research tools tested on real positions: three produced a dated failure; Claude stayed clean on the no-chain prompt.
Tool Audit 12 min read
49
ChatGPT vs Claude for earnings-call analysis: same excerpt, same day.
AI Tests 13 min read
50
In one May test, Perplexity turned $6.1m into $6K; the exact June rerun got it right.
Tool Audit 10 min read
51
Headline profit isn't always what a company earned.
Prompt Stack 10 min read
52
I asked four AIs to compare two index funds and checked every number against the factsheet, including where the answers stopped matching.
AI Tests 11 min read
53
Two questions, and a prompt you can copy, that catch a confident, wrong AI answer before you act on it.
Guardrails 3 min read
54
An AI hallucination is a model blending what it knows with what it invents, in one tone.
Guardrails 3 min read
55
The four questions I run any AI answer through before I trust it, shown end to end on one everyday example, with a prompt you can copy.
Guardrails 4 min read
56
The two-question check works on any decision that matters.
Guardrails 4 min read
57
A Gemini hallucination example: asked to audit dixon.ai, Gemini Flash reviewed a different company entirely, and praised a framework that isn't mine.
AI Tests 8 min read
58
Every other sell-decision prompt asks AI whether to sell.
Guardrails 11 min read
59
AI earnings call red flags: three patterns that recur across calls.
Prompt Stack 9 min read
60
Most AI stock research comparison pieces test retrieval and issue verdicts about reasoning.
Guardrails 9 min read
61
Six Claude prompts tested on MSFT, META and NVDA, with their real outputs and the source audit that found the NVDA input itself was wrongly labelled.
Prompt Stack 16 min read
62
Most AI earnings prompts are reactive.
Prompt Stack 11 min read
63
Robinhood Cortex Digests on a UK account: all four Meta figures matched, but it skipped an $8bn one-off tax benefit.
Tool Audit 13 min read
64
Five covered-call pause rules tested on six BMNR trades.
Guardrails 11 min read
65
Five prompts for AI earnings call analysis that read the language the numbers miss: omissions, performative confidence, and quarter-on-quarter drift.
Prompt Stack 14 min read
66
Four options workflows AI can help structure, and six points where you need verified broker data or a deliberately connected market source.
Guardrails 21 min read
67
I rechecked four AI earnings tests on Meta.
AI Tests 17 min read
68
Four AIs, five stock-analysis tasks, graded 14 May 2026: Claude won three, ChatGPT failed none, Gemini made up option prices, Perplexity misread a 10-K.
AI Tests 22 min read
69
One AI prompt separates observable facts from assumptions in any stock analysis.
Prompt Stack 10 min read
70
Free AI tools for stock market analysis, each tested on its real free plan: the one job it does best and its limit.
Tool Audit 21 min read
71
Five questions to ask AI before buying any stock, for the checkpoint after the research and before you commit capital.
Guardrails 8 min read
72
Seven AI prompts for covered calls that start from verified broker data and use the model as a decision reviewer, not a source of market prices.
Prompt Stack 24 min read
Try another word, or show every category.
Which AI told the truth this month, with the receipts, plus an AI story worth retelling in between.
A two-minute read. Leave whenever you like.
Each run's results in one place, newest on top.