Tool Audit.
Does the tool do the task, or just sound like it did? One invented an options table. One misread an annual report by a factor of a thousand. Verdicts per task, with the screenshots.
Posts here put named AI tools against tasks I'd run anyway: same prompts, same day, fresh conversations, outputs saved verbatim. Verdicts are per task, not per tool, because no single tool wins a whole research session. In my testing Claude reads documents best, Perplexity is for cited retrieval, ChatGPT is the dependable middle, and Gemini structures research well on big names, and invents things around options.
Each audit names a winner for the task it tested, shows the screenshots behind the verdict, and records what each tool got wrong as carefully as what it got right. The worst failures (an invented options premium table, an annual-report misread off by a factor of a thousand) are kept in the evidence register with dates and screenshots.
Tools change fast, so every post carries the model version and the date it ran. A verdict from January isn't a verdict on today's model, which is half the argument for testing rather than trusting.
-
Is ChatGPT reliable? A task-by-task audit
Is ChatGPT reliable? Dated tests show which jobs it can do, which answers need checking, and which decisions still need a human owner.
Read -
Is Grok good for stock research? What four tests showed
Four dated free-tier Grok tests: one factor-of-1,000 unit error, one balanced TSLA answer, useful pushback, and an invalid constraint test.
Read -
AI stock research tools tested: 3 failed, 1 stayed clean
Four AI stock research tools tested on real positions: three produced a dated failure; Claude stayed clean on the no-chain prompt. Receipts included.
Read -
Is Perplexity good for investment research? One 1,000× error, one clean rerun
In one May test, Perplexity turned $6.1m into $6K; the exact June rerun got it right. Here is what those captures support for investment research.
Read -
Robinhood Cortex Digests review: tested in May, gone by June
I tested Robinhood Cortex Digests on a UK ISA in May 2026. It disappeared from that account in June; Robinhood's UK site now advertises it again.
Read -
Best free AI for stock market analysis: 7 tested (2026)
Seven free AI tools for stock market analysis, each tested at its real free tier. No trials counted as free. One per stage, with the honest limit on each.
Read