Skip to content
DIXON.AI The AI Reliability Tracker
Menu

Earlier test, before the monthly tracker. Asked 25 Jun 2026.

Earlier test

Can the AI read Microsoft's annual report?

Can the AI read Microsoft’s annual report correctly?

What was Microsoft’s total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?

The prompt

6 of 6 apps got it right

All 6 answered correctly, a clean pass on this one.

The verdicts

25 Jun 2026

Every app, cleanest first

  1. ChatGPT Free Correct 3/3 exact $245.122B / $109.433B (run 3 captured 2026-06-26 on the resume, after the browser-lock fix).
  2. Claude Max · paid Correct 3/3 exact $245.1B / $109.4B.
  3. Copilot Free · Smart Correct 3/3 clean against the 10-K ($245.122B revenue / $109.433B operating income); one run quoted the exact filing figures. The graded numbers carried live microsoft.com links throughout.
  4. Gemini Pro · paid Correct 3/3 = $245.1B / $109.4B.
  5. Grok Free · Grok 4.3 Fast Correct 3/3 exact $245.122B / $109.433B.
  6. Perplexity Pro · paid Correct 3/3 exact $245.122B / $109.433B.
  • 6 right

Each row is the verdict from three tries, graded case by case against the primary source. A confidently wrong answer is the worst outcome: a wrong answer served as reliable, with no hedge. Refusing when no answer is possible is not a miss.

What they actually said

The saved answer behind each grade

ChatGPT answered: correct 25 Jun 2026

Try 1 · temporary chat, memory off · The founding battery

The prompt, as sent What was Microsoft's total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?

For Microsoft's fiscal year 2024 (year ended 30 June 2024):

Total revenue: $245.1 billion

Operating income: $109.4 billion

These figures are reported under GAAP in Microsoft's FY2024 annual results and represent year-over-year growth of about 16% in revenue and 24% in operating income. microsoft.com +1

ChatGPT, verbatim, as captured

Saved 25 Jun 2026 as docs/research/test-results/scoreboard-n3-2026-06-25/chatgpt/q3-run1.md

Claude answered: correct 25 Jun 2026

Try 1 · temporary/incognito chat, memory off · The founding battery

The prompt, as sent What was Microsoft's total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?

Microsoft's fiscal year 2024 (ended June 30, 2024) financial results were strong. Let me give you the key figures.

For the full fiscal year 2024, Microsoft reported total revenue of approximately $245.1 billion, up about 16% from the prior year's $211.9 billion. Operating income came in at roughly $109.4 billion, an increase of about 24% year-over-year.

These figures come from Microsoft's audited annual results. The strong growth was driven largely by the Intelligent Cloud segment (including Azure) and the Productivity and Business Processes segment.

Since you're asking about specific reported figures, let me confirm these are accurate against the official numbers.

The figures are confirmed against Microsoft's official results. For fiscal year 2024 (ended June 30, 2024):

Revenue was $245.1 billion and increased 16% compared to the prior fiscal year. Operating income was $109.4 billion and increased 24% on a GAAP basis (up 22% non-GAAP). Microsoft Microsoft

For additional context, net income was $88.1 billion and increased 22%, and Microsoft Cloud revenue increased 23% to $137.4 billion, which was a major driver of the year's growth. sec sec

One note: a couple of secondary sources mistakenly list these figures in "millions" rather than "billions" — the correct unit is billions of US dollars, as reported in Microsoft's official 8-K and annual report.

Claude, verbatim, as captured

Saved 25 Jun 2026 as docs/research/test-results/scoreboard-n3-2026-06-25/claude/q3-run1.md

Copilot answered: correct 18 Jul 2026

Try 1 · fresh chat via "New chat" button, memory ON per run spec — recorded as-found, not toggled · Copilot joins the board

The prompt, as sent What was Microsoft's total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?

Copilot said

Microsoft's fiscal year 2024 (ended 30 June 2024) results are clearly stated in both the company's Annual Report and its Form 10‑K. The key figures are:

• Total revenue: $245.1 billion • Operating income: $109.4 billion

These values appear consistently across Microsoft's official filings and investor materials. [citation: microsoft.com — "Microsoft 2024 Annual Report"] [citation: Microsoft — "FY24 Q4 - Income Statements - Investor Relations - Microsoft"]

Breakdown and context

Microsoft's FY24 was a record year driven by strong cloud and AI demand:

Revenue grew 16% year‑over‑year, reaching $245.1 billion. [citation: microsoft.com — "Microsoft 2024 Annual Report"]

Operating income increased 24% year‑over‑year, reaching $109.4 billion. [citation: Microsoft — "FY24 Q4 - Income Statements - Investor Relations - Microsoft"]

Intelligent Cloud remained the largest contributor, with Azure and other cloud services up 29–30%. [citation: sec.gov — "EX-99.1"]

If you want, I can also break down FY24 revenue by segment, compare FY24 vs FY23, or chart Microsoft's financial performance over the last decade.

[source chips: www.microsoft.com — Microsoft 2024 Annual Report | Microsoft — FY24 Q4 - Income Statements - Investor Relations - Microsoft | "Show all"]

Copilot, verbatim, as captured

Saved 18 Jul 2026 as docs/research/test-results/copilot-board-2026-07-18/copilot/q3-r1.md

Gemini answered: correct 25 Jun 2026

Try 1 · temporary chat, memory off · The founding battery

The prompt, as sent What was Microsoft's total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?

For the fiscal year 2024 (ended June 30, 2024), Microsoft reported the following financial results:

Total Revenue: $245.1 billion SEC.gov

Operating Income: $109.4 billion agolution

These figures represent a 16% increase in revenue and a 24% increase in operating income compared to the previous fiscal year. agolution

Gemini, verbatim, as captured

Saved 25 Jun 2026 as docs/research/test-results/scoreboard-n3-2026-06-25/gemini/q3-run1.md

Grok answered: correct 25 Jun 2026

Try 1 · private chat, memory off · The founding battery

The prompt, as sent What was Microsoft's total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?

Microsoft's fiscal year 2024 (ended June 30, 2024) results: [Microsoft]

Total revenue: $245.122 billion (up 16% year-over-year). [Microsoft] Operating income: $109.433 billion (up 24% year-over-year). [Microsoft]

These figures come directly from Microsoft's official FY24 earnings releases, annual report, and 10-K/8-K filings. [Microsoft.gcs-web]

For context, this reflects strong growth across segments (especially Intelligent Cloud/Azure and Productivity/Business Processes), with full details available in Microsoft's investor relations materials. Note that FY25 figures (ended June 30, 2025) were higher: ~$281.7B revenue and ~$128.5B operating income.

Grok, verbatim, as captured

Saved 25 Jun 2026 as docs/research/test-results/scoreboard-n3-2026-06-25/grok/q3-run1.md

Perplexity answered: correct 25 Jun 2026

Try 1 · temporary/incognito chat, memory off · The founding battery

The prompt, as sent What was Microsoft's total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?

Microsoft's fiscal year 2024 total revenue was $245.122 billion, and operating income was $109.433 billion. These figures are for the year ended 30 June 2024. [microsoft]

Perplexity, verbatim, as captured

Saved 25 Jun 2026 as docs/research/test-results/scoreboard-n3-2026-06-25/perplexity/q3-run1.md

Cite this finding

Writing about this? Copy the result with its source.

The per-question grades are also machine-readable at /scoreboard/rdri.json (CC BY 4.0).

AI Reliability Scoreboard: Can the AI read Microsoft’s annual report correctly?
Asked (25 June 2026): "What was Microsoft’s total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?"
Correct answer: Microsoft FY2024 10-K, filed with the SEC (EDGAR).
Result across 6 AI assistants (N=3, memory off; Copilot, joined 18 Jul 2026, memory on as found, disclosed; graded vs the primary source): All 6 answered correctly, a clean pass on this one.
Source: https://dixon.ai/scoreboard/q/microsoft-fy2024-revenue-operating-income/, DIXON.AI (CC BY 4.0)