Eazler AI Lab AI Engineering Journal
Skip to article
Trends◷ 14 min readUpdated:

AI agent performance jumped on benchmarks, but only about 2 in 10 respondents have scaled agents organization-wide

We rechecked our June 2026 note's claim that the AI market is shifting to agents, using the Stanford AI Index 2026 and McKinsey's 2025 and 2026 State of AI surveys. Benchmark scores show what agents can do in tests; enterprise adoption rates show how far companies have rolled them out

On this page

On 2026-06-16 this blog published a note saying that the center of the AI market was shifting quickly to "agentic systems that execute work." It cited no numbers. This report rechecks that claim, mainly against three source documents: the AI Index 2026, the annual report from Stanford's Institute for Human-Centered AI (HAI), and the 2025 and 2026 editions of State of AI, McKinsey's yearly enterprise survey. The evidence points in two directions. On benchmarks, leading AI agents are now scoring close to the human baseline, but in mid-2026 only about 2 in 10 respondents said their organization had scaled agents organization-wide. The two numbers measure different things, so neither can be used to explain the other.

Korean original: 한국어 원문 (2026-06-16, rewritten 2026-10-06)Scope: AI Index 2026 text and figures, McKinsey State of AI 2025 and 2026, two generative AI usage datasetsSources checked: 2026-10-06 · no new measurements of our own

Key findings

66.3%
Best task success rate on OSWorld (Claude Opus 4.5)
Humans 72.35%; earlier best 1–12%. AI Index 2026
~20%
Respondents who say their organization is scaling AI agents organization-wide
McKinsey 2026, May–June 2026, 1,719 respondents
37%
Respondents who say AI contributed to EBIT (earnings before interest and taxes)
Roughly the same as 39% in 2025. McKinsey 2026
Bottom line: The June 2026 note said that "the center of the market is shifting to agents." The sources support only part of that: agents' benchmark performance has risen quickly. The evidence that the center of enterprise operations has shifted is still weak. On OSWorld, a benchmark that has agents perform real computer tasks, the best model's task success rate is 66.3%, within about 6 percentage points of the 72.35% human baseline. But in McKinsey's 2025 survey, the share of respondents using agents at the scaling phase did not exceed 10% in any business function, and in the 2026 survey only about 2 in 10 said their organization had scaled agents organization-wide. Scaling is concentrated in large companies with more than $1 billion in revenue (27% → 40%) and in IT, knowledge management and software engineering. The share saying AI contributed to EBIT, 37%, is roughly unchanged from a year earlier.

Terms used in this report

  • AI agents, in McKinsey's 2025 report, are "systems based on foundation models capable of acting in the real world, planning and executing multiple steps in a workflow." Unlike a chatbot that only answers questions, an agent calls tools and keeps working through a task.
  • The scaling phase is one of the adoption stages in McKinsey's survey. The report describes it as "expanding the deployment and adoption of the technology within at least one business function." It comes after experimenting and piloting. In this report, organization-wide scaling refers to responses that McKinsey's 2026 report describes as "reaching the scaling phase across their organization." It is a stricter bar than scaling within a single function.
  • EBIT is earnings before interest and taxes, a measure of profit from operations. McKinsey separately counts respondents who say AI use contributed any amount to EBIT.
  • A share of respondents is not a share of companies. McKinsey's survey asks individuals about their own organization, and to correct for different response rates by country, it weights each response by the respondent's country's share of global GDP. This report says "respondents," as the source does.
  • OSWorld is a benchmark that gives agents 369 tasks on Ubuntu, Windows and macOS, covering desktop and web apps, file operations and workflows across several apps. The human baseline of 72.35% is the share of tasks solved by computer science students.
  • Telemetry is usage data that software records automatically while it runs. Instead of asking people, it aggregates those records.

Capability: on benchmarks, agents are close to the human baseline

The AI Index 2026 describes 2025 as the year agents "advanced from answering questions to completing tasks." The evidence comes from benchmarks that have agents work in real environments and then check the resulting state. Every value below appears in the AI Index 2026 text or figures, and the original data source for each benchmark is listed alongside.

BenchmarkWhat the agent has to doBest modelHuman baselineOriginal data source
OSWorld369 real computer tasks across three operating systems66.3%72.35%Epoch AI. Best model: Claude Opus 4.5. Earlier best results: 1–12%
WebArena812 long-horizon web tasks such as finding information or changing settings, graded on the final state of the site74.3%78.2%WebArena leaderboard. About 15% in 2023, 74.3% in early 2026
SWE-bench VerifiedProduce a patch for a real GitHub issue; human-validated issues only~76.8%—SWE-bench leaderboard, February 2026. Only results measured with the same agent harness (mini-SWE-agent-v2) are compared

Two qualifiers are easy to lose when these numbers are repeated.

  • "SWE-bench went from 60% to nearly 100%" is not a resolve rate. The AI Index summary says SWE-bench Verified performance rose from about 60% to close to 100% in one year. That value comes from an index the AI Index built to compare different benchmarks on one scale: it converts the best model's score each year into a percentage of the human baseline. The actual resolve rate in the body of the same report is about 76.8% as of February 2026, with the top models clustered between 70% and 76%.
  • The 12% in "from 12% to 66%" is not a single year's value. The AI Index body says the strongest models "have historically reached only 1%–12% success" on OSWorld, and the summary shortens this to "from roughly 12% to 66.3%." The same summary adds that agents still fail roughly one in three attempts on structured benchmarks.

Benchmark scores are measured on fixed task sets. The AI Index itself notes that these benchmarks "may not fully capture the breadth of capabilities required for real-world AI deployment." That is why they need to be read alongside the enterprise surveys in the next section.

Enterprise adoption: in the surveys, scaling is still limited to some companies and some functions

Most of the enterprise adoption figures in the AI Index 2026 are taken from McKinsey's 2025 survey. The AI Index itself says these figures are self-reported survey data and should be read as showing direction rather than a complete picture. McKinsey published its 2026 survey results on 2026-08-25, so this report puts the 2025 and 2026 results side by side.

Item2025 survey2026 survey
Fieldwork and sample2025-06-25 to 07-29, 1,993 respondents in 105 countries2026-05-04 to 06-08, 1,719 respondents in 97 countries
Regular AI use in at least one business function88%"Nearly nine in ten"
AI at the scaling phase organization-wideThe 2025 report's text says "approximately one-third." The 2026 report gives the prior-year value as 38%44%
Scaling agents (in at least one function)23%No overall figure in the text. By size only: 40% at organizations with more than $1 billion in revenue (27% the year before), 22% at smaller ones (unchanged)
Experimenting with agents39%Not in the text
Agent scaling by business function10% or less in every functionMost common in IT, knowledge management and software engineering
Agents at the scaling phase organization-wideNot in the text~20%
Software coding agents at the scaling phase organization-wideNot in the text~20% (31% at large organizations)
AI contributed to EBIT39%37%
AI use limited by operating costs (including tokens)Not in the text~20%

Three things stand out in the table.

  • "88% AI adoption" and "single-digit agent scaling" are different questions in the same survey. The 88% asks whether the organization regularly uses AI in any one function. Agent scaling is a much narrower question. Summarizing the 2025 survey, the AI Index writes that "across most business functions, a majority of respondents reported no agent use at all" and that "scaled use was in the single digits for nearly all functions." Even in IT and knowledge management, the functions with the most activity, about two-thirds or more of respondents reported no agent use.
  • Scaling is concentrated in large companies and the technology sector. In the 2026 survey, the share of respondents from organizations with more than $1 billion in revenue who report scaling agents rose from 27% to 40%, while smaller organizations stayed at 22%. In the 2025 survey, the technology sector had higher rates of scaled agent use than other industries in software engineering (24%), IT (22%) and service operations (21%) (AI Index Figure 4.3.8).
  • Financial impact has not followed wider use. The share saying AI contributed to EBIT went from 39% to 37%, roughly the same. "AI high performers," who attribute 5% or more of EBIT to AI and say they have seen "significant" value from it, were about 6% of respondents in both years. Meanwhile, 80% of respondents said AI had improved their own productivity.

The surveys also asked separately about barriers to scaling AI agents. In the 2025 responsible AI survey run by the AI Index and McKinsey (which excludes responses from China), 62% named security and risk concerns as the main obstacle to fully scaling agentic AI, followed by technical limitations and regulatory uncertainty at 38% each. This barrier is consistent with the June 2026 note's emphasis on "permissions, audit logs and execution control." But these surveys did not measure whether such controls actually speed up scaling.

Coding agents deserve a separate look. In the 2026 survey, 32% of respondents said their organization "decided against buying one or more software products or features because they could be built internally with agentic coding tools." We cover individual developers' usage rates separately, from four survey organizations' original data, in AI coding agent adoption in 2026.

The word "adoption" covers three different measurements

In the AI Index 2026 summary, 88%, 53% and 28.3% all appear under the word "adoption." Tracing them back to their sources shows that each counts something different.

NumberWhat was countedSource and period
88%Respondents whose organization regularly uses AI in at least one business functionMcKinsey survey, June–July 2025
79%Same survey, generative AI onlyAI Index Figure 4.3.1. The chapter highlights give 70%, which differs from the body
53%U.S. adults aged 18–64 using generative AI, within three years of ChatGPT's releaseBick, Blandin and Deming's U.S. national survey (Real-Time Population Survey, RPS), as cited by the AI Index
61.8%Same survey, same age rangeGenAI Adoption Tracker, May 2026
28.3%Share of U.S. residents aged 15–64 who used a generative AI product. Microsoft telemetry adjusted for device and OS market share, internet penetration and populationMicrosoft AI Economy Institute, second half of 2025, as cited by the AI Index. 33.0% in Q2 2026
40.6%South Korea, same metric. 12th among the economies coveredMicrosoft AI Economy Institute, Q2 2026 (as of June)
  • The 88% is about organizations, not people. If one employee in one function uses AI regularly, the organization counts as an adopter.
  • The 53% is a U.S. figure. The AI Index summary calls it "53% population adoption" without naming a country, but a footnote in the body says the sample is U.S. adults aged 18–64.
  • In the U.S. alone, survey and telemetry methods produce results that differ by nearly twofold. Survey-based figures are 53% to 61.8%; Microsoft telemetry gives 28.3% to 33.0%. The age range, period and method all differ, so these sources cannot settle which is right. Microsoft notes that its metric "reflects usage, not capability or impact."
  • South Korea showed large gains on Microsoft's metric. It went from 25.9% in the first half of 2025 to 30.7% in the second half, 37.1% in Q1 2026 and 40.6% in Q2 2026, and Microsoft says South Korea posted the largest gain of any major economy for three consecutive reporting periods. This is a measure of individual generative AI use; none of the sources in this report give a separate agent adoption rate for Korean companies.

Revisiting the claims in the June 2026 note

The original note covered a "Top 10 trends" list, business opportunities and a recommended architecture all at once, but did not give evidence for each claim. We separated what we could and could not confirm this time.

Claim in the original noteEvidence checked nowHow this report handles it
The center of the AI market is shifting quickly to agentic systems that execute workBenchmark performance has risen quickly. In the enterprise surveys, scaling-phase responses were 10% or less per function in 2025 and about 20% organization-wide in 2026Kept, narrowed Stated for capability only
The key to enterprise adoption is permissions, audit logs and execution control62% named security and risk concerns as the main obstacle to scaling agentsKept, narrowed Stated only as a barrier
Exploding model costs are the bottleneck for deploymentAbout 20% say operating costs limit their AI use; about 10% each for agents, chatbots and coding agentsKept, narrowed Changed to "some organizations"
Developers' role is moving from writing code to directing agentsAbout 20% have scaled coding agents organization-wide, and 32% dropped a purchase because they could build in-house. We did not find data this time that measures the change in role itselfRemoved
AI competitiveness in 2026 will be decided by product, data, permission and verification systemsA forecast with no measurable basisRemoved
Top 10 trend ranking, business opportunity list, recommended architectureThere was no ranking method, and the architecture is opinion, not measurementRemoved
Market changes from Korea's AI Basic Act (the country's framework AI law) taking effectOutside the scope of this report. We did not recheck the statuteRemoved

Checklist

What to doWhy
When you see "AI adoption X%," first check whether it comes from an organization survey, a survey of individuals or telemetryThe same report's summary presents 88% (organization survey), 53% (survey of U.S. adults) and 28.3% (telemetry) all as "adoption"
Check whether "agent adoption" means experimenting, piloting or scalingIn McKinsey's 2025 survey, 62% were at least experimenting, but 23% were scaling, and no more than 10% in any one function
Check whether a benchmark number is an actual resolve rate or a value converted relative to the human baselineFor SWE-bench Verified, "close to 100%" (relative to the human baseline) and "about 76.8%" (resolve rate) both appear in the same report
Check numbers in summary sentences against the body and figuresThe AI Index economy chapter gives the share of organizations using generative AI as 70% in its highlights and 79% in its body and figure
If you are considering scaling agents internally, put security and risk review on the schedule from the start62% named security and risk concerns as the main obstacle to scaling. This is a response about barriers; which controls speed up scaling was not measured
Look at the proportion before copying what survey "high performers" doHigh performers, who attribute 5% or more of EBIT to AI and report "significant" value, were about 6% of respondents in both years. Their traits are correlations, not established causes

What is not settled yet

  • This report is a 2026-10-06 rewrite, to our current standard, of a note first published on 2026-06-16. The original note's Top 10 ranking and recommended architecture were removed because their basis could not be verified. We made no new measurements; every figure is a value stated in the sources listed below.
  • Benchmark values are as of when the AI Index 2026 compiled them. The AI Index says domain performance results reflect early 2026 unless otherwise noted, so scores from later models are not included. We did not recheck the current rankings on each leaderboard.
  • Enterprise figures come from self-reported surveys. Several people from one organization can respond, and responses are weighted by each country's share of global GDP. The 2025 (1,993) and 2026 (1,719) samples differ. McKinsey says that looking only at the 552 respondents who answered in both years gave the same results on workforce changes, but it does not report the same check for other questions.
  • We could not reconcile one figure in McKinsey's text. The 2025 report says "approximately one-third" of respondents report scaling AI organization-wide, while the 2026 report gives the prior-year value as 38%. We could not confirm from the article text whether these refer to the same question.
  • We read McKinsey's reports through Internet Archive copies. We could not access mckinsey.com directly, so we read a copy saved on 2026-09-21 and could not check detailed exhibit values that are not in the article text. For per-function figures we used only the AI Index's citations and McKinsey's own sentences.
  • Microsoft's usage metric is built by a vendor from its own telemetry. The adjustment method is described in Microsoft's technical paper; we did not verify it. South Korea's rank and gains are comparisons within this metric.
  • This report has no agent adoption data specifically for Korean companies. McKinsey does not publish country-level figures in its article text.

References

All sources were retrieved and checked on 2026-10-06.

SourceWhat this report takes from itType
Stanford HAI, The AI Index 2026 Annual Report (published April 2026; PDF file properties show a 2026-06-29 build)OSWorld, WebArena and SWE-bench values and qualifiers, definition of the human-baseline index, enterprise adoption section (citing McKinsey 2025), barriers to scaling agents, the sample behind 53%, citation of Microsoft's metric, the 70% vs. 79% discrepancy between highlights and bodyCompilation (own indices primary, cited figures secondary)
McKinsey, The state of AI in 2026: On the road to ROI (2026-08-25; Internet Archive copy of 2026-09-21)2026 fieldwork and sample, agent and coding agent scaling, large organizations 27% → 40%, EBIT 37%, high performers 6%, cost constraints, 32% building in-house instead of buyingPrimary (survey)
McKinsey, The state of AI in 2025: Agents, innovation, and transformation (2025-11-05; Internet Archive copy of the same URL)Definition of agents, definition of the scaling phase, 88%, agent scaling 23% and experimenting 39%, 10% or less per function, EBIT 39%, 2025 fieldwork and samplePrimary (survey)
GenAI Adoption Tracker (Bick, Blandin, Deming; Harvard Project on Workforce)Generative AI use among U.S. adults aged 18–64, 61.8% (May 2026); survey design (RPS)Primary (survey)
Microsoft AI Economy Institute, AI Diffusion Report data and reports (Global AI Diffusion Q2 2026, September 2026)Metric definition (ages 15–64, adjusted telemetry), half-year and quarterly values for South Korea and the U.S., South Korea's rankVendor data

The 2026-06-16 initial note was rewritten on 2026-10-06 to our current standard. Sources the original note listed, such as Gartner, NVIDIA and Hugging Face, were not used for any claim in this report and have been removed from the list. If the AI Index or McKinsey revises its figures, we will update this report and note the date.

Newsletter

The week’s new reports, every Sunday

One email a week with that week’s reports, skipped when nothing new came out. Nothing but report news.

Used only to announce new reports. Unsubscribe any time. Privacy Policy
Publisher

Eazler AI Lab is the AI engineering journal of Eazler Inc. We read primary sources in full, and say so when something is unverified.

Editorial standards and method →

We also post report summaries on Threads: @eazler.inc.

Building or adopting AI agents? hello@eazler.com