AI agent performance jumped on benchmarks, but only about 2 in 10 respondents have scaled agents organization-wide
We rechecked our June 2026 note's claim that the AI market is shifting to agents, using the Stanford AI Index 2026 and McKinsey's 2025 and 2026 State of AI surveys. Benchmark scores show what agents can do in tests; enterprise adoption rates show how far companies have rolled them out
On this page
On 2026-06-16 this blog published a note saying that the center of the AI market was shifting quickly to "agentic systems that execute work." It cited no numbers. This report rechecks that claim, mainly against three source documents: the AI Index 2026, the annual report from Stanford's Institute for Human-Centered AI (HAI), and the 2025 and 2026 editions of State of AI, McKinsey's yearly enterprise survey. The evidence points in two directions. On benchmarks, leading AI agents are now scoring close to the human baseline, but in mid-2026 only about 2 in 10 respondents said their organization had scaled agents organization-wide. The two numbers measure different things, so neither can be used to explain the other.
Key findings
Humans 72.35%; earlier best 1–12%. AI Index 2026
McKinsey 2026, May–June 2026, 1,719 respondents
Roughly the same as 39% in 2025. McKinsey 2026
Terms used in this report
- AI agents, in McKinsey's 2025 report, are "systems based on foundation models capable of acting in the real world, planning and executing multiple steps in a workflow." Unlike a chatbot that only answers questions, an agent calls tools and keeps working through a task.
- The scaling phase is one of the adoption stages in McKinsey's survey. The report describes it as "expanding the deployment and adoption of the technology within at least one business function." It comes after experimenting and piloting. In this report, organization-wide scaling refers to responses that McKinsey's 2026 report describes as "reaching the scaling phase across their organization." It is a stricter bar than scaling within a single function.
- EBIT is earnings before interest and taxes, a measure of profit from operations. McKinsey separately counts respondents who say AI use contributed any amount to EBIT.
- A share of respondents is not a share of companies. McKinsey's survey asks individuals about their own organization, and to correct for different response rates by country, it weights each response by the respondent's country's share of global GDP. This report says "respondents," as the source does.
- OSWorld is a benchmark that gives agents 369 tasks on Ubuntu, Windows and macOS, covering desktop and web apps, file operations and workflows across several apps. The human baseline of 72.35% is the share of tasks solved by computer science students.
- Telemetry is usage data that software records automatically while it runs. Instead of asking people, it aggregates those records.
Capability: on benchmarks, agents are close to the human baseline
The AI Index 2026 describes 2025 as the year agents "advanced from answering questions to completing tasks." The evidence comes from benchmarks that have agents work in real environments and then check the resulting state. Every value below appears in the AI Index 2026 text or figures, and the original data source for each benchmark is listed alongside.
| Benchmark | What the agent has to do | Best model | Human baseline | Original data source |
|---|---|---|---|---|
| OSWorld | 369 real computer tasks across three operating systems | 66.3% | 72.35% | Epoch AI. Best model: Claude Opus 4.5. Earlier best results: 1–12% |
| WebArena | 812 long-horizon web tasks such as finding information or changing settings, graded on the final state of the site | 74.3% | 78.2% | WebArena leaderboard. About 15% in 2023, 74.3% in early 2026 |
| SWE-bench Verified | Produce a patch for a real GitHub issue; human-validated issues only | ~76.8% | — | SWE-bench leaderboard, February 2026. Only results measured with the same agent harness (mini-SWE-agent-v2) are compared |
Two qualifiers are easy to lose when these numbers are repeated.
- "SWE-bench went from 60% to nearly 100%" is not a resolve rate. The AI Index summary says SWE-bench Verified performance rose from about 60% to close to 100% in one year. That value comes from an index the AI Index built to compare different benchmarks on one scale: it converts the best model's score each year into a percentage of the human baseline. The actual resolve rate in the body of the same report is about 76.8% as of February 2026, with the top models clustered between 70% and 76%.
- The 12% in "from 12% to 66%" is not a single year's value. The AI Index body says the strongest models "have historically reached only 1%–12% success" on OSWorld, and the summary shortens this to "from roughly 12% to 66.3%." The same summary adds that agents still fail roughly one in three attempts on structured benchmarks.
Benchmark scores are measured on fixed task sets. The AI Index itself notes that these benchmarks "may not fully capture the breadth of capabilities required for real-world AI deployment." That is why they need to be read alongside the enterprise surveys in the next section.
Enterprise adoption: in the surveys, scaling is still limited to some companies and some functions
Most of the enterprise adoption figures in the AI Index 2026 are taken from McKinsey's 2025 survey. The AI Index itself says these figures are self-reported survey data and should be read as showing direction rather than a complete picture. McKinsey published its 2026 survey results on 2026-08-25, so this report puts the 2025 and 2026 results side by side.
| Item | 2025 survey | 2026 survey |
|---|---|---|
| Fieldwork and sample | 2025-06-25 to 07-29, 1,993 respondents in 105 countries | 2026-05-04 to 06-08, 1,719 respondents in 97 countries |
| Regular AI use in at least one business function | 88% | "Nearly nine in ten" |
| AI at the scaling phase organization-wide | The 2025 report's text says "approximately one-third." The 2026 report gives the prior-year value as 38% | 44% |
| Scaling agents (in at least one function) | 23% | No overall figure in the text. By size only: 40% at organizations with more than $1 billion in revenue (27% the year before), 22% at smaller ones (unchanged) |
| Experimenting with agents | 39% | Not in the text |
| Agent scaling by business function | 10% or less in every function | Most common in IT, knowledge management and software engineering |
| Agents at the scaling phase organization-wide | Not in the text | ~20% |
| Software coding agents at the scaling phase organization-wide | Not in the text | ~20% (31% at large organizations) |
| AI contributed to EBIT | 39% | 37% |
| AI use limited by operating costs (including tokens) | Not in the text | ~20% |
Three things stand out in the table.
- "88% AI adoption" and "single-digit agent scaling" are different questions in the same survey. The 88% asks whether the organization regularly uses AI in any one function. Agent scaling is a much narrower question. Summarizing the 2025 survey, the AI Index writes that "across most business functions, a majority of respondents reported no agent use at all" and that "scaled use was in the single digits for nearly all functions." Even in IT and knowledge management, the functions with the most activity, about two-thirds or more of respondents reported no agent use.
- Scaling is concentrated in large companies and the technology sector. In the 2026 survey, the share of respondents from organizations with more than $1 billion in revenue who report scaling agents rose from 27% to 40%, while smaller organizations stayed at 22%. In the 2025 survey, the technology sector had higher rates of scaled agent use than other industries in software engineering (24%), IT (22%) and service operations (21%) (AI Index Figure 4.3.8).
- Financial impact has not followed wider use. The share saying AI contributed to EBIT went from 39% to 37%, roughly the same. "AI high performers," who attribute 5% or more of EBIT to AI and say they have seen "significant" value from it, were about 6% of respondents in both years. Meanwhile, 80% of respondents said AI had improved their own productivity.
The surveys also asked separately about barriers to scaling AI agents. In the 2025 responsible AI survey run by the AI Index and McKinsey (which excludes responses from China), 62% named security and risk concerns as the main obstacle to fully scaling agentic AI, followed by technical limitations and regulatory uncertainty at 38% each. This barrier is consistent with the June 2026 note's emphasis on "permissions, audit logs and execution control." But these surveys did not measure whether such controls actually speed up scaling.
The word "adoption" covers three different measurements
In the AI Index 2026 summary, 88%, 53% and 28.3% all appear under the word "adoption." Tracing them back to their sources shows that each counts something different.
| Number | What was counted | Source and period |
|---|---|---|
| 88% | Respondents whose organization regularly uses AI in at least one business function | McKinsey survey, June–July 2025 |
| 79% | Same survey, generative AI only | AI Index Figure 4.3.1. The chapter highlights give 70%, which differs from the body |
| 53% | U.S. adults aged 18–64 using generative AI, within three years of ChatGPT's release | Bick, Blandin and Deming's U.S. national survey (Real-Time Population Survey, RPS), as cited by the AI Index |
| 61.8% | Same survey, same age range | GenAI Adoption Tracker, May 2026 |
| 28.3% | Share of U.S. residents aged 15–64 who used a generative AI product. Microsoft telemetry adjusted for device and OS market share, internet penetration and population | Microsoft AI Economy Institute, second half of 2025, as cited by the AI Index. 33.0% in Q2 2026 |
| 40.6% | South Korea, same metric. 12th among the economies covered | Microsoft AI Economy Institute, Q2 2026 (as of June) |
- The 88% is about organizations, not people. If one employee in one function uses AI regularly, the organization counts as an adopter.
- The 53% is a U.S. figure. The AI Index summary calls it "53% population adoption" without naming a country, but a footnote in the body says the sample is U.S. adults aged 18–64.
- In the U.S. alone, survey and telemetry methods produce results that differ by nearly twofold. Survey-based figures are 53% to 61.8%; Microsoft telemetry gives 28.3% to 33.0%. The age range, period and method all differ, so these sources cannot settle which is right. Microsoft notes that its metric "reflects usage, not capability or impact."
- South Korea showed large gains on Microsoft's metric. It went from 25.9% in the first half of 2025 to 30.7% in the second half, 37.1% in Q1 2026 and 40.6% in Q2 2026, and Microsoft says South Korea posted the largest gain of any major economy for three consecutive reporting periods. This is a measure of individual generative AI use; none of the sources in this report give a separate agent adoption rate for Korean companies.
Revisiting the claims in the June 2026 note
The original note covered a "Top 10 trends" list, business opportunities and a recommended architecture all at once, but did not give evidence for each claim. We separated what we could and could not confirm this time.
| Claim in the original note | Evidence checked now | How this report handles it |
|---|---|---|
| The center of the AI market is shifting quickly to agentic systems that execute work | Benchmark performance has risen quickly. In the enterprise surveys, scaling-phase responses were 10% or less per function in 2025 and about 20% organization-wide in 2026 | Kept, narrowed Stated for capability only |
| The key to enterprise adoption is permissions, audit logs and execution control | 62% named security and risk concerns as the main obstacle to scaling agents | Kept, narrowed Stated only as a barrier |
| Exploding model costs are the bottleneck for deployment | About 20% say operating costs limit their AI use; about 10% each for agents, chatbots and coding agents | Kept, narrowed Changed to "some organizations" |
| Developers' role is moving from writing code to directing agents | About 20% have scaled coding agents organization-wide, and 32% dropped a purchase because they could build in-house. We did not find data this time that measures the change in role itself | Removed |
| AI competitiveness in 2026 will be decided by product, data, permission and verification systems | A forecast with no measurable basis | Removed |
| Top 10 trend ranking, business opportunity list, recommended architecture | There was no ranking method, and the architecture is opinion, not measurement | Removed |
| Market changes from Korea's AI Basic Act (the country's framework AI law) taking effect | Outside the scope of this report. We did not recheck the statute | Removed |
Checklist
| What to do | Why |
|---|---|
| When you see "AI adoption X%," first check whether it comes from an organization survey, a survey of individuals or telemetry | The same report's summary presents 88% (organization survey), 53% (survey of U.S. adults) and 28.3% (telemetry) all as "adoption" |
| Check whether "agent adoption" means experimenting, piloting or scaling | In McKinsey's 2025 survey, 62% were at least experimenting, but 23% were scaling, and no more than 10% in any one function |
| Check whether a benchmark number is an actual resolve rate or a value converted relative to the human baseline | For SWE-bench Verified, "close to 100%" (relative to the human baseline) and "about 76.8%" (resolve rate) both appear in the same report |
| Check numbers in summary sentences against the body and figures | The AI Index economy chapter gives the share of organizations using generative AI as 70% in its highlights and 79% in its body and figure |
| If you are considering scaling agents internally, put security and risk review on the schedule from the start | 62% named security and risk concerns as the main obstacle to scaling. This is a response about barriers; which controls speed up scaling was not measured |
| Look at the proportion before copying what survey "high performers" do | High performers, who attribute 5% or more of EBIT to AI and report "significant" value, were about 6% of respondents in both years. Their traits are correlations, not established causes |
What is not settled yet
- This report is a 2026-10-06 rewrite, to our current standard, of a note first published on 2026-06-16. The original note's Top 10 ranking and recommended architecture were removed because their basis could not be verified. We made no new measurements; every figure is a value stated in the sources listed below.
- Benchmark values are as of when the AI Index 2026 compiled them. The AI Index says domain performance results reflect early 2026 unless otherwise noted, so scores from later models are not included. We did not recheck the current rankings on each leaderboard.
- Enterprise figures come from self-reported surveys. Several people from one organization can respond, and responses are weighted by each country's share of global GDP. The 2025 (1,993) and 2026 (1,719) samples differ. McKinsey says that looking only at the 552 respondents who answered in both years gave the same results on workforce changes, but it does not report the same check for other questions.
- We could not reconcile one figure in McKinsey's text. The 2025 report says "approximately one-third" of respondents report scaling AI organization-wide, while the 2026 report gives the prior-year value as 38%. We could not confirm from the article text whether these refer to the same question.
- We read McKinsey's reports through Internet Archive copies. We could not access mckinsey.com directly, so we read a copy saved on 2026-09-21 and could not check detailed exhibit values that are not in the article text. For per-function figures we used only the AI Index's citations and McKinsey's own sentences.
- Microsoft's usage metric is built by a vendor from its own telemetry. The adjustment method is described in Microsoft's technical paper; we did not verify it. South Korea's rank and gains are comparisons within this metric.
- This report has no agent adoption data specifically for Korean companies. McKinsey does not publish country-level figures in its article text.
References
All sources were retrieved and checked on 2026-10-06.
| Source | What this report takes from it | Type |
|---|---|---|
| Stanford HAI, The AI Index 2026 Annual Report (published April 2026; PDF file properties show a 2026-06-29 build) | OSWorld, WebArena and SWE-bench values and qualifiers, definition of the human-baseline index, enterprise adoption section (citing McKinsey 2025), barriers to scaling agents, the sample behind 53%, citation of Microsoft's metric, the 70% vs. 79% discrepancy between highlights and body | Compilation (own indices primary, cited figures secondary) |
| McKinsey, The state of AI in 2026: On the road to ROI (2026-08-25; Internet Archive copy of 2026-09-21) | 2026 fieldwork and sample, agent and coding agent scaling, large organizations 27% → 40%, EBIT 37%, high performers 6%, cost constraints, 32% building in-house instead of buying | Primary (survey) |
| McKinsey, The state of AI in 2025: Agents, innovation, and transformation (2025-11-05; Internet Archive copy of the same URL) | Definition of agents, definition of the scaling phase, 88%, agent scaling 23% and experimenting 39%, 10% or less per function, EBIT 39%, 2025 fieldwork and sample | Primary (survey) |
| GenAI Adoption Tracker (Bick, Blandin, Deming; Harvard Project on Workforce) | Generative AI use among U.S. adults aged 18–64, 61.8% (May 2026); survey design (RPS) | Primary (survey) |
| Microsoft AI Economy Institute, AI Diffusion Report data and reports (Global AI Diffusion Q2 2026, September 2026) | Metric definition (ages 15–64, adjusted telemetry), half-year and quarterly values for South Korea and the U.S., South Korea's rank | Vendor data |
The 2026-06-16 initial note was rewritten on 2026-10-06 to our current standard. Sources the original note listed, such as Gartner, NVIDIA and Hugging Face, were not used for any claim in this report and have been removed from the list. If the AI Index or McKinsey revises its figures, we will update this report and note the date.