返回资讯中心
外部精选
软件工程
#开发者实时流

Can a Million AI Agents Create Superintelligence?

Ramez Naam is, in my opinion, one of the best futurists alive. But although he has a Substack (which you should definitely follow), he doesn’t write nearly enough. So I’ve been encouraging him to write more by cross-pos…

Hacker News 最新speckx2026/10/20 · 26 天前30 分钟阅读

以下正文同步自 Hacker News 最新,版权归原站所有,已转换为易读排版。

Ramez Naam

Oct 19, 2026

225

14

21

Share

Art by GPT-6

Ramez Naam is, in my opinion, one of the best futurists alive. But although he has a Substack (which you should definitely follow), he doesn’t write nearly enough. So I’ve been encouraging him to write more by cross-posting his posts on my blog.

Somewhat to my surprise, Ramez has turned out to be a lot more of an AI skeptic than I would have though. He’s certainly not dismissive of the technology, but he disagrees with many of the more expansive and dramatic claims coming out of the big labs (especially Anthropic). In his first post in this series, he expressed skepticism that recursive self-improvement (RSI) would lead to a fast takeoff of AI capabilities in the near future:

Where’s the “intelligence explosion”?

Ramez Naam

·

Sep 27

Read full story

In this post, he expresses skepticism about the potential for agent swarms — large numbers of AI agents working in parallel — to offer dramatic increases in AI capabilities. Agent swarms have been in the news a lot, both because of the Hugging Face attack, and OpenAI’s solution of the famous Navier-Stokes problem is also widely attributed to a large swarm. But Ramez argues that parallelization is just another kind of input that suffers from diminishing returns, and that we should therefore temper our expectations about what agents swarms are able to achieve.

As was the case with his previous post, I’m not sure how much this matters, when the capabilities of the underlying models — swarm or no swarm — are still improving at such a steady and impressive rate. But it’s a very intellectually interesting argument, and Ramez can be very persuasive.

In my previous post, we asked whether AIs could improve themselves all the way to absurdly high levels of superintelligence. My conclusion: today’s feedback loop is probably too weak, because improving AI faces diminishing returns at every step. Even fully autonomous AIs doing all the research and coding don’t make those diminishing returns disappear. We should keep updating that conclusion as real-world parameters and data change.

But we didn’t look closely at another possibility: running millions or billions of AI minds in parallel. How much do they help? That’s what we’ll look at here.

Plenty of people have modeled how more AI agents working in parallel could fuel recursive self-improvement. But the data we have today tell a different story. More agents are useful for speed: they can solve many problems faster. They’re less useful for boosting AI intelligence. Multi-agent gains in solving harder problems often diminish incredibly quickly and may even saturate. Whether multi-agent systems can produce the conceptual breakthroughs RSI might require to become self-sustaining is the harder question.

Without breakthroughs in how well agents parallelize problems - something that may depend on the structure of machine learning problems themselves - it’s hard to see even millions or billions of copies of today’s models making repeated breakthroughs on the hardest problems. These are among the strongest diminishing returns we’ve looked at. Of course, these diminishing returns may change. And we have less experimental data to go off of today than we’d like. We’ll need to recalibrate as new evidence comes in. I’ll end with the things we should track and my predictions about a natural experiment from newly released Anthropic data.

Below is the two-image summary: The experimental observations of how large numbers of agents scale to solve harder problems (what I’m referring to as intelligence) are far far lower than the assumptions in studies that predict that AI recursive self-improvement will lead to an intelligence explosion. The first image is at the scale of 100 parallel AI agents. The second is at the scale of a billion AI parallel agents.

Real world experiments show dramatically lower intelligence gains from parallel agents than hypothetical AI models.

Extrapolated out to a billion agents, the intelligence gain in hypothetical models is orders of magnitude beyond real world experiment gain curves.

To recap the last post: recursive self-improvement (RSI) means AI improvements feeding back into the next round of AI research. Four findings stood out:

Real AI research is harder than benchmark scores suggest. OpenAI’s models needed human help on much shorter research tasks than the coding benchmarks led us to expect.

More AI activity produces much smaller gains in useful work. OpenAI used 124 times as many tokens per researcher but ran only 1.6 times as many experiments per researcher.

Maintaining progress requires ever more resources. Training and thinking time face steep diminishing returns. Anthropic reports that more powerful AI has been key to maintaining the current pace of AI progress.

The measured software feedback loop doesn’t yet look self-sustaining. Our tentative calibration put it roughly five to ten times below the strength needed.

I want to reiterate a distinction here: fully automated AI self-improvement doesn’t at all guarantee an intelligence explosion. Diminishing returns in AI capabilities dampen that feedback loop. Parallel agents can help automate a search across AI parameters, but don’t look nearly as useful in making new conceptual breakthroughs. My expectation is that we’ll need those sorts of breakthroughs for self-improvement to become self-sustaining, let alone to accelerate rapidly and reach truly profound levels of superintelligence.

Today, let’s examine in much more detail what it would mean to run thousands, millions, or billions of AI researchers in parallel.

In this post I’m focusing only on software: AI researchers improving the algorithms that make AI better or cheaper to run. Hardware, investment, and economic growth have their own feedback loops, which we discussed briefly in the last post. Here, we’re asking how much more the AI minds themselves can discover.

The country of geniuses and the assumptions about adding agents.

The different shapes of diminishing returns.

Where more agents buy speed, and what that speed costs.

Intelligence gains are much harder than speed gains.

The best examples of improving collective intelligence.

The Anthropic test and what would change my mind.

In Machines of Loving Grace, Dario Amodei imagines a:

Millions of AI minds, each more capable than a Nobel Prize winner across many fields, working at much higher speed. That would be extraordinary. The intelligence of each mind is a crucial part of the premise.

Tom Davidson and Daniel Eth’s Forethought paper describes the equivalent of “millions of top-notch human researchers.” Benjamin Todd’s explainer points to “millions of competent engineers working on AI research.” Dwarkesh Patel emphasizes AI’s “massive population size and perfect knowledge transfer.”

How does the number of AI agents running in parallel enter these arguments? In Eth and Davidson’s illustrative model, twice as many researchers produce twice as many papers. Cheaper AI lets the same hardware run more researchers, while each software improvement gets harder to find. Alan Chan and colleagues’ 2026 paper, including AI pioneers Geoffrey Hinton and Yoshua Bengio, assumes an even larger effect from adding researchers: doubling effective research labor increases the rate of software improvement by about 2.6 times, holding the software level fixed.

Those are assumptions about what more researchers produce. The growing number of AI researchers must keep finding improvements fast enough to outweigh the increasing difficulty of further progress. We’ll come back to those assumptions after looking at what larger AI teams actually achieve.

Meanwhile, we had OpenAI’s Navier–Stokes announcement: around 10,000 agents working concurrently during an 88-hour run solved a mathematics Millenium Problem. It made the idea vivid. A datacenter full of AI mathematicians, tackling a famously hard problem.

I understand the excitement. But the number of agents tells us how many AI researchers we ran. We also need to measure what those additional researchers contributed.

On MTS Live, I described a ladder of increasingly hard scaling:

Super-linear: Twice the input produces more than twice the output. Accelerating returns.

Linear: Twice the input produces twice the output. Independent jobs can look like this. A power-law exponent of 1 is the same case.

Power-law diminishing returns: Output grows as input raised to a power below 1. At exponent 0.5, doubling output takes four times the input. At 0.2, it takes 32 times. At 0.1, it takes 1,024 times.

Logarithmic: Each multiplication of input buys the same additional gain. Another five points might require another tenfold increase in compute.

Sub-logarithmic: Even successive tenfold increases buy smaller gains. Those gains can keep shrinking, or saturate at a ceiling. A slow rise doesn’t require a hard plateau.

Not all diminishing returns are alike. Some are much harder than others.

The classic pre-training scaling laws describe power-law reductions in prediction loss. Many test-time score curves look roughly logarithmic over the measured range. Some multi-agent results flatten much more sharply.

Let’s illustrate this with numbers. In the figure below, every curve earns the same gain from the first doubling of input. The later differences then become visible. The hardest curves share a vertical scale, and each panel states its endpoint.

Different diminishing returns scaling patterns lead to very different long term results.

For runaway RSI, improvements have to make subsequent improvements arrive faster and faster. Logarithmic returns to the number of AI researchers are too weak to sustain that loop if every further doubling of software efficiency requires a fixed percentage more research. Sub-logarithmic scaling or a plateau are weaker still. The experiments I’ll summarize in the rest of this post aren’t perfect, and I wish we had more data. But the clearest larger-team evidence we have today points to logarithmic or sub-logarithmic intelligence gains. Those look too weak to make RSI self-sustaining, let alone runaway, under the assumptions we’re examining.

There are at least three reasons a larger team might be limited in its ability to produce better answers, and probably more. Let’s start with these:

First, coordination skills. Can the agents divide the problem, manage the work, check each other, and combine their results? Can they communicate what matters without spending all their time communicating? A team needs good project management as well as good individual contributors.

Second, homogeneity of thought. Are the agents contributing useful new ideas, or repeating the same approaches and mistakes? A hundred copies can share the same blind spots. More varied answers help only if some of that variety is right.

Third, the structure of the problem. How much can happen in parallel, and how much has to wait for earlier results? A million independent searches can run at once. A sequential investigation can’t. Even figuring out how to divide a conceptual problem may require an insight the team hasn’t found.

Three places where more agents can run into limits.

These limits interact. A better model can supply an idea its copies previously lacked, find a better division of labor, or recognize a solution the team had been overlooking. A difficult task may become easier to parallelize once somebody discovers the right approach. That’s why the shape of the curve matters, and why it can change.

Before we go further, let’s separate two things: speed, or how quickly agents solve a problem, and collective intelligence, or whether they can solve a harder problem and reach a new level of skill. We’ll use verified benchmark scores as evidence of that intelligence. They aren’t a universal IQ scale.

So far, adding agents seems much more effective at speeding up execution than at raising the level of probl

正文由 探How 从来源站点 RSS 同步,内容未经改写;遇到排版缺失或需要图片、视频时请以原文为准。

打开原文
去社区讨论 →