Darwin
Technology

The People Building AI Can't Agree on How Fast It Should Move

Dario Amodei wants stronger safeguards. Jensen Huang thinks continued development is itself the answer. Sam Altman and Elon Musk warn about AI risk while racing to build it anyway. The people shaping AI's future can't agree on how fast it should move.

Written byDarwin Corp
Published16 September 2026
Read7 min

Summary

AI's most influential builders are split on pace. Anthropic's Dario Amodei argues for stronger safeguards as models grow more autonomous, while NVIDIA's Jensen Huang argues continued development itself improves safety and outcomes. Meanwhile Sam Altman, Elon Musk and others warn about AI risk while their own companies compete to build frontier systems first, a structural tension that money, competition and geopolitics make hard to resolve.

Artificial intelligence is advancing at an extraordinary pace. New models arrive within months of one another, AI agents are becoming more autonomous, computing infrastructure is expanding rapidly, and billions of dollars are being invested in the race to build increasingly capable systems.

But behind that acceleration is an increasingly visible disagreement.

Some of the most influential people building AI do not agree on how quickly the technology should move forward. Executives including Anthropic CEO Dario Amodei have argued that increasingly powerful AI systems require stronger safeguards and greater coordination. Others, including NVIDIA CEO Jensen Huang, have pushed back against the idea that slowing technological development is the right response.

Meanwhile, companies including OpenAI, Google DeepMind, Meta and xAI continue competing to build more capable models, agents and infrastructure.

The result is an unusual moment in technology, the people pushing AI forward are simultaneously debating how much acceleration is too much.

AI is no longer just a software race

The first generation of modern generative AI was largely experienced through chat interfaces. You asked a question. The model generated an answer.

That relationship is changing.

AI systems are increasingly being designed to use tools, write and execute code, search information, interact with software and complete multi-step tasks with less human intervention. The distinction matters. A chatbot generating an incorrect paragraph creates one category of risk. An autonomous system making decisions or performing actions creates another.

This transition toward AI agents is one reason conversations about AI safety have become more prominent inside the industry itself. The debate is no longer simply about whether artificial intelligence will become more powerful. Almost everyone building frontier AI expects that it will. The disagreement is about what should happen as those capabilities increase.

Dario Amodei wants more caution

Anthropic has positioned AI safety as a central part of its identity since the company was founded by former OpenAI employees.

CEO Dario Amodei has repeatedly warned that increasingly capable AI systems could introduce serious risks if development moves faster than society's ability to understand and control them. His argument is not necessarily that AI development should stop. It is that the capabilities of frontier models may progress quickly enough that governments, companies and researchers need stronger evaluation systems and safeguards before those models become substantially more autonomous.

That position represents one side of a growing philosophical divide inside Silicon Valley: build powerful AI, but understand what you are building before giving it significantly more responsibility.

Jensen Huang sees slowing down differently

NVIDIA occupies a very different position in the AI ecosystem. The company's GPUs power much of the infrastructure used to train and operate modern AI models. As demand for artificial intelligence has exploded, NVIDIA has become one of the companies most closely associated with the AI boom.

CEO Jensen Huang has generally argued for continued development rather than deliberately slowing technological progress. From this perspective, better technology can itself become part of the solution. More capable AI can improve cybersecurity, scientific research, healthcare, engineering and productivity. Development also takes place globally, making unilateral attempts to slow progress difficult when competitors may continue advancing.

This creates one of the most interesting disagreements in AI. Does safety require slowing the development of increasingly powerful systems, or does continuing to develop better technology ultimately make those systems safer and more useful? There is no industry-wide answer.

Sam Altman sits somewhere inside the contradiction

OpenAI represents perhaps the clearest example of the tension.

CEO Sam Altman has spoken publicly about potentially serious risks from increasingly powerful artificial intelligence. At the same time, OpenAI remains one of the companies pushing frontier AI capabilities forward most aggressively.

That apparent contradiction reflects something much larger than one company. AI laboratories are simultaneously warning about the potential consequences of advanced artificial intelligence while competing intensely to build it first. If one company decides to move significantly slower, another company may continue.

And competition is no longer limited to American startups. Google, Meta, Anthropic, xAI, NVIDIA, Mistral and numerous Chinese AI laboratories are participating in an increasingly international technological race. Nobody wants to discover that caution allowed a competitor to establish an overwhelming technological advantage.

Meta is making a different bet

Mark Zuckerberg has reorganised large parts of Meta around artificial intelligence. Meta's strategy has also differed from some competitors through its support for more openly available AI models and its enormous investment in computing infrastructure.

The company's broader ambition extends beyond putting another chatbot inside Facebook or Instagram. AI could eventually operate across messaging, advertising, content creation, wearable devices and personal computing.

That introduces another layer to the debate. The question is not simply how intelligent AI becomes. It is how deeply AI should be integrated into people's everyday lives. An assistant that understands your calendar is useful. An assistant that understands your messages, relationships, interests, purchases, location and behaviour could be considerably more useful. It could also require substantially more trust.

Google has another problem: scale

Google entered the AI era with something few AI startups possess, billions of existing users. Gemini can potentially connect artificial intelligence across Search, Android, Gmail, YouTube, Workspace and Google's wider ecosystem.

That scale creates enormous opportunities. It also means mistakes can propagate across products used by enormous populations.

Google DeepMind CEO Demis Hassabis has frequently discussed the transformative potential of advanced artificial intelligence, particularly in scientific discovery. DeepMind's work with AlphaFold demonstrated how machine learning could contribute to solving scientific problems that previously required enormous amounts of human effort.

The optimistic argument for accelerating AI becomes particularly powerful here. If advanced AI can accelerate medicine, materials science, climate research or engineering, slowing it also carries an opportunity cost. The debate therefore cannot easily be reduced to fast versus slow. There are potential consequences on both sides.

Elon Musk adds another contradiction

Elon Musk has been one of the most vocal public figures warning about the long-term dangers of artificial intelligence. He also founded xAI, which is now competing directly with OpenAI, Anthropic, Google and Meta.

That combination illustrates the strange position the technology industry finds itself in. Someone can believe advanced AI presents substantial risks while simultaneously believing that building advanced AI is necessary.

From the perspective of individual companies, the reasoning can become circular. AI may be dangerous. But if somebody is going to build it anyway, perhaps it is better that we build it. When multiple companies reach the same conclusion, competition accelerates.

Then there is the money

The philosophical arguments surrounding AI cannot be separated from economics.

AI companies are raising enormous amounts of capital. Technology companies are constructing data centres, buying GPUs and developing specialised chips. Governments increasingly view artificial intelligence as strategically important infrastructure.

The incentives overwhelmingly reward progress. A company that develops a significantly better model can attract users, developers, investment and enterprise customers. A company that deliberately waits may lose them.

This creates a structural problem for voluntary restraint. Even executives genuinely concerned about AI safety operate inside companies competing for talent, investment and market share. Safety may be a shared objective. Competition remains an individual one.

The debate is bigger than the CEOs

Perhaps the most important development is that concerns about AI are increasingly coming from researchers working inside the organisations building it.

Employees and former employees from major AI laboratories have publicly raised questions about model behaviour, alignment, autonomous systems and whether existing safety processes can keep pace with capability improvements.

That does not mean catastrophic outcomes are inevitable. It does mean uncertainty is real. Frontier AI systems are becoming complicated enough that even their creators cannot always predict precisely how they will behave in every environment. And as AI gains access to more tools, the consequences of unexpected behaviour potentially increase.

So who decides how fast AI should move?

This may become one of the defining technology questions of the next decade.

Leaving the decision entirely to AI companies creates obvious conflicts of interest. Moving regulation too aggressively could slow useful innovation or advantage countries operating under different rules. Waiting until problems emerge could mean regulation arrives only after powerful systems are already deeply integrated into society.

There is no simple answer. What is clear is that artificial intelligence is no longer developing quietly inside research laboratories. It has become an economic race, a geopolitical competition and increasingly a question about how much autonomy society is prepared to give machines.

The executives building these systems disagree about the risks, the timelines and the appropriate response. Yet almost all of them continue building.

And perhaps that is the most important contradiction in the AI industry today. Everyone is debating whether artificial intelligence is moving too fast, while almost nobody competing at the frontier can afford to be the one who slows down.

Frequently asked questions

They weigh risk and opportunity differently. Executives like Dario Amodei emphasise the need for stronger safeguards as models become more capable and autonomous, while others, like Jensen Huang, argue that continued development itself improves safety, science and productivity, and that unilateral restraint is difficult when competitors globally continue advancing.

The safety argument holds that increasingly powerful AI systems need stronger evaluation, oversight and coordination before being given more autonomy. The acceleration argument holds that better technology can solve more problems than it creates, from cybersecurity to medicine, and that slowing down carries its own risks and costs.

It reflects a broader industry tension. AI labs are simultaneously warning about the potential consequences of advanced AI and competing intensely to build it first, partly because if one company slows down, competitors, including international labs, are unlikely to do the same.

Meta has invested heavily in more openly available AI models and enormous computing infrastructure, with ambitions to integrate AI across messaging, advertising, content creation, wearables and personal computing rather than a single chatbot product.

There is no single answer yet. Leaving the decision entirely to AI companies raises conflict-of-interest concerns, aggressive regulation risks slowing useful innovation or disadvantaging some countries, and waiting for problems to emerge risks regulation arriving after powerful systems are already widely deployed.