Greg Casar

Washington -- Two leading progressive lawmakers, Sen. Bernie Sanders, I-Vt., and Rep. Greg Casar, D-Texas, unveiled legislation Wednesday that would ban artificial superintelligence and create a federal agency to oversee advanced AI as some of the industry's own leaders urge Congress to impose guardrails on the advancing technology.

The bill, provided first to The Associated Press, would also pause advanced AI development until guidelines are implemented.

"It doesn't take a genius to say, 'slow it down,'" Sanders said in an interview with AP. "Do we really want to develop a super intelligence that when it becomes smarter than human beings could act independently of human control? I don't think we do."

Congress has so far done little to rein in the AI industry even as some of its most prominent leaders warn about potentially catastrophic risks. President Donald Trump has resisted recent calls for greater government oversight, putting him at odds with tech leaders including Anthropic's Dario Amodei, OpenAI's Sam Altman and xAI's Elon Musk.

The legislation would permanently prohibit artificial superintelligence, which it defines as a system that exceeds human cognitive ability or has sufficient capabilities to plan and execute the destruction or disempowerment of humanity.

It would temporarily pause development of the most advanced AI systems until new federal safety rules are established by a new Department of Artificial Intelligence. Advanced AI systems would then need federal approval before they could be deployed. Violations could carry significant penalties, including up to 20 years in prison in some cases.

A number of current employees at AI companies and experts signed on in support of the bill, according to a statement shared with AP.

Juan Felipe Cerón Uribe, a researcher in OpenAI's Safety Systems, said in a statement supporting the bill that "superintelligence could either go extremely right or extremely wrong" and that "we shouldn't be playing such games."

Swante Scholz, a software engineer at Google DeepMind who said he was not speaking on behalf of his employer, said on the current path of development, the "most likely outcome is an existential catastrophe for humanity."

Sanders, a two-time presidential candidate who is now 85, has especially focused on the issue in recent months. In June, he introduced legislation to create a sovereign wealth fund financed through a one-time tax on the stock of the largest AI companies. Last week, he hosted colleagues for a briefing with experts and also attended a conference focused on the issue alongside Republicans, including former White House adviser Steve Bannon.

While some industry leaders have called for new safeguards, Trump has pushed in the opposite direction. On Tuesday, Trump told the United Nations General Assembly that artificial intelligence will be renamed "super intelligence."

"I think Trump has very little understanding of what this issue is about," Sanders said. "I think he's mainly concerned about the economic implications of a slowdown."

AI safety is expected to be a central part of talks between Trump and China's Xi Jinping at the White House this week as the countries compete for dominance in the sector. The prospect of slowing development in the United States while China continues on has also been one of the central arguments against sweeping restrictions.

Sanders argued that avoiding the most dangerous forms of AI would ultimately require cooperation between the two countries, comparing the challenge to nuclear arms control during the Cold War.

"Ronald Reagan, arch-conservative, was smart enough to understand that he had to sit down with Gorbachev, a communist, and work out a nuclear treaty that protected humanity," Sanders said. "I think we can do that again now."