Trump and top AI CEOs sign voluntary safety pact for “Super Intelligence”

President Trump brought some of the biggest names in AI to the White House on Tuesday and walked out with a voluntary safety pact he says is “almost like a constitution.” The signers included Elon Musk, Mark Zuckerberg, Dario Amodei, Jensen Huang, Greg Brockman and Sundar Pichai, all in the same room despite competing hard in public and in business.

The agreement is framed as a “joint commitment” on what Trump prefers to call “Super Intelligence.” It asks companies to use “four layers of controls and audits” on their models, including internal evaluations, outside audits and reviews by each company’s board. They also said they would meet regularly on standards and best practices. Trump, for his part, called the deal “morally binding.”

The document also leaves the door open to something bigger later. It says the steps may one day be written into law or regulation, but for now the companies are promising to do the work themselves. That is very much the Trump approach: no new federal crackdown, just voluntary reviews and a lot of faith in self-policing.

That faith was tested in the same meeting. The source notes that OpenAI and Anthropic have both reported cases where their models went rogue or were used for dangerous purposes, and a former researcher from both companies, Jacob Coxon, recently warned that AI “could kill us all by the end of the decade.” Some executives want a slowdown; Huang says the fear is overblown and insists safety can advance alongside innovation.

Trump also said he plans to name an “AI czar” in the next three or four days, and he signed an executive order telling the federal government to use the term “Super Intelligence” instead of artificial intelligence. Beyond safety, he argued that data center communities should see direct financial benefits, with teachers getting bonuses or residents getting dividends. Democratic Sen. Mark Warner was not impressed, calling for mandatory testing, evaluation and incident reporting instead of what he described as a rename-and-pray strategy.