The people building the systems that might kill us are now publicly quitting over it—and half of Twitter thinks it's performance art.

The Summary

The Signal

This isn't the usual AI safety theater. Jacob Coxon didn't just write a concerned blog post. He quit Anthropic, walked away from what's likely a seven-figure job, and said the company—along with OpenAI where he previously worked—is "ignoring or at best mishandling" the threat of AI systems becoming superhuman and potentially lethal within five years. Then other Anthropic researchers piled on publicly, echoing his timeline and his fears.

That's not normal. Anthropic markets itself as the responsible AI company, the one that supposedly cares about safety more than OpenAI does. When your own safety researchers start fleeing and calling you out, that's a structural problem, not a PR hiccup.

"Many in industry believe that without regulation AI could kill off humanity."

The extinction timeline is aggressive: 2030. Not 2050 or "eventually." Coxon and the other researchers claim AI will achieve superhuman capabilities and spiral beyond control before the end of this decade. Whether you buy that or not, the fact that people who've seen the internal models and training runs believe it matters. These aren't philosophers or think tank fellows. They're the ones writing the code.

The political response split immediately and predictably. Ted Cruz read Coxon's thread and called it "highly concerning" on national television. Meanwhile, Elon Musk—who's actively building AI agents through xAI and deploying them across X—dismissed the whole thing as a "psyop", with other conservative voices calling it a "setup." The subtext is obvious: AI safety talk is just another excuse for regulation that slows down the winners.

Key fault lines emerging:

  • Researchers inside labs vs. founders and execs pushing product
  • Bipartisan political concern vs. libertarian accelerationist dismissal
  • "Pause and regulate" vs. "build faster or China wins"

Here's what makes this moment different from past AI safety dustups. The warnings aren't coming from outsiders or academics with no skin in the game. They're coming from people who just walked away from the center of the industry. More Anthropic staff joined Coxon in posting their own warnings the day after his thread, turning this into a coordinated internal revolt, not a lone dissenter.

And the "psyop" framing from Musk isn't just dismissive—it's strategic. If you can paint existential risk as a coordinated PR stunt, you neutralize the argument without engaging it. You don't have to address the technical claims. You just call it theater and move on to shipping the next model.

The Implication

Watch what happens to these researchers next. If they get shunned or quietly sidelined, it tells you the industry has decided speed matters more than safety. If they get hired into government roles or advisory positions, it means the regulatory apparatus is taking them seriously. Either way, the idea that AI labs can self-regulate just took a hit.

For anyone building agents or deploying AI at scale, this is your warning shot. The people closest to the models think we're five years from catastrophic risk. You can dismiss that as doomerism, but you can't dismiss the fact that the builders are walking away. That changes the insurance calculations, the liability models, and eventually the willingness of capital to keep funding unchecked acceleration. Plan accordingly.

Sources

The Guardian Tech