More from the article ...

... "We really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade," Evan Hubinger, the San Francisco-based company's Alignment Science Lead, said in a post on X. "I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to."

Superintelligence is the still-theoretical notion of an AI agent that is smarter than even the sharpest human minds.

Hubinger issued his dramatic post following the resignation of a colleague, Anthropic researcher Jacob Coxon, on Tuesday.

"I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly," Coxon said in a post on X. "They are racing straight to self-improving superintelligence and gambling with our lives."

"At OpenAI, many have not deeply internalized the civilizational stakes. At Anthropic, the stakes are well-understood, but they are locked in a race to get there first -- they believe no one else will act responsibly, so they must do it themselves, despite the risk," Coxon said. ...