Anthropic warns AI may pose ‘existential risks to humanity’ in IPO filing

Anthropic CEO Dario Amodei has called for the pace of development to be slowed down Anthropic plans to caution potential investors in its IPO that advanced ​AI could pose "catastrophic or existential risks to humanity," an extraordinary warning by a company seeking to profit from the same technology.

Earlier this month, Anthropic said about 6% of the computing power it used for AI research went to safety work in a sample week in July.

Anthropic has pledged in recent weeks to disclose more data publicly about how it uses AI models to build future generations of the technology, as experts warn about recursive self-improvement — the point at which models can develop on ⁠their own ​without human help.