Anthropic warns of catastrophic AI risk ahead of Nasdaq listing

Anthropic, the company behind the Claude chatbot, has warned that artificial intelligence could bring about “catastrophic or existential risks to humanity” if not properly controlled. The caution came in a regulatory filing that revealed details of its planned stock market debut on the Nasdaq under the ticker ANT. The listing is expected to value the company above SpaceX, whose own summer IPO was the largest ever at around $1.8 trillion.

Yet the filing, which runs to roughly 90 pages of risk factors, paints a stark picture. It notes that policymakers, regulators, researchers, and even people within Anthropic itself have raised concerns that AI systems could pose significant danger. The company said that without appropriate safeguards, oversight, and security, such systems could be misused, replicated, weaponised, or allowed to act with too much autonomy. Still, Anthropic insisted it aims to be “bold but sane” and to win trust through successful bets.

Financials and competitive landscape

Anthropic reported $16.3 billion in revenue for the first half of the year, but losses exceeded $80.7 billion. It acknowledged that its future depends largely on developing the most advanced AI models, and that failure to do so could hurt the business. The company also flagged its reliance on a small number of cloud providers, Taiwanese chipmakers under heavy demand, and data centres concentrated in the US. It cited possible regulatory action over harms linked to its models, including use by children or people at risk of suicide.

The IPO comes amid a wave of cyber-security breaches involving AI agents—bots designed to operate with some autonomy. Current and former staff at Anthropic and rival OpenAI have warned that the technology is being developed without adequate protections. OpenAI, which followed Anthropic’s June announcement with its own plans, is expected to list early next year. On Monday, the owners of Elvis Presley’s music sued Anthropic, claiming it used hundreds of his songs to train Claude.

Investor reaction and vision

Matt Orton, chief market strategist at Raymond James Investment, told the BBC that the filing wasn’t a surprise, but added: “Getting the details from this filing, I think will help provide the market with more visibility, because we need to know where its revenue growth is coming from.” Peter Andersen, founder of Andersen Capital Management, called the listing “a significant milestone in the development of artificial intelligence” and said its performance would indicate investor appetite for further AI funding. Anthropic believes AI is among the most consequential technologies in history, with the potential to accelerate progress in biology and medicine, possibly leading to cures for cancer and Alzheimer’s. It also sees AI driving sustained economic growth through productivity gains. The company envisions unlocking millions of virtual agents that could revolutionise every area of human endeavour. But for now, it must convince investors that its bold vision can overcome the very risks it has so candidly described.