Anthropic highlights AI safety concerns in filing
Artificial intelligence firm Anthropic has filed plans for a stock market listing, highlighting its rapid revenue growth while acknowledging significant safety concerns. The company’s disclosure to investors outlines risks including potential conflicts with the Trump administration and AI systems operating independently, alongside massive investments in computing infrastructure.
The listing, which could raise as much as $100 billion, would be the first by one of the standalone companies leading the race to build advanced AI. This comes amid uncertainty around the globe on whether the AI boom can deliver profits, with some believing the huge listing next month will help both the firm and the sector.
A new study by French insurer Axa found that people around the world now regard AI as a greater threat than climate change. Meanwhile, Australia’s cybersecurity agency warned that artificial intelligence poses an “unprecedented” threat because foreign governments could use it to hack computer networks and critical infrastructure.
90 pages of prospectus devoted to risks
The 400-page prospectus devotes over 90 pages to risks specific to the AI industry, which has faced a string of reports in recent months of AI systems behaving in unexpected and harmful ways. The filing cited concerns that advanced systems “could pose catastrophic or existential risks to society if not developed and deployed responsibly.”
Anthropic’s business has grown quickly, with sales reaching $11.6 billion in the April-June quarter, up from $787 million a year earlier. The company made its first operating profit in that quarter, close to $1 billion. Much of the growth comes from businesses using Claude to write software and handle office work, with nearly 12,000 organizations now spending at least $100,000 a year with Anthropic.
Read Also: Jio’s record IPO boosts India’s tech ambitions
Huge spending on computing capacity
To power its AI, Anthropic has committed hundreds of billions of dollars to computing capacity, including up to $120.5 billion with SpaceX and about $110 billion with Amazon. The company warned that if demand falls short of its projections, many of these payments must be made regardless of how much capacity it actually uses.
The Australian Signals Directorate said on Tuesday that rapidly advancing AI models could be of huge benefit if harnessed for good, but also warned of the risks of hackers using AI to launch attacks at “greater scale than ever before”. The directorate reported a stark increase in cybersecurity incidents, with over 4,400 warnings about potentially malicious activity over the past year – an 80% increase compared to the prior 12 months.
Anthropic’s filing noted that its engagement with policymakers and public positions on AI regulation and safety could subject it to heightened scrutiny, political backlash, or disproportionate regulatory action. The company has been targeted in recent months by the administration of US President Donald Trump for refusing to lift restrictions on how the Pentagon could use its technology.
Anthropic is registered as a “public benefit corporation,” which requires it to weigh its goal of developing AI safely alongside making money for shareholders. The company’s seven co-founders will keep control of just over half of shareholder votes after the listing. In conclusion, Anthropic’s listing is a significant development in the AI industry, and its success will be closely watched by investors and regulators alike.
