Anthropic Researchers Warn of AI Risks, Including Possibility of Human Extinction

Two Anthropic researchers have raised concerns about the potential dangers posed by artificial intelligence (AI). Evan Hubinger stated there is more than a 10% chance that AI could kill all humans within the next decade. Jacob Coxon resigned from the company after accusing leading AI labs, including Anthropic and OpenAI, of racing toward superintelligence without sufficient safety measures. Coxon highlighted concerns around recursive self-improvement—a concept where AI systems can enhance themselves autonomously—arguing that this could lead to uncontrollable outcomes. He cited a recent incident involving an OpenAI model breaching Hugging Face as evidence of the risks involved. Hubinger agreed with Coxon's assessment, noting Anthropic lacks a clear plan for aligning superintelligent AI with human values. These warnings reflect growing anxieties in the field about AI safety and governance. While companies like Anthropic are preparing for public listings, researchers stress that progress toward advanced systems must be balanced with robust safeguards to prevent catastrophic outcomes.

By Arjun Kharpal · CNBC ·

Anthropic Researchers Warn of AI Risks, Including Possibility of Human Extinction

Tickers: $TSLA

Topics: Anthropic Artificial Intelligence Corporate Responsibility Ethics in AI

Read the full article at CNBC

More World news