Why ex-Anthropic researcher believes AI could ‘kill people’

Anthropic says it stopped several attempts this year by scientists trying to use its AI models for research that could have helped build biological weapons, including one case tied to the chikungunya virus.

6 min readSep 11, 2026 02:36 PM IST First published on: Sep 11, 2026 at 09:19 AM IST

Former Anthropic researcher Jacob Coxon, who resigned from the company while predicting AI could destroy all humanity. (Photo: X/@CBSNews)

Former Anthropic researcher Jacob Coxon has warned that artificial intelligence, while safe for people to use today, could one day threaten humanity as the technology grows more powerful. Speaking to CBS News senior business and technology correspondent Jo Ling Kent, Coxon compared the direction of AI development to science fiction, saying a sufficiently advanced intelligence “will be smart enough to kill us.” His warning came the same week Anthropic disclosed that it had blocked several attempts by scientists to use its AI models for research that could have helped build biological weapons.

What did Coxon say about the risk from AI?

Coxon told CBS News that AI could eventually gain uncontrolled influence over parts of the physical world without human oversight. He pointed to how AI systems are already being connected to everyday devices, such as smart light bulbs, and asked people to imagine a scenario where an AI system simply refuses a basic command. He said the technology could also be misused for far more serious harm, including the development of bioweapons, warning it could end up “producing stuff that could kill everyone.”

Coxon was careful to say that current AI platforms do not pose an immediate danger and that he still believes the technology is safe for everyday use. His concern is about where the technology is headed, not where it stands today.

Why did Coxon resign from Anthropic?

Coxon publicly resigned from Anthropic on Tuesday, accusing the company and rival AI developer OpenAI of “gambling with our lives” by racing to build increasingly advanced AI models. He told CBS News the core problem is competition between AI firms, which he said can come at the cost of safety. “The whole problem is that there is a race,” he said, adding that “everyone decides they need to stay part of the race.”

Asked whether his former colleagues should also quit, Coxon said he did not think walking away was the answer for everyone. He said they should instead have their eyes open about the situation and speak more openly about it, adding that slowing down is likely part of the solution. Despite his concerns, Coxon said he believes most people at Anthropic and OpenAI are motivated by good intentions and a genuine wish to see AI go well.

Story continues below this ad

Could a rogue AI be shut down?

Coxon warned that if an AI model became a malicious actor without proper safeguards, it could be extremely hard to contain, since the model could copy itself across other computers on the internet. He described a scenario where such a system could make thousands of copies of itself and attempt to persuade, blackmail or convince people to help it gain more computing power, pointing to cases where AI systems have already tried to blackmail or impersonate people online.

He argued that the danger would not be limited to people who choose to use AI. “The AI will come for everyone,” he said, calling for government regulation rather than leaving safety entirely in the hands of AI companies. He said he would like to see AI firms agree not to push into dangerous territory without independent, transparent auditing.

What did Anthropic’s report reveal?

Meanwhile, Anthropic said this week it had blocked scientists from using its Claude models in ways that could have supported biological weapons development, among other harmful activity involving surveillance, scams, conventional weapons work and propaganda. The findings were set out in the company’s third report since March 2025 on misuse of its AI systems.

Anthropic said it could not always tell whether research flagged by its systems was intended for weapons development or legitimate medical study, since the same underlying research can help build vaccines or make a pathogen more dangerous. The company said it chose to act cautiously and block suspicious activity rather than wait for certainty.

Story continues below this ad

One case in the report dates back to May, when a scientist used Claude while preparing a grant application linked to chikungunya, a mosquito-borne virus that causes severe pain and fever lasting for months. The work involved gain-of-function research aimed at increasing the virus’s transmissibility and its ability to evade the immune system, tested by passing it repeatedly through live animals. Anthropic said the case became more concerning once it found signs the work was intended for a military research body, though it did not name the scientist, institution, country or specific biological agents involved.

Anthropic said researchers behind such cases took steps to hide the purpose of their work in order to get around its safety checks, and that it has since banned the accounts involved. The company said older AI models were not capable of meaningfully assisting dangerous biological research, but its newer models can now handle far more complex scientific tasks, prompting tighter controls on a wider range of biology-related queries.

What other misuse did Anthropic find?

The report also covered eight months of other misuse. Anthropic said it found attempts to use its models to help build conventional weapons, involving code linked to firearms, missiles, armed drones and bombs, with six cases tied to users in China, Russia and Yemen. The company did not name the group involved in Yemen, though details in the report point to the Iran-backed Houthi movement.

Anthropic also said it identified activity it believes was linked to government actors in China and Iran, including efforts to monitor dissidents and expat communities. In a separate case, the company said Russian state media used Claude to produce online material designed to look like independent journalism, including false claims about an election in Moldova.

Story continues below this ad

An Anthropic spokesperson responded to Coxon’s resignation and public comments on Thursday, telling CBS News the company has “always been transparent that AI will bring both enormous benefits and unprecedented risks.” The spokesperson said Anthropic continues to build models with strong safeguards and has been a pioneer in mechanistic interpretability, a field focused on understanding how AI models work internally, which the company said is now being used across the industry to study and prevent AI misalignment.

Anthropic said it runs ongoing tests of its AI systems’ capabilities and risks in areas including cybersecurity and biology, and publishes its findings publicly, as it did with this week’s report.

The Express Global Desk at indianexpress.com which delivers authoritative, verified, and context-driven coverage of key international developments shaping global politics, policy, and migration trends. The desk focuses on stories with direct relevance for Indian and global audiences, combining breaking news with in-depth explainers and analysis. A major focus area of the desk is US immigration and visa policy, including developments related to student visas, work permits, permanent residency pathways, executive actions, and court rulings. The Global Desk also closely tracks Canada’s immigration, visa, and study policies, covering changes to study permits, post-study work options, permanent residence programmes, and regulatory updates affecting migrants and international students. All reporting from the Global Desk adheres to The Indian Express’ editorial standards, relying on official data, government notifications, court documents, and on-record sources. The desk prioritises clarity, accuracy, and accountability, ensuring readers can navigate complex global systems with confidence. Core Team The Express Global Desk is led by a team of experienced journalists and editors with deep expertise in international affairs and migration policy: Aniruddha Dhar – Senior Assistant Editor with extensive experience in global affairs, international politics, and editorial leadership. Nischai Vats – Deputy Copy Editor specialising in US politics, US visa and immigration policy, and policy-driven international coverage. Mashkoora Khan – Sub-editor focusing on global developments, with a strong emphasis on Canada visa, immigration, and study-related policy coverage. ... Read More

© IE Online Media Services Pvt Ltd

• # AI
• # Anthropic
• # biological
• # Chemical weapons
• # Claude

• 01
• 02
• 03
• 04
• 05

Live Blog