Skip to content
Breaking:

Anthropic Disclosures and National Security Analysts Spotlight AI Biosecurity Risks

As model developers block attempts to probe pathogen engineering, security experts warn that low entry barriers and high-containment lab density amplify global biological threats.

By The Company Wire4 min read
Share
Anthropic — Anthropic Disclosures and National Security Analysts Spotlight AI Biosecurity Risks
Anthropic — Anthropic Disclosures and National Security Analysts Spotlight AI Biosecurity Risks. Photo: Wired.

Concerns over artificial intelligence misuse in pathogen research have drawn fresh scrutiny to global biosafety standards and automated safety guardrails. The focus follows a recent misuse disclosure from AI developer Anthropic, which detailed five separate attempts by foreign researchers to bypass safety guardrails on its Claude model to query gain-of-function pathogen modifications.

Anthropic rejected the requests and closed the associated accounts, noting that while gain-of-function data has legitimate medical applications—such as vaccine and antiviral development—dual-use risks require strict containment to prevent automated tools from facilitating the engineering of deadlier or more transmissible agents.

The broader context surrounding biological risks and automated systems was detailed in a report published by Wired (https://www.wired.com/story/you-dont-need-ai-to-be-concerned-about-bioweapons-development-but-it-helps/), which featured an interview by Michael Mechanic with national security author Annie Jacobsen following the late-July publication of her book, Biological War: A Scenario. Jacobsen noted that while AI-enabled biology has heightened public attention, the underlying barrier to entry for biological threats remains dangerously low even without machine learning tools.

According to security specialists cited in the report, accidental containment breaches represent a statistically higher threat than deliberate biological weapon deployments. An estimated 3,600 Biosafety Level 3 and Biosafety Level 4 facilities operate globally to study high-consequence pathogens. The report highlighted historical precedents of laboratory accidents, such as the fatal Marburg virus infection of Soviet scientist Nikolai Ustinov, alongside research efforts including mousepox alterations and airborne H5N1 avian influenza transmission experiments in ferrets.

International conventions prohibit offensive biological weapons development. According to U.S. State Department assessments cited by Jacobsen, Russia and North Korea maintain illegal biological weapons programs, while China and Iran operate programs of concern. The U.S. dismantled its offensive bioweapons initiative under President Richard Nixon, shifting institutional focus to defensive countermeasures.

Following the book's release, Jacobsen spoke with personnel at the Fort Detrick Biosafety Level 4 facility in Frederick, Maryland, at the invitation of lab director Dr. Nicholas Bergman, where researchers are increasingly tracking the implications of AI-assisted biological research. Biosecurity experts such as presidential advisor David Relman have also warned of long-term biological risks, including hypothetical synthetic mirror-life organisms, reinforcing calls for strict access controls and rigorous laboratory containment.

Sources

  1. Wired

Company: Anthropic

Written by

The Company Wire

Newsroom · San Francisco

Inside the companies building what’s next. Reporting on startups, technology, funding and the people shaping them.