Senior US defense leaders, including Secretary Pete Hegseth, held discussions with representatives from artificial intelligence firm Anthropic this week to address a significant disagreement over defense use of the company's advanced Claude AI model. Reports indicate Hegseth issued an ultimatum, giving Anthropic CEO Dario Amodei by Friday to agree to the department's terms or risk serious consequences.
A Clash Over Ethics and Access
The company, which positions itself as the most safety-conscious of the leading AI developers, has been engaged in a weeks-long standoff with the Department of Defense. The core issue revolves around the extent to which the armed forces can utilize the Claude large language model. Whereas defense officials are pushing for unrestricted access to its capabilities, Anthropic has allegedly refused allowing its technology to be used for applications such as wide-scale monitoring or AI-driven lethal platforms that could engage targets absent human oversight.
"I think, if a company wants to make money from the US government, from the US Department of Defense, those safeguards should be adjusted for our use cases – so long as they’re lawful," said a senior Pentagon AI official last week.
The DoD has reportedly incorporated Claude into certain workflows, but has threatened to sever the relationship over what it perceives as excessive limitations imposed by the AI company.
Billions and Wider AI Deals
This negotiation underscores the larger question of whether the AI industry will push back against government requests for defense applications of their products. The Pentagon previously struck lucrative deals with several prominent AI firms, including Anthropic, Google, and OpenAI, offering contracts worth up to $200 million. Until recently, Anthropic's Claude was the only AI model authorized for use in the Pentagon's classified networks.
Yet, in a significant move, the DoD finalized a contract on Monday allowing the use of Elon Musk's xAI chatbot within those same environments. This follows previous backlash regarding that specific AI's output of harmful imagery.
It is important to note that xAI and OpenAI have according to reports agreed to the government's terms on usage, with a defense official stating that OpenAI had allowed its model for "all legal purposes."
Ideological Dimensions and Global Consequences
The context of the talks is significant, occurring a month after the US military allegedly used Claude to support a sensitive international mission. There has been a strong push from the sitting administration to integrate AI extensively into military strategy.
Meanwhile, Anthropic's leadership has publicly campaigned for stronger AI oversight and has supported initiatives advocating comprehensive protections. The firm's perceived ideological stance have reportedly affected its investor relations, with some pro-Trump venture capital firms backing out from potential investments.
What's Next of Artificial Intelligence in Warfare
The Pentagon has invested billions into developing AI-enabled systems, from unmanned vehicles to AI-assisted decision-making tools. This accelerating advancement has brought urgent moral dilemmas to the forefront, particularly regarding the handing over of lethal choices to algorithms.
- Lethal AI: Debates have moved beyond theoretical, with ongoing wars featuring semiautonomous drones that can operate independently.
- Sector Pushback: The outcome of the Anthropic negotiation could establish a pattern for how other AI firms engage with defense contracts.
- International Competition: There is a declared objective to dominate the global AI technology race, introducing a layer of geopolitical competition to the moral conversation.
The weekend ultimatum looms, putting immense strain on Anthropic to decide whether to comply with the military's requirements or uphold its public ethical commitments and risk substantial financial and partnership repercussions.