Senate Democrats are trying to ‘codify’ Anthropic’s red lines on autonomous weapons and mass surveillance | The Verge
Overview
Tech Expand Amazon Apple Facebook Google Microsoft Samsung Business See all tech
Reviews Expand Smart Home Reviews Phone Reviews Tablet Reviews Headphone Reviews See all reviews
Details
Science Expand Space Energy Environment Health See all science
Entertainment Expand TV Shows Movies Audio See all entertainment
Policy Expand Antitrust Politics Law Security See all policy
Gadgets Expand Laptops Phones TVs Headphones Speakers Wearables See all gadgets
Verge Shopping Expand Buying Guides Deals Gift Guides See all shopping
Streaming Expand Disney HBONetflix You Tube Creators See all streaming
Transportation Expand Electric Cars Autonomous Cars Ride-sharing Scooters See all transportation
Policy Close Policy Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Policy
Posts from this topic will be added to your daily email digest and your homepage feed.
AIClose AIPosts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All AI
Posts from this topic will be added to your daily email digest and your homepage feed.
Report Close Report Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Report
Posts from this topic will be added to your daily email digest and your homepage feed.
Senate Democrats are trying to ‘codify’ Anthropic’s red lines on autonomous weapons and mass surveillance
Adam Schiff doesn’t want to rely on the Pentagon or AI CEOs’ word when it comes to autonomous weapons.
Adam Schiff doesn’t want to rely on the Pentagon or AI CEOs’ word when it comes to autonomous weapons.
Posts from this author will be added to your daily email digest and your homepage feed.
Posts from this author will be added to your daily email digest and your homepage feed.
Anthropic’s fight with the Pentagon is expanding to Congress. Sen. Adam Schiff (D-CA) is working on a new bill to “codify” Anthropic’s red lines and ensure humans make the ultimate decisions in questions of life and death, and Sen. Elissa Slotkin (D-MI) recently introduced a bill to limit the Defense Department’s ability to use AI for mass surveillance of Americans.
The Trump administration blacklisted Anthropic earlier this month after it set limits on how the military could use its AI models, designating it a supply-chain risk. Anthropic has filed suit, accusing the government of violating its constitutional rights. It’s insisted that the Pentagon avoid using its products for fully autonomous weapons and mass domestic surveillance — resisting a deal signed by major competitor Open AI. Anthropic is waiting to hear if a court will block the administration’s decision to label it a supply chain risk.
“I was alarmed to see the Pentagon take aim at Anthropic because Anthropic was simply trying to insist on policies that the vast majority of American people agree with,” Schiff told The Verge in a phone interview last week. “The idea that they would therefore then try to turn around and kill the company, kill one of the preeminent leaders of AI is such a hostile, dictatorial kind of an act. They would set back America’s leadership in AI, and Anthropic is one of the very best.”
Schiff’s office is still in the process of drafting the legislation, but he said the aim is to ensure AI isn’t used for “certain illicit purposes.” Slotkin recently introduced a similar bill last week called the AI Guardrails Act, to reinforce protections against domestic mass surveillance and the use of autonomous lethal weapons without human intervention. It’s not yet clear how Schiff’s bill will differ or align on key points, though it covers similar ground. Schiff spokesperson Ruby Robles Perez said his office continues to talk with stakeholders and industry leaders before finalizing their bill. Slotkin’s bill restricts the Department of Defense’s ability to use AI to detonate a nuclear weapon or track people or groups in the US, but also outlines how the Defense Secretary can notify Congress in the event that “extraordinary circumstances” necessitate the use of AI to deploy autonomous lethal weapons.
In the bill Schiff is drafting, the specifics about what constitutes an autonomous weapon or domestic surveillance are still the subject of discussion, but he said they are also looking to existing frameworks from the Biden administration. “We haven’t resolved all of those questions yet, including how this language would apply to those who were non-citizens, but people who are lawfully in the country are deserving of protection. And then as a human rights matter, it may go beyond that as well,” Schiff said.
“We don’t want to delegate that kind of responsibility over life and death to an algorithm”
One principle guiding this effort is the idea of a human in the loop. “Whenever a technology has the capability of taking a human life, there needs to be a human operator in the chain of command. We don’t want to delegate that kind of responsibility over life and death to an algorithm,” Schiff said.
But that doesn’t mean there’s no role for AI on the battlefield. “There are certainly circumstances in which, because AI can operate faster than human beings can, you want AI to be able to tip and cue information for human operators either that need to take steps to defend the country or that need to adjust given what it can see in real time on the battlefield,” Schiff said. “So the applications are very significant. They can be very beneficial from a national security and defense perspective. But they can also mean life or death. They can mean distinguishing between a civilian target and a military target, or getting those things wrong.”
With a Democratic minority in both houses, the short-term success of the bill may depend on Republicans’ willingness to be seen as critical of the administration. With midterms approaching, it will only get harder until the end of the year to pass new legislation, though the balance of power in Congress could shift if Democrats regain one or both chambers. It could still take at least another week or two to unveil the proposal, but Schiff is looking at legislative vehicles like the National Defense Authorization Act (NDAA) to move it forward.
“There’s certainly bipartisan support in the public for these kinds of limitations,” Schiff said. “As always, you confront the issue when you’re taking steps to prevent any kind of administrative abuse that it raises issues with some of my colleagues about whether it can be read as an implicit criticism of the administration. So we’ll have to deal with that, but I’m hoping that we can make it bipartisan.”
Since Anthropic put up its fight with the Pentagon, Open AI has scrambled to defend its reasons for signing terms that have garnered public pushback. Even with Open AI saying it will insist on the same terms, Schiff said he’d rather not have to place that trust in the Pentagon or any CEO. “I would have a lot more confidence, frankly, if these were statutory requirements, than relying on the lawfulness of the Pentagon or the word of an AI CEO,” he said.
Lauren Feiner Close Lauren Feiner Senior Policy Reporter Posts from this author will be added to your daily email digest and your homepage feed. Follow Follow See All by Lauren Feiner
Posts from this author will be added to your daily email digest and your homepage feed.
AIClose AIPosts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All AI
Posts from this topic will be added to your daily email digest and your homepage feed.
Anthropic Close Anthropic Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Anthropic
Posts from this topic will be added to your daily email digest and your homepage feed.
Law Close Law Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Law
Posts from this topic will be added to your daily email digest and your homepage feed.
Policy Close Policy Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Policy
Posts from this topic will be added to your daily email digest and your homepage feed.
Politics Close Politics Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Politics
Posts from this topic will be added to your daily email digest and your homepage feed.
Report Close Report Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Report
Posts from this topic will be added to your daily email digest and your homepage feed.
More in: AI vs. the Pentagon: killer robots, mass surveillance, and red lines
Nvidia CEO Jensen Huang says ‘I think we’ve achieved AGI’
The US government just banned consumer routers made outside the US
Donut Lab’s solid-state battery could barely hold a charge after getting damaged
Open AI just gave up on Sora and its billion-dollar Disney deal
Key Takeaways
- Tech Expand Amazon Apple Facebook Google Microsoft Samsung Business See all tech
- Reviews Expand Smart Home Reviews Phone Reviews Tablet Reviews Headphone Reviews See all reviews
- Science Expand Space Energy Environment Health See all science
- Entertainment Expand TV Shows Movies Audio See all entertainment
- Policy Expand Antitrust Politics Law Security See all policy
