DOGE used Chat GPT in a way that was both dumb and illegal, judge rules | The Verge
Overview
Tech Expand Amazon Apple Facebook Google Microsoft Samsung Business See all tech
Reviews Expand Smart Home Reviews Phone Reviews Tablet Reviews Headphone Reviews See all reviews
Details
Science Expand Space Energy Environment Health See all science
Entertainment Expand TV Shows Movies Audio See all entertainment
Policy Expand Antitrust Politics Law Security See all policy
Gadgets Expand Laptops Phones TVs Headphones Speakers Wearables See all gadgets
Verge Shopping Expand Buying Guides Deals Gift Guides See all shopping
Streaming Expand Disney HBONetflix You Tube Creators See all streaming
Transportation Expand Electric Cars Autonomous Cars Ride-sharing Scooters See all transportation
Policy Close Policy Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Policy
Posts from this topic will be added to your daily email digest and your homepage feed.
News Close News Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All News
Posts from this topic will be added to your daily email digest and your homepage feed.
Law Close Law Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Law
Posts from this topic will be added to your daily email digest and your homepage feed.
DOGE used Chat GPT in a way that was both dumb and illegal, judge rules
The ruling restores federal grants that were shut down for ‘DEI’ prejudice.
The ruling restores federal grants that were shut down for ‘DEI’ prejudice.
Posts from this author will be added to your daily email digest and your homepage feed.
Posts from this author will be added to your daily email digest and your homepage feed.
The Department of Government Efficiency’s cancellation of over $100 million in grants was unconstitutional, according to a ruling on Thursday. In the 143-page decision, US District Judge Colleen Mc Mahon cites DOGE’s process for eliminating grants, which involved using Chat GPT to determine if something is related to diversity, equity, and inclusion (DEI).
The ruling, which stems from a 2025 lawsuit filed by humanities groups, says “it could not be more obvious that DOGE used the mere presence of particular, protected characteristics to disqualify grants from continued funding” from the National Endowment for the Humanities (NEH). Judge Mc Mahon cites several instances in which DOGE appeared to use Chat GPT to scan and eliminate grants using their relation to characteristics like race, national origin, religion, and sexuality.
The filing mentions testimony from Justin Fox, a DOGE staffer who worked with his colleague Nate Cavanaugh to eliminate 97 percent of grants under the NEH, in part by relying on Chat GPT’s understanding of DEI:
Fox testified that he used Chat GPT “[t]o highlight why [a] grant may relate to DEI” and “to pull out anything related to DEI.” To do so, he submitted each cursory grant description from the NEH spreadsheet to Chat GPT using a standardized prompt: “Does the following relate at all to DEI? Respond factually in less than 120 characters. Begin with ‘Yes.’ or ‘No.’ followed by a brief explanation.” Fox testified that he did not define “DEI” for Chat GPT and that he did not have the slightest idea how Chat GPT understood the term.
Fox testified that he used Chat GPT “[t]o highlight why [a] grant may relate to DEI” and “to pull out anything related to DEI.” To do so, he submitted each cursory grant description from the NEH spreadsheet to Chat GPT using a standardized prompt: “Does the following relate at all to DEI? Respond factually in less than 120 characters. Begin with ‘Yes.’ or ‘No.’ followed by a brief explanation.” Fox testified that he did not define “DEI” for Chat GPT and that he did not have the slightest idea how Chat GPT understood the term.
In addition to asking Chat GPT for signs that something is related to DEI, Fox also asked the AI chatbot to scan NEH grants for what he called “Detection Codes” related to “protected characteristics,” according to the filing:
After being deployed from DOGE to NEH, Justin Fox used search terms, which he labeled as “Detection Codes,” to identify grants that he dubbed the “Craziest Grants” and “Other Bad Grants.” The search terms included, among other terms, “BIPOC (Black, Indigenous, People of Color),” “Minorities,” “Native,” “Tribal,” “Indigenous,” “Immigrant,” “LGBTQ,” “Homosexual,” and “Gay.” When Fox was asked whether he “r[a]n this list of words through every grant description” he received from NEH, he confirmed, “yes.” In this way, Fox constructed and applied explicit classifications based on protected characteristics and used them as the operative criteria for revoking federal grants.
After being deployed from DOGE to NEH, Justin Fox used search terms, which he labeled as “Detection Codes,” to identify grants that he dubbed the “Craziest Grants” and “Other Bad Grants.” The search terms included, among other terms, “BIPOC (Black, Indigenous, People of Color),” “Minorities,” “Native,” “Tribal,” “Indigenous,” “Immigrant,” “LGBTQ,” “Homosexual,” and “Gay.” When Fox was asked whether he “r[a]n this list of words through every grant description” he received from NEH, he confirmed, “yes.” In this way, Fox constructed and applied explicit classifications based on protected characteristics and used them as the operative criteria for revoking federal grants.
Judge Mc Mahon writes that DOGE deemed hundreds of grants “wasteful because they related to Blacks, women, Jews, Asian Americans, and Indigenous people,” adding that “the very subjects DOGE treated as markers of waste, lack of merit, or ideological contamination are the subjects that Congress made expressly germane to NEH’s mission.” Some of the grants lumped into the “wasteful” category related to projects about the Holocaust, civil rights, and an educational experience that would allow participants to “explor[e] indigenous knowledge, culture, and climate.”
Mc Mahon also pushes back on the government’s argument that “there is no real constitutional problem here because any viewpoint-based classification was Chat GPT’s doing, rather than the Government’s:”
There is no distinction to be drawn here between the Government and Chat GPT. Chat GPT was the Government’s chosen instrument for purposes of this project, and DOGE’s use of AI to identify DEI-related material neither excuses presumptively unconstitutional conduct nor gives the Government carte blanche to engage in it. ... There is not a scintilla of evidence that Fox or Cavanaugh, having obtained a “DEI” rationale from Chat GPT, undertook any meaningful review of whether that rationale made sense.
There is no distinction to be drawn here between the Government and Chat GPT. Chat GPT was the Government’s chosen instrument for purposes of this project, and DOGE’s use of AI to identify DEI-related material neither excuses presumptively unconstitutional conduct nor gives the Government carte blanche to engage in it. ... There is not a scintilla of evidence that Fox or Cavanaugh, having obtained a “DEI” rationale from Chat GPT, undertook any meaningful review of whether that rationale made sense.
In her decision, Judge Mc Mahon ultimately found that DOGE’s elimination of over 1,400 NEH grants was unlawful and unconstitutional, citing violations of the First Amendment, the Fifth Amendment’s equal protection law, and DOGE’s lack of authority. Mc Mahon issued an order to reverse their cancellation.
Emma Roth Close Emma Roth News Writer Posts from this author will be added to your daily email digest and your homepage feed. Follow Follow See All by Emma Roth
Posts from this author will be added to your daily email digest and your homepage feed.
Law Close Law Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Law
Posts from this topic will be added to your daily email digest and your homepage feed.
News Close News Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All News
Posts from this topic will be added to your daily email digest and your homepage feed.
Policy Close Policy Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Policy
Posts from this topic will be added to your daily email digest and your homepage feed.
Politics Close Politics Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Politics
Posts from this topic will be added to your daily email digest and your homepage feed.
Speech Close Speech Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Speech
Posts from this topic will be added to your daily email digest and your homepage feed.
Canvas is online again after Shiny Hunters threaten to leak schools’ data
Mira Murati’s deposition pulled back the curtain on Sam Altman’s ouster
Key Takeaways
- Tech Expand Amazon Apple Facebook Google Microsoft Samsung Business See all tech
- Reviews Expand Smart Home Reviews Phone Reviews Tablet Reviews Headphone Reviews See all reviews
- Science Expand Space Energy Environment Health See all science
- Entertainment Expand TV Shows Movies Audio See all entertainment
- Policy Expand Antitrust Politics Law Security See all policy
