Submission + - DOGE Developed Error-Prone AI Tool to "Munch" Veterans Affairs Contracts
As the Trump administration prepared to cancel contracts at the Department of Veteran Affairs this year, officials turned to a software engineer with no health care or government experience to guide them.
The code, using outdated and inexpensive AI models, produced results with glaring mistakes. For instance, it hallucinated the size of contracts, frequently misreading them and inflating their value. It concluded more than a thousand were each worth $34 million, when in fact some were for as little as $35,000.
The programmer who wrote the code had 15 years of experience with no formal AI training. He had previously automated manual processes at his own almost failed startup. The review tool code is posted here. The contracts selected were labeled "MUNCHABLE." It does not appear that anyone in DOGE checked his code or how the results were used. He was terminated after he was interviewed by Fast Company.