When AI Writes the Software, Who Verifies It?
The rise of AI in software development is transforming how code is generated, with major companies reporting significant portions of their new code being AI-generated. However, this rapid production raises concerns about the verification of code quality and security, as traditional review methods may not keep pace. As AI-generated code becomes more prevalent, the risks associated with unverified software could lead to systemic vulnerabilities in critical infrastructure.
- ▪Metal raised $125 million to rewrite defense industry code using AI.
- ▪Nearly half of AI-generated code fails basic security tests.
- ▪Poor software quality costs the U.S. economy $2.41 trillion per year.
Opening excerpt (first ~120 words) tap to expand
When AI Writes the World's Software, Who Verifies It? 2026-02-28 AI Is Rewriting the World's Software Code Metal recently raised $125 million to rewrite defense industry code using AI. Google and Microsoft both report that 25–30% of their new code is AI-generated. AWS used AI to modernize 40 million lines of COBOL for Toyota. Microsoft's CTO predicts that 95% of all code will be AI-generated by 2030. The rewriting of the world's software is not coming. It is underway. Anthropic recently built a 100,000-line C compiler using parallel AI agents in two weeks, for under $20,000. It boots Linux and compiles SQLite, PostgreSQL, Redis, and Lua. AI can now produce large-scale software at astonishing speed. But can it prove the compiler correct? Not yet. No one is formally verifying the result.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at Github.