AI hallucinations are infiltrating expert work—and entering the permanent body of knowledge
AI tools are increasingly being used in academic research, but they are also leading to significant issues with fabricated references. A recent study found that the rate of fake references in biomedical literature has grown dramatically, raising concerns about the integrity of scientific work. Experts are now questioning the reliability of AI-generated content and its implications for the medical field.
- ▪A study audited nearly 2.5 million biomedical papers and found over 4,000 fabricated references.
- ▪The rate of fabricated references in biomedical literature has increased more than 12-fold over the past three years.
- ▪One in 277 papers published in early 2026 contained at least one non-existent reference.
Opening excerpt (first ~120 words) tap to expand
It was a process that had become routine for Maxim Topaz. Recommended Video The associate professor at Columbia University’s School of Nursing had grown accustomed to having artificial intelligence tools help polish scientific papers for grammar, formatting, and other details. But a few weeks after submitting his latest research, the academic journal he was due to publish in came back with questions about a reference. The AI tool Topaz had used had silently inserted a fabricated source into his work. “I felt deeply embarrassed,” Topaz, who leads a team at Columbia developing AI applications in healthcare, told Fortune. “I’m an AI researcher. I know about hallucinations,” he said.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at Fortune.
Discussion
0 commentsMore from Fortune
