🔍 The Surge of AI-Generated Fake Citations in Academic Publishing

In recent years, artificial intelligence (AI) tools like ChatGPT and other large language models (LLMs) have revolutionized research workflows, but they've also unleashed a torrent of fabricated references flooding journal submissions across U.S. higher education. Editors report a sharp uptick in manuscripts containing citations to nonexistent papers, journals, or DOIs—plausible inventions known as 'hallucinations' that evade initial peer review. These fake citations aren't mere typos; they're AI's confident fabrications, mimicking real scholarship with authentic-sounding authors, titles, and formats.

At the forefront of this crisis are U.S. university professors and journal editors grappling with submissions where up to a third of references prove bogus. For instance, one education adjunct requested a phantom 2023 paper from Georgia Southern University's Charles Hodges and the University of New Mexico's Stephanie Moore, complete with a fake DOI linking to the real Online Learning Journal. Such incidents highlight how AI pollutes the scholarly record, forcing educators to chase ghosts instead of advancing knowledge.

How AI Hallucinates Citations: A Step-by-Step Breakdown

AI hallucinations occur when LLMs generate text beyond their training data, filling gaps with invented details. Here's the process: First, a user prompts the AI for literature support, say on eLearning efficacy. The model recalls patterns from vast datasets but fabricates specifics—like authors, years, or venues—to complete the response. Second, it formats them convincingly in APA or MLA style, often blending real elements (e.g., living professors' names) with fakes. Third, users incorporate them without verification, submitting to journals.

This isn't random; studies show fabrication rates as high as 19.9% for citations in mental health reviews, rising to 46% for niche topics like digital interventions for binge eating disorder. Errors plague even 'real' cites: 45.4% have wrong DOIs, years, or authors. In U.S. colleges, students and faculty alike fall into this trap, amplifying the issue amid 'publish or perish' pressures.

Real-World Cases Shaking U.S. Universities

U.S. higher education institutions are ground zero. At Georgia State University, Assistant Professor Andrew Heiss caught students citing AI-forged papers that later appeared in professional journals, creating a feedback loop of deceit. USC's Gale Sinatra queried AI for her publications, unearthing fakes mixed with genuine ones—forcing CV cross-checks.

Conference scandals abound: GPTZero identified 100 hallucinated citations in 51 NeurIPS 2025 papers (a premier AI event dominated by U.S. researchers) and 50+ in ICLR 2026 submissions. Editors at journals like Journal of Technology and Teacher Education now spot these post-peer review, during copyediting—too late for some good manuscripts tainted by association.

Statistics Revealing the Scale of the Problem

The numbers are alarming. A JMIR Mental Health study found nearly two-thirds of GPT-4o-generated citations fabricated or erroneous, with rates climbing for obscure topics. Journal editors like Andrea Harkins-Brown of Journal of Technology and Teacher Education confirm a rise since 2025, with fakes slipping past multiple reviews.

• NeurIPS 2025: 100+ fake citations in 51/4,841 papers (1.1% affected).
• Mental health lit reviews: 20% fully fabricated, 45% flawed.
• Librarians lose 15% of time chasing AI ghosts.
• Submission surges (220% at AI conferences) strain peer review.

These figures underscore a systemic threat to U.S. academic output, where fake refs now haunt even elite venues.

Impacts on Peer Review and University Faculty

Peer reviewers, overwhelmed by volume, miss fakes—NeurIPS papers underwent 3+ checks yet published hallucinations. U.S. professors face disheartening workloads verifying student work, while good papers get desk-rejected. 'Publish or perish' incentivizes shortcuts, sacrificing integrity.

Broader fallout: Eroded public trust in science, polluted databases like Google Scholar, and career harm—citations are metrics, but fakes dilute them. As UC San Diego's Craig Callender notes, it's the 'logical end' of publishing's 'swamp.'

U.S. Universities' Evolving Policies on AI Use

Most U.S. colleges mandate AI disclosure, treating undisclosed use as plagiarism. No outright bans; focus on integrity. Georgia State and USC emphasize verification training. Publishers like Springer screen pre-editorially.

For faculty job seekers, mastering AI ethics is key—check tips for academic CVs highlighting verification skills amid this crisis.

Detection Tools and Strategies for Professors

Combat with GPTZero's Hallucination Check, which flags unverifiable cites. Manual steps: Cross-check DOIs on PubMed/Scopus, request full texts, trace authors.

• Pre-submission: Run AI detectors.
• Review: Verify 10-20% random refs.
• Teaching: Train students on verification via professor reviews and tools.

Journals eye automated screening; U.S. unis integrate into syllabi.

Stakeholder Perspectives: From Editors to Students

Editors like Stephanie Moore lament increases: 'We’ve definitely been seeing an increase.' Students confuse fakes in real sources. Librarians chase phantoms. Solutions demand collective vigilance.

For higher ed careers, explore faculty positions emphasizing AI literacy.

Photo by Markus Winkler on Unsplash

Future Outlook and Actionable Insights

The crisis escalates without intervention—AI slop could drown quality research. U.S. unis must invest in training, tools, and policies. Researchers: Always verify AI output. Institutions: Foster verification culture.

Optimism lies in tools like open-source lit reviewers outperforming LLMs. Stay ahead with career advice and university jobs at AcademicJobs.com. Share experiences on Rate My Professor.