When the Provenance Paper Itself Is Forged

Opening Scene

The most dangerous kind of forgery isn’t an obviously fake object — it’s a genuinely convincing forged provenance document, complete with authentic-looking seals and signatures, attached to something that isn’t what it claims to be. This specific, especially dangerous risk has a direct parallel in language models: a fabricated citation that looks entirely legitimate, complete with a plausible author, title, and publication, but simply doesn’t exist.

In Plain English

Fabricated citations are a specific, especially dangerous form of hallucination because they carry the surface appearance of verifiability — a real-looking reference — while pointing to nothing real at all. This is particularly risky because users often treat the mere presence of a citation as evidence of trustworthiness, exactly the assumption addressed in Article 6, without independently checking whether the cited source actually exists and says what it’s claimed to say.

The Old Way

Before fabricated citations were widely recognized as a specific, especially dangerous risk category, they were sometimes underweighted relative to other hallucination types:

• Fabricated citations were sometimes treated as just one example of general hallucination, without recognizing their specifically elevated danger from carrying false surface credibility.
• There wasn’t yet a well-established practice of specifically testing a model’s tendency to fabricate plausible-looking but nonexistent citations.
• Users sometimes trusted citations without independent verification precisely because they carried the surface appearance of legitimate scholarship or sourcing.

Recognizing fabricated citations as a specific, elevated-risk category, deserving dedicated testing and verification, reflects the accumulated understanding this series has built about hallucination’s varied, sometimes especially deceptive forms.

What’s Changing (and Why AI Is the Reason)

1. Evaluation practices increasingly include dedicated tests specifically for citation fabrication, connecting directly to the citation verification practices covered in Article 6.
2. This connects directly to the fabrication-versus-confabulation distinction covered in Article 5, since fabricated citations are a clear, checkable example of outright fabrication.
3. Automated citation-checking tools, verifying a citation actually exists and supports its associated claim, have become an increasingly practical mitigation for this specific risk.

The Metaphor, Fully Extended

The Antiques Appraiser	Fabricated Citation Concept
A forged provenance document with authentic-looking seals	A fabricated citation with a plausible author, title, and publication
Carrying false surface credibility while pointing to nothing real	Carrying false surface credibility while referencing nothing real
A specific, especially dangerous kind of forgery	A specific, especially dangerous kind of hallucination
Requiring dedicated, independent verification, not surface trust	Requiring dedicated, independent verification, not surface trust

Quick Recap

• Fabricated citations are a specific, especially dangerous form of hallucination that carry false surface credibility.
• This is particularly risky because users often treat citation presence as evidence of trustworthiness.
• Dedicated testing and automated citation-checking tools are effective mitigations for this specific risk.
• This connects directly to the citation verification practices covered in Article 6.

Where This Fits in the Series

Article 14 covered the specific danger of fabricated citations. Article 15 turns to a practical checklist: mitigation techniques and prompting strategies for every appraisal.