A citation is a promise: if you doubt this, here is where you can check it. When the citation itself is invented, the promise becomes a trap. And language models are capable of inventing citations that look completely legitimate.

A real-world warning

In 2023, in the United States case Mata v. Avianca, lawyers submitted a legal brief that cited court decisions which did not exist. The citations had been produced by an AI chatbot, complete with realistic case names and quotations. The court sanctioned the lawyers. The case became a widely cited example of what happens when generated references are trusted without checking.

Why models invent sources

A language model does not look up a reference the way a librarian does. It predicts text that fits the pattern of a reference: an institution's name, a plausible title, a web address with the right structure. Often the result points to a real document. Sometimes it points to nothing at all, while looking exactly the same.

Three kinds of bad citation

  • The fabricated source. A report or study that was never published.
  • The broken address. A real organisation, but an address path that was guessed and leads nowhere.
  • The misattributed finding. A real document that does not say what it is cited for.

The first two can be caught automatically. The third requires reading the source.

What Honest Lens does

The Claim to Evidence engine treats every link from the model as unverified until proven otherwise:

  • The model is instructed never to construct addresses and to omit the link when unsure.
  • After the analysis, the server requests every cited address.
  • Links that return "not found", or point to domains that do not exist, are removed, and the report says a suggested link could not be verified.
  • Links that exist but block automated checks are marked not auto-verified, rather than presented as confirmed.
  • Links that respond normally are marked checked.

You can watch this happen in the live progress panel, which lists each domain as it is checked.

What this does not guarantee

A working link proves the page exists, not that it supports the claim. That is why each source in a report comes with a short description of what it states, and why reading the source yourself is still the strongest check there is.